Senior Data Engineer - Python, CI/CD

<div class="content-intro"><h3>About ClickHouse</h3> <p>Recognized on the 2025 Forbes Cloud 100 list, ClickHouse is one of the most innovative and fast-growing private cloud companies. With more than 3,000 customers and ARR that has grown over 250 percent year over year, ClickHouse leads the market in real-time analytics, data warehousing, observability, and AI workloads.</p> <p>The company’s sustained, accelerating momentum was recently validated by a $400M Series D financing round. Over the past three months, customers including Capital One, Lovable, Decagon, Polymarket, and Airwallex have adopted the platform or expanded existing deployments. These customers join an established base of AI innovators and global brands such as Meta, Cursor, Sony, and Tesla.</p> <p>We’re on a mission to transform how companies use data. Come be a part of our journey!</p></div><h3><strong>About the role</strong></h3> <p>At ClickHouse, we believe in making product decisions grounded in data, not gut feelings. To support that, we've built a comprehensive internal data warehouse — read more about it on <a href="https://clickhouse.com/blog/building-a-data-warehouse-with-clickhouse">our blog</a>. It powers analytics, forecasting, and decision-making across every team in the company.</p> <p>Our stack centers on <strong>ClickHouse</strong> as the core storage and processing engine, complemented by <strong>dbt</strong>, <strong>Airflow</strong>, <strong>S3</strong>, <strong>AWS</strong>, <strong>Superset</strong>, and <strong>GitHub</strong> <strong>Actions</strong>. We ingest data from 30+ distinct external sources, process over <strong>2.5 PB</strong> of data, and deliver most data marts to business consumers with a <strong>1-hour end-to-end latency</strong> - a standard that demands highly optimized, rock-solid transformation pipelines.</p> <p>We're looking for a <strong>Senior Data Engineer</strong> to help evolve the DWH platform, push its technical boundaries, and deliver reliable, high-performance data models to business users across the organization.</p> <h3><strong>Key Responsibilities</strong></h3> <ol> <li><strong>DWH Platform Development</strong></li> <ul> <li>Design and develop reusable Airflow components - operators, connectors, and hooks - along with custom integrations tailored to our data architecture.</li> <li>Build reusable dbt macros and abstractions: incremental strategies, ETL building blocks, and generic data quality tests, all optimized for ClickHouse-specific behavior and our data patterns.</li> <li>Develop DataOps tooling - CI pipelines, data migration frameworks, and security controls - with a strong focus on reliability, self-service usability, and scale.</li> </ul> <li><strong>Team contributions</strong></li> <ul> <li>Conduct thorough code reviews for team members and other team contributors.</li> <li>Actively participate in technical and architectural design discussions.</li> <li>Drive technical leadership in specific areas of our stack.</li> <li>Continuously improve the team's development environment, with a focus on automation - including AI-assisted workflows.</li> <li>Contribute to platform stability through proactive troubleshooting and timely incident resolution.</li> </ul> <li><strong>Data modeling</strong></li> <ul> <li>Develop, refactor, and optimize business data models in line with our modeling standards and ClickHouse best practices.</li> <li>Mentor and support contributors through code reviews and technical guidance.</li> <li>Lead the design and implementation of the most technically demanding data marts - particularly those involving high data velocity, large volumes, or complex business logic.</li> </ul> </ol> <h3><strong>Qualifications</strong></h3> <p><strong>Required:</strong></p> <ul> <li>Exceptional SQL skills - this is non-negotiable.</li> <li>Strong hands-on experience with<strong> Airflow</strong>, <strong>dbt</strong>, and <strong>Python</strong>.</li> <li>Proven track record building and optimizing large-scale, high-throughput data pipelines.</li> <li>Solid understanding of data warehousing fundamentals: ETL/ELT, dimensional modeling, and data quality.</li> <li>Bachelor's degree in Computer Science or a related field.</li> <li>Comfortable thriving in a fast-paced startup environment — exciting and dynamic, but sometimes wonderfully chaotic.</li> </ul> <p><strong>Preferred:</strong></p> <ul> <li>Hands-on experience with <strong>ClickHouse</strong> - a significant advantage.</li> <li>Familiarity with <strong>AWS</strong> or other cloud platforms.</li> <li>Experience with&nbsp;<strong>CI/CD</strong> development, especially using <strong>GitHub Actions</strong>.</li> </ul><div class="content-pay-transparency"><div class="pay-input"><div class="title">The typical starting salary for this role in the US is</div><div class="pay-range"><span>$84,000</span><span class="divider">&mdash;</span><span>$143,000 USD</span></div></div><div class="pay-input"><div class="title">The typical starting salary for this role in US Premium Markets is</div><div class="pay-range"><span>$115,000</span><span class="divider">&mdash;</span><span>$170,000 USD</span></div></div></div><div class="content-conclusion"><h3><strong>Compensation</strong></h3> <p><span style="font-weight: 400;">For roles based in the&nbsp;<strong>United States</strong>, t</span>he typical starting salary range for this position is listed above. In certain locations, such as the San Francisco Bay Area and the New York City Metro Area, a premium market range may apply, as listed.</p> <p class="p1">These salary ranges reflect what we reasonably and in good faith believe to be the minimum and maximum pay for this role at the time of posting. The actual compensation may be higher or lower than the amounts listed, and the ranges may be subject to future adjustments.</p> <p class="p1">An individual’s placement within the range will depend on various factors, including (but not limited to) education, qualifications, certifications, experience, skills, location, performance, and the needs of the business or organization.</p> <p><span style="font-weight: 400;">If you have any questions or comments about compensation as a candidate, please get in touch with us at&nbsp;<a href="mailto:paytransparency@clickhouse.com">paytransparency@clickhouse.com</a>.</span></p> <h3><strong>Perks</strong></h3> <ul> <li style="font-weight: 400;"><strong>Flexible work environment</strong><span style="font-weight: 400;"> - ClickHouse is a globally distributed company and remote-friendly. We currently operate in over 20 countries.</span></li> <li style="font-weight: 400;"><strong>Healthcare</strong><span style="font-weight: 400;"> - Employer contributions towards your healthcare.</span></li> <li style="font-weight: 400;"><strong>Equity in the company</strong><span style="font-weight: 400;"> - Every new team member who joins our company receives stock options.</span></li> <li style="font-weight: 400;"><strong>Time off</strong><span style="font-weight: 400;"> - Flexible time off in the US, generous entitlement in other countries.</span></li> <li style="font-weight: 400;"><strong>A $500 Home office setup </strong><span style="font-weight: 400;">if you’re a remote employee.</span></li> <li style="font-weight: 400;"><strong>Global Gatherings </strong>– We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites.</li> </ul> <p><strong>Culture - We All Shape It</strong></p> <p><span style="font-weight: 400;">As part of a rapidly scaling start up, you will be instrumental in shaping our culture.&nbsp;</span></p> <p><span style="font-weight: 400;">Are you interested in finding out more about our culture? &nbsp;Learn more about our values <a href="https://clickhouse.com/company/careers">here</a>.&nbsp; Check out our<a href="https://clickhouse.com/blog"> blog posts</a> or follow us on <a href="https://www.linkedin.com/company/clickhouseinc/life/0c1ee7f4-2129-488d-b413-e7f6270659fd/?viewAsMember=true">LinkedIn</a> to find out more about what’s happening at ClickHouse.</span></p> <p><strong>Equal Opportunity &amp; Privacy&nbsp;</strong></p> <p>ClickHouse provides equal employment opportunities to all employees and applicants and prohibits discrimination and harassment of any type based on factors such as race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.&nbsp;</p> <p><span style="font-weight: 400;">Please see&nbsp;<a href="https://clickhouse.com/legal/applicant-privacy-notice" target="_blank" data-saferedirecturl="https://www.google.com/url?q=https://www.elastic.co/legal/applicant-privacy-statement&amp;source=gmail&amp;ust=1611068262479000&amp;usg=AFQjCNG3orAPk5sJIr9WVm0ZDxYw82c5DA">here</a>&nbsp;for our Privacy Statement.</span></p></div>