ClickHouse

Senior Software Engineer - Clickpipes (CDC/Streaming)

Canada · Remote·$147K–238K

Engineering

Note:. We are hiring for this role remotely in any country ClickHouse has a hiring presence.

ABOUT THE TEAM

The ClickPipes - Database Integrations team builds the platform that enables real-time data replication from databases into ClickHouse at petabyte scale.

As a member of this team, you will be solving complex database-related challenges and distributed systems problems, such as understanding database internals to optimize snapshotting strategy, handling schema evolution during live replication, managing data type compatibility across systems, maintaining low end-to-end latency under unpredictable loads, and leveraging durable execution frameworks to ensure data consistency over unreliable networks. We work in the open — our database integrations are built on PeerDB https://github.com/PeerDB-io/peerdb, an open-source CDC platform we actively maintain and contribute to.

See some of our recent work

  • ClickPipes for Postgres now supports failover replication slots https://clickhouse.com/blog/clickpipes-postgres-failover-replication
  • MongoDB CDC to ClickHouse with Native JSON Support https://clickhouse.com/blog/mongodb-cdc-clickhouse-preview
  • Under the Hood: Building MySQL Change Data Capture in ClickPipes https://clickhouse.com/blog/building-msql-change-data-capture-in-clickpipes

WHAT YOU’LL DO

  • Build data-intensive systems
  • Design and develop high-throughput integrations with databases (Postgres, MySQL, MongoDB), data lakes (Iceberg, Delta Lake), and data warehouses (BigQuery, Snowflake).
  • Handle edge cases in real-world production scen
Read the rest on jobs.ashbyhq.com