Lead Data Engineer

Job summary

We are adding a Lead Data Engineer to our Analytics team. The Analytics team moves data from about 30 source systems into Snowflake. You'll own ingestion, modelling and data quality checks. This hire will help replace a set of fragile nightly scripts with tested, monitored pipelines. Remote within Croatia. The team meets in Zagreb once a quarter, travel covered. Equipment is provided, including a laptop.

Main duties

• Write data quality tests with dbt or Great Expectations and alert on failures.
• Design table layouts and partitioning for Parquet, Delta Lake or Iceberg.
• Build batch and streaming pipelines with Airflow, Dagster or Prefect.
• Process large datasets with Spark on Databricks or EMR.
• Model data in dbt using staging, intermediate and mart layers.
• Ingest data from APIs, SaaS tools and databases with Fivetran, Airbyte or custom Python.

What you'll need

• 8-10 years of data engineering, or backend work with data at volume.
• Working knowledge of AWS, GCP or Azure data services.
• Strong Python for data processing.

Bonus points

• Kafka, Flink or Spark Structured Streaming.
• Dbt Certified Developer or Databricks certification.

Compensation and benefits

• Private medical care.
• Extra annual leave days.
• Multisport card.

Company overview

Public sector agencies, utilities and large health systems licence our asset management platform under multi-year contracts. We run one of the larger SaaS platforms for commercial insurance carriers, processing millions of policy transactions a year.

Let us know your current notice period and salary expectations.

Please submit your CV in English.

Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Kvarner Digital d.o.o..