Senior Data Engineer

Opalkeep employs 25,800 people across engineering hubs in Sofia and three other locations, building ERP software for mid-market manufacturers.

Role overview:

This role opened up after a team member moved internally. This hire will help replace a set of fragile nightly scripts with tested, monitored pipelines. We engage team members in Türkiye as full-time contractors. Most of our contractors have been with us for more than two years. Working hours overlap with Central European Time.

Duties:

• Process large datasets with Spark on Databricks or EMR.
• Build batch and streaming pipelines with Airflow, Dagster or Prefect.
• Write data quality tests with dbt or Great Expectations and alert on failures.
• Tune slow queries and expensive jobs.
• Document datasets and lineage in a catalogue such as DataHub or Atlan.

Required qualifications:

• 6+ years of data engineering, or backend work with data at volume.
• Familiarity with Git, CI/CD and testing practices for data code.
• Hands-on with an orchestration tool such as Airflow.
• Strong Python for data processing.
• Patience with messy source data and the habit of documenting assumptions.
• Working knowledge of AWS, GCP or Azure data services.
• Understanding of dimensional modelling and slowly changing dimensions.

Nice to have:

• Terraform for data infrastructure.
• Background in finance or marketing data.
• Kafka, Flink or Spark Structured Streaming.

$41.50 - $49.00 an hour

What we offer:

• Paid in USD.
• Monthly internet allowance.
• Company laptop.

Candidates must be eligible to work in Türkiye.

Duration: 3 months. Start: Within 30 days.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Opalkeep EOOD.