Data Engineer (Python)

Opalkeep employs 25,800 people across engineering hubs in Sofia and three other locations, building ERP software for mid-market manufacturers.

The position

Opalkeep needs someone who writes solid SQL and Python and treats pipelines like production software. You will be employed through our employer-of-record partner in Peru, with a local contract and salary paid in local currency. Working hours overlap with Central European Time. Most communication happens in Slack, with short video calls when needed.

Duties

• Build batch and streaming pipelines with Airflow, Dagster or Prefect.
• Document datasets and lineage in a catalogue such as DataHub or Atlan.
• Design table layouts and partitioning for Parquet, Delta Lake or Iceberg.
• Handle PII according to retention, masking and access policies.
• Ingest data from APIs, SaaS tools and databases with Fivetran, Airbyte or custom Python.
• Write data quality tests with dbt or Great Expectations and alert on failures.
• Process large datasets with Spark on Databricks or EMR.
• Work with analysts to define metrics and fix discrepancies between reports.

Minimum qualifications

• 3+ years of data engineering, or backend work with data at volume.
• Expert SQL, including window functions and query tuning.
• Patience with messy source data and the habit of documenting assumptions.
• Understanding of dimensional modelling and slowly changing dimensions.
• Hands-on with an orchestration tool such as Airflow.

Also helpful

• Dbt Certified Developer or Databricks certification.

Why work with us

Compensation: PEN 16,500 to PEN 21,000 per month

• Flexible hours.
• Annual salary review.
• Monthly internet allowance.
• Annual team retreat.
• Wellness allowance.
• Company laptop.

Due to the number of applications, only shortlisted candidates will be contacted.

Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Opalkeep EOOD.