Data Engineer (Spark)

Advertising, subscriptions and transaction fees each bring in a significant share of revenue. Traffic during holiday peaks can reach ten times normal levels, and the platform is built for it. We started in 1996 and have grown to about 109,600 people.

About the role:

The Data Engineering team moves data from about 30 source systems into Snowflake. You'll own ingestion, modelling and data quality checks. Canalcross needs someone who writes solid SQL and Python and treats pipelines like production software. Our team is spread across 20 countries. Headquarters is in Madrid. We hire in Pakistan through an employer of record, so this is a regular full-time job with local payroll and statutory benefits. Core hours are 10:00 to 15:00 CET. You will need a stable internet connection and a backup power source (UPS or inverter).

Essential duties and responsibilities:

• Work with analysts to define metrics and fix discrepancies between reports.
• Build batch and streaming pipelines with Airflow, Dagster or Prefect.
• Design table layouts and partitioning for Parquet, Delta Lake or Iceberg.
• Document datasets and lineage in a catalogue such as DataHub or Atlan.
• Maintain CI for data code and review pull requests.
• Process large datasets with Spark on Databricks or EMR.

Required qualifications:

• 2-4 years of data engineering, or backend work with data at volume.
• Working knowledge of AWS, GCP or Azure data services.
• Hands-on with an orchestration tool such as Airflow.
• Patience with messy source data and the habit of documenting assumptions.

Preferred qualifications:

• Kafka, Flink or Spark Structured Streaming.
• Terraform for data infrastructure.
• Background in finance or marketing data.

Pay and benefits:

• Company laptop.
• Annual salary review.
• Annual team retreat.
• Co-working space stipend.
• Paid sick days.

Candidates must be eligible to work in Pakistan.

Please submit your CV in English.

Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Canalcross.