Data Engineer

WHO WE ARE

Advertising, subscriptions and transaction fees each bring in a significant share of revenue. Traffic during holiday peaks can reach ten times normal levels, and the platform is built for it. We started in 1996 and have grown to about 109,600 people.

This hire will help replace a set of fragile nightly scripts with tested, monitored pipelines. Canalcross needs someone who writes solid SQL and Python and treats pipelines like production software. The company is based in Madrid, Spain. The team is spread across multiple countries. This is a long-term contractor role, paid monthly in USD. Working hours overlap with Central European Time. You will need a stable internet connection and a backup power source (UPS or inverter).

ESSENTIAL DUTIES AND RESPONSIBILITIES

• Tune slow queries and expensive jobs.
• Build batch and streaming pipelines with Airflow, Dagster or Prefect.
• Ingest data from APIs, SaaS tools and databases with Fivetran, Airbyte or custom Python.
• Respond to pipeline failures and backfill data when needed.
• Handle PII according to retention, masking and access policies.
• Maintain CI for data code and review pull requests.
• Work with analysts to define metrics and fix discrepancies between reports.
• Document datasets and lineage in a catalogue such as DataHub or Atlan.

QUALIFICATIONS

• 3-5 years of data engineering, or backend work with data at volume.
• Working knowledge of AWS, GCP or Azure data services.
• Patience with messy source data and the habit of documenting assumptions.
• Strong Python for data processing.
• Hands-on with an orchestration tool such as Airflow.

BENEFITS

$1,500 - $1,750/month

• Monthly internet allowance.
• Paid in USD.

Please submit your CV in English.

Duration: 6 months. Start: Flexible.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Canalcross.