Data Engineer (Python)

We run a marketplace with over 300,000 active sellers and fulfillment centres in four regions. We started in 2008 and have grown to about 890 people.

Overview:

Walsh Digital is looking for a Data Engineer (Python) to join a small, steady team. The Finance Data team moves data from about 30 source systems into Snowflake. You'll own ingestion, modelling and data quality checks. This hire will help replace a set of fragile nightly scripts with tested, monitored pipelines. This role is fully remote within Ireland. Normal working hours, Monday to Friday. We use Slack, Notion and Google Meet. Cameras on for team calls.

Main duties:

• Document datasets and lineage in a catalogue such as DataHub or Atlan.
• Tune slow queries and expensive jobs.
• Build batch and streaming pipelines with Airflow, Dagster or Prefect.
• Handle PII according to retention, masking and access policies.
• Design table layouts and partitioning for Parquet, Delta Lake or Iceberg.

Required qualifications:

• 3+ years of data engineering, or backend work with data at volume.
• Familiarity with Git, CI/CD and testing practices for data code.
• Strong Python for data processing.
• Hands-on with an orchestration tool such as Airflow.

Nice to have:

• Background in finance or marketing data.
• Reverse ETL tools like Hightouch or Census.
• Dbt Certified Developer or Databricks certification.
• Kafka, Flink or Spark Structured Streaming.

Pay: €92,000-€111,000 pa

Why work with us:

• Health insurance for you and your family.
• Company pension scheme.
• 23 days annual leave plus bank holidays.

We may close the vacancy early if we receive a high number of applications.

You must have the right to work in Ireland.

Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Walsh Digital.