Data Engineer

More than 9,000 organisations use our HR and payroll suite, from regional hospitals to school districts. On-call rotates weekly and pays a flat stipend whether or not the pager goes off.

OVERVIEW:

We're looking for a Data Engineer to join our team. This is a remote role. This hire will help replace a set of fragile nightly scripts with tested, monitored pipelines. Remote position. Most of the team is in London, but nobody is required to come in. Monday to Friday, regular working hours, flexible start and finish. We use Slack, Notion and Google Meet. Cameras on for team calls.

RESPONSIBILITIES:

• Tune slow queries and expensive jobs.
• Work with analysts to define metrics and fix discrepancies between reports.
• Document datasets and lineage in a catalogue such as DataHub or Atlan.
• Maintain CI for data code and review pull requests.
• Respond to pipeline failures and backfill data when needed.
• Write data quality tests with dbt or Great Expectations and alert on failures.
• Design table layouts and partitioning for Parquet, Delta Lake or Iceberg.

QUALIFICATIONS:

• 2-4 years of data engineering, or backend work with data at volume.
• Expert SQL, including window functions and query tuning.
• Familiarity with Git, CI/CD and testing practices for data code.
• Strong Python for data processing.
• Hands-on with an orchestration tool such as Airflow.
• Patience with messy source data and the habit of documenting assumptions.
• Working knowledge of AWS, GCP or Azure data services.

PREFERRED QUALIFICATIONS:

• Kafka, Flink or Spark Structured Streaming.
• Dbt Certified Developer or Databricks certification.
• Terraform for data infrastructure.
• Reverse ETL tools like Hightouch or Census.

PERKS AND BENEFITS:

• Healthcare cash plan.
• Company pension.
• 25 days holiday plus bank holidays.
• Life assurance (4x salary)
• Death in service benefit.

We are a Disability Confident employer.

You must have the right to work in the UK.

Start: Flexible.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Brassline Ltd.