Senior Data Engineer

Public sector agencies, utilities and large health systems licence our asset management platform under multi-year contracts. We run one of the larger SaaS platforms for commercial insurance carriers, processing millions of policy transactions a year. Releases go out Tuesday mornings, never on Fridays.

Role overview:

This is a backfill for a team member who moved to another team. The Data Platform team moves data from about 30 source systems into Snowflake. You'll own ingestion, modelling and data quality checks. Remote within India. The team meets in New Delhi once a quarter, travel covered. You can set your own hours around a daily morning check-in.

Main duties:

• Write data quality tests with dbt or Great Expectations and alert on failures
• Document datasets and lineage in a catalogue such as DataHub or Atlan
• Respond to pipeline failures and backfill data when needed
• Design table layouts and partitioning for Parquet, Delta Lake or Iceberg
• Build batch and streaming pipelines with Airflow, Dagster or Prefect
• Model data in dbt using staging, intermediate and mart layers

Required qualifications:

• 5+ years of data engineering, or backend work with data at volume
• Working knowledge of AWS, GCP or Azure data services
• Patience with messy source data and the habit of documenting assumptions
• Familiarity with Git, CI/CD and testing practices for data code
• Hands-on with an orchestration tool such as Airflow
• Understanding of dimensional modelling and slowly changing dimensions

Preferred qualifications:

• Reverse ETL tools like Hightouch or Census
• Dbt Certified Developer or Databricks certification
• Terraform for data infrastructure
• Background in finance or marketing data

Rate: ₹19,00,000 - ₹26,00,000 per annum

What we offer:

• Health insurance for you and your family
• Provident fund
• Paid leave

Applications are reviewed weekly.

Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Stonehill Data Pvt Ltd.