Principal Data Engineer

Headquartered in Mumbai since 2003, the company now sells in 40 countries and supports customers in 11 languages. More than 9,000 organisations use our HR and payroll suite, from regional hospitals to school districts. We started in 2003 and have grown to about 400 people. We keep recurring meetings to Tuesdays and Thursdays where we can.

About the role:

We are adding a Principal Data Engineer to our Data Engineering team. This hire will help replace a set of fragile nightly scripts with tested, monitored pipelines. The Data Engineering team moves data from about 30 source systems into Snowflake. You'll own ingestion, modelling and data quality checks. You can work from home anywhere in India. We have no office requirement. Most of our work is async, and meetings are kept short. Reliable internet and a power backup are a must.

Responsibilities:

• Process large datasets with Spark on Databricks or EMR
• Model data in dbt using staging, intermediate and mart layers
• Write data quality tests with dbt or Great Expectations and alert on failures
• Tune slow queries and expensive jobs
• Build batch and streaming pipelines with Airflow, Dagster or Prefect

Minimum qualifications:

• 8+ years of data engineering, or backend work with data at volume
• Patience with messy source data and the habit of documenting assumptions
• Hands-on with an orchestration tool such as Airflow
• Strong Python for data processing
• Familiarity with Git, CI/CD and testing practices for data code

Pay and benefits:

Salary range: ₹22-25.5 LPA

• Health insurance for you and your family
• Provident fund
• Paid leave
• Gratuity
• Flexible hours
• Meal coupons
• Group term life insurance

Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Meadowsweet Labs.