Lead Data Engineer

Overview:

Ochresmith Cloud needs someone who writes solid SQL and Python and treats pipelines like production software. The Data Infrastructure team moves data from about 30 source systems into Snowflake. You'll own ingestion, modelling and data quality checks. Remote, open to candidates across India. Normal business hours, Monday to Friday, with some flexibility. We talk mostly in Slack and hop on quick calls when something needs discussing.

In this role you will:

• Build batch and streaming pipelines with Airflow, Dagster or Prefect
• Design table layouts and partitioning for Parquet, Delta Lake or Iceberg
• Tune slow queries and expensive jobs
• Respond to pipeline failures and backfill data when needed
• Process large datasets with Spark on Databricks or EMR
• Maintain CI for data code and review pull requests

Required qualifications:

• 7+ years of data engineering, or backend work with data at volume
• Working knowledge of AWS, GCP or Azure data services
• Patience with messy source data and the habit of documenting assumptions
• Expert SQL, including window functions and query tuning
• Strong Python for data processing

Desirable:

• Kafka, Flink or Spark Structured Streaming
• Terraform for data infrastructure

Benefits:

Pay: ₹22,00,000 - ₹27,00,000 per annum

• Health insurance for you and your family
• Provident fund
• Paid leave
• Internet reimbursement
• Gratuity
• Learning budget
• Flexible hours

A bit about us:

Annual releases gave way to two-week sprints years ago, and the platform now handles over 200 million API calls a day.

Start: Within 30 days.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Ochresmith Cloud.