Data Engineer - Python

We are adding a Data Engineer - Python to our Data Engineering team. The Data Engineering team moves data from about 30 source systems into Snowflake. You'll own ingestion, modelling and data quality checks. Remote, open to candidates across India. Hours are flexible, with one short team call each morning. Please make sure you have dependable internet and backup power.

Duties

• Write data quality tests with dbt or Great Expectations and alert on failures.
• Process large datasets with Spark on Databricks or EMR.
• Respond to pipeline failures and backfill data when needed.
• Ingest data from APIs, SaaS tools and databases with Fivetran, Airbyte or custom Python.
• Work with analysts to define metrics and fix discrepancies between reports.
• Design table layouts and partitioning for Parquet, Delta Lake or Iceberg.

What you'll need

• 3-5 years of data engineering, or backend work with data at volume.
• Understanding of dimensional modelling and slowly changing dimensions.
• Hands-on with an orchestration tool such as Airflow.
• Expert SQL, including window functions and query tuning.
• Familiarity with Git, CI/CD and testing practices for data code.

Preferred

• Kafka, Flink or Spark Structured Streaming.

Perks and benefits

• Health insurance for you and your family.
• Provident fund.
• Paid leave.
• Gratuity.
• ESOPs.
• Internet reimbursement.

A bit about us

Our website and apps help renters search listings, schedule tours and submit applications. We operate a subscription e-commerce site selling coffee, tea and brewing gear, shipped from our own warehouse. We started in 2014 and have grown to about 80 people. Support shifts are shared, so engineers spend a few hours a quarter answering customer tickets.

Candidates must be eligible to work in India.

Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Gardenport HQ.