Junior Data Engineer

Since 2010, the company has expanded from listings into payments, shipping and seller financing. Bluffcraft HQ operates consumer websites and apps used by tens of millions of people each month.

About the role

Bluffcraft HQ has an opening for a Junior Data Engineer. This hire will help replace a set of fragile nightly scripts with tested, monitored pipelines. Remote within India. The team meets in Bengaluru once a quarter, travel covered. Normal working hours, Monday to Friday.

Responsibilities

• Document datasets and lineage in a catalogue such as DataHub or Atlan.
• Model data in dbt using staging, intermediate and mart layers.
• Work with analysts to define metrics and fix discrepancies between reports.
• Tune slow queries and expensive jobs.
• Write data quality tests with dbt or Great Expectations and alert on failures.
• Respond to pipeline failures and backfill data when needed.
• Process large datasets with Spark on Databricks or EMR.

Required qualifications

• 1+ years of data engineering, or backend work with data at volume.
• Strong Python for data processing.
• Hands-on with an orchestration tool such as Airflow.
• Familiarity with Git, CI/CD and testing practices for data code.
• Working knowledge of AWS, GCP or Azure data services.
• Understanding of dimensional modelling and slowly changing dimensions.
• Expert SQL, including window functions and query tuning.

Preferred

• Background in finance or marketing data.
• Reverse ETL tools like Hightouch or Census.
• Kafka, Flink or Spark Structured Streaming.
• Terraform for data infrastructure.

What we offer

• Health insurance for you and your family.
• Provident fund.
• Paid leave.
• Internet reimbursement.
• Meal coupons.
• Gratuity.

We will only contact shortlisted applicants.

Applications are reviewed weekly.

Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Bluffcraft HQ Pvt Ltd.