Data Engineer (Streaming)

ABOUT US

Lynn Digital builds scheduling and dispatch software for field service companies, from two-truck plumbing outfits to regional HVAC contractors. The product is a mobile app plus a React web dashboard, with a Python and PostgreSQL backend on AWS. Releases go out Tuesday mornings, never on Fridays.

Our team is growing and we are hiring a Data Engineer (Streaming). The operations team moves data from about 30 source systems into Snowflake. You'll own ingestion, modelling and data quality checks. We hire in India through an employer of record, so this is a regular full-time job with local payroll and statutory benefits. Core hours are 9:00 AM to 1:00 PM US Eastern. A stable internet connection and a backup power option are required.

KEY RESPONSIBILITIES

• Model data in dbt using staging, intermediate and mart layers
• Work with analysts to define metrics and fix discrepancies between reports
• Process large datasets with Spark on Databricks or EMR
• Write data quality tests with dbt or Great Expectations and alert on failures
• Design table layouts and partitioning for Parquet, Delta Lake or Iceberg
• Ingest data from APIs, SaaS tools and databases with Fivetran, Airbyte or custom Python

REQUIREMENTS

• 3-5 years of data engineering, or backend work with data at volume
• Patience with messy source data and the habit of documenting assumptions
• Expert SQL, including window functions and query tuning
• Strong Python for data processing
• Understanding of dimensional modelling and slowly changing dimensions
• Working knowledge of AWS, GCP or Azure data services

WHAT WE OFFER

Salary range: ₹33,00,000 - ₹41,00,000 per annum

• 20 days paid time off
• Co-working space stipend
• Paid parental leave
• Annual team retreat
• Wellness allowance

Shortlisted candidates will hear from us within two weeks.

We look at every application, usually within a week.

Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Lynn Digital.