Senior Data Engineer (Streaming)

Public sector agencies, utilities and large health systems licence our asset management platform under multi-year contracts. On-call rotates weekly and pays a flat stipend whether or not the pager goes off.

Overview:

Northmoor needs someone who writes solid SQL and Python and treats pipelines like production software. Employment is through our payroll partner in Bangladesh. Salary is paid monthly in taka. Working hours overlap with Central European Time.

What you'll do:

• Ingest data from APIs, SaaS tools and databases with Fivetran, Airbyte or custom Python
• Build batch and streaming pipelines with Airflow, Dagster or Prefect
• Handle PII according to retention, masking and access policies
• Write data quality tests with dbt or Great Expectations and alert on failures
• Maintain CI for data code and review pull requests
• Tune slow queries and expensive jobs

Minimum qualifications:

• 5-7 years of data engineering, or backend work with data at volume
• Understanding of dimensional modelling and slowly changing dimensions
• Hands-on with an orchestration tool such as Airflow
• Strong Python for data processing
• Working knowledge of AWS, GCP or Azure data services
• Patience with messy source data and the habit of documenting assumptions

Preferred:

• Kafka, Flink or Spark Structured Streaming
• Reverse ETL tools like Hightouch or Census

Rate: BDT 195,000 to BDT 245,000 pcm

Benefits:

• Performance bonus
• Co-working space stipend
• Two weeks of paid leave at year end
• Public holidays observed per your country
• Monthly internet allowance

Please submit your CV in English.

Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Northmoor.