Senior Data Engineer

A bit about us

Public sector agencies, utilities and large health systems licence our asset management platform under multi-year contracts. SC Labs employs 700 people across engineering hubs in Lahore and three other locations, building ERP software for mid-market manufacturers. Laptops are MacBook Pros, and you pick your own editor.

Overview

Our team is growing and we are hiring a Senior Data Engineer. This hire will help replace a set of fragile nightly scripts with tested, monitored pipelines. Remote position. Most of the team is in Lahore, but nobody is required to come in. Normal working hours, Monday to Friday. We use Slack, Notion and Google Meet. Cameras on for team calls.

What you'll do

• Process large datasets with Spark on Databricks or EMR
• Tune slow queries and expensive jobs
• Write data quality tests with dbt or Great Expectations and alert on failures
• Model data in dbt using staging, intermediate and mart layers
• Build batch and streaming pipelines with Airflow, Dagster or Prefect

Minimum qualifications

• 7+ years of data engineering, or backend work with data at volume
• Understanding of dimensional modelling and slowly changing dimensions
• Working knowledge of AWS, GCP or Azure data services
• Strong Python for data processing

Desirable

• Background in finance or marketing data
• Terraform for data infrastructure
• Dbt Certified Developer or Databricks certification

What we offer

Compensation: PKR 245,000 - PKR 300,000 a month

• Medical insurance
• Provident fund
• Paid leave

Candidates must be eligible to work in Pakistan.

Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at SC Labs.