Data Engineer

About the role

Our team is growing and we are hiring a Data Engineer. The operations team moves data from about 30 source systems into Snowflake. You'll own ingestion, modelling and data quality checks. Remote position. Most of the team is in Lahore, but nobody is required to come in. Normal working hours, Monday to Friday.

Essential duties and responsibilities

• Process large datasets with Spark on Databricks or EMR.
• Work with analysts to define metrics and fix discrepancies between reports.
• Maintain CI for data code and review pull requests.
• Write data quality tests with dbt or Great Expectations and alert on failures.
• Handle PII according to retention, masking and access policies.
• Build batch and streaming pipelines with Airflow, Dagster or Prefect.
• Document datasets and lineage in a catalogue such as DataHub or Atlan.
• Tune slow queries and expensive jobs.

Minimum qualifications

• 2-4 years of data engineering, or backend work with data at volume.
• Strong Python for data processing.
• Hands-on with an orchestration tool such as Airflow.
• Familiarity with Git, CI/CD and testing practices for data code.
• Expert SQL, including window functions and query tuning.

What you get

Pay: PKR 180,000 - PKR 210,000 a month

• Flexible schedule.

Company overview

Profitable, no outside investors, and no plans to take any. We grow when customers pay us.

We review applications as they come in.

Duration: 12 months. Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Crescent Digital.