Senior Data Engineer, Streaming

Who we are

Annual releases gave way to two-week sprints years ago, and the platform now handles over 200 million API calls a day. Headquartered in Karachi since 2002, the company now sells in 40 countries and supports customers in 11 languages.

This role opened up after a team member moved internally. The Data Platform team moves data from about 30 source systems into Snowflake. You'll own ingestion, modelling and data quality checks. Ryeloft Apps needs someone who writes solid SQL and Python and treats pipelines like production software. Remote within Pakistan. The team meets in Karachi once a quarter, travel covered. Hours are flexible, with one short team call each morning.

What you'll do

• Respond to pipeline failures and backfill data when needed.
• Handle PII according to retention, masking and access policies.
• Ingest data from APIs, SaaS tools and databases with Fivetran, Airbyte or custom Python.
• Work with analysts to define metrics and fix discrepancies between reports.
• Maintain CI for data code and review pull requests.
• Document datasets and lineage in a catalogue such as DataHub or Atlan.
• Design table layouts and partitioning for Parquet, Delta Lake or Iceberg.

You'll need

• 5+ years of data engineering, or backend work with data at volume.
• Working knowledge of AWS, GCP or Azure data services.
• Expert SQL, including window functions and query tuning.
• Understanding of dimensional modelling and slowly changing dimensions.

Benefits

• Medical insurance.
• Provident fund.
• Paid leave.

Please mention your notice period and expected salary.

Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Ryeloft Apps.