Principal Data Engineer

A bit about us:

Since 2020, the company has expanded from listings into payments, shipping and seller financing.

The previous person in this role moved to another team. The Analytics team moves data from about 30 source systems into Snowflake. You'll own ingestion, modelling and data quality checks. Remote, open to candidates across South Africa. Normal working hours, Monday to Friday. You get a company laptop and a headset before you start.

Essential duties and responsibilities:

Design table layouts and partitioning for Parquet, Delta Lake or Iceberg. Write data quality tests with dbt or Great Expectations and alert on failures. Work with analysts to define metrics and fix discrepancies between reports. Tune slow queries and expensive jobs. Ingest data from APIs, SaaS tools and databases with Fivetran, Airbyte or custom Python.

Skills and experience:

7+ years of data engineering, or backend work with data at volume. Expert SQL, including window functions and query tuning. Working knowledge of AWS, GCP or Azure data services. Understanding of dimensional modelling and slowly changing dimensions. Hands-on with an orchestration tool such as Airflow.

Bonus points:

Background in finance or marketing data. Reverse ETL tools like Hightouch or Census. Kafka, Flink or Spark Structured Streaming.

Perks and benefits:

Medical aid contribution. Provident fund. Group life cover. 13th cheque. Study assistance. Data allowance.

Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Skiffmill HQ.