Senior Data Engineer - Streaming

The role:

We're looking for another Senior Data Engineer - Streaming to build and maintain the pipelines that feed our warehouse, dashboards and models. On site, Jakarta.

Responsibilities:

• Process large datasets with Spark on Databricks or EMR.
• Manage warehouse objects, roles and spend in Snowflake, BigQuery or Redshift.
• Build batch and streaming pipelines with Airflow, Dagster or Prefect.
• Work with analysts to define metrics and fix discrepancies between reports.
• Stream events through Kafka or Kinesis into the lake and warehouse.
• Document datasets and lineage in a catalogue such as DataHub or Atlan.
• Handle PII according to retention, masking and access policies.

What we're looking for:

• 5-7 years of data engineering, or backend work with data at volume.
• Patience with messy source data and the habit of documenting assumptions.
• Hands-on with an orchestration tool such as Airflow.
• Experience with a cloud data warehouse (Snowflake, BigQuery, Redshift or Synapse)
• Understanding of dimensional modelling and slowly changing dimensions.
• Expert SQL, including window functions and query tuning.

Perks and benefits:

Rate: IDR 31,000,000-IDR 38,000,000 per month

• Training budget.
• Flexible benefits.

About us:

Our product started as a side project in 1997 and now has a few hundred paying customers, mostly in Jakarta.

This posting may close early if we receive enough applications.

Duration: 12 months. Start: Flexible.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Bahari Cloud.