Senior Data Engineer, Streaming (Remote)

Content moderation runs around the clock, with reviewers in multiple time zones and languages. Advertising, subscriptions and transaction fees each bring in a significant share of revenue. Product reviews happen on Thursdays, with demos of whatever shipped that week.

The role:

Bulkhead Apps needs someone who writes solid SQL and Python and treats pipelines like production software. This hire will help replace a set of fragile nightly scripts with tested, monitored pipelines. Remote, open to candidates across the US. Flexible hours with a daily team call in the morning.

Day to day:

• Respond to pipeline failures and backfill data when needed.
• Handle PII according to retention, masking and access policies.
• Model data in dbt using staging, intermediate and mart layers.
• Tune slow queries and expensive jobs.
• Process large datasets with Spark on Databricks or EMR.
• Write data quality tests with dbt or Great Expectations and alert on failures.
• Ingest data from APIs, SaaS tools and databases with Fivetran, Airbyte or custom Python.
• Work with analysts to define metrics and fix discrepancies between reports.

Required qualifications:

• 7+ years of data engineering, or backend work with data at volume.
• Understanding of dimensional modeling and slowly changing dimensions.
• Working knowledge of AWS, GCP or Azure data services.
• Familiarity with Git, CI/CD and testing practices for data code.
• Patience with messy source data and the habit of documenting assumptions.

Preferred:

• Knowledge of GDPR, CCPA or HIPAA data handling rules.
• Background in finance or marketing data.
• Dbt Certified Developer or Databricks certification.
• Kafka, Flink or Spark Structured Streaming.

Starting pay: $106.50 - $127.00 an hour, depending on experience and certifications.

What you get:

• Health, dental and vision coverage starting on day one.
• 401(k) with 4% match.
• Paid time off.

EOE. We participate in E-Verify.

We are unable to sponsor visas for this position.

Most hires start within two to three weeks of an offer.

Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Bulkhead Apps.