Senior Data Engineer - Spark

The company

Tideridge HQ operates consumer websites and apps used by tens of millions of people each month. Advertising, subscriptions and transaction fees each bring in a significant share of revenue.

Tideridge HQ needs someone who writes solid SQL and Python and treats pipelines like production software. The Analytics team moves data from about 30 source systems into Snowflake. You'll own ingestion, modeling and data quality checks. Remote, open to candidates across the US. We send you a laptop and the accessories you need on day one.

Job duties

• Process large datasets with Spark on Databricks or EMR
• Handle PII according to retention, masking and access policies
• Model data in dbt using staging, intermediate and mart layers
• Work with analysts to define metrics and fix discrepancies between reports
• Write data quality tests with dbt or Great Expectations and alert on failures
• Build batch and streaming pipelines with Airflow, Dagster or Prefect
• Document datasets and lineage in a catalog such as DataHub or Atlan

Skills and experience

• 7+ years of data engineering, or backend work with data at volume
• Working knowledge of AWS, GCP or Azure data services
• Familiarity with Git, CI/CD and testing practices for data code
• Understanding of dimensional modeling and slowly changing dimensions

Perks and benefits

The base pay range for this position is $180,000-$215,000 per year. Actual pay depends on experience, skills and location.

• Medical, dental and vision insurance
• 401(k) with company match
• Paid time off
• Profit sharing
• Professional development budget
• Health savings account (HSA) with employer contribution

Tideridge HQ provides equal employment opportunities to all employees and applicants.

New hires usually start two to three weeks after accepting an offer.

Start: Flexible.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Tideridge HQ LLC.