Senior Data Engineer

Arbortrack HQ operates consumer websites and apps used by tens of millions of people each month. Our engineering, trust and safety, and customer support teams work across offices in New York City and several other countries.

Job summary

We're looking for a Senior Data Engineer to join our team. This is a remote role. This hire will help replace a set of fragile nightly scripts with tested, monitored pipelines. You can work from home anywhere in the US. We have no office requirement.

Duties

• Model data in dbt using staging, intermediate and mart layers
• Write data quality tests with dbt or Great Expectations and alert on failures
• Document datasets and lineage in a catalog such as DataHub or Atlan
• Respond to pipeline failures and backfill data when needed
• Process large datasets with Spark on Databricks or EMR

What you need

• 5-7 years of data engineering, or backend work with data at volume
• Understanding of dimensional modeling and slowly changing dimensions
• Expert SQL, including window functions and query tuning
• Familiarity with Git, CI/CD and testing practices for data code
• Patience with messy source data and the habit of documenting assumptions
• Hands-on with an orchestration tool such as Airflow
• Strong Python for data processing

Pay range: $190,000 - $220,000/year. Final offer will depend on experience.

Benefits

• Health savings account (HSA) with employer contribution
• 401(k) with company match
• Three weeks of PTO to start
• Short- and long-term disability
• Flexible schedule

Arbortrack HQ is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.

Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Arbortrack HQ.