Data Engineer II

Stonesmith Data employs 1,300 people across engineering hubs in New York City and three other locations, building ERP software for mid-market manufacturers. We keep recurring meetings to Tuesdays and Thursdays where we can.

Position summary

Stonesmith Data needs someone who writes solid SQL and Python and treats pipelines like production software. Remote, open to candidates across the US.

Day to day

• Document datasets and lineage in a catalog such as DataHub or Atlan.
• Respond to pipeline failures and backfill data when needed.
• Write data quality tests with dbt or Great Expectations and alert on failures.
• Process large datasets with Spark on Databricks or EMR.
• Maintain CI for data code and review pull requests.

Minimum qualifications

• 3-5 years of data engineering, or backend work with data at volume.
• Strong Python for data processing.
• Hands-on with an orchestration tool such as Airflow.
• Familiarity with Git, CI/CD and testing practices for data code.
• Understanding of dimensional modeling and slowly changing dimensions.
• Patience with messy source data and the habit of documenting assumptions.

Preferred qualifications

• Reverse ETL tools like Hightouch or Census.
• Knowledge of GDPR, CCPA or HIPAA data handling rules.
• Terraform for data infrastructure.
• Dbt Certified Developer or Databricks certification.

Pay range: $159,000 - $200,000/year. Final offer will depend on experience.

What you get

• Medical, dental and vision insurance.
• 401(k) with a 100% match up to 5%.
• 12 weeks of paid parental leave.

We are an equal opportunity employer and value diversity. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Interview process: a phone call, a meeting with the hiring manager, and a final conversation with the team.

Start: Flexible.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Stonesmith Data.