Senior Data Engineer

Larchwater employs 4,800 people across engineering hubs in Huntsville and three other locations, building ERP software for mid-market manufacturers. Public sector agencies, utilities and large health systems license our asset management platform under multi-year contracts.

Overview

Larchwater needs someone who writes solid SQL and Python and treats pipelines like production software. Remote, open to candidates across the US. Weekday working hours, with room to shift your day when needed.

In this role you will

• Design table layouts and partitioning for Parquet, Delta Lake or Iceberg
• Respond to pipeline failures and backfill data when needed
• Tune slow queries and expensive jobs
• Process large datasets with Spark on Databricks or EMR
• Ingest data from APIs, SaaS tools and databases with Fivetran, Airbyte or custom Python
• Write data quality tests with dbt or Great Expectations and alert on failures
• Build batch and streaming pipelines with Airflow, Dagster or Prefect
• Model data in dbt using staging, intermediate and mart layers

Minimum qualifications

• 5+ years of data engineering, or backend work with data at volume
• Hands-on with an orchestration tool such as Airflow
• Working knowledge of AWS, GCP or Azure data services
• Strong Python for data processing
• Understanding of dimensional modeling and slowly changing dimensions
• Expert SQL, including window functions and query tuning
• Familiarity with Git, CI/CD and testing practices for data code

Preferred qualifications

• Terraform for data infrastructure
• Kafka, Flink or Spark Structured Streaming
• Reverse ETL tools like Hightouch or Census
• Background in finance or marketing data

The base pay range for this position is $180,000 - $240,000 annually. Actual pay depends on experience, skills and location.

Why work with us

• Health savings account (HSA) with employer contribution
• 401(k) with a 100% match up to 5%
• Paid time off
• Annual bonus
• Cell phone reimbursement

Start: Flexible.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Larchwater.