Data Engineer - Analytics Engineering

Who we are

Clients range from single-location retailers to franchise groups with hundreds of stores, all running our point-of-sale and loyalty software. Built in Scottsdale, our document management tool is used by county clerks, title companies and small law offices.

Our team is growing and we are hiring a Data Engineer - Analytics Engineering. The operations team moves data from about 30 source systems into Snowflake. You'll own ingestion, modelling and data quality checks. This hire will help replace a set of fragile nightly scripts with tested, monitored pipelines. The company is based in Scottsdale, the US. The team is spread across multiple countries. You will join as an independent contractor on a long-term agreement. Payment is monthly in USD. You will need at least 4 hours of overlap with US Central time. Good written English matters here, since most updates are written.

Essential duties and responsibilities

• Ingest data from APIs, SaaS tools and databases with Fivetran, Airbyte or custom Python
• Maintain CI for data code and review pull requests
• Model data in dbt using staging, intermediate and mart layers
• Build batch and streaming pipelines with Airflow, Dagster or Prefect
• Document datasets and lineage in a catalogue such as DataHub or Atlan
• Respond to pipeline failures and backfill data when needed
• Process large datasets with Spark on Databricks or EMR

What we're looking for

• 3+ years of data engineering, or backend work with data at volume
• Patience with messy source data and the habit of documenting assumptions
• Working knowledge of AWS, GCP or Azure data services
• Expert SQL, including window functions and query tuning
• Understanding of dimensional modelling and slowly changing dimensions

Nice to have

• Kafka, Flink or Spark Structured Streaming

Why work with us

• Company laptop
• Flexible hours
• Long-term engagement

Duration: 3 months. Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Scottsdale Software.