Principal Data Engineer

Position summary

We are adding a Principal Data Engineer to our Analytics team. The Analytics team moves data from about 30 source systems into Snowflake. You'll own ingestion, modeling and data quality checks. This hire will help replace a set of fragile nightly scripts with tested, monitored pipelines. This role is fully remote within the US. Normal working hours, Monday to Friday. Please make sure you have a quiet place to work and a solid internet connection.

Day to day

• Process large datasets with Spark on Databricks or EMR
• Build batch and streaming pipelines with Airflow, Dagster or Prefect
• Tune slow queries and expensive jobs
• Model data in dbt using staging, intermediate and mart layers
• Maintain CI for data code and review pull requests
• Work with analysts to define metrics and fix discrepancies between reports
• Respond to pipeline failures and backfill data when needed

You'll need

• 8+ years of data engineering, or backend work with data at volume
• Patience with messy source data and the habit of documenting assumptions
• Expert SQL, including window functions and query tuning
• Strong Python for data processing
• Familiarity with Git, CI/CD and testing practices for data code
• Hands-on with an orchestration tool such as Airflow

Benefits

The base pay range for this position is $198,000 - $235,000 annually. Actual pay depends on experience, skills and location.

• Medical, dental and vision insurance
• 401(k) with 4% match
• Three weeks of PTO to start
• Referral program

About the company

Clients range from single-location retailers to franchise groups with hundreds of stores, all running our point-of-sale and loyalty software. Laptops are MacBook Pros, and you pick your own editor.

We are an equal opportunity employer and value diversity. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

No agencies or third-party recruiters, please.

Start: Flexible.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Great Lakes Cloud.