Associate Data Engineer - Databricks

Who we are:

Clients range from single-location retailers to franchise groups with hundreds of stores, all running our point-of-sale and loyalty software. Laptops are MacBook Pros, and you pick your own editor.

About the role:

This is a backfill for a team member who moved to another team. The operations team moves data from about 30 source systems into Snowflake. You'll own ingestion, modeling and data quality checks. This role is fully remote within the US.

What you'll do:

• Design table layouts and partitioning for Parquet, Delta Lake or Iceberg.
• Process large datasets with Spark on Databricks or EMR.
• Maintain CI for data code and review pull requests.
• Write data quality tests with dbt or Great Expectations and alert on failures.
• Ingest data from APIs, SaaS tools and databases with Fivetran, Airbyte or custom Python.
• Respond to pipeline failures and backfill data when needed.

What we're looking for:

• Working knowledge of AWS, GCP or Azure data services.
• Hands-on with an orchestration tool such as Airflow.
• Expert SQL, including window functions and query tuning.
• Patience with messy source data and the habit of documenting assumptions.
• Understanding of dimensional modeling and slowly changing dimensions.

Nice to have:

• Background in finance or marketing data.
• Knowledge of GDPR, CCPA or HIPAA data handling rules.
• Dbt Certified Developer or Databricks certification.

Why work with us:

• Health, dental and vision coverage starting on day one.
• 401(k) with company match.
• Paid time off.

Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Great Lakes Cloud.