Data Engineer

Two developers, a designer and a support lead make up most of the company, so everyone touches the product. Profitable, no outside investors, and no plans to take any. We grow when customers pay us.

North Shore Labs needs someone who writes solid SQL and Python and treats pipelines like production software. This hire will help replace a set of fragile nightly scripts with tested, monitored pipelines. Remote within the US. The team meets in New York City once a quarter, travel covered. Normal working hours, Monday to Friday. We use Slack, Notion and Google Meet. Cameras on for team calls.

Day to day

• Build batch and streaming pipelines with Airflow, Dagster or Prefect
• Maintain CI for data code and review pull requests
• Work with analysts to define metrics and fix discrepancies between reports
• Tune slow queries and expensive jobs
• Respond to pipeline failures and backfill data when needed
• Handle PII according to retention, masking and access policies
• Document datasets and lineage in a catalog such as DataHub or Atlan

Requirements

• 3+ years of data engineering, or backend work with data at volume
• Expert SQL, including window functions and query tuning
• Familiarity with Git, CI/CD and testing practices for data code
• Patience with messy source data and the habit of documenting assumptions
• Working knowledge of AWS, GCP or Azure data services

Perks and benefits

Compensation: $149,000 to $181,000/year

• Medical, dental and vision insurance
• 401(k) with company match
• Three weeks of PTO to start
• Referral program
• Home office stipend
• Annual bonus

Agencies: please do not contact us about this role.

New hires usually start two to three weeks after accepting an offer.

Start: Flexible.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at North Shore Labs LLC.