Principal Data Engineer - Remote

About RPP Systems

Annual releases gave way to two-week sprints years ago, and the platform now handles over 200 million API calls a day. Our engineering group is split into roughly 60 product teams, each owning its services end to end, with on-call shared across time zones. On-call rotates weekly and pays a flat stipend whether or not the pager goes off.

Role overview

The Data Engineering team moves data from about 30 source systems into Snowflake. You'll own ingestion, modeling and data quality checks. RPP Systems needs someone who writes solid SQL and Python and treats pipelines like production software. You can work from home anywhere in the US. We have no office requirement. We use Slack, Notion and Google Meet. Cameras on for team calls.

Day to day

• Tune slow queries and expensive jobs
• Document datasets and lineage in a catalog such as DataHub or Atlan
• Handle PII according to retention, masking and access policies
• Ingest data from APIs, SaaS tools and databases with Fivetran, Airbyte or custom Python
• Build batch and streaming pipelines with Airflow, Dagster or Prefect
• Respond to pipeline failures and backfill data when needed
• Work with analysts to define metrics and fix discrepancies between reports
• Model data in dbt using staging, intermediate and mart layers

Required qualifications

• 7+ years of data engineering, or backend work with data at volume
• Strong Python for data processing
• Working knowledge of AWS, GCP or Azure data services
• Hands-on with an orchestration tool such as Airflow
• Familiarity with Git, CI/CD and testing practices for data code
• Expert SQL, including window functions and query tuning

Pluses

• Dbt Certified Developer or Databricks certification
• Terraform for data infrastructure

What you get

Pay: $108.00 to $123.50/hr

• Home office stipend
• Referral program

RPP Systems provides equal employment opportunities to all employees and applicants.

Applicants must be authorized to work in the U.S.

Duration: 9 months. Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at RPP Systems Inc..