Junior Data Engineer, Python

About Lexington Labs:

Small accounting firms in Kentucky use our engagement letter and e-signature tool, and most heard about us from a colleague. Profitable, no outside investors, and no plans to take any. We grow when customers pay us. Releases go out Tuesday mornings, never on Fridays.

Overview:

Lexington Labs has an opening for a Junior Data Engineer, Python. The operations team moves data from about 30 source systems into Snowflake. You'll own ingestion, modeling and data quality checks. Remote, open to candidates across the US. Normal working hours, Monday to Friday. You will need a reliable internet connection and a quiet place to work.

Main duties:

• Document datasets and lineage in a catalog such as DataHub or Atlan.
• Process large datasets with Spark on Databricks or EMR.
• Build batch and streaming pipelines with Airflow, Dagster or Prefect.
• Design table layouts and partitioning for Parquet, Delta Lake or Iceberg.
• Work with analysts to define metrics and fix discrepancies between reports.
• Tune slow queries and expensive jobs.
• Write data quality tests with dbt or Great Expectations and alert on failures.

Minimum qualifications:

• 1+ years of data engineering, or backend work with data at volume.
• Working knowledge of AWS, GCP or Azure data services.
• Expert SQL, including window functions and query tuning.
• Understanding of dimensional modeling and slowly changing dimensions.

Preferred qualifications:

• Knowledge of GDPR, CCPA or HIPAA data handling rules.
• Kafka, Flink or Spark Structured Streaming.

What you get:

Salary: $104,000 to $124,000 per year

• Health insurance.
• 401(k) with a 100% match up to 5%.
• Paid sick leave.
• Employee discount.
• Annual bonus.

This position requires a background check.

Applicants must be authorized to work in the U.S.

Start: Flexible.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Lexington Labs, LLC.