Data Engineer

Who we are:

Most of what we build is back-office software for property managers, including lease tracking, work orders and tenant payments. Clients range from single-location retailers to franchise groups with hundreds of stores, all running our point-of-sale and loyalty software. Founded in 2012, we now have 180 employees. Laptops are MacBook Pros, and you pick your own editor.

What this job is:

This is a new role. The team has doubled in size over the past year. This hire will help replace a set of fragile nightly scripts with tested, monitored pipelines. We engage team members in Pakistan as full-time contractors. Most of our contractors have been with us for more than two years. Core hours are 9:00 AM to 1:00 PM US Eastern. Equipment is provided, including a laptop.

What you'll do:

• Build batch and streaming pipelines with Airflow, Dagster or Prefect
• Process large datasets with Spark on Databricks or EMR
• Ingest data from APIs, SaaS tools and databases with Fivetran, Airbyte or custom Python
• Maintain CI for data code and review pull requests
• Document datasets and lineage in a catalogue such as DataHub or Atlan

What you bring:

• 3+ years of data engineering, or backend work with data at volume
• Familiarity with Git, CI/CD and testing practices for data code
• Understanding of dimensional modelling and slowly changing dimensions
• Strong Python for data processing
• Expert SQL, including window functions and query tuning

Pluses:

• Kafka, Flink or Spark Structured Streaming

Pay and benefits:

Salary range: $1,450-$1,700 monthly

• Company laptop
• Long-term engagement
• Monthly payments via wire transfer or Wise
• Paid in USD

Duration: 6 months. Start: Immediately.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Esposito Digital.