ML Engineer - Computer Vision

Our engineering group is split into roughly 60 product teams, each owning its services end to end, with on-call shared across time zones. Annual releases gave way to two-week sprints years ago, and the platform now handles over 200 million API calls a day. Founded in 1987, we now have 220 employees. On-call rotates weekly and pays a flat stipend whether or not the pager goes off.

Job summary:

We are backfilling a position after an internal move. We're looking for an engineer to build retrieval-augmented generation features on hosted and open-weight language models, with proper evaluation. This role is fully remote within the US. Day-to-day communication is in Slack and Google Meet.

In this role you will:

• Develop RAG pipelines with embeddings, vector stores (pgvector, Pinecone, Weaviate) and rerankers.
• Set up evaluation harnesses and regression tests for model quality.
• Build training pipelines in PyTorch or TensorFlow and run them on GPUs in AWS, GCP or Azure.
• Productionize data science prototypes without rewriting everything.
• Handle on-call for the ML services the team owns.
• Write clean, tested Python and review teammates' code.

Required qualifications:

• 2+ years of software engineering experience, with at least two spent on ML systems in production.
• Knowledge of LLM APIs, prompt design and evaluation methods.
• Strong Python and solid engineering habits (testing, packaging, code review)
• Experience deploying models as services and monitoring them.
• BS or MS in computer science, engineering or a related field.
• Familiarity with Docker, Kubernetes and a cloud ML platform (SageMaker, Vertex AI, Azure ML)

Preferred:

• Recommendation or ranking systems at scale.
• Computer vision background (OpenCV, detection, segmentation)
• Distributed training with DeepSpeed or FSDP.
• Guardrails, red teaming or safety evaluation for LLM features.

The base pay range for this position is $205,000 - $250,000 per year. Actual pay depends on experience, skills and location.

Compensation and benefits:

• Health insurance.
• 401(k) with a 100% match up to 5%.
• Three weeks of PTO to start.
• Life insurance.

Caskline Labs provides equal employment opportunities to all employees and applicants.

This position requires a background check.

Start: Within 30 days.

Demo job created on 11jobs for testing and demonstrations. It is not an actual opening at Caskline Labs LLC.