Join to apply for the Delivery Director role at Turing

This range is provided by Turing. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$170,000.00/yr - $200,000.00/yr

Additional compensation types

RSUs

Overview

We are seeking a seasoned, techno-functional leader to drive the development and execution of large-scale LLM training programs. This role is deeply technical and client-facing, with significant emphasis on dataset creation, annotation workflows, and high-quality data pipelines for foundational model training. The ideal candidate combines deep technical understanding of the LLM training lifecycle, strong operational rigor, and exceptional cross-functional leadership.

Key Responsibilities

• Lead the generation and delivery of high-quality, scalable LLM training datasets with a focus on SFT, RLHF, Reasoning, and agentic workflows.
• Oversee the end-to-end data lifecycle from client intake to delivery, including collaboration with the clients for defining the data requirements, writing down the data annotation steps/workflow, quality metrics, review workflows, and delivery setup.
• Serve as the primary client contact for large enterprise engagements; manage stakeholder expectations, requirements gathering, and delivery timelines.
• Collaborate with engineering, product, research, and delivery teams to ensure technical feasibility and alignment across workstreams.
• Develop, document, and refine best practices for prompt evaluation, data schema design, evaluation metrics (e.g., win rate, pairwise preference), and human-in-the-loop QA.
• Recruit, manage, and mentor engineering leads and program managers working across multiple AI training pods.
• Operate as a strategic business partner to our clients; provide insight on tradeoffs, resourcing, and performance metrics.
• Build internal capability by harvesting reusable assets and contribute in continued improvements across data quality, tools and processes.

Required Qualifications

• 10+ years of experience building and leading large scale technical delivery teams
• Proven ability to lead large cross functional teams (100+) by building strong operations
• Bachelor’s degree in Engineering, Computer Science or equivalent practical experience leading large-scale technical initiatives.
• Demonstrated experience managing large-scale dataset generation or annotation for LLMs, ideally with experience in RLHF or SFT pipelines.
• Strong understanding of quality review mechanisms including prompt win rate, agreement metrics, inter-annotator consistency, and preference modeling.
• Experience with human data generation across at least one of the modalities (Text, Image, Video, Audio)
• Technical fluency in Python, cloud infrastructure, data platforms, machine learning concepts and modern Machine Learning tooling (e.g., HuggingFace, LangChain, Weights & Biases).
• Strong communication skills with experience presenting to executive stakeholders, managing client escalations, and aligning delivery with strategic goals.

Preferred Qualifications

• Prior experience at AI Data Platform companies
• Past experience with retrieval augmented generation (RAG), fine-tuning, and human evaluation workflows.
• Familiarity with fine-tuning LLMs, prompt engineering at scale, and instruction dataset design.
• Familiarity with bench marks (SWE Bench, MMMLU, or equivalent)

Location

SF Bay Area (Remote/Hybrid but must be in the SF Bay Area)

Compensation

$170,000 to $200,000 OTE + Equity

Seniority level

Director

Employment type

Full-time

Job function

Information Technology and Strategy/Planning

Industries

Software Development and IT Services and IT Consulting