Delivery Director

New Today

Delivery Director Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises looking to deploy advanced AI systems. Turing accelerates frontier research with high-quality data, specialized talent, and training pipelines that advance thinking, reasoning, coding, multimodality, and STEM. For enterprises, Turing builds proprietary intelligence systems that integrate AI into mission-critical workflows, unlock transformative outcomes, and drive lasting competitive advantage. We are seeking a seasoned, techno-functional leader to drive the development and execution of large-scale LLM training programs. This role is deeply technical and client-facing, with significant emphasis on dataset creation, annotation workflows, and high-quality data pipelines for foundational model training. The ideal candidate combines deep technical understanding of the LLM training lifecycle, strong operational rigor, and exceptional cross-functional leadership.
Check all associated application documentation thoroughly before clicking on the apply button at the bottom of this description. Responsibilities
Lead the generation and delivery of high-quality, scalable LLM training datasets with a focus on SFT, RLHF, Reasoning, and agentic workflows.
Oversee the end-to-end data lifecycle from client intake to delivery, including collaboration with the clients for defining the data requirements, writing down the data annotation steps / workflow, quality metrics, review workflows, and delivery setup.
Serve as the primary client contact for large enterprise engagements; manage stakeholder expectations, requirements gathering, and delivery timelines.
Collaborate with engineering, product, research, and delivery teams to ensure technical feasibility and alignment across workstreams.
Develop, document, and refine best practices for prompt evaluation, data schema design, evaluation metrics (e.g., win rate, pairwise preference), and human-in-the-loop QA.
Recruit, manage, and mentor engineering leads and program managers working across multiple AI training pods.
Operate as a strategic business partner to our clients; provide insight on tradeoffs, resourcing, and performance metrics.
Build internal capability by harvesting reusable assets and contribute in continued improvements across data quality, tools and processes.
Required Qualifications
10+ years of experience building and leading large scale technical delivery teams
Proven ability to lead large cross functional teams (100+) by building strong operations
Bachelor's degree in Engineering, Computer Science or equivalent practical experience leading large-scale technical initiatives
Demonstrated experience managing large-scale dataset generation or annotation for LLMs, ideally with experience in RLHF or SFT pipelines
Strong understanding of quality review mechanisms including prompt win rate, agreement metrics, inter-annotator consistency, and preference modeling
Experience with human data generation across at least one of the modalities (Text, Image, Video, Audio)
Technical fluency in Python, cloud infrastructure, data platforms, machine learning concepts and modern Machine Learning tooling (e.g., HuggingFace, LangChain, Weights & Biases)
Strong communication skills with experience presenting to executive stakeholders, managing client escalations, and aligning delivery with strategic goals
Preferred Qualifications
Prior experience at AI Data Platform companies
Past experience with retrieval augmented generation (RAG), fine-tuning, and human evaluation workflows
Familiarity with fine-tuning LLMs, prompt engineering at scale, and instruction dataset design
Familiarity with benchmarks (SWE Bench, MMMLU, or equivalent)
Location : SF Bay Area (Remote / Hybrid but must be in the SF Bay Area) Compensation : $170,000 to $200,000 OTE + Equity
Values We are client first : We put our clients at the center of everything we do, because their success is the ultimate measure of our value.
We work at start-up speed: We move fast, stay agile and favor action because momentum is the foundation of perfection
We are AI forward : We help our clients build the future of AI and implement it in our own roles and workflow to amplify productivity.
Advantages of joining Turing
Amazing work culture (Super collaborative & supportive work environment; 5 days a week)
Awesome colleagues (Surround yourself with top talent from Meta, Google, LinkedIn etc. as well as people with deep startup experience)
Competitive compensation
Flexible working hours
Don’t meet every single requirement? Studies have shown that women and people of color are less likely to apply to jobs unless they meet every single qualification. Turing is proud to be an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender identity, sexual orientation, age, marital status, disability, protected veteran status, or any other legally protected characteristics. At Turing we are dedicated to building a diverse, inclusive and authentic workplace and celebrate authenticity, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyways. You may be just the right candidate for this or other roles.
For applicants from the European Union, please review Turing's GDPR notice here.
#J-18808-Ljbffr
Location:
San Francisco, CA
Job Type:
FullTime
Category:
Management And Consultancy

We found some similar jobs based on your search