intermediateData Science & AILive cohorts
LLM Application Engineering
Retrieval, evals and cost control for production LLM apps
LLM Application Engineering: Retrieval, evals and cost control for production LLM apps.
What you'll be able to do
- Build a retrieval pipeline
- Write offline evals that catch regressions
- Control token spend
Curriculum
Getting started
How this course workspreview
Setting up your environmentpreview11m
Starter repo & setup checklist
Core concepts
The mental model18m
Working through the happy path16m
What breaks in production (and why)
Interactive walkthrough
Applied practice
Building the reference implementation25m
Guided exercise: build it yourself
Cheat sheet, templates & further reading
Build & assess
Knowledge check
LLM Application Engineering: final assignment
Where to go next
Reviews
Aryan Joshi★★★★★
Cut our token spend by 60% using exactly this.
Sana Kapoor★★★★
Everyone teaches RAG. Almost nobody teaches how to know it works.