AI Model Evaluation (MEAP)

AI Model Evaluation teaches you how to effectively evaluate and assess machine learning models for better scaling and integration into production systems. Each chapter tackles a different evaluation method. You'll start with offline evaluations, then move into live A/B tests, shadow traffic deployments, qualitative evaluations, and LLM-based feedback loops. You’ll learn how to evaluate both model behavior and engineering system performance, with a hands-on example grounded in a movie recommendation engine.