Bistro Innovation Labs
Bistro Innovation Labs
Berlin
Back to Talk
Talk2024-02-181 min read

Navigating via Retrieval Evaluation to Demystify LLM Wonderland

How to demystify LLM applications by taking retrieval evaluation seriously — the retrieval-first view of RAG failures.

View original source

Given at the MLOps Community 'AI in Production' 2024 conference. Most LLM failures in production are retrieval failures wearing an LLM mask. This talk shows how to expose them.

#rag#evaluation#mlops