RAG Doesn't Teach the Model Anything
Retrieval-Augmented Generation gets described as if the model absorbed your documents.
Retrieval-Augmented Generation gets described as if the model absorbed your documents. It didn't. The weights never move — RAG hands the model a few relevant passages fresh on every single query, and forgets them just as completely the moment that query ends.
Surya · 4 min read