CIO questions · Models & knowledge
RAG or fine-tuning?
The short answer
They are not equivalent alternatives. RAG provides knowledge; fine-tuning changes behavior. Use RAG for policies, documents, regulations, products, procedures and information that changes. Consider fine-tuning when enough examples demonstrate specialized, relatively stable behavior. In critical processes, both still need to coexist with deterministic rules, tools and evaluation.
How to decide
- Need knowledge → RAG
- Need behavior → fine-tuning
- Need guarantees → rules, tools and evaluation
The Onni principle
RAG provides knowledge. Fine-tuning changes behavior.
The architecture behind it
- Knowledge
- Context
- Model gateway
- Evaluation