When it is really needed
When the response format matters: strict format, narrow style, specific terminology. Fine-tuning is poor at adding knowledge – RAG is used for knowledge.
What it is replaced with
First, try a detailed instruction and examples right in the prompt. It is cheaper, can be changed in a minute and does not require a labeled dataset.