RAG isn't always the better choice. It's worth using when you have documents, need accuracy, and want to point back to a source. Ask for a joke, and a plain chatbot is lighter and easier.
Let's think about it this way for a second
RAG is a good fit for rules, handbooks, lesson notes, FAQs, and docs you've written yourself — cases where the answer needs to exist in the text and be traceable back to it. It's a poor fit for creative writing, breaking news, one person's private thoughts, or "just answer with anything" questions. Without documents, RAG is just an empty plate — a nice-looking plate doesn't mean there's food on it.
Let's connect it to everyday life
Good example: a student asks "When is the assignment due?" and the date is sitting right there in syllabus.pdf. Bad example: "Predict what will happen next year" — that's simply not in any document. For your first project, stick to just 3–5 files. Don't dump in all of Wikipedia — that's like stuffing your whole fridge full because you're hungry; it doesn't actually help you find the right meal.
Let's try it hands-on together
Good first RAG jobs
- School handbook Q&A
- Your own class notes
- Product FAQ you wrote
Not for a first RAG
- Predict the future
- Search the whole internet
- Private chats you do not ownYou'll be able to decide whether a given task calls for RAG or not.5-Minute Try-It
Think of 5 files you have. Sort them into 3 good candidates for RAG and 2 that aren't, and explain why.
One Quick Warning
Don't feed someone else's writing into RAG without asking permission. Start with your own sample notes instead.