Retrieval and Context Systems
AIE-1033 credits · 50h required · 1h optional · after AIE-101
Retrieval is the default answer to most enterprise AI questions and is wrong often enough that knowing when not to use it is the differentiator. This course refuses the word RAG for as long as possible, because it welds together two separate problems — finding the right thing, and writing a good answer from it — and most broken systems are broken in only one of them.
The lab. Two corpora of your own, chosen because they fail differently. Carpark SG's official rate documents are dense with codes, acronyms and proper nouns — HDB and URA terminology that embeddings blur together and lexical search nails. Indie Degree's own resource corpus is prose-heavy with near-synonymous topics, where lexical search fails and embeddings shine. If a technique only helps on one of them, that is the finding.
By the end you can
- Build hybrid retrieval and show where lexical beats dense, with numbers
- Choose a chunking strategy from measured retrieval quality rather than from a blog post
- Evaluate retrieval separately from generation, and locate which half is failing
- Articulate when long context replaces retrieval and when it does not
- Enforce document-level access control through a retrieval pipeline, and prove it holds
0 of 40 required items complete
0m of 50h 15m
M1 · Two problems wearing one name
0/5 · 5h 45mlecture · 1h 30m · tier 0 self-marked
Beyond the Basics of Retrieval Augmented Generation — Hamel Husain
lecture · 1h 30m · tier 0 self-marked
CMU Advanced NLP Fall 2024 (10): Retrieval and RAG — Graham Neubig
reading · 45m · tier 0 self-marked
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
reading · 45m · tier 0 self-marked
assignment · 1h 15m · tier 2 panel-assessed
M2 · Embeddings and the limits of similarity
0/5 · 6hreading · 45m · tier 0 self-marked
reading · 1h · tier 0 self-marked
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models
assignment · 2h 30m · tier 1 machine-verified
assignment · 1h 30m · tier 1 machine-verified
retention · 15m · tier 1 machine-verified
M3 · Chunking, measured
0/5 · 6h 15mreading · 1h · tier 0 self-marked
reading · 45m · tier 0 self-marked
Searching for Best Practices in Retrieval-Augmented Generation
assignment · 2h 30m · tier 1 machine-verified
assignment · 1h 45m · tier 1 machine-verified
retention · 15m · tier 1 machine-verified
M4 · Hybrid and lexical search
0/5 · 6h 15mreading · 45m · tier 0 self-marked
Reciprocal Rank Fusion outperforms Condorcet and individual Rank Learning Methods
reading · 1h · tier 0 self-marked
ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT
assignment · 2h 30m · tier 1 machine-verified
assignment · 1h 45m · tier 1 machine-verified
retention · 15m · tier 1 machine-verified
M5 · Reranking
0/5 · 5hreading · 45m · tier 0 self-marked
reading · 45m · tier 0 self-marked
assignment · 2h · tier 1 machine-verified
assignment · 1h 15m · tier 2 panel-assessed
retention · 15m · tier 1 machine-verified
M6 · Evaluating retrieval separately from generation
0/5 · 5h 30mreading · 45m · tier 0 self-marked
RAGAS: Automated Evaluation of Retrieval Augmented Generation
reading · 1h · tier 0 self-marked
assignment · 2h · tier 1 machine-verified
assignment · 1h 30m · tier 1 machine-verified
retention · 15m · tier 1 machine-verified
M7 · When long context replaces retrieval
0/2 · 4h 15mreading · 1h · tier 0 self-marked
Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approach
assignment · 2h 30m · tier 1 machine-verified
M8 · Production retrieval
0/4 · 5h 30mreading · 45m · tier 0 self-marked
assignment · 2h 30m · tier 1 machine-verified
assignment · 2h · tier 1 machine-verified
retention · 15m · tier 1 machine-verified
M9 · Course project
0/4 · 6h 30mproject · 2h 30m · tier 3 artifact
project · 1h 45m · tier 2 panel-assessed
project · 1h 15m · tier 3 artifact
defense · 1h · tier 4 defended