RAG & Vector Databases interview questions
Embeddings, vector indexing (HNSW, IVFFlat), hybrid search, chunking strategies, re-ranking, and query transformation.
What to study
- Dense vs sparse embeddings and hybrid keyword + semantic search.
- Chunking strategies (semantic, sliding window) and document parsing.
- HNSW vs IVFFlat index tradeoffs for latency, memory, and recall.
Questions and answers
What is the difference between HNSW and IVFFlat vector indexes?
Intermediate · 2 min read
What is Retrieval-Augmented Generation (RAG) and why is it used?
Beginner · 2 min read
How do dense and sparse vector embeddings differ?
Beginner · 2 min read
How does hybrid search combine BM25 and vector embeddings?
Intermediate · 2 min read
How do cross-encoder rerankers and late-interaction (ColBERT) models work?
Advanced · 2 min read
What is chunk size and chunk overlap in text splitting?
Beginner · 2 min read
What is Cosine Similarity vs Euclidean Distance in vector search?
Beginner · 2 min read
What is the 'Lost in the Middle' phenomenon in LLM retrieval?
Beginner · 2 min read
How does query rewriting and Hypothetical Document Embeddings (HyDE) work?
Intermediate · 2 min read
How do GraphRAG and Knowledge Graphs enhance vector retrieval?
Advanced · 2 min read
What is an embedding model and how does vector dimension affect search quality?
Beginner · 2 min read
What is semantic search and how does it differ from traditional keyword search?
Beginner · 2 min read
What is document metadata filtering in vector databases?
Beginner · 2 min read
What is single-representation vs multi-representation document retrieval?
Beginner · 2 min read
What is document parsing and why do table formats break standard text splitters?
Beginner · 2 min read
How does Parent-Document Retrieval link fine-grained vector chunks back to full parent context?
Intermediate · 2 min read
How does Reciprocal Rank Fusion (RRF) combine scores from sparse and dense retrievers?
Intermediate · 2 min read
How does contextual compression reduce context window token usage during RAG?
Intermediate · 2 min read
How does RAPTOR perform hierarchical tree-organized retrieval?
Advanced · 2 min read
How does Self-RAG train models to dynamically decide when to retrieve, evaluate, and critique documents?
Advanced · 2 min read