Graph RAG for Multi-Hop Questions

  • Python
  • Pydantic
  • Groq
  • NumPy
Question
When the facts for an answer sit in different news articles, does walking a knowledge graph find it where similarity search does not?
Setup
Relation extraction over 110 Indian insurance articles, with deal status and ownership periods; 222 names merged into 136 companies and people; cited answers.
Result
Graph RAG 10/11, vector RAG 9/11, the model alone 3/11.
Flow
  1. 115 articles
  2. Extract
  3. Resolve · 222 → 136
  4. Graph · 166 edges
  5. 2-hop walk
  6. Cited answer
Scope

11 questions, one run each, over 110 of 115 articles (5 didn’t extract). A direction, not a proof.

4/4 vs 3/4cross-article questions · graph vs vector

One question apart. Read it as a direction, not a proof.

Graph RAG4/4
Vector RAG3/4
Model alone1/4
Fig. 2Correct answers by method. Every citation was checked against its source.
Decisions
  • Every relation has a status (asserted, prospective, denied), so a pending deal is never reported as done.
  • No fuzzy entity matching. Every alias was checked by reading the source articles.
  • Round-robin evidence, after one deal filled 14 of 30 context slots.
  • A fair baseline: vector RAG gets the same prompt, model and citation format; only retrieval differs.
Entry 2, 4 of 7