It can improve quality but adds latency and another model dependency.
RAG ARCHITECTUREENTERPRISE AI ARCHITECTURE
Reranking Layer
Reranking reorders candidate chunks using a stronger relevance model or task-specific scorer.
The system retrieves 30 candidates cheaply and reranks the best 8 for final context.
Does the quality gain justify added latency and cost?
REMEMBERReranking is an architecture trade-off, not a mandatory layer.
No uploads · No company data · No account required