RAG Architecture Evolution

From a linear retrieval–generation loop to composable retrieval modules

RAG Architecture Evolution From a linear retrieval–generation loop to composable retrieval modules NAIVE RAG · BASIC LINEAR FLOW ADVANCED RAG · PRE- AND POST-RETRIEVAL OPTIMIZATION MODULAR RAG · LEGO-LIKE ORCHESTRATION Index · knowledge vectorization · NAIVE RAG · BASIC LINEAR FLOW · offline Index knowledge vectorization offline Retrieve · semantic recall · NAIVE RAG · BASIC LINEAR FLOW · online · retrieval phase Retrieve semantic recall online · retrieval phase Generate · integrate context + answer · NAIVE RAG · BASIC LINEAR FLOW · online · generation phase Generate integrate context + answer online · generation phase Index · external knowledge · ADVANCED RAG · PRE- AND POST-RETRIEVAL OPTIMIZATION · offline Index external knowledge offline Pre-retrieval · query rewriting · ADVANCED RAG · PRE- AND POST-RETRIEVAL OPTIMIZATION · online optimization Pre-retrieval query rewriting online optimization Retrieve · candidate recall · ADVANCED RAG · PRE- AND POST-RETRIEVAL OPTIMIZATION · online · retrieval phase Retrieve candidate recall online · retrieval phase Post-retrieval · reranking · ADVANCED RAG · PRE- AND POST-RETRIEVAL OPTIMIZATION · online optimization Post-retrieval reranking online optimization Generate · integrate context + answer · ADVANCED RAG · PRE- AND POST-RETRIEVAL OPTIMIZATION · online · generation phase Generate integrate context + answer online · generation phase Router · select a path · MODULAR RAG · LEGO-LIKE ORCHESTRATION · dynamic orchestration Router select a path dynamic orchestration Query Transform · rewrite · decompose · MODULAR RAG · LEGO-LIKE ORCHESTRATION · composable module Query Transform rewrite · decompose composable module Retrieval Modules · dense · sparse · tools · MODULAR RAG · LEGO-LIKE ORCHESTRATION · select or combine Retrieval Modules dense · sparse · tools select or combine Fusion · merge retrieved evidence · MODULAR RAG · LEGO-LIKE ORCHESTRATION · composable module Fusion merge retrieved evidence composable module Generate · grounded response · MODULAR RAG · LEGO-LIKE ORCHESTRATION · generation phase Generate grounded response generation phase vector index retrieved context serves Legend Database Backend Cloud Frontend Security Message bus

Architecture diagram • Built with Archify • Hover to trace • R route • Click to focus • +/− zoom • M radar • T theme • E export