RAG Latency Budgeter
Calculate the performance bottleneck of your RAG pipeline from retrieval to generation.
Pipeline Stages (ms)
Latency Breakdown
Prefill Latency750ms
Time until user sees first word
Generation Time6000ms
Total time for completion
Total End-to-End Latency6.75s
Retrieval Rerank TTFT Gen