Search Tech Bulletin

Explore the library

Research paper

OpenDC-Infer-LC: Benchmarking Production-Valid Long-Context and RAG LLM Serving

Compare serving performance under realistic loads for systems that combine long context with retrieved documents.

OpenDC-Infer-LC: Benchmarking Production-Valid Long-Context and RAG LLM Serving cover