Skip to content

Research paper

Inference Perf: A Benchmarking Tool for GenAI Inference

Journal of Open Source SoftwareAug 2026PDF

Learn what an open benchmarking tool measures when generative AI models serve inference requests.

Artificial intelligence Generative AI Model evaluation Kubernetes

Inference Perf: A Benchmarking Tool for GenAI Inference cover

Publisher’s source