WEKA and Oracle Cloud Infrastructure Validate 10x Throughput Gains for Long-Context AI Inference

Joint benchmarks on OCI H100 infrastructure showed 10x more concurrent users, 10x higher token throughput, and 7x more tokens served without adding GPUs WEKA, the AI data and memory infrastructure company, announced production-scale benchmarks that show how organizations can improve the economics of long-context AI inference by serving more users and tokens on the same GPU footprint. […]

Last updated Jun 10, 2026 by ATDb automated enrichment