Google’s Gemma series continues to throw up all kinds of interesting models. The latest is Magenta RealTime 2 (MRT2), an open-weights model ...

Anyscale is the AI compute platform built by the creators of Ray, the most widely adopted open-source framework for scaling Python and AI workloads. Anyscale powers AI at companies including Coinbase, ...

PALO ALTO, Calif., May 11, 2026 /PRNewswire/ -- AKOOL today announced a major breakthrough in AI video infrastructure with the launch of its production-grade video inference engine, delivering 10–20× ...

With Flash GA, the company is attempting to transition from being a provider of raw compute to becoming the essential orchestration layer for the AI-first cloud.

Built alongside early design partners, the Inference Engine gives AI developers unified control over performance, cost, and scale — with customers reporting up to 67% lower inference costs.

Amazon Web Services plans to deploy processors designed by Cerebras inside its data centers, the latest vote of confidence in the startup, which specializes in chips that power artificial-intelligence ...

Every GPU cluster has dead time. Training jobs finish, workloads shift and hardware sits dark while power and cooling costs keep running. For neocloud operators, those empty cycles are lost margin.

wLLM is a 100% ground-up, high-performance inference engine specifically architected for the Windows ecosystem. Built in pure Python and PyTorch, it delivers server-grade continuous batching and ...

This is a python package focused on systems performance: quantized weights, KV cache reuse, dynamic batching, token streaming, and rigorous benchmarking across backends. llminfer is for engineers who ...

Adding big blocks of SRAM to collections of AI tensor engines, or better still, a waferscale collection of such engines, turbocharges AI inference, as has been shown time and again by AI upstarts ...

Shakti P. Singh, Principal Engineer at Intuit and former OCI model inference lead, specializing in scalable AI systems and LLM inference. Generative models are rapidly making inroads into enterprise ...