AI & Machine Learning
342 articles RSS
How Decision Models Are Being Evaluated: Rival Indexes, a Pac-Man Benchmark and a Prompt-Injection Test
Reporting from TechCrunch, The Register and Artificial Analysis shows decision models judged by competing indexes, a game benchmark, vendor-run tests and a security study, with no single shared comparison.
Valkey Project Benchmarks a Shared Valkey KV Cache for LLM Inference, Reporting 25% More Requests Served on the Same Two GPU Nodes
A Valkey blog post reports that a three-shard Valkey 9 cache served 4,631 requests versus 3,692 on the same two 8-GPU nodes, at a cost of about 15% on top of the GPU bill.
Diffusers 0.42.0 Adds FLUX.3 Image Klein, Kandinsky 6 and SANA-WM Pipelines and Drops Python 3.10
Hugging Face's Diffusers 0.42.0 adds FLUX.3 Image Klein, Bria Fibo 2.0, Kandinsky 6, SANA-WM and RFD4-Proteína, and now requires Python 3.11 or newer.
DeepSpeed 0.19.8 Removes Elastic Training, Progressive Layer Dropping and Apex AMP, Turning Leftover Configs Into Errors
DeepSpeed 0.19.8 removes elastic training, Progressive Layer Dropping, Apex AMP and graph harvesting; configs that still set them now raise DeepSpeedConfigError.
Agentic AI Foundation Adds Agent Skills, Open Responses, OpenEnv and OpenSandbox, Taking It From Three Projects at Launch to 10 With 305 Members
The Linux Foundation's Agentic AI Foundation says Anthropic, OpenAI, Hugging Face and Alibaba each contributed a project, bringing it to 10 hosted projects and 305 member organizations.
Mistral Launches Voxtral 3 With Four Speech Models and a LiveKit-Based Voice Agent SDK, Pricing Voice Agents From $0.04 per Minute
Mistral AI's Voxtral 3 post lists three transcription models, a text-to-speech model at $13 per 1M characters and a voice agent SDK built on LiveKit; benchmark claims are Mistral's own.
Cheaper Flagships, Premium Speed Tiers and Spend Caps: What Three Pricing Moves Mean for Developers' AI Budgets
OpenAI and Anthropic list one model at several per-token rates by speed, OpenAI prices GPT-6.1 Sol at a fifth of Astra, and Red Hat reportedly caps developer token spend.
vLLM 0.32.0 Drops Python 3.10, Stops Allowing Every CORS Origin by Default and Removes Cascade Attention
vLLM 0.32.0 requires Python 3.11 or later, restricts default CORS origins, removes cascade attention and fixes three security advisories, per its release notes.
MLX 0.32.4 Adds Attention and Gated Delta Net Gradients, Metal 1-Bit Affine Quantization and Python 3.15 Wheels
Apple's MLX array framework shipped v0.32.4 on October 14 with training-oriented VJPs, 1-bit affine quantization on CPU and Metal, Python 3.15 support and stft/istft.
Anthropic Launches User Profiles in the Claude API So Safety Enforcement Can Target One End Customer Instead of a Whole Organization
Anthropic's user profiles let API platforms tag each request with an end customer's ID, so a safety restriction or ban can apply to one customer; related webhook events are not yet live.
OpenAI Adds Prompt-to-Voice Custom Voices and Native Decisions Integration to GPT-Live in the API
OpenAI's changelog lists prompt-to-voice for all API customers on October 16 and native Decisions integration in GPT-Live on October 15, plus nine new voices.
JAX 0.12.0 Adds an IFRT Proxy Backend and Custom VJP Rematerialization, and Requires Haswell-Class x86-64 CPUs and NumPy 2.2
JAX 0.12.0, tagged October 19, adds erfcinv, a polynomial primitive, defremat and a proxy backend, and removes jax.custom_remat and support for AVX-only CPUs.