AI & Machine Learning
342 articles RSS
What Inference Speedup Claims Disclose: MLPerf Rounds, Project Benchmarks and MLCommons' Planned Shift to Served-Endpoint Testing
Independent coverage of MLPerf Inference v6.0 and v6.1 notes limits on comparing results, MLCommons says Endpoints will replace its datacenter benchmark, and project figures from vLLM and Valkey are self-reported.
NVIDIA Makes Nemotron 3.5 Transcribe Available as an Open-Weight Model for 40 Languages Under OpenMDW-1.1, With Granary v2 Training Data
NVIDIA says its open-weight Nemotron 3.5 Transcribe handles transcription, speaker labels, translation and audio Q&A in one checkpoint, with benchmark results that are NVIDIA's own and a model built for recorded audio.
Kiro CLI 2.36.0 Adds Approve for Me, Which Judges Actions No Rule Settles in V3 Sessions, and Subcommand Approval Rules
Kiro's 2.36.0 changelog adds Approve for me to interactive V3 sessions; its docs say it judges only actions no rule settles and does not replace security controls.
Watermarks, Routing, Harnesses and Sampling Settings: Which Controls Recent AI Platform Moves Leave With Developers and Which With Providers
Reports on watermarks, model routing, a managed agent harness and removed sampling parameters show some settings fixed by the provider and others left to developers.
GitHub Makes Agentic Workflows and Copilot Fusion Generally Available and Rolls Out Shared Copilot Automations in October 28 Changelog Entries
GitHub's October 28 changelog entries describe general availability for Agentic Workflows and Copilot Fusion, shared Copilot Automations, and a public preview of Copilot Projects.
TRL 1.17.0 Adds Mistral Large 4 Training on a Single 8xB300 Node and Makes Score Centering the Default AsyncGRPO Objective
Hugging Face's TRL v1.17.0 adds a single-node LoRA example for Mistral Large 4, changes the AsyncGRPO default objective to score centering and makes GRPOConfig raise on top_p or min_p without top_k when vLLM importance sampling is on.
Agent-Assisted Rust Rewrites Report Large Gains, While Most Figures Are Self-Reported, Baselines Are Questioned and Verification Is a Stated Concern
Reporting on Bun, Copilot's runtime, OpenAI's Habitat, TypeScript ports and a Rails benchmark finds large claimed speedups, mostly self-reported, with disputed baselines and verification limits.
NVIDIA Dynamo 1.6.0 Adds Pluggable Router Flow Control and LPX Kubernetes Components, and Deprecates the Router's Scoring Flags
Dynamo v1.6.0, published October 22, adds request-classifier plugins to its router, LPU-backed LPX components for Kubernetes, and snapshot-backed engine failover, and moves to SGLang v0.5.21 and vLLM v0.31.0.
IBM Releases Granite Speech 5.0 2B Under Apache 2.0 and Updates Two Existing Granite Speech Models
IBM published granite-speech-5.0-2b and revised versions of granite-speech-5.0-470m-turboctc and granite-speech-4.1-2b-plus, all Apache 2.0, with IBM-reported leaderboard and error-rate figures.
GitHub Copilot Assisted Permissions Reach General Availability in the CLI, App and VS Code, With Separate Enterprise Switches for Allow-All
GitHub's October 26 changelog says assisted permissions, which use a language model to judge permission requests, are generally available; its docs say the feature is not a substitute for sandboxing.
llm-d 1.0.0 Graduates Its Router Configuration API to v1, Aligns Component Versions and Deprecates Its ROCm Image
llm-d v1.0.0, published October 20, aligns component versions across its organization, moves the router configuration API to v1, adds DisaggregatedSet and deprecates its own ROCm image build.
OpenAI Adds a 12-Hour Prompt Caching Option to the Responses API, With Cache Writes Priced at 2.5 Times the Input Rate
OpenAI's API changelog says developers can now choose 12-hour prompt caching; its guide lists a 2.5x cache-write rate against 1.25x for the 30-minute default.