All Articles · SURL AI News

SemIf demonstrates in-browser option-score readout, but decision probabilities still need separate calibration

This local inference experiment compares reading option logits directly with generating JSON token by token, letting developers measure the cost of output formats. Results remain sensitive to quantization, browser behavior, and test order, and option probabilities cannot be treated directly as measures of reliability.

2026-09-20

AI 安全

Trail of Bits Builds MASM Audit Tools with Agents, Publishes 95 Lean Correctness Proofs

The team used agents to help build decompilation, static analysis, and formal verification tools, then applied them to an audit of the Miden virtual machine. The public code provides a starting point for reproducing the verification, but the proofs remain bounded by the semantic model and theorem assumptions.

2026-09-20

GitHub Repo

TypeSafe Python SDK 0.7.0 Adds Typed Responses for Jev, Switches Serialization to Pydantic

The update maps decision answers to Pydantic models for classification and routing workflows. The serialization change requires migration testing, while Chinese-language accuracy and probability thresholds still need separate evaluation.

2026-09-20

Grok Voice Transcribe 2.0 reduces transcription errors; watch the default model switch

The new version retains existing transcription pricing, while both official multilingual short-utterance tests and independent batch benchmarks show lower word error rates. Batch speed, Chinese formatting support, and the default model switch still require separate verification.

2026-09-19

推論系統

AMD details MLPerf inference optimizations, boosting eight-GPU GPT-OSS serving throughput by about 38%

AMD improved GPT-OSS-120B benchmark throughput on MI355X GPUs by splitting attention kernels and adjusting scheduling. Public weights and reproduction instructions provide a starting point, but aspects of the environment configuration and model card still need clarification.

2026-09-19

GitHub Repo

AutoGPT 0.8.0 adopts per-installation keys; deployments using defaults must migrate credentials

The release removes shared default keys and refuses to start with the old, publicly known encryption key. Existing credentials require re-encryption, while JWT verification compatibility changes and documentation gaps also affect upgrades.

2026-09-19

GitHub Repo

vLLM Publishes Multi-GPU NVDEC Tests, Showing More Than Twice the Video Captioning Throughput of CPU Decoding

vLLM has published multi-GPU scaling tests of hardware video decoding, easing CPU bottlenecks in short-caption generation. Gains remain workload-dependent, and deployments must reserve GPU memory for decoding processes.

2026-09-19

AI 基礎設施

AIPerf Reworks LLM Benchmarking with Multiple Processes, but Streaming Metrics Still Require Token-Counting Checks

NVIDIA details AIPerf, the successor to GenAI-Perf, which brings load generation, results processing, and traffic replay into a multiprocess architecture. It offers more comprehensive measurements of inference services, but migration compatibility and streaming token counts still affect how results should be interpreted.

2026-09-19

AI 基礎設施

Exa Snapshot fixes historical web content for agent evaluations, while search ranking still uses current signals

Exa has introduced historical web content retrieval, letting agents access evidence within a specified time cutoff to reduce evaluation contamination from answers published later. The feature remains in research preview, with limits on historical access and supported search modes under the public plan.

2026-09-19

GitHub Repo

OpenHands 1.20 lets agent profiles select secrets, with server-enforced scope limits

The release adds secret allowlists to agent profiles, reducing the chance that automated tasks receive unrelated credentials. Existing configurations remain unrestricted by default, so deployers must check backend support and other credential delivery paths.

2026-09-19

AI 研究

SoL-Pi cuts agent costs with four mechanisms, retaining about 94% of baseline EdgeBench scores

NVIDIA and collaborators used automated experiments to optimize an agent harness, reducing token traffic by roughly 45% to 49% across two models. The public extension preserves raw evidence for retrieval, but the full configuration still involves trade-offs in scores and task completion rates.

2026-09-19

GitHub Repo

Ollama 0.34.3 release candidate exposes model thinking options, reducing hardcoded agent settings

The update lets the model information API return supported thinking levels and defaults, reducing the need for clients to maintain their own configuration tables. The release is still in prerelease, and other metadata gaps and documentation discrepancies require further checking.

2026-09-19