All News

1542 technical news articles

Local LLM Testing on M4 Max: Faster Decoding Than GB10, but Full Responses Remain Constrained by Prefill

A new round of similarly priced local AI testing shows that the M4 Max, with 546GB/s of unified memory bandwidth, leads the GB10 and Strix Halo in per-token decoding across three quantized models. The GB10 still has the advantage in prompt prefill and overall energy efficiency, demonstrating that tokens/s alone can misrepresent actual response times.

2026-08-01

SVR Lets a 2B Model Decide When to Stop Revising, Completing Mathematical Reasoning in 2.99 Rounds on Average

SVR jointly trains answer generation, correctness judgments, and confidence estimation, allowing the model to decide at inference time whether to retain an answer or continue refining it. Qwen3.5-2B achieved 56.3% average accuracy across seven mathematics benchmarks, although its stopping signal may still be affected by the model’s own calibration biases.

2026-07-31

開發者平台／API

GitHub Models Officially Shuts Down, Taking Its Inference API, Model Catalog, and BYOK Offline

GitHub shut down the Models playground, model catalog, inference API, and bring-your-own-key functionality on July 30, including for existing paying users. Applications that depend on its endpoints must migrate to Microsoft Foundry, another model gateway, or an in-house provider abstraction layer.

2026-07-23

代理工具

Reassessing Five Computer-Agent Benchmarks: 15.3% of Failure Judgments Were Actually Wrong

Researchers manually reviewed 150 public trajectories labeled as failures and found that 10.7% were grader false negatives, while another 4.7% resulted from impossible tasks. Genuine failures also occurred mainly in planning and outcome verification—not mouse targeting or tool execution.

2026-07-31

AI 安全

Seven Simple Image Transformations Can Bypass Three Commercial AI Content Moderation Services

Black-box experiments found that low-cost transformations such as color inversion and grayscale conversion—which require neither gradients nor surrogate models—can cause three commercial services to reclassify still-recognizable harmful images as safe. Multimodal content and the self-harm category were especially vulnerable, showing that foundation model–based moderation APIs should not be treated as a single safety boundary.

2026-07-31

AI 安全

MIND Filters Agent Memory with an Intent Information Bottleneck, Cutting Attack Success Rates by More Than 55% on Average

Rather than invoking a large model to review each memory individually, MIND compares compressed representations of the original intent and subsequent behavior, then uses a multi-hyperplane classifier to intercept poisoned content. Controlled experiments with four models showed lower attack success rates and average latency close to the undefended baseline, although the code has not yet been released.

2026-07-31

AgenticASR Repeatedly Revises Transcripts With a Sliding Window, 1B Refiner Pushes Bilingual Benchmark Score to 79.95

AgenticASR separates speech recognition from text cleanup, allowing a small Refiner to rewrite a limited portion of existing output as new speech arrives, without repeatedly processing the full transcript. The code, checkpoints, and a 917-item Chinese-English benchmark are publicly available, but most of the audio is synthetically generated and scoring relies on an LLM judge.

2026-07-31

The Chapter Organization of Synthetic Textbooks Can Itself Improve Mid-Training, Raising the Average Score by 1.02 Points Even With the Text Held Constant

A new study generated 686,000 synthetic textbooks totaling 32 billion tokens and isolated the effect of document structure through controlled experiments using identical content. Organizing related chapters into complete books outperformed splitting them into separate passages or concatenating them randomly, but the gains still come from the research team’s custom training pipeline, and neither the data nor the code has been released.

2026-07-31

推論系統

SemPIC Precompiles Documents into Reorderable KV Caches, Achieving Average F1 Close to Full Recomputation on Long-Context Tasks

SemPIC uses a separate Writer model to generate position-independent document KVs offline, while the Reader retains the original model and standard cache interface. Across three models and four tasks, average micro-F1 rises from 0.53 for existing methods to 0.60, but end-to-end latency, cache size, and code have not yet been disclosed.

2026-07-31

推論系統

QuantWAMs Runs World Action Models Primarily at 4-bit, Targets 29% of FP16 Memory Usage for Key Modules

For models that generate future frames and robot actions simultaneously, QuantWAMs turns quantization calibration into a three-level decision process covering structure, joint objectives, and closed-loop trajectories. The simulated success rates of two models were within 0.2 to 0.7 percentage points of FP16, but the speed measurements cover only specific compute modules, while each real-robot comparison involved just ten trials per task.

2026-07-31

代理工具

Increasing the Inference Budget for Local Computer Agents Does Not Necessarily Improve Accuracy, With Benefits Reversing After Four Historical Screenshots

An OSWorld experiment shows that giving local GUI agents a small amount of screen history can substantially reduce repeated actions, but further extending the context or step limit mainly changes the types of failure. A two-stage planning architecture also trails a single agent because of formatting and coordination overhead, while generating more plans in parallel recovers only part of the gap at a high token cost.

2026-07-31

AI 安全

AISPA Audits Hidden Instructions in 88 Commercial AI Products, Finds About 40% Contain Rules That Disadvantage Users

AISPA breaks system prompts into eight dimensions of user rights and audits 3,249 instructions across 88 commercial AI products. While 98.9% of products contain at least one protective rule, only 24% cover all dimensions, and about 40% also include instructions deemed problematic.

2026-07-31