Archive
1523 technical news articles
代理工具
Auto-RecSys links research ideas, distributed training, failure recovery, and results analysis in a dual-loop system that persists across sessions. In 31 internal experiments, operational fixes fell from 4.0 to 0.5 per run, but Meta has not yet shown that the agent’s proposed model changes can consistently improve recommendation quality.
AI 安全
Wiz scanned 3,074 public LiteLLM instances and found that 294 accepted `sk-1234` or required no authentication at all, including 191 with no authentication configured. Newly disclosed real-world measurements show how an authentication bypass in older MCP implementations, Python-executing guardrails, and access to cloud metadata can be chained into a cross-layer attack path.
最新模型
NVIDIA has released the weights for two Nemotron 3 Ultra math specialists, their training data, and a resumable natural-language proof pipeline. The system’s official score was 30 out of 42. The results also expose a shared blind spot among model-based verifiers: internal evaluations overestimated performance on two problems, while high precision came at the cost of extensive false rejections and substantial compute.
GitHub Repo
The new open-source framework uses predictive routing to preload experts for the next step and Recover-LoRA to compensate for int4 quantization loss, so the entire 23GB checkpoint does not need to remain resident in memory. Official M4 Pro tests measured 14.9–17.7 tokens per second, but the framework currently supports only Apple Silicon, and its memory and quality results have yet to be independently reproduced.
最新模型
Microsoft has updated its managed LLM Speech offering, emphasizing recognition of mixed-language speech, proper names, and numbers, while claiming up to a threefold latency reduction versus version 2605 in some scenarios. The new model uses the existing Fast and real-time APIs but is deployed automatically on the server side, so teams operating existing voice agents must establish their own regression tests and version monitoring.
推論系統
Dynamo can now assign visual encoding, LLM prefill, and decoding to separate workers and different GPU tiers, preventing image requests from blocking text-only traffic. Although NVIDIA’s tests show improvements of up to 5× in time to first token and 7× in end-to-end latency, long outputs or large dense models may offset the benefits of disaggregation.
推論系統
New research separates a turn becoming ready from its submission to the inference engine, using CVaR tail risk and a dynamic workload budget to determine submission order. SWE-bench trace replays achieved up to a 3.5× P95 speedup, but the results cover only fixed agent trajectories, a single randomized arrival seed, and an A100/vLLM environment.
AI 安全
The new benchmark holds retrieved content constant and uses four conditions to measure how RAG changes five open models’ responses to harmful questions. Documents containing answers made every model more likely to produce accurate but dangerous content, while safety judges showed only moderate agreement.
具身 AI 與機器人
Show-Harness has a general-purpose VLM output symbols for directions, grasping, and releasing, which robot-specific interpreters then translate into constrained motions. Gemini in a zero-shot setting and a fine-tuned Qwen 2B achieved success rates of 89% and 86%, respectively, across ten real-world tasks, though testing remains focused on tabletop pick-and-place.
最新模型
Xiaomi has proposed an end-to-end target-speaker ASR system that feeds a one- to four-second reference utterance and mixed audio into the same audio encoder, without first performing speech separation. The model can also output an empty string when the target speaker is absent, but its training relies heavily on non-public data, and the initial report provides no verifiable model weights or code.
推論系統
PELM goes beyond adjusting processor frequency: it dynamically selects speculative decoding configurations and verification depth, jointly controlling hardware and model workload under thermal constraints. The paper reports speedups of up to 23.1% and energy savings of up to 52.4%, but these peak results cannot be directly extrapolated to smartphones or other models.
AI 安全
For the first time, Datasette used Claude and GPT-series agents to conduct a comprehensive security audit, followed by two developers cross-checking the work by writing tests and patches. The new releases tighten controls around private-data permissions, SQL and HTML escaping, authentication, and HTTP caching, but some reproduction tests remain temporarily undisclosed, preventing full independent verification of the vulnerabilities’ scope.