Archive
AI 晶片、GPU、資料中心、邊緣裝置與硬體安全。
AI 基礎設施
DSX MaxLPS uses real-time telemetry to reallocate unused power. NVIDIA found that the provisioned power for a GB200 NVL72 rack could be reduced from 125 kW to 90 kW while maintaining throughput. The solution also combines workload-specific power profiles with 45°C liquid cooling, but its core Dynamic Power Software remains in Developer Preview.
推論系統
Daedalus-150M is designed specifically for single-user, 4-bit CPU inference, allowing most network layers to avoid repeatedly reading an ever-growing KV cache. Preliminary results indicate that its speed advantage increases with context length, but the model is limited to 2K context, and its performance figures still await independent reproduction across different hardware.
代理工具
NVIDIA has updated its open-source agent execution stack, focusing on state drift across vLLM, llama.cpp, Ollama, and the model router. The new release also tightens sandbox lifecycle management, image provenance, and failure recovery, though it remains a patch release in a rapidly evolving project.
代理工具
Nsight AI can now connect live CUDA documentation to MCP clients such as Codex and Claude, or deploy a complete coding-assistance backend locally. The open-source Blueprint combines generation, completion, embedding, and reranking models, but the reference configuration requires a Hopper-class GPU and at least 200GB of storage.
代理工具
NVIDIA adapted the AVO agent architecture, originally used for evolutionary search over GPU kernels, to interactive reasoning and achieved a 100.00 RHAE score with Claude Opus 5. The results show that agent memory and verification loops can substantially change the performance of the same model, but they cover only public environments, and the comparison with VISTA is not a controlled ablation.
硬體
Waymo has disclosed its Robotaxi heterogeneous computing architecture for the first time. Its custom ASICs process camera, lidar, and radar data in real time before passing it to the core inference engine. Because the stated 1,000 TOPS figure does not specify numerical precision or power consumption, it cannot be directly compared with NVIDIA’s or Tesla’s full-vehicle platforms.
硬體
VSPG stores each action as a unit hypervector, reformulating the softmax policy gradient as advantage-weighted vector superposition and normalization, without requiring automatic differentiation for the actor or optimizer state. It achieves higher returns and greater resilience to bit errors in two building-control climates, but performance depends heavily on the fixed encoder.
AI 基礎設施
Rather than moving to a new process node, the CS-4 increases the WSE-3’s clock speed, power delivery, and I/O, then combines three wafer-scale processors in a Nexus rack. Cerebras claims inference speeds of up to 30 times those of GPU-based systems, but its PFLOPS and throughput-per-watt figures still lack comparable independent end-to-end testing.
推論系統
A preregistered study attempted to train expert locality directly into an MoE router, but found a clear trade-off between cache performance and model quality. Combining training-based and training-free rerouting reduced misses further, yet still did not demonstrate a proportional end-to-end speedup.
硬體
The 28 nm ETHEREAL chip separates irregular event-graph access from regular spline convolution and supports per-layer 4/8-bit precision. DAGr-GNN measurements reached 25.6 microseconds and 1.6 microjoules per event, although the final three detection-head layers were still evaluated off-chip.
最新模型
Rather than modifying or distilling models, OYS uses Bayesian optimization to find a low-step denoising schedule for each model and task. The study reports improvements across six text-to-image models and an inpainting task, but the search cost must be amortized over a large volume of generated samples.
推論系統
Qwen3.8-27B 讓 27B 級模型進入單張 24GB 消費級 GPU 的可用範圍。公開資料顯示，一般 GGUF 部署約落在 30 至 60 tok/s；在 RTX 4090 上啟用 KV cache 量化、MTP 與新版 llama.cpp 後，社群實測可提升至 70 至 85 tok/s，但這仍不是開箱即得的基準。