Archive
AI 晶片、GPU、資料中心、邊緣裝置與硬體安全。
推論系統
The roughly 280-million-parameter draft model adds speculative decoding to LFM2.5-VL-3B and is available with public weights and framework integrations. Official tests cover specific hardware and settings; vision encoding, prefill, and concurrent workloads can still limit overall gains.
最新模型
The new version combines layout parsing with a vision-language model to support cross-page tables and form-field extraction. The official evaluation changed some of its test coverage, and API model-version mappings should be checked before deployment.
GitHub Repo
The new release uses a background thread to preload the next batch of images, reducing the time the GPU spends waiting for data. Published benchmarks cover specific YOLO26n configurations, while the release summary and merge history still differ on the feature’s scope.
推論系統
The implementation combines 92 layers in a single Pallas call, improving memory bandwidth utilization through cross-layer weight prefetching. The official comparison is limited to a specific topology and small batches, and speculative decoding performance also depends on the draft acceptance rate.
GitHub Repo
The release bundles Node.js and uv for both Intel and Apple Silicon, selecting the appropriate versions at startup. The desktop app remains an early preview, and full agent workflows and backend configurations require validation in actual deployment environments.
AI 基礎設施
BioNeMo combines grouped expert operations, expert parallelism, and MXFP8 to improve throughput for specific training workloads. The fastest configuration changes both precision and parallelism strategy, so its gains still need to be evaluated alongside convergence quality.
硬體
The SDK provides super resolution and frame generation interfaces for mobile games, along with native integration documentation. The initial frame generation implementation adds one rendered frame’s worth of input latency, so its benefits must be assessed alongside power consumption and image quality.
推論系統
Tests running DeepSeek-R1 on eight B200 GPUs show that confidential computing increases average per-token latency by less than 5%. The results depend on adjustments to memory transfers, kernel timing, and multi-GPU communication, and still require validation under actual serving workloads.
推論系統
A new article details inference testing on eight MI350X GPUs using data collected in July. The README at the specified commit differs from the article on workloads, while differences in engine configurations also limit performance comparisons.
GitHub Repo
The new approach separates portable model layers from hardware-specific optimizations, with the first components integrated into the Transformers backend. Initial H100 tests show throughput close to the existing path, but layer coverage and cross-platform performance still need verification.
推論系統
Physical AI Toolchain adds support for deploying inference on remote GPUs, with two robotic arm examples. Prior research shows that added latency and image bandwidth demands can offset computational gains, so deployments must assess the entire control pipeline.
AI 研究
A new benchmark evaluates coding agents on 53 SGLang tasks, finding that some patches that pass other checks still fail to serve models correctly. The results are limited to a specific test environment, and passing the benchmark does not mean the code is ready for production.