硬體

AI 晶片、GPU、資料中心、邊緣裝置與硬體安全。

llama.cpp b10456 Fixes SYCL Quantization Transcoding Scheduling, Boosting Q4_0→FP32 Throughput on Arc 70 to 158.19 GB/s

The new release configures threads and work-groups according to quantization block size, preventing over- or undersubscription in the SYCL copy kernel. Microbenchmark throughput on Arc 70 rose from 20.21 to 158.19 GB/s, but this does not represent the speedup in token generation for a complete model.

2026-08-17

最新模型

Intern-S2-Mobius Shares FFN Memory Globally, With the 35B Model Reporting Nearly 4× End-to-End Inference Acceleration

Intern-S2-Mobius separates the knowledge storage and attention-based reasoning traditionally tied to each Transformer layer, allowing multiple Reasoners to repeatedly query the same global Memory. The open weights can be loaded with LMDeploy, vLLM, or Transformers, but the nearly 4× acceleration remains a result from the official evaluation under specific conditions.

2026-08-17

代理工具

Pydantic AI 2.31 Moves AG-UI Run Identification into the Event Stream, Enabling Streaming Before Delayed Input Arrives

The new release allows a `UIEventStream` to be created before `run_input` is available and lets `AGUIEventStream` hold its own thread and run IDs. It also fixes Temporal sandbox compatibility and tracing attribution for fallback models, reducing diagnostic blind spots in long-running agent workflows.

2026-08-17

最新模型

SpaceX Completes Acquisition of Cursor, Bringing Composer Training and the Grok Development Toolchain Into a Single Stack

Cursor has confirmed that it is joining SpaceXAI. The two companies will jointly improve Grok Build, Grok Bot, the Grok API, and Cursor. The deal vertically integrates GPU infrastructure, coding-model training, and access to millions of developers, but no timeline has been announced for migrating models, data, or APIs.

2026-08-16

推論系統

llama.cpp b10448 Adds Native Kimi K3 Support, Losslessly Reorders MXFP4 to Avoid a 5.5 TB BF16 Intermediate

The new release adds support for the Kimi K3 text model, hybrid KDA/MLA attention, latent MoE, and tool-call parsing. The converter directly reorders the MXFP4 bit layout, eliminating the need to first expand the entire 2.8T-parameter model to BF16.

2026-08-16

最新模型

Gemini 3.7 Flash Targets Coding Agents; LiteLLM Warns That the `minimal` Reasoning Level Returns HTTP 400

Google is rolling out Gemini 3.7 Flash across its API, Antigravity, Android Studio, and enterprise agent platforms, offering a limited-time 50% discount to capture high-volume agent workloads. Early integrations show that multimodal input, tool calling, and cross-API formats are already supported, but reasoning parameters and cost data still pose migration pitfalls.

2026-08-16

生成式 AI 工具

ComfyUI 0.33.1 Adds Native MiniMax Music 3 and CUDA Graph Support, Fixes Non-Dynamic VRAM Mode

ComfyUI 0.33.1 brings MiniMax Music 3 model loading and inference nodes into the core and adds CUDA Graph support for backend use. The release also fixes Music 3 failing to run with fixed VRAM configurations and issues detecting QKV layouts in some MiniMax weights.

2026-08-16

推論系統

vToken Virtualizes the KV Cache at Token Granularity, Up to Doubling Concurrency Under Memory Constraints

vToken adds a logical token table and asynchronous compaction on top of the existing PagedAttention design, allowing per-token eviction to actually release physical blocks. Its vLLM prototype improves SLA-constrained throughput by up to 1.37×, but the code has not yet been released, and the authors have not shown that its data-movement costs are suitable for all hardware and workloads.

2026-08-16

最新模型

GLM-5.3 Retains the 5.2 Base and Scales Up Post-Training; Surge in Cybersecurity Capabilities Delays Open-Weight Release by Two Weeks

Z.ai says GLM-5.3 was not pretrained from scratch, with improvements in coding and cybersecurity capabilities coming entirely from larger-scale post-training. The model reports an 84.5% success rate on CyberGym, but its weights will not be released until a dual-use risk assessment is complete.

2026-08-15

最新模型

LittleLearner Limits Pretraining Knowledge to a Fifth-Grade Level, With Few-Shot Prompting on Advanced Math Still Stuck at Around 6%

Researchers filtered 88 billion tokens of K–5 material from FineWeb‑Edu and trained 0.6B, 1.3B, and 5B models from scratch alongside compute-matched control models. Experiments show that scaling the models, applying SFT＋GRPO, and providing in-context examples primarily elicit existing capabilities rather than clearly pushing beyond the pretraining knowledge boundary.

2026-08-15

推論系統

RMM Prunes the Matrix Multiplication Contraction Axis Based on Input, Accelerating Llama 3.1 8B Long-Context Inference by Up to 1.40×

Reduced Matrix Multiplication leaves weights unchanged and, based on the column norms of the current activation, computes only the highest-scoring shared dimensions in a matrix multiplication. A100 tests show that gains increase with sequence length, but for short contexts, selection and kernel-launch overhead almost entirely offset the savings.

2026-08-15

AI 基礎設施

OpScale Breaks LLM Scaling Down to the Operator Level, Cutting Average GPU Use for Qwen2 Serving by 35%–50%

Instead of replicating an entire model, OpScale scales only the operators currently creating bottlenecks—such as attention and MLP—based on traffic and sequence length. The authors replayed 929,000 requests on A100 and GB200 clusters, using up to 36.3% fewer GPUs while meeting the same latency targets, but the prototype code has not yet been released.

2026-08-15