最新模型

新模型、開放權重、多模態、語音、影像與模型架構。

GitHub Repo

Open Secure AI Alliance Sets Out to Build an Open Agent Defense Stack, but Shared Tools and Governance Have Yet to Materialize

NVIDIA and more than 30 organizations have formed the Open Secure AI Alliance, with plans to share models, agent frameworks, identity, isolation, and vulnerability-scanning technologies. Its initial members have identified foundational components including NOOA, SPIFFE/SPIRE, Safetensors, Lightwell, and MDASH, but the alliance has yet to announce a shared repository, testing specifications, or a delivery timeline.

代理工具

GitHub Copilot Opens Agent Telemetry and Token Limits in JetBrains, While BYOK Endpoints Gain Centralized Model Controls

GitHub has updated its JetBrains plugin to let agent workflows export OpenTelemetry data and to support input and output token limits for bring-your-own-key configurations and custom endpoints. Claude agent flows can also connect directly to MCP servers and custom agents, but deployment teams still need to validate tool-call content, cost attribution, and data redaction.

硬體

ESP32-S3 Runs a 28.9-Million-Parameter Model from 16MB Flash Using Hierarchical Embeddings, Generating About 9.5 Tokens per Second

The open-source esp32-ai project moves most parameters into memory-mapped Flash while keeping only a small Transformer core in fast memory, enabling a roughly $8 microcontroller to generate text entirely offline. The result shows that hierarchical models can be embedded in firmware, but TinyStories-level output should not be equated with general language understanding or device-control capabilities.

推論系統

HPD-Parsing Splits Document Generation into Parallel Branches, With the 1B Model Reaching Peak Throughput of 4,752 Tokens per Second

PaddlePaddle has released the 1B-parameter HPD-Parsing model, which uses a global layout branch to coordinate multiple block decoders and bypass the sequential bottleneck of generating an entire page token by token. Official tests show throughput 2.62 times that of the fastest existing comparison model, but the system currently depends on a custom vLLM package, and its peak figure cannot be directly equated with end-to-end PDF processing speed.

硬體

Nemotron 3 Ultra Integrated with ACE-RTL Iterative Agent Achieves a 97.1% Average Pass Rate Across Nine Chip Design Task Categories

NVIDIA put Nemotron 3 Ultra into a fixed generation, simulation, and reflection loop, achieving a 97.1% average pass rate across nine categories of RTL tasks in CVDP. The results also show that the agent framework can substantially improve scores across models, although the comparison remains limited to three open models and a single evaluation pipeline.