All News

1536 technical news articles

推論系統

TensorRT Model Connect Enters Public Preview: Package Hugging Face Models for Native C++ Inference Without ONNX

NVIDIA has open-sourced TensorRT Model Connect, which uses two commands to turn supported Hugging Face or local checkpoints into versioned bundles that can be handed off to C++ applications. It shortens the model-porting path, but remains a reference implementation; support and performance must be validated for each model, precision, and hardware configuration.

硬體

PTXBench Tests LLMs Writing H100/B200-Specific PTX Directly; No Model Reliably Matches State-of-the-Art Kernel Libraries

PTXBench checks whether generated kernels are correct, whether specified instructions actually execute, and how their performance compares with cuBLAS, cuDNN, and FlashInfer. The results show that generating instructions for new architectures does not necessarily translate into effective acceleration, with B200 attention kernels proving especially difficult.

代理工具

StagedWorkspace Uses Content Hashes to Synchronize Agents’ Parsed Views and Native Files, Boosting OfficeQA Pass@1 by 8.3 to 12.1 Points

The new system binds a document agent’s search results, native files, diff views, and final submissions to explicit versions, preventing the agent from reading stale parsed content while editing a newer file. Ablations within a fixed framework show that providing both parsed and native views outperforms either view alone, though the full codebase and cross-framework reproductions are still needed.

硬體

rl-triton Unifies Seven Reinforcement Learning Return Computations as GPU Scans, Delivering Up to a 5.70× Speedup for Full Calls

The open-source rl-triton library rewrites credit-assignment recurrences such as GAE, V-Trace, and Retrace as Triton associative scans, reducing sequential dependency depth from O(T) to O(log T). In tests with 4,096 environments and 128 steps, it was 1.6× to 5.70× faster than an already vectorized torch.compile baseline, although end-to-end PPO speedup for large policies was only about 1.02×.