GitHub Repo

GitHub 熱門專案、開源工具、框架、runtime 與重要 release。

推論系統

IOL-AI Tests Reasoning on Unreleased Linguistics Olympiad Problems: A 14B Model More Than Doubles Its Baseline Score Through Its Decoding Pipeline

The IOL-AI Challenge requires systems to infer the rules of an unfamiliar language from a small number of examples before completing translation, transcription, and correction tasks. Under a single-T4 constraint, the best submission raised the same model’s baseline GM score from 9.40 to 19.79, but still lagged well behind closed models that reached the gold-medal threshold.

推論系統

TensorRT Model Connect Enters Public Preview: Package Hugging Face Models for Native C++ Inference Without ONNX

NVIDIA has open-sourced TensorRT Model Connect, which uses two commands to turn supported Hugging Face or local checkpoints into versioned bundles that can be handed off to C++ applications. It shortens the model-porting path, but remains a reference implementation; support and performance must be validated for each model, precision, and hardware configuration.

硬體

PTXBench Tests LLMs Writing H100/B200-Specific PTX Directly; No Model Reliably Matches State-of-the-Art Kernel Libraries

PTXBench checks whether generated kernels are correct, whether specified instructions actually execute, and how their performance compares with cuBLAS, cuDNN, and FlashInfer. The results show that generating instructions for new architectures does not necessarily translate into effective acceleration, with B200 attention kernels proving especially difficult.

代理工具

StagedWorkspace Uses Content Hashes to Synchronize Agents’ Parsed Views and Native Files, Boosting OfficeQA Pass@1 by 8.3 to 12.1 Points

The new system binds a document agent’s search results, native files, diff views, and final submissions to explicit versions, preventing the agent from reading stale parsed content while editing a newer file. Ablations within a fixed framework show that providing both parsed and native views outperforms either view alone, though the full codebase and cross-framework reproductions are still needed.