GitHub Repo

GitHub 熱門專案、開源工具、框架、runtime 與重要 release。

最新模型

SGLang-Omni Integrates MOSS-Transcribe-Diarize, Bringing Multi-Speaker Transcription to Continuous Batching

SGLang-Omni has added a deployment path for MOSS-Transcribe-Diarize that returns segment-level timestamps, text, and speaker labels in a single response through an OpenAI-compatible endpoint. This makes the open 0.9B model easier to deploy in online services, although the three evaluation datasets used for the official performance results are not currently fully public.

AI 基礎設施

NVIDIA ModelExpress Transfers Weights GPU-to-GPU, Cutting Scale-Out Time for an 806 GiB Model to Under Two Minutes

NVIDIA has detailed ModelExpress’s complete transfer path, allowing new inference replicas to copy weights and compilation caches from existing GPUs, with P2P RDMA as the preferred method. In an eight-B200 test, the company cut DeepSeek-V4-Pro’s time to API readiness from eight minutes to 1 minute 44 seconds, though the result depends heavily on identical GPU models, high-speed networking, and compatible tensor configurations.

代理工具

OpenForgeRL Brings Real-World Agent Frameworks into Reinforcement Learning, Decoupling Training and Execution with an Agent Server

Researchers from Microsoft Research and other institutions have introduced OpenForgeRL, enabling Codex, OpenClaw, and GUI agents to undergo end-to-end reinforcement learning within their native execution frameworks. The system uses a model-call proxy server and Kubernetes to isolate rollouts, but its code, data, and weights have yet to be fully released.

最新模型

ReMo Reallocates Visual Information Across Audio and Text, Cutting Omni-LLM Input Tokens by 54%

A KAIST team has proposed ReMo, a training-free method that removes visual tokens at the input stage when their content can be explained by audio, while preserving object semantics through text proxies. In the authors’ own tests, it compressed inputs to the Qwen Omni series by more than half without reducing average scores, but neither the code nor independent reproduction results have been released.

最新模型

Faster IndexTTS-2 Ports Its Autoregressive Speech Pipeline to TensorRT, Delivering Up to 3.6× End-to-End Speedup

A new study restructures IndexTTS-2’s GPT, Diffusion Transformer, and vocoder using TensorRT and TensorRT-LLM, while adding streaming and batched inference. Experiments on the English and Chinese Seed-TTS benchmarks show up to a 5× speedup for GPT, but the currently available public materials remain insufficient to directly reproduce the complete optimization pipeline.

GitHub Repo

OpenWorker Open-Sources Desktop Agent: Stores Credentials Locally and Connects to More Than 25 Work Tools Through Approval Gates

Andrew Ng’s team has released OpenWorker under the MIT License, keeping the agent loop, credentials, and conversations on the user’s computer while supporting cloud models and local models via Ollama. It can generate files and operate Slack, calendars, and terminals, but “local-first” does not necessarily mean data never leaves the device.