最新模型

新模型、開放權重、多模態、語音、影像與模型架構。

推論系統

FreeToken Dynamically Allocates CPU, GPU, and PCIe Resources to Run a 35B MoE Model with 8GB of VRAM

Instead of using fixed offloading, FreeToken uses measured bandwidth to decide whether to transfer cache-missed experts to the GPU or execute them directly on the CPU. The paper also demonstrates a 753B model served by a single workstation GPU, but the full weights still require system memory; this should not be interpreted as “fitting all 753B parameters on one GPU.”

最新模型

Marin Launches Open Training of a 535B-A23B Model, Publicly Trackable Across 11 GB200 NVL72 Systems

Marin has begun training a mixture-of-experts (MoE) model with 535B total parameters and approximately 23B active parameters per token. The project plans to use 11 GB200 NVL72 systems to process roughly 18T to 18.75T tokens. Configurations, scaling experiments, and real-time telemetry are public, but model quality, the long-context strategy, and the final token budget have yet to be finalized.