推論系統
TensorRT Model Connect Compiles Model Checkpoints into Native C++ Bundles, but the Interface Is Not Yet Finalized
NVIDIA has released TensorRT Model Connect, which uses Python build tools to package supported Hugging Face checkpoints into TensorRT bundles loadable from C++. The project claims support for 84 model families and 221 end-to-end manifests, but it remains in nightly development, and inclusion in the support matrix does not mean every hardware configuration has been validated.