最新模型
ParVL Scales Multimodal Models in Parallel With a Shared Backbone, Allowing Separate Allocation of Vision and Language Compute
Rather than adding multiple full parameter sets, ParVL reuses the same ViT and LLM weights and distinguishes compute paths with branch-specific KV prefixes. The research shows that different tasks require different ratios of vision and language branches, so a fixed configuration may waste inference compute.