最新模型
Together Fine-Tuning Service Lets LoRA Train MoE Experts Directly and Exposes the Tokens Actually Sent to the Trainer
Together AI has added Expert LoRA, per-example weighting, pre-training data validation, and real-time metrics, allowing developers to tune MoE expert layers instead of only attention modules. In the company’s experiments, knowledge recall rose from 15% to as high as 89%, but the comparison was limited in scope, and expert and attention adapters currently cannot be used together.