最新模型
TriviaRoomQA Tests Everyday Knowledge Across Six Languages, Revealing Systematic Gaps in 30 Open Models on Pop Culture and News Questions
The new benchmark uses 3,300 parallel questions in six languages and 5,340 French questions to test whether models can access the same everyday and long-tail knowledge across languages. Larger models are more accurate overall, but still fail to eliminate gaps caused by pop culture, recent events, and language switching.