Back to explore

Study on Jev's Probability Allocation in Multi-Answer Tasks

The post shares a study on model behavior in multi-answer tasks: models can rank correct options before distractors yet still assign low probabilities to some correct items. The paper evaluates Jev and other models on MetaTool, HotpotQA, and ECtHR.

多答案任务里,模型能把正确选项全排在干扰项前,却仍可能给其中一些正确项过低概率。 https://arxiv.org/abs/2610.29217 论文在 MetaTool、HotpotQA 和 ECtHR 上,读取 Jev、Liquid d1、GPT-6 Luna Decisions

Study on Jev's Probability Allocation in Multi-Answer Tasks 1Study on Jev's Probability Allocation in Multi-Answer Tasks 2
· 0 likesOpen on X