维基百科链接竞速:高选项数决策演示
让模型在数百到数千个链接中选择下一步,用游戏方式展示决策速度与约束输出的效果。原帖附有 4 分 04 秒视频。

用户测试 TypeSafe AI 的 Jev 模型能否数出 strawberry 中 r 的数量,结果显示其表现与普通 LLM 类似,存在不确定性。
can @typesafeai Jev count the r's in strawberry? no. 47% says 3, 47% says 2. a coin flip, same as every LLM. On 70% on 168 test words, it undercounts doubled letters like everyone then I gave it the letters instead of the word: ["s","t","r","a","w","b","e","r","r","y"]