Back to explore

同一diffへのJevスコアは引数順とラベルで変動

ユーザーがJevに同一のdiffをAとBとして与えどちらが良いか尋ねたところ、引数順とラベルがスコアに影響し、Aは約0.95で安定し順序を入れ替えると結果が変わった。

(2/5) hit some wild results. argument order and labels both move the score i gave jev 2 identical diffs (labelled A and B) and asked which is better. the results were shocking: fork A at 0.95 (five runs: 0.95, 0.96, 0.95, 0.96, 0.96) put B first with the same names and A is

同一diffへのJevスコアは引数順とラベルで変動 1
· 2 likesOpen on X