Back to explore

Qwen permutation averaging vs Jev improvement

The author reports that averaging 8 permutations of Qwen outputs reduces KL error by ~79%, and all 720 permutations by ~97%, while Jev shows only slight improvement.

If Qwen favors the first option, let every answer take a turn there—then average the probabilities. Averaging 8 permutations reduced its KL error by ~79%; all 720 reduced it by ~97%, relative to average single-order error. Jev improved only slightly.

Qwen permutation averaging vs Jev improvement 1
· 0 likesOpen on X