Back to explore

Built a Jev-style model with $20

Eldan shares experience building Winnow-12B for $20: trained mostly on synthetic decision data, with the real work in filtering, auditing, counterexamples, and curation. It ranked #1 on When2Call and #6/50 on Decision Index 0.2, beating much larger models.

Built my own Jev-style model with $20. Winnow-12B was trained mostly on synthetic decision data. The real work was filtering, auditing, counterexamples, and curation. Result: #1 on When2Call, #6/50 on Decision Index 0.2, against much larger models. https://huggingface.co/EldanRing/Winnow-12B…

Built a Jev-style model with $20 1
· 0 likesOpen on X