Back to explore

Jev calibration reaches parity on MMLU; 8-bit quant fits in ~30GB locally

Update: the next checkpoint has effectively reached Jev calibration parity on MMLU, and 8-bit quantization looks good with an expected local footprint of ~30GB.

Update: next checkpoint has effectively reached Jev calibration parity on MMLU! Also 8 bit quant is looking good and should fit in ~30gb memory locally!

Jev calibration reaches parity on MMLU; 8-bit quant fits in ~30GB locally 1
· 2 likesOpen on X