Back to explore

Local Jev-style engine: running something similar on RTX 4060 with Gemma 12B

Author shares using an existing open-source Gemma 12B model on an RTX 4060 8GB to build a Jev-style decision engine, comparing with a normal LLM, and noting paid Jev API can be avoided.

⚔️ Local Jev IQ = the smartest model your laptop can run. Same GGUF. Two swords: a normal LLM and a Jev-style decision engine on a RTX 4060 8 GB VRAM. Everyone’s lining up for the paid Jev API. I used open-source options on a Gemma 12B I already had. ✅ Same server. Two URLs.

Local Jev-style engine: running something similar on RTX 4060 with Gemma 12B 1Local Jev-style engine: running something similar on RTX 4060 with Gemma 12B 2Local Jev-style engine: running something similar on RTX 4060 with Gemma 12B 3
· 1 likesOpen on X