Back to explore

Developer praises Jev classifier for multi-model inference routing

Developer Chris Dukes says TypeSafe's Jev classifier works well and is suited for routing to multiple models served at once at inference time, though limited by 8GB VRAM.

Major shoutout to @typesafeai ; #Jev the #classifier works a treat, and is going to be great to route to multiple models served at once when it comes inference time... ...or at least, that would be my PROPER use-case if I wasn't kneecapped at 8GB VRAM 🥲🥲 many thanks for the

Developer praises Jev classifier for multi-model inference routing 1Developer praises Jev classifier for multi-model inference routing 2
· 0 likesOpen on X