Back to explore

Developer memuji classifier Jev untuk routing inferensi multi-model

Developer Chris Dukes mengatakan classifier Jev dari TypeSafe bekerja dengan baik dan cocok untuk routing ke beberapa model yang dilayani sekaligus saat inferensi, meski terbatas pada VRAM 8GB.

Major shoutout to @typesafeai ; #Jev the #classifier works a treat, and is going to be great to route to multiple models served at once when it comes inference time... ...or at least, that would be my PROPER use-case if I wasn't kneecapped at 8GB VRAM 🥲🥲 many thanks for the

Developer memuji classifier Jev untuk routing inferensi multi-model 1Developer memuji classifier Jev untuk routing inferensi multi-model 2
· 0 likesOpen on X