返回探索

Visual Edition Jev 发布:本地多模态 4bit 量化部署

Visual Edition Jev 发布,按社区思路将候选结果映射到固定标签,prefill 后直接采样并限制输出 token,采用多模态 qwen-3.5-0.8B 4bit 量化在 16G M4 MacBook Pro 本地流畅运行。

Visual Edition Jev is Here https://github.com/hr98w/jev-visual… Following the community's ideas, mapping candidate results to fixed labels, direct sampling after prefill, limiting output tokens, using multimodal qwen-3.5-0.8B 4bit quantized deployment locally, running smoothly on 16g m4 mbp

· 303 次赞在 X 打开