Back to explore

Jev Enables Computer Use Without Screenshots

Jev uses a local CoreML model to segment buttons and UI elements on screen, with on-device OCR reading labels, enabling computer use without screenshots or LLMs.

Okay so Jev can actually do computer use really well Without any screenshots, or LLMs and no Pixels leave my mac I dont even read the Dom elements A local CoreML model segments every button and UI element on screen. On-device OCR reads the labels. That text is all Jev gets.

· 1.9K likesOpen on X