ComingUp
Omi – watches your screen, hears conversations, tells you what to do

Omi – watches your screen, hears conversations, tells you what to do

Apr 16, 2026 AI & Machine Learning
conversation analysis screen monitoring virtual assistant

Gallery

Omi – watches your screen, hears conversations, tells you what to do

About

Spent 4 months and built Omi for Desktop, your life architect: It sees your screen, hears your conversations and will advise you on what to do nextBasically Cluely + Rewind + Granola + Wisprflow + ChatGPT + Claude in one appI talk to claude/chatgpt 24/7 but I find it frustrating that i have to capture/send screenshots of my screen and that it doesn't help proactively during my workWhenever omi sees something wrong about my workflow, it will send me a proactive notification with advice. It will also point to something I'm missing.The hardest part was to nail proactivity - after trying 20+ similar tools I didn't find a single one with smart proactive notifications based on content on your screen. I made it look at your screen every second with 4 main prompts:1. Is the user productive or distracted?2. Is there anything useful to say right now?3. is there any task to add to do later?4. is there anything important to remember about the user?Full stack: - Swift - Rust backend - Deepgram transcription - Claude code for messaging - GPT 5.4 summaries - Gemini for embeddings and translationOpen source, stores screenshots locally, uses Claude Code for chat. Has cloud to sync with hardware or mobile app but can be disabled in settings

Comments (0)

No comments yet. Be the first to comment!