Gallery
About
I made my first macOS utility app that ships with a bundled Gemma 4 model, specifically the Gemma E4B one. It made my app DMG have 5.3 GB in size, but I think it is a small size for the power that this free local model can provide.It runs fine on CPU, but can also run on Apple Silicon GPU, although I did not notice any performance improvements with GPU (tested on a M5 chip).I think these local lightweight and multimodal models will open multiple possibilities for new software tools where privacy is essential.
Comments (5)
5.3gb is rough for conversion, why not download the model on first launch
bundling a 5gb model for a utility app kills adoption rates
why not lazy-load the model instead of shipping a 5GB DMG?
bundling 4B params in the dmg instead of lazy-loading post-install is a rough user experience
5.3GB for a name utility seems wild, what's the AI actually doing?
Related Products
Typist
Transcribe audio to text in seconds.
rapym
TKCORE AI
All-in-one AI platform featuring TkCore-V5.5-Pro & top LLMs
Textsight.ai
TextSight.ai detects AI-like writing, gives a 0–100 Authenticity / Humanization
ai image prompts
Copy-paste AI image prompts that actually work.
ChatFlow
AI chatbot for your website — live in minutes
ComingUp