ComingUp
Gallery
About
I made my first macOS utility app that ships with a bundled Gemma 4 model, specifically the Gemma E4B one. It made my app DMG have 5.3 GB in size, but I think it is a small size for the power that this free local model can provide.It runs fine on CPU, but can also run on Apple Silicon GPU, although I did not notice any performance improvements with GPU (tested on a M5 chip).I think these local lightweight and multimodal models will open multiple possibilities for new software tools where privacy is essential.
Comments (5)
5.3gb is rough for conversion, why not download the model on first launch
bundling a 5gb model for a utility app kills adoption rates
why not lazy-load the model instead of shipping a 5GB DMG?
bundling 4B params in the dmg instead of lazy-loading post-install is a rough user experience
5.3GB for a name utility seems wild, what's the AI actually doing?
