ComingUp ComingUp
Teaching a 1.5B model to generate bash commands at gpt-4o level using 400k synth

Teaching a 1.5B model to generate bash commands at gpt-4o level using 400k synth

Posted on behalf of the maker

Is this your project? Ask us to take it down

Gallery

Teaching a 1.5B model to generate bash commands at gpt-4o level using 400k synth

About

Purely a hobby side project to see how far I can push a really small model, using (mostly) automated training pipelines

Original mention: https://news.ycombinator.com/item?id=49869735

There were a bunch of requests to release it. Full synthetic data: https://huggingface.co/datasets/dirac-run/ec-training-data

Models: https://huggingface.co/dirac-run/ec-1.5b-gguf and https://huggingface.co/dirac-run/ec-0.6b-gguf

Cli https://github.com/dirac-run/ec

feel free to train/use the data as you wish.

Comments (0)

No comments yet. Be the first to comment!