zwaetschgeraeuber@lemmy.worldtoTechnology@lemmy.world•Mozilla lays off 60 people, wants to build AI into FirefoxEnglish
0·
7 months agoYou can run a 7b model on cpu really fast even on a phone.
You can run a 7b model on cpu really fast even on a phone.
Correct. Phone keyboard fed my writing lol
Nice distract from ukraine
Gandalf failed the sleight of hand check
I like lineage os, but i tought its about do disappear?
Even if it will plateau, same was said with moorrs law, which held up way longer than expected. There are so many ways to improve this. Open source community is getting to the point where you can actually run decent models on normal private hardware (talking about 70-120b model)