AI models that can perform well without sending everything off to the cloud to do so are going to be high on my wish list. Partly for privacy, partly for responsiveness, partly for resilience when the internet goes down. I’ve heard some rumors that this is a focus for the AI that will drive the next upgrade to Siri, and I hope that turns out to be true.
This community !localllama@sh.itjust.works is dedicated to local LLMs but the one on reddit, with the same name, is much larger. The guides are a bit dated but should suffice for a start.
A privacy-enhanced personal assistant that doesn’t send anything to the cloud.
AI models that can perform well without sending everything off to the cloud to do so are going to be high on my wish list. Partly for privacy, partly for responsiveness, partly for resilience when the internet goes down. I’ve heard some rumors that this is a focus for the AI that will drive the next upgrade to Siri, and I hope that turns out to be true.
There’s a number to chose from, depending on your hardware and preferences.
On this here server, you could go to !fosai@lemmy.world for a start.
This community !localllama@sh.itjust.works is dedicated to local LLMs but the one on reddit, with the same name, is much larger. The guides are a bit dated but should suffice for a start.