Anyone using AI Locally - as in on their own computer?

Joined
Dec 11, 2011
Messages
1,206
Location
USA
I have downloaded and am using an AI model on my own PC. It's private and I don't have to deal with Chatgpt having access to my stufff.

Anyone else?
 
What are you trying to accomplish? If you have a decent dedicated GPU (Nvidia RTX series with 16GB+ memory) you can actually use it for basic tasks like analyzing data, small code snippets, or writing short stories. Yes you can do it with less resources but it becomes less and less useful.

But if you're expecting capability similar to what even a free plan with ChatGPT or Grok etc can offer... it's not going to happen on your computer. Even if you fill your garage with AI servers... the open source models just aren't the same. Sure, there are some really good ones, but you simply don't have the engineering minds and financial resources to make something comparable to the latest version of ChatGPT or Grok etc.
 
I have been very impressed with it so far. So based on the responses no one is doing this.

Here's the youtube video that inspired me to try this:



The whole video makes a nice business case for the upcoming failure of the AI data centers - we shall see.
 
I use ChatGPT daily and so does my wife. My biggest use case is coaching on my weight loss journey. It is very helpful as I navigate trying to lose weight. It has provided great insight to several things. At work we use Copilot. It's good as well.

You need to understand it's AI and still needs to be vetted with a human brain.
 
I'm using it to write reports on sensitive customer information that shouldn't be shared with chatgpt, or any online resource for that matter. I input the raw data, and it generates a rough draft. I clean it up, and "resubmit" that version. And then it's done in almost no time at all. Very helpful.

So in my particular case, it is my "technical writer" that is gathering my raw data, and compiling it into a reasonable explanation of what we saw. But without another person involved and way faster.
 
I tried. Most of the on premise model I used are kind of retarded. The closest thing we have would be called digital twins which is based off of ontology and not large language model.
 
I'm using it to write reports on sensitive customer information that shouldn't be shared with chatgpt, or any online resource for that matter. I input the raw data, and it generates a rough draft. I clean it up, and "resubmit" that version. And then it's done in almost no time at all. Very helpful.

So in my particular case, it is my "technical writer" that is gathering my raw data, and compiling it into a reasonable explanation of what we saw. But without another person involved and way faster.
We use the commercial version of Co Pilot and our IT blocked the consumer version of every single AI out there to avoid accidental leak. If we want Gemini / ChatGPT / Anthropic etc we can request for approval and they typically approve those. This is how those AI companies make money.
 
Nothing is perfect. I would bet the farm that I have used it hundreds more times than you in science, math, genealogy, you name it. But hey if you are fine doing without it that's obviously ok.
There's no doubt for some things it's fine. It's no different than a calculator. However would you bet tens of millions of dollars on the output from Chat GPT? I doubt it

Remember there are numerous levels of AI. I would not rely on the "free" AI tools for much.
 
Back
Top Bottom