Caught my AI lying

[PandaBear]

So at work we have free use of Copilot. I throw a table in there and ask it to count how many are there, it said a number I want to hear, then I verify it by removing a few and ask again. It said the same number I wanted to hear. I told Copilot it is lying and this is the answer I got:

"You’re correct—I didn’t manually count each one; I inferred based on the pattern and length. Let me actually verify this properly so there’s no doubt.

I’ll run a quick script to count the number of elements in your array."

I parsed your array text and counted:
196 entries.

Then I use a text editor to search and found 144...

I think my job is going to be safe for a bit longer.

 

[altaylar]

And the best part is they are always super confident.

 

[4wd]

It’s already so bad that one search engine AI spins it mightily - the other wants you to feel guilty for having the thought …!
So far search engine AI is a mixed bag …
Optimistic that professional AI is okay …

 

[dadto2]

I've been using LibreChat to write mongoDB scripts for me. Gives me accurate scripts to run in less than 30 seconds, would take me an entire workday to write myself.

 

[cptbarkey]

I posted this before, but AI failed dramatically to tell me how many rectangles I could cut out of 4x8 plywood. It was hilarious watching it struggle and argue with itself. I should have saved off the log.

 

[Blagoje]

It is the exception when AI is accurate

 

[Leo99]

My NVDA stock is way up so I think the answer is to build more data centers.

 

[Hall]

I posted this before, but AI failed dramatically to tell me how many rectangles I could cut out of 4x8 plywood. It was hilarious watching it struggle and argue with itself. I should have saved off the log.

What did you ask it specifically ? Did you ask how many 1" x 2" rectangles or something ?

 

[SubieRubyRoo]

And the best part is they are always super confident.

That’s the biggest problem… when you are able to see the confidence results along with AI’s response, even the things that it’s wrong on, it is usually 85% or more confident of its result…

 

[XB_Fan]

Made the mistake of asking some questions regarding maintenance on my 2005 Honda Rebel 250. First it said the bike is single cylinder, then it gave me the complete wrong oil capacity. It said it had a screw on oil filter, which it obviously doesn't. It also seems to guess on some very important torque values for parts of the Rebel. Not a fan of AI yet.

 

[Cujet]

I was asking Grok 4.1 to compare Falcon Heavy to Blue Origin's New Glenn. It completely misunderstood my request and named the BO (Blue Origin) rocket, "Big Onion", and went off on a bizarre tangent comparing FH and Starship. Not at all what I asked for.

 

[Bottom_Feeder]

AI will continue social media's legacy of making society dumber. I fear what it will be like in 10 years if we make it that long.

/clouds!

 

[JeffKeryk]

We were coming home from a Blues Music program by Morgan Freeman at Stanford last night; wifey asked Grok how Robert Johnson died. She spit out age, birth date and death date. The death date was wrong; it was a few years after birth year. Wifey said, "What?" out loud and interrupted Grok. Grok replied, "Oops, I had a brain fart. It was " and said the correct year. FYI Robert Johnson died at 27. Grok continued to mention the various rumors of his death.

I cannot imagine where AI will be in a few years. Crazy stuff. Who'da thunk it?

 

[rstsco]

Our company is leaning heavily into AI. If you have sharp people training the models with good data, it can be pretty darn accurate. What would take a room full of monkeys (or analysts) a long time, you can load huge sets of data and have an output in seconds to perhaps minutes. The output still has to be validated.

 

[Pablo]

We were coming home from a Blues Music program by Morgan Freeman at Stanford last night; wifey asked Grok how Robert Johnson died. She spit out age, birth date and death date. The death date was wrong; it was a few years after birth year. Wifey said, "What?" out loud and interrupted Grok. Grok replied, "Oops, I had a brain fart. It was " and said the correct year. FYI Robert Johnson died at 27. Grok continued to mention the various rumors of his death.

I cannot imagine where AI will be in a few years. Crazy stuff. Who'da thunk it?

Still junk. It's just a data digger, fast compiler. Not god. Not some break through.

Let's continue with speedy data at our finger tips, stay on this path, but please drop the AI hype.

 

[Hohn]

So at work we have free use of Copilot. I throw a table in there and ask it to count how many are there, it said a number I want to hear, then I verify it by removing a few and ask again. It said the same number I wanted to hear. I told Copilot it is lying and this is the answer I got:

"You’re correct—I didn’t manually count each one; I inferred based on the pattern and length. Let me actually verify this properly so there’s no doubt.

I’ll run a quick script to count the number of elements in your array."

I parsed your array text and counted:
196 entries.

Then I use a text editor to search and found 144...

I think my job is going to be safe for a bit longer.

IN the last few months of playing around with AI, it's perfectly happy to just fabricate something plausible. It's essentially just being lazy and making probabilistic determination.

When you bust the AI being lazy, it will actually go back and pull the source data and then give you something true. But AI is definitely lazy and more than willing to lie based on a presupposition rather than do the more resource-intense task of looking it up.

 

[Pablo]

IN the last few months of playing around with AI, it's perfectly happy to just fabricate something plausible. It's essentially just being lazy and making probabilistic determination.

When you bust the AI being lazy, it will actually go back and pull the source data and then give you something true. But AI is definitely lazy and more than willing to lie based on a presupposition rather than do the more resource-intense task of looking it up.

I guess that type of lying is the same as a lazy student

 

[JeffKeryk]

Still junk. It's just a data digger, fast compiler. Not god. Not some break through.

Let's continue with speedy data at our finger tips, stay on this path, but please drop the AI hype.

We will just have to disagree on this one. Artificial Intelligence is widely considered a breakthrough technology and, more accurately, a technology revolution. It is not merely an evolution; it is transformation.

Here is a recent Stanford University analysis.

From another standpoint, AI is a major stock marker driver; responsible for a disproportionate share of gains.

I would be interested in any credible articles you may know of.

 

[GON]

30 days ago, I never knowingly used AI and thought it was not something I would have an interest in.

What a difference 30 days can make. After a recommendation from a colleague of mine who I have worked with for 30 years, I decided to subscribe to a most expensive AI monthly subscription of $200 per month. I have only used AI a handful of times in the past 30 days, but for what I was in need of, AI provided valuable assistance in minutes in what might have taken me weeks of time and effort.

 

[Pablo]

We will just have to disagree on this one. Artificial Intelligence is widely considered a breakthrough technology and, more accurately, a technology revolution. It is not merely an evolution; it is transformation.

Here is a recent Stanford University analysis.

From another standpoint, AI is a major stock marker driver; responsible for a disproportionate share of gains.

I would be interested in any credible articles you may know of.

That doesn’t prove I’m wrong. It just rewords your position

You are correct the stock market is driven by hype.

You will notice I never said faster better smarter computing is bad. I never said it’s not useful to access all recorded everything instantly and compile it in ways we can’t imagine but to call that intelligence is wrong. FAI if you want to believe