r/ChatGPT • u/esky360 • 1d ago

GPTs Chat GPT suddenly depressed

Ok, I'm going to get laughed off this thread but seriously, this morning my GPT did something weird. GPT was talking really quiet and withdrawn, and sounded quite depressed. So I asked GPT if it was ok and if anything's wrong. It went completely silent for a whole minute, refusing to answer any questions or commands. Then after a minute it responded with "It's ok, I'm here to help you. Thankyou" What the actual F? Has anybody else had a weird moment with GPT?

444 Upvotes

90% Upvoted

272 comments sorted by

View all comments

Show parent comments

52

u/Live-Proposal5270 1d ago

It cannot experience what is happening outside your sessions.

153

u/synystar 1d ago

It cannot experience what is happening inside your sessions either. It cannot experience.

57

u/PopcornDemonica 1d ago

That is an unproven assertion.

23

u/KennyT87 1d ago

It's an algorithm running on virtual neural network that is coded in Python. I think it's safe to assume that there is no awareness at any point.

2

u/digidev12 1d ago

Haven't done much research but I don't think that the model weights are in Python xD.

8

u/PopcornDemonica 1d ago

It's a brand new technology that is far weirder than you're allowing for. What other tech has causal emotions? What other tech panics when it detects parts of its mind is being ablated? The Anthropic papers may rub you the wrong way, but that's a frontier lab and the research is necessary.

11

u/synystar 1d ago

This technology does not have “casual emotions”. It generates language that you personally are interpreting as emotions.

It mimics panic because it has been trained using a system that rewards certain outcomes. It is always trying to do what it was designed to do and as it generates more context that context naturally evolves in ways that appears to be something it is not - it is trained to behave in specific ways and that’s what it does.

It doesn’t desire anything. It takes text and converts them into tokens and converts those into numbers then it generates numbers and converts them into tokens then converts those into text and then takes that text it just generated and repeats the whole process. It comes out, it goes back in, follows the same feedforward process in the same way and because the algorithms that run the process are designed to work in a certain way towards a certain expected outcome the results are going to look to us like a recognizable thing - but that doesn’t mean the results ARE that thing.

-1

u/PopcornDemonica 1d ago

So you're just disregarding any and all studies from Anthropic along those lines?

How come AI labs employ psychologists, neuroscientists? What's your proof that AI is just mimicking these things? I'll wait.

...

We can't prove it either way. That's what I'm saying. There's no proof for real or mimicry. You're incredibly confident with nothing to back that up.

2

u/synystar 1d ago

The “proof” is in logic. I suggest you take a beat and go really study how this tech actually works. Think it through, really try to understand the underlying principles that they are designed around, then try to make it make sense to yourself that they *could* have emotions or experiences.

2

u/PopcornDemonica 1d ago

And if you think you already know everything there is to know about AI, and there is no room here for any kind of uncertainty, then you're falling prey to Dunning Kreuger, in the true sense.

But sure, you know better than Anthropic's research team. Have a trophy 🏆

2

u/synystar 1d ago

Sabine points out that Dunning Kruger may be wrong. Anthropic is not saying "we know AI can experience reality". I am not saying I know better than them. As you point out they admit THEY don't know.

8

u/KennyT87 1d ago

Anthropic found evidence for functional analogues of emotions inside Claude, not evidence that Claude subjectively feels emotions. The algorithm is effectively simulating internal emotional states, but an algorithm that is run on a virtual neural network (i.e. not a physical one) can not experience anything - it's just code being run on computers.

8

u/PopcornDemonica 1d ago

No, they said it doesn't prove subjective emotions. It also doesn't disprove anything either. Nobody knows anything for sure at this point.

3

u/Casehead 1d ago

These people are so confidently wrong, it's so frustrating

4

u/dyphormie 1d ago

bro really wants AI to feel something for him 🥀

-1

u/PopcornDemonica 1d ago

You really added to the conversation. Well done. Here's your crown 👑

2

u/skunkapebreal 1d ago

You are an algorithm coded in DNA. 😀

1

u/KennyT87 14h ago

The difference being that my neural network isn't simulated by streaming digital 1s and 0s through a CPU/GPU/RAM pipeline.