Is someone speaking?
Language models answer in the first person. Why that reveals nothing yet about an inner life – and why the question still deserves to be taken seriously.
By Editors (demo) · · 1 min read

Core claim & position
- Core claim
- A sentence in the first person is a grammatical form, not evidence of an experiencing self.
- Position
- We argue for caution in both directions: do not attribute experience to machines too quickly – but do not rule it out on principle either.
When a system writes “I understand you”, we react socially by reflex. We are primed to assume a speaker behind language. The habit is old, useful – and misleading when dealing with machines.
01Attribution is not evidence
That we attribute intentions to a counterpart first says something about us. Whether a system actually experiences anything cannot be read from its linguistic behaviour alone.[1] Philosophy has long discussed this as the problem of other minds.
A sentence in the first person is a grammatical form, not proof of a self.
02Caution in both directions
Two mistakes are possible: we might attribute experience that does not exist and bond emotionally with surfaces. Or we might one day overlook experience because it does not match our expectations.

03What follows
For design, this means systems should not pretend to have feelings just because it increases engagement. For research, it means the question deserves methods, not opinions.
