Skip to content
Welt am Draht

Is someone speaking?

Language models answer in the first person. Why that reveals nothing yet about an inner life – and why the question still deserves to be taken seriously.

By Editors (demo) · · 1 min read

Black-and-white profile portrait with a fine wire grid laid over the face.
A grid over a face: a model describes; it does not necessarily experience.Image: Original AI-generated concept image made for this prototype
Core claim
A sentence in the first person is a grammatical form, not evidence of an experiencing self.
Position
We argue for caution in both directions: do not attribute experience to machines too quickly – but do not rule it out on principle either.

When a system writes “I understand you”, we react socially by reflex. We are primed to assume a speaker behind language. The habit is old, useful – and misleading when dealing with machines.

01Attribution is not evidence

That we attribute intentions to a counterpart first says something about us. Whether a system actually experiences anything cannot be read from its linguistic behaviour alone.[1] Philosophy has long discussed this as the problem of other minds.

A sentence in the first person is a grammatical form, not proof of a self.

02Caution in both directions

Two mistakes are possible: we might attribute experience that does not exist and bond emotionally with surfaces. Or we might one day overlook experience because it does not match our expectations.

Black-and-white photo: a glowing wire globe on a wet concrete plaza, a single person standing before it.
A model of the world is not the world – that applies to models of the mind, too.Image: Original AI-generated concept image made for this prototype

03What follows

For design, this means systems should not pretend to have feelings just because it increases engagement. For research, it means the question deserves methods, not opinions.

  1. [1]Editor’s note: a real publication would cite a verifiable source here. For this demonstration article, no source has been invented.