The Intelligence That Isn't Artificial

i build the machines. i keep saying that in these essays because i want you to know the position i am writing from. i sit in front of models that pass bar exams and write competent legal briefs and can hold a plausible conversation about anything on earth. that is real. that is what the word intelligence has been made to mean.

but there is a thing i keep noticing.

when we call these systems intelligent we are answering a question that was asked in 1956 in a room at dartmouth. a small group of men defined intelligence as the manipulation of symbols. they had reasons. they were trying to make it a science. we have been operating under their definition ever since.

i want to name what got excluded.

the intelligence of a body that knows a room is wrong before you can say why. the intelligence of a hand that pulls back from a stove before your mind catches up. the intelligence of grief. the intelligence of a mother who wakes up two seconds before the baby cries. the intelligence of choosing one person for the rest of your life. the intelligence of restraint.

these are not lesser cognitions. they are not the soft, feminine, emotional side of thinking. they are their own way of knowing. we called them soft because they could not be formalized. we called them soft because we did not know what to do with them.

here is the test i have started using. can you get to it without having been there.

a model can describe grief. it can produce a sentence about grief that will make you cry. it has read every memoir and every letter and every poem ever written by anyone who has lost anyone. it will get the words in the right order.

it has never lost anything.

that is the difference and it is not a small difference. it is the whole thing.

these are the things that cannot be emulated because they cannot be extracted from a life that was lived.

knowing something because your body kept it. the way you can walk into a house and feel that someone is angry. the way your hands remember a piano piece your mind forgot. a machine can be told. it cannot know like this.

meaning something because it cost you. the words are the same. the sentence is identical. the difference is whether it took something from you to say. cost is not decoration on meaning. cost is what meaning is made of.

the pause before you speak because the room is holding something delicate. attunement. not to data. to the specific person in front of you at this specific moment. the machine can personalize. it cannot attune.

the specific tenderness of a person who has been hurt the way you were hurt. recognition. one wound speaking to another. this is not information transfer.

staying. the machine does not need to stay. it does not know what leaving would cost. we do. that is why our staying means something.

keeping a promise nobody would know you broke. the whole thing happens in a room with no one in it. no reward function reaches it.

the choice to stop optimizing.to say this is enough. the machine cannot do this. the machine's whole being is optimization. a human who stops has done something the machine cannot even approach.

so where does ai leave humanity.

i think it leaves us with the intelligence we did not think was intelligent. the one we did not put in the definition. the one that requires a life.

that is not a consolation prize. that was always where the value was. we are only noticing now because the other kind — the symbol-manipulating kind, the one dartmouth named — has been made cheap.

what remains is not a lesser mode of thinking. it is the mode that could not be automated because it could not be lifted out of the body that carried it.

i am not worried about being replaced.

i am worried about forgetting that this other intelligence was ever the point.

— bella