What Would a Conscious AI Mean?

Keith MacKay Posted on Jun 1 • Originally published at tlcmentor.substack.com What Would a Conscious AI Mean? # ai # systemdesign # management What Would a Conscious AI Mean? Anthropic's CEO can't rule it out. Lawyers are drafting frameworks. I've been thinking about and debating this for 40 years. We are closer to machine consciousness with each passing model, but no closer to answering what that means or how to handle it societally. On a February 2026 episode of the New York Times "Interesting Times" podcast, Anthropic CEO Dario Amodei said something most tech executives have carefully avoided: "We don't know if the models are conscious. We are not even sure that we know what it would mean for a model to be conscious, or whether a model can be conscious. But we're open to the idea that it could be." [1] Interesting times indeed. This wasn't hedging. It was honesty. And it opens a question the industry would very much like to table for later: if an AI system is, or becomes, conscious, what do we owe it? I've been sitting with that question since the 1980s. My degree from MIT was in Brain and Cognitive Sciences, in a track focused on understanding human brains and helping computers work more like them. I did internships in MIT's AI Lab, working on projects that look quaint now but were bricks in the foundation for everything we're running today. Back then, "can machines think?" was a theoretical debate among academics. Today, the company building those machines is hiring AI welfare researchers and publishing papers on their models' possible inner lives. The debate has left the classroom. What do I think regarding consciousness? I don't think we're there yet. That said, I don't have a great working definition of what makes a person conscious, let alone an AI. And I'm not alone -- society doesn't seem to have much of a handle on it either. Outside of anime and late-night dorm chats it hasn't been anything but theoretical. But AI brains are changing, and advancing