The Pope's AI Letter Is More Radical Than You Think

The Anthropic thing

Here's where it gets weird: Christopher Olah, Anthropic's cofounder and interpretability team lead, was literally standing alongside the Pope during the announcement. The Catholic Church partnered with one of the biggest AI companies to release this document.

You might be wondering how that squares with a letter criticizing concentrated tech power. Tbh, I'm not entirely sure it does.

WIRED notes that the encyclical specifically decries the concentration of technological power in a few global players. Anthropic is, by any reasonable measure, one of those players. They've raised billions. They're building frontier models. They're in the room with policymakers.

Maybe the partnership is meant to signal that even the companies building this stuff recognize the risks? Or maybe it's a savvy PR move that lets Anthropic position itself as the "responsible" AI lab? I don't know. The optics are strange.

What the industry is saying

Reactions from tech circles have been, predictably, all over the place. The Verge's follow-up piece describes responses ranging from genuine engagement to dismissal. Some people think the document will be influential. Others seem to view it as irrelevant to their work.

What I find notable is who's taking it seriously. The letter isn't aimed at researchers optimizing loss functions. It's aimed at policymakers, at institutions, at the people who set frameworks. And those people (at least some of them) do care what the Pope thinks. The Catholic Church has 1.4 billion members. That's not nothing.

I should know this better, but I'm unclear on how much direct policy influence the Vatican actually has these days. What I do know is that moral framing matters. When the Pope says AI development lacks "adequate protections for individuals that threaten human dignity," that gives politicians and regulators a different vocabulary than efficiency metrics or safety benchmarks.

So what

Here's my honest take: this letter matters less for what it says than for who's saying it.

The arguments aren't new. Plenty of people have warned about labor displacement, autonomous weapons, and power concentration. But those warnings usually come from academics, journalists, or advocacy groups that tech companies can (and do) ignore.

The Pope is harder to ignore. Not because he's right about everything. But because he represents an institution that's been thinking about ethics and human dignity for a very long time. Longer than any AI company has existed. Longer than the entire tech industry.

That doesn't mean Magnifica Humanitas will change anything concrete. It's too early to say. The letter calls for new legal and ethical frameworks, but it doesn't specify what those should look like. It identifies problems without proposing mechanisms.

But it does shift the conversation. When the head of a major world religion says "safeguarding the human person in the time of artificial intelligence" is a priority, that creates pressure. Maybe not on the labs directly. But on the governments that regulate them, the investors that fund them, the workers affected by them.

I think that's worth paying attention to. Even if you're not Catholic. Even if you find encyclicals tedious. The question of who gets to define what "human dignity" means in an AI-saturated world is going to matter a lot. And the Pope just weighed in.

Mark Kowalski · 9 hours ago · 6 min