I'm an atheist, but most of what I have heard from popes in recent years seems like sound and possibly needed advice.
Also, even though I feel AI and robotics are very important for progressing humanity, I think that much of the world has long since lost a proper sense of intrinsic human value. It's really gone from overt exploitation to slightly more mild exploitation where we pretend the system is really merit based.
And as AI and robotics remove the need for human labor, I hope that someone like the pope can convince people that we should value human beings inherently and more fairly. Inexpensive labor and intelligence should make this feasible.
I hope the speech isn't something dumb like "remember only humans have souls" because I think that's really premature and pretty obvious that AIs are not people at this point.
The really convincing and somewhat deeper simulations of humans are probably only a few years down the line though.
Which comes back to the Rovelli dualism article that was on the front page before. I think we should not be in a hurry to try to duplicate humans in depth (such as imitating emotions, pain, stream of consciousness, self-preservation, etc).
It's just completely unnecessary to go that far to get useful AI, and obviously unethical to subject a real human emulation to slavery.
Human value has rarely existed. Pre-industrial world didn't have much human value. Your were a lord or a serf. There was not much in between. A lord's life had value, a serf's value was nothing.
Post-industrial world needed human capital. Hence, the need for human value. If you notice most of this "need" has arisen out of then need for industrial expansion.
Post-AI will be interesting. Will we go back to pre-industrial or get something better.
I also wonder if it’s just harder to rule a much larger population in the modern world than in those times. Any jackass can show up and say that he was chosen to lead by some higher power. But you must still convince enough people that that is the case or at least have a military large enough that you can control.
I don't think this is factually accurate. What it really boils down is a question of scale of societies.
Most of us humans inherently value each other. There are exceptions, and small communities can get nasty. But for the most part, small human communities tend to be supportive and valuing each other.
This really only stops being the case when you get large-scale societies that allow humans to view others through an overly abstract lens. Combine that with an unchecked accumulation of power, and you have the potential for those in power to view the rest as without value.
I'm not religious and haven't been since 2008. However, the world today is very different from then. It's fragmented, far more authoritarian, much more dangerous, with "us vs them" mentalities just gaining more and more traction in general in so many countries. There are almost no political leaders left in the world offering a vision that is distinct from mere survival instinct or domination or some mixture of the two. In the last decade we've seen the rise of multiple world-historical tyrants. Meanwhile, many major religions have lost all moral credibility due to continued decades of horrible violence. I can't believe I'm saying this, but it'd be nice to see some real, genuine world leadership from the Pope right now.
The title seems to be editorialized. To me, it makes it sound like Christopher Olah (the mentioned Anthropic co-founder) is a co-author. Instead he is going to be one of several speakers present when the encyclical is released.
> Pope Leo XIV’s first encyclical, Magnifica humanitas, on preserving the human person in the age of artificial intelligence, will be released on May 25. A presentation event with the Pope and various speakers is scheduled for the same day at the Vatican.
Among the "various speakers" is Christopher Olah. But hard to express under 80 characters I bet.
It's a tall order to live up to the impact of Rerum novarum, the encyclical by the former Pope Leo that greatly guided thinking out of the industrial revolution. Personally, I'm excited to read this. If we take the claims of most AI labs at face value, they believe their work will fundamentally change the relationship between humans and the economy. More involvement from faith leaders is a good thing.
I <3 the sci-fi gods like Herbert, Heinlein and Asimov, and they all had great sci-fi takes on religion ... but Hyperion has THE best take on sci-fi religions IMHO.
Who is this for? Is this to promote AI to the general Catholic public, or is it some kind of cultural signal to potential conservative institutional customers that Anthropic isn’t just a stereotypical bunch of godless California hippies?
Normally when I see these sorts of things it’s obvious what it is for and why, but this one confuses me.
It’s for me. It’s strange so I’m probably going to watch it. It helps that I generally like the modern Catholic church’s direction on things (besides abortion but I’m willing to overlook that).
I hope you saw others' correction to the title here that indicate Olah is just a speaker at an event on the same day, not an author (although he almost certainly was consulted for his opinions while the Pope and his assistants were working on the Encyclical). So what matters here is what the Pope is trying to do, not Olah's intentions in his minor role.
The Pope has already spoken quite a bit about ai, and exhorted priests to keep ai out of their homilies, which should be a sacred fruit of prayer and study.
Just from what I have seen he said and my Catholic Theological background, I would say he will definitely be talking about at least a couple things: 1) the relationship between ai and our intellectual labor, and how to use it fruitfully to grow without losing ourselves in it (a very similar concern to many on hn as far as I understand); and more importantly for him and again for many 2) how to use ai in society in a way that everybody can enjoy the fruits of it, instead of just the elite few (similar to the priority of Rerum novarum). This Pope chose his name because of this theme, and has consistently demonstrated that social justice is amongst his highest priority concerns - to the point that he has asked the Church to stop focusing so heavily on sexual ethics because there are such weighty injustices in the world that require our focused effort and attention.
That is just what the (edited) title makes it sound like. The article states that Christopher Olah will be a speaker present at the encyclical release. It does not imply that he had any hand or influence in the content.
Well yeah, private companies influencing doctrine would be far more scandalous for believers I guess. The point is the church making connections with companies straight away, sidestepping heads of state.
I think in the case of Anthropic, it shows they’re at the very least willing to engage with the most important people in the philosophical and theological realm they’re in the midst of disrupting.
When the question asked is roughly of “can an AI ever be considered a human soul?”, there isn’t a philosopher alive whose individual opinion would be considered more meaningful than Pope Leo’s.
It’s unlikely that the church’s opinion would influence the future business choices of Anthropic. I think it still remains a positive business move to publicly engage with the church.
I don't know enough to disagree with this specifically, but reductionism and generalizing is its own problem. A PR stunt is far cry from a power grab. Reductionism favors addressing large trends, and large boogeymen, classes, groups, etc.. instead of doing the diligent work of finding root causes, nuanced as they might be, and addressing those.
If what you say is right, I would challenge that by still insisting the corporations can only do what governments let them. You might say they run governments behind the scenes, to which I would say, who let them? They keep influencing elections? Then elections don't seem to be working, that's the root cause perhaps? In all the major political issues, that's the trend I'm seeing, democracy failing, but then I'll challenge myself and ask why is it failing?
The old sentiment of "if it can't be fixed, it isn't a problem" seems rampant. Modern democracy itself is a fix for some other sets of problems. In the US at least, it is in theory designed to be mended and fixed. Perhaps the real cause is lack of political will power by everyone pursuing politics, to even talk about changing the way the government is architectured, altering constitutions, talking about parting ways with land and population (secession), or incorporation of some. Perhaps the population just isn't that interested in educating themselves on matters of civics, therefore how democracy works needs a rewrite at its core?
Either way, I rambled on, i know, but it's with a point i hope is obvious: the common political sentiment around billionaires, corporations, oligarchs (or similar "woke" or "DEI" dogwhistles on the right) simply don't address root causes. They're reductive by design, not accident.
I'm an atheist, but most of what I have heard from popes in recent years seems like sound and possibly needed advice.
Also, even though I feel AI and robotics are very important for progressing humanity, I think that much of the world has long since lost a proper sense of intrinsic human value. It's really gone from overt exploitation to slightly more mild exploitation where we pretend the system is really merit based.
And as AI and robotics remove the need for human labor, I hope that someone like the pope can convince people that we should value human beings inherently and more fairly. Inexpensive labor and intelligence should make this feasible.
I hope the speech isn't something dumb like "remember only humans have souls" because I think that's really premature and pretty obvious that AIs are not people at this point.
The really convincing and somewhat deeper simulations of humans are probably only a few years down the line though.
Which comes back to the Rovelli dualism article that was on the front page before. I think we should not be in a hurry to try to duplicate humans in depth (such as imitating emotions, pain, stream of consciousness, self-preservation, etc). It's just completely unnecessary to go that far to get useful AI, and obviously unethical to subject a real human emulation to slavery.
Human value has rarely existed. Pre-industrial world didn't have much human value. Your were a lord or a serf. There was not much in between. A lord's life had value, a serf's value was nothing.
Post-industrial world needed human capital. Hence, the need for human value. If you notice most of this "need" has arisen out of then need for industrial expansion.
Post-AI will be interesting. Will we go back to pre-industrial or get something better.
I also wonder if it’s just harder to rule a much larger population in the modern world than in those times. Any jackass can show up and say that he was chosen to lead by some higher power. But you must still convince enough people that that is the case or at least have a military large enough that you can control.
I don't think this is factually accurate. What it really boils down is a question of scale of societies.
Most of us humans inherently value each other. There are exceptions, and small communities can get nasty. But for the most part, small human communities tend to be supportive and valuing each other.
This really only stops being the case when you get large-scale societies that allow humans to view others through an overly abstract lens. Combine that with an unchecked accumulation of power, and you have the potential for those in power to view the rest as without value.
When it’s necessary for the pope to tell the orange one to calm down about wiping out a civilisation, you know things are bad.
I'm not religious and haven't been since 2008. However, the world today is very different from then. It's fragmented, far more authoritarian, much more dangerous, with "us vs them" mentalities just gaining more and more traction in general in so many countries. There are almost no political leaders left in the world offering a vision that is distinct from mere survival instinct or domination or some mixture of the two. In the last decade we've seen the rise of multiple world-historical tyrants. Meanwhile, many major religions have lost all moral credibility due to continued decades of horrible violence. I can't believe I'm saying this, but it'd be nice to see some real, genuine world leadership from the Pope right now.
The title seems to be editorialized. To me, it makes it sound like Christopher Olah (the mentioned Anthropic co-founder) is a co-author. Instead he is going to be one of several speakers present when the encyclical is released.
yeah 'anthropic employee to appear on panel'
Agree, the introduction from article:
> Pope Leo XIV’s first encyclical, Magnifica humanitas, on preserving the human person in the age of artificial intelligence, will be released on May 25. A presentation event with the Pope and various speakers is scheduled for the same day at the Vatican.
Among the "various speakers" is Christopher Olah. But hard to express under 80 characters I bet.
It's a tall order to live up to the impact of Rerum novarum, the encyclical by the former Pope Leo that greatly guided thinking out of the industrial revolution. Personally, I'm excited to read this. If we take the claims of most AI labs at face value, they believe their work will fundamentally change the relationship between humans and the economy. More involvement from faith leaders is a good thing.
I mean, the industrial revolution probably could have gone a little better.
Hopefully this time we can avoid multiple, world wide wars.
This reminds me of the second half of the Hyperion cantos by Dan Simmons
I <3 the sci-fi gods like Herbert, Heinlein and Asimov, and they all had great sci-fi takes on religion ... but Hyperion has THE best take on sci-fi religions IMHO.
You mean the Endymion books, or Fall of Hyperion? I'm rereading the latter right now..
Amodei seems apropos
Who is this for? Is this to promote AI to the general Catholic public, or is it some kind of cultural signal to potential conservative institutional customers that Anthropic isn’t just a stereotypical bunch of godless California hippies?
Normally when I see these sorts of things it’s obvious what it is for and why, but this one confuses me.
My guess is that it (re)affirms that LLMs don't have souls and only people do.
If you've read any Vatican publications, the theme is being the authority on the ontology of reality.
EDIT: A decree for bioethics https://www.vatican.va/roman_curia/congregations/cfaith/docu... I'd expect a similar deal for AI.
I have met many people who don't seem to have a soul.
Heretic!
> Ankh-Morpork! Brawling city of a hundred thousand souls! And, as the Patrician privately observed, ten times that number of actual people.
-- Guards! Guards! by Terry Pratchett
All of the people who I agree with are ensouled, all of them I disagree with are not.
It’s for me. It’s strange so I’m probably going to watch it. It helps that I generally like the modern Catholic church’s direction on things (besides abortion but I’m willing to overlook that).
It's part of the gradual agenda to label AI the antichrist.
I hope you saw others' correction to the title here that indicate Olah is just a speaker at an event on the same day, not an author (although he almost certainly was consulted for his opinions while the Pope and his assistants were working on the Encyclical). So what matters here is what the Pope is trying to do, not Olah's intentions in his minor role.
The Pope has already spoken quite a bit about ai, and exhorted priests to keep ai out of their homilies, which should be a sacred fruit of prayer and study.
Just from what I have seen he said and my Catholic Theological background, I would say he will definitely be talking about at least a couple things: 1) the relationship between ai and our intellectual labor, and how to use it fruitfully to grow without losing ourselves in it (a very similar concern to many on hn as far as I understand); and more importantly for him and again for many 2) how to use ai in society in a way that everybody can enjoy the fruits of it, instead of just the elite few (similar to the priority of Rerum novarum). This Pope chose his name because of this theme, and has consistently demonstrated that social justice is amongst his highest priority concerns - to the point that he has asked the Church to stop focusing so heavily on sexual ethics because there are such weighty injustices in the world that require our focused effort and attention.
Another weird thing is this religious group trying to exert control over the AI companies:
https://newsroom.ap.org/detail/Techisturningincreasinglytore...
Why are the AI companies meeting with them at all? Just seems uncomfortable and suspicious.
The world is getting real tired of these tech bros.
Title is more like: Pope's first encyclical on preserving the human person in AI age coming May 25
Why does this seem like it came out of a meeting where someone kept saying "how can we leverage AI?"
Not at all. The Rerum Novarum timing is too intentional.
I bet it will be 100 AI written, with guidance, natch, just because...
For anyone concerned about the growing power of giant corporations, the fact that they're doing joint statements with religious leaders is...wow.
Regardless of content, it seems an extra step in solidifying where power lies.
That is just what the (edited) title makes it sound like. The article states that Christopher Olah will be a speaker present at the encyclical release. It does not imply that he had any hand or influence in the content.
Well yeah, private companies influencing doctrine would be far more scandalous for believers I guess. The point is the church making connections with companies straight away, sidestepping heads of state.
I think in the case of Anthropic, it shows they’re at the very least willing to engage with the most important people in the philosophical and theological realm they’re in the midst of disrupting.
When the question asked is roughly of “can an AI ever be considered a human soul?”, there isn’t a philosopher alive whose individual opinion would be considered more meaningful than Pope Leo’s.
It’s unlikely that the church’s opinion would influence the future business choices of Anthropic. I think it still remains a positive business move to publicly engage with the church.
I don't know enough to disagree with this specifically, but reductionism and generalizing is its own problem. A PR stunt is far cry from a power grab. Reductionism favors addressing large trends, and large boogeymen, classes, groups, etc.. instead of doing the diligent work of finding root causes, nuanced as they might be, and addressing those.
If what you say is right, I would challenge that by still insisting the corporations can only do what governments let them. You might say they run governments behind the scenes, to which I would say, who let them? They keep influencing elections? Then elections don't seem to be working, that's the root cause perhaps? In all the major political issues, that's the trend I'm seeing, democracy failing, but then I'll challenge myself and ask why is it failing?
The old sentiment of "if it can't be fixed, it isn't a problem" seems rampant. Modern democracy itself is a fix for some other sets of problems. In the US at least, it is in theory designed to be mended and fixed. Perhaps the real cause is lack of political will power by everyone pursuing politics, to even talk about changing the way the government is architectured, altering constitutions, talking about parting ways with land and population (secession), or incorporation of some. Perhaps the population just isn't that interested in educating themselves on matters of civics, therefore how democracy works needs a rewrite at its core?
Either way, I rambled on, i know, but it's with a point i hope is obvious: the common political sentiment around billionaires, corporations, oligarchs (or similar "woke" or "DEI" dogwhistles on the right) simply don't address root causes. They're reductive by design, not accident.