AI Impersonations of Religious Figures: A Growing Concern in North East India and Beyond
The Rise of AI-Generated Scams Targeting Religious Leaders
In November 2022, Father Mike Schmitz, a popular Catholic priest and podcaster, addressed his congregation of over 1.2 million YouTube subscribers with an unusual warning. AI-generated impersonation scams had targeted him, and other religious leaders were not immune.
Cybersecurity expert Rachel Tobac, CEO of SocialProof Security, explained that pastors have become popular subjects of AI scams due to their online presence. On platforms like TikTok and Reels, scammers pose as priests, delivering enthusiastic sermons and soliciting donations or cryptocurrency investments.
The implications of these scams are significant, especially for North East India, where many religious leaders have a strong following. As more religious figures embrace digital platforms, they increase their exposure to such threats.
Deepfakes and the Misrepresentation of Religious Leaders
Deepfakes, or AI-generated videos that mimic a person's voice and appearance, have also been used to impersonate religious leaders. In some cases, these deepfakes are used to solicit donations or spread misinformation.
In the Philippines, megachurches have reported deepfakes featuring their pastors. An evangelical church in Nebraska issued an AI scammer alert, and one churchgoer shared screenshots of texts purported to be from their pastor.
For North East India, this trend poses a challenge. As religious leaders increasingly engage with their communities online, they must be vigilant against deepfakes and other forms of AI-generated misinformation.
The Influence of AI on Religious Beliefs
AI isn't just being used for scams. Some viral AI-generated videos feature pastors delivering unexpected sermons that quickly rack up views. These videos may seek to influence the way people think, potentially leading to mental health issues.
Industry watchdogs like Rachel Tobac and Lucas Hansen of CivAI are concerned about users of religious AI experiencing severe mental health consequences. OpenAI reported that hundreds of thousands of ChatGPT users may show signs of psychosis and other mental health issues in their chatbot conversations every week.
In North East India, it's crucial to be aware of these potential risks and to promote responsible use of AI in religious contexts.
The Future of AI and Religion
While some faith leaders have embraced AI as a tool for sermon preparation and communication, concerns about its impact on mental health and the potential for misuse persist.
Father Schmitz, who has been impersonated by AI without his consent, has expressed reservations about the technology. He compares the advancement of AI to the lethargic humans in the movie Wall-E, who have ceased to know how to do things as they rely on technology.
As AI continues to evolve, it will be essential for religious leaders and their communities to navigate its potential benefits and risks responsibly. In North East India, this means staying informed, promoting digital safety, and fostering critical thinking.