Artificial Intelligence (AI) is being used at alarming levels for generating child sexual abuse material (CSAM), with analysts saying that it has reached a tipping point.

The watchdog group Internet Watch Foundation (IWF) said that the creation and distribution of AI-generated CSAM are becoming increasingly sophisticated too.&nbsp;

Unlike in the past, these images and videos are finding their way into public online platforms&nbsp;as opposed to the Dark Web, the internet underbelly accessible only through special browsers like Tor.

Watch: US Prosecutors Intensify Action Against AI-Generated Child Abuse Images

<div class="ui-state-default" contenteditable="false">
<div class="twitter-block" draggable="false">
<div class="videoWrapper trancodeVideo"><iframe allowfullscreen="" autoplay="1" class="includeVideo" frameborder="0" height="350" src="https://www.wionews.com/videos/us-prosecutors-intensify-action-against-ai-generated-child-abuse-images-768547/embed" style="width:100%;max-width:560px;" width="560"></iframe></div>
</div>
<a class="close-mark close-div" href="#" id="jqclosemark">×</a></div>

The increasing photorealism of AI-generated visuals is making it difficult for authorities and watchdog agencies to figure out if these are images of a real child needing help, a situation described by an IWF analyst as a 'tipping point'.

What set alarm bells ringing is that just within the past six months, the number of instances of reported AI-generated child sex abuse imagery crossed what it was in the whole previous year.

In this period, the IWF acted on 74 reports of such content, a sharp rise from 70 in all the 12 months prior.&nbsp;

What's more disturbing is that the AI tools creating these images are trained on real victims' content, complicating efforts to identify genuine cases needing intervention, according to Derek Ray-Hill, the IWF interim chief executive.

“Recent months show that this problem is not going away and is in fact getting worse,” The Guardian newspaper quoted him as saying.

<a href="https://www.wionews.com/world/un-report-exposes-extreme-levels-of-child-abuse-in-armed-conflicts-especially-in-gaza-and-sudan-730923">Also read: UN report exposes 'extreme levels' of child abuse in armed conflicts, especially in Gaza and Sudan</a> 
 
The abuse content ranges from real-looking deepfake videos to altered inappropriate images of clothed children.

More than half of the flagged material is hosted on servers in Russia and the United States, besides Japan and the Netherlands, according to IWF.

The disturbing news comes amid increasing criticism of social media apps over offering safe haven to abusers, and sextortion.

<a href="https://www.wionews.com/world/new-york-catholic-diocese-to-pay-323mn-to-530-child-sex-abuse-survivors-in-largest-diocese-bankruptcy-762507">Also read: New York Catholic diocese to pay $323mn to 530 child sex abuse survivors, in largest US diocese bankruptcy</a> 
 
Users on platforms like Instagram are being blackmailed after being tricked into sharing intimate images, according to the Guardian report.

The image-sharing platform owned by Meta is reportedly launching measures to combat such crimes. 
 
It will automatically blur nude images sent via direct messages and caution users about opening them. They will also have the option to block or report senders of such images.

The feature will be enabled by default for teenage accounts while adults can opt in to join.

(With inputs from agencies)

Artificial Intelligence (AI) is being used at alarming levels for generating child sexual abuse material (CSAM), with analysts saying that it has reached a tipping point.

Artificial Intelligence (AI) is being used at alarming levels for generating child sexual abuse material (CSAM), with analysts saying that it has reached a tipping point. The watchdog group Internet Watch Foundation (IWF) said that the creation and distribution of AI-generated CSAM are becoming increasingly sophisticated too. Unlike in the past, these images and videos are finding their way into public online platforms as opposed to the Dark Web, the internet underbelly accessible only through special browsers like Tor. Watch: US Prosecutors Intensify Action Against AI-Generated Child Abuse Images × The increasing photorealism of AI-generated visuals is making it difficult for authorities and watchdog agencies to figure out if these are images of a real child needing help, a situation described by an IWF analyst as a 'tipping point'. What set alarm bells ringing is that just within the past six months, the number of instances of reported AI-generated child sex abuse imagery crossed what it was in the whole previous year. In this period, the IWF acted on 74 reports of such content, a sharp rise from 70 in all the 12 months prior. What's more disturbing is that the AI tools creating these images are trained on real victims' content, complicating efforts to identify genuine cases needing intervention, according to Derek Ray-Hill, the IWF interim chief executive. “Recent months show that this problem is not going away and is in fact getting worse,” The Guardian newspaper quoted him as saying. Also read: UN report exposes 'extreme levels' of child abuse in armed conflicts, especially in Gaza and Sudan The abuse content ranges from real-looking deepfake videos to altered inappropriate images of clothed children. More than half of the flagged material is hosted on servers in Russia and the United States, besides Japan and the Netherlands, according to IWF. The disturbing news comes amid increasing criticism of social media apps over offering safe haven to abusers, and sextortion. Also read: New York Catholic diocese to pay $323mn to 530 child sex abuse survivors, in largest US diocese bankruptcy Users on platforms like Instagram are being blackmailed after being tricked into sharing intimate images, according to the Guardian report. The image-sharing platform owned by Meta is reportedly launching measures to combat such crimes. It will automatically blur nude images sent via direct messages and caution users about opening them. They will also have the option to block or report senders of such images. The feature will be enabled by default for teenage accounts while adults can opt in to join. (With inputs from agencies)

AI-generated child sex abuse images, videos rising at alarming levels, warn internet watchdogs

A viral deepfake video showing French President Emmanuel Macron kissing a male security guard has sparked controversy and raised concerns about the growing threat of AI-manipulated content. The video, though convincingly realistic, is entirely fabricated and part of a broader wave of deepfake misinformation circulating online. Such videos, which can distort reality, pose serious risks to public figures and the integrity of information shared on digital platforms. This incident highlights the challenges governments and tech companies face in combating deepfakes and preventing their misuse in shaping public perception and discourse.

Viral Deepfake Video Shows Macron Kissing Male Security Guard

Artificial Intelligence is revolutionising every sphere of our lives as we know it. But the latest developments from India suggest that artificial intelligence may have a major impact on how the country votes. Our next report looks in depth at this new phenomenon.

India's election commission combats deepfakes

Delhi Police on Saturday (Jan 20) arrested the mastermind and creator behind the deepfake video featuring actress Rashmika Mandanna from Andhra Pradesh, media reports said. The manipulated video, where Rashmika's face was superimposed onto British influencer Zara Patel, had gone viral, sparking a widespread investigation.

Since November, authorities have been diligently pursuing leads in the Rashmika case. The Delhi Police had interrogated numerous social media users who shared the deepfake, but the creator had remained elusive until now. The law enforcement agency had previously reached out to Meta as well in November, urging them to provide the URL of the account responsible for circulating the viral video.

An FIR had been filed in connection with the incident. Recently, Indian cricket legend&nbsp;Sachin Tendulkar also fell victim to a deepfake video. The video was manipulated to endorse an online game.

Also Read |&nbsp;<a href="https://www.wionews.com/entertainment/buoy-meets-satellite-kristen-stewart-brings-bizarre-ai-romance-to-sundance-681809">Buoy meets satellite: Kristen Stewart brings bizarre AI romance to Sundance</a>

Tendulkar discredited the video and urged others to report such instances.

"These videos are fake. It is disturbing to see rampant misuse of technology. Request everyone to report videos, ads &amp; apps like these in large numbers. Social media platforms need to be alert and responsive to complaints. Swift action from their end is crucial to stopping the spread of misinformation and fake news," Sachin wrote on X.

Also Read |&nbsp;<a href="https://www.wionews.com/entertainment/shoaib-malik-ties-knot-with-pakistan-actor-sana-javed-amid-separation-rumours-with-sania-mirza-681800">Shoaib Malik ties knot with Pakistan actor Sana Javed amid separation rumours with Sania Mirza</a>

<h2>India's action on deepfakes&nbsp;</h2>

In response to the rising threat of deepfakes, the Indian government has announced its intention to formulate regulations targeting the menace. The Ministry of Electronics and Information Technology will spearhead the efforts to draft regulations, making social media platforms and content creators accountable for the menace.

During the G20 Virtual Summit, PM Modi had expressed concern about deepfake technology, asserting that AI must be safe for the public. In collaboration with nations like the United Kingdom, United States, Australia, and China, India signed the Bletchley Declaration during the AI Safety Summit, signaling a collective commitment to collaborate on AI safety research.

(With inputs from agencies)

Delhi Police on Saturday (Jan 20) arrested the mastermind and creator behind the deepfake video featuring actress Rashmika Mandanna from Andhra Pradesh, media reports said.

Delhi Police on Saturday (Jan 20) arrested the mastermind and creator behind the deepfake video featuring actress Rashmika Mandanna from Andhra Pradesh, media reports said. The manipulated video, where Rashmika's face was superimposed onto British influencer Zara Patel, had gone viral, sparking a widespread investigation. Since November, authorities have been diligently pursuing leads in the Rashmika case. The Delhi Police had interrogated numerous social media users who shared the deepfake, but the creator had remained elusive until now. The law enforcement agency had previously reached out to Meta as well in November, urging them to provide the URL of the account responsible for circulating the viral video. An FIR had been filed in connection with the incident. Recently, Indian cricket legend Sachin Tendulkar also fell victim to a deepfake video. The video was manipulated to endorse an online game. Also Read | Buoy meets satellite: Kristen Stewart brings bizarre AI romance to Sundance Tendulkar discredited the video and urged others to report such instances. "These videos are fake. It is disturbing to see rampant misuse of technology. Request everyone to report videos, ads & apps like these in large numbers. Social media platforms need to be alert and responsive to complaints. Swift action from their end is crucial to stopping the spread of misinformation and fake news," Sachin wrote on X. Also Read | Shoaib Malik ties knot with Pakistan actor Sana Javed amid separation rumours with Sania Mirza India's action on deepfakes In response to the rising threat of deepfakes, the Indian government has announced its intention to formulate regulations targeting the menace. The Ministry of Electronics and Information Technology will spearhead the efforts to draft regulations, making social media platforms and content creators accountable for the menace. During the G20 Virtual Summit, PM Modi had expressed concern about deepfake technology, asserting that AI must be safe for the public. In collaboration with nations like the United Kingdom, United States, Australia, and China, India signed the Bletchley Declaration during the AI Safety Summit, signaling a collective commitment to collaborate on AI safety research. (With inputs from agencies)

Indian actor Rashmika Mandanna’s viral deepfake video: Delhi Police nabs creator in Andhra Pradesh

Former Indian cricketer Sachin Tendulkar has become the victim of a deepfake video which is going viral on social media in which his voice has been manipulated to promote an online game.&nbsp;

In this deepfake video, Tendulkar is seen advertising an online game, providing the example of daughter Sara earning $ 2,171.53 per day by making predictions in the game.&nbsp;

After this video went viral, Sachin Tendulkar took to his social media platform X (formerly Twitter) to raise concern about the misuse of technology, and&nbsp;wrote “These videos are fake. It is disturbing to see rampant misuse of technology. Request everyone to report videos, ads &amp; apps like these in large numbers. Social Media platforms need to be alert and responsive to complaints. Swift action from their end is crucial to stopping the spread of misinformation and deep fakes ”&nbsp;

Also read|&nbsp;<a href="https://www.wionews.com/sports/australian-open-stefanos-tsitsipas-blows-away-zizou-bergs-in-first-round-despite-early-struggle-680169">Australian Open: Stefanos Tsitsipas blows away Zizou Bergs in first round despite early struggle</a>

&nbsp;

<div class="ui-state-default" contenteditable="false">
<div class="twitter-block" draggable="false">
<blockquote class="twitter-tweet" data-media-max-width="560">
These videos are fake. It is disturbing to see rampant misuse of technology. Request everyone to report videos, ads &amp; apps like these in large numbers. 
 
Social Media platforms need to be alert and responsive to complaints. Swift action from their end is crucial to stopping the… <a href="https://t.co/4MwXthxSOM">pic.twitter.com/4MwXthxSOM</a>
— Sachin Tendulkar (@sachin_rt) <a href="https://twitter.com/sachin_rt/status/1746794062961950824?ref_src=twsrc%5Etfw">January 15, 2024</a></blockquote>
<script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script></div>
<a class="close-mark close-div" href="#" id="jqclosemark">×</a></div>

&nbsp;

<h2>What are deepfakes?</h2>

Artificial intelligence (AI) techniques are used to create manipulated media or deepfakes, usually videos. These methods create the illusion that the person in the video is talking or doing things they never actually did by substituting their voice or appearance for another's.

However, one can identify deepfake videos by paying attention to visual and audio inconsistencies along with other signs such as facial expressions, surroundings, audio discrepancies and by verifying the source.&nbsp;

Also read|<a href="https://www.wionews.com/cricket/siddharth-desai-takes-seven-for-as-gujarat-defend-109-against-karnataka-in-ranji-trophy-watch-680185">Siddharth Desai takes seven-for as Gujarat defend 109 against Karnataka in Ranji Trophy - WATCH</a>

Rashmika Mandana is the most recent celebrity among many others to become a victim of deepfake video. The persistent exploitation of technology is a growing concern in the digital age, as deepfakes make it harder to distinguish between fact and fabrication.

(With inputs from agencies)

Former Indian cricketer Sachin Tendulkar has become the victim of a deepfake video which is going viral on social media in which his voice has been manipulated to promote an online game.

Former Indian cricketer Sachin Tendulkar has become the victim of a deepfake video which is going viral on social media in which his voice has been manipulated to promote an online game. In this deepfake video, Tendulkar is seen advertising an online game, providing the example of daughter Sara earning $ 2,171.53 per day by making predictions in the game. After this video went viral, Sachin Tendulkar took to his social media platform X (formerly Twitter) to raise concern about the misuse of technology, and wrote “These videos are fake. It is disturbing to see rampant misuse of technology. Request everyone to report videos, ads & apps like these in large numbers. Social Media platforms need to be alert and responsive to complaints. Swift action from their end is crucial to stopping the spread of misinformation and deep fakes ” Also read| Australian Open: Stefanos Tsitsipas blows away Zizou Bergs in first round despite early struggle These videos are fake. It is disturbing to see rampant misuse of technology. Request everyone to report videos, ads & apps like these in large numbers. Social Media platforms need to be alert and responsive to complaints. Swift action from their end is crucial to stopping the… pic.twitter.com/4MwXthxSOM — Sachin Tendulkar (@sachin_rt) January 15, 2024 × What are deepfakes? Artificial intelligence (AI) techniques are used to create manipulated media or deepfakes, usually videos. These methods create the illusion that the person in the video is talking or doing things they never actually did by substituting their voice or appearance for another's. However, one can identify deepfake videos by paying attention to visual and audio inconsistencies along with other signs such as facial expressions, surroundings, audio discrepancies and by verifying the source. Also read|Siddharth Desai takes seven-for as Gujarat defend 109 against Karnataka in Ranji Trophy - WATCH Rashmika Mandana is the most recent celebrity among many others to become a victim of deepfake video. The persistent exploitation of technology is a growing concern in the digital age, as deepfakes make it harder to distinguish between fact and fabrication. (With inputs from agencies)

Sachin Tendulkar’s deepfake video goes viral, he says such rampant misuse of technology is disturbing

Indian actor alia bhatt is the latest to fall victim to the disturbing trend of deepfake videos that have been on the rise in the countr

Actor alia bhatt becomes latest victim of deepfake

A deepfake video of Indian actor Kajol has gone viral on social media. Another one showing Prime Minister Modi doing an Indian folk dance was also circulated online. This has prompted the Indian premier to address the growing menace of deepfakes.

Gravitas: Indian PM Modi calls out deepfake videos

deepfake-videos

Deepfake Videos, News on Deepfake Videos, stories on Deepfake Videos, articles on Deepfake Videos, Deepfake Videos stories at Wion, Deepfake Videos news, Deepfake Videos latest news