MCMC tracking down individuals misusing AI, producing humiliating photos - Fahmi

PUTRAJAYA: The Malaysian Communications and Multimedia Commission (MCMC) is tracking down individuals involved in the misuse of artificial intelligence (AI) technology to edit photographs to humiliate social media users, said Communications Minister Fahmi Fadzil.

Fahmi said the move is to enable strict action to be taken and ensure the safety of online users, especially children.

"MCMC is tracking down the individuals, and to MCMC's knowledge, some of them were involved in prostitution activities before and punished but were found to be involved in vice again but in a different form and using other services.

"This is one of the reasons why we are deeply concerned and are taking several strict measures regarding online safety, among others, we insist that children, aged 13 and below, are banned from using any social media application," he told reporters after attending his ministry's monthly assembly here today.

Previously, it went viral on the X, about the humiliating photo editing activities which received negative reactions from netizens and requested that the government ban the use of that technology in this country.

Fahmi said the Communications Ministry has held a meeting with several representatives of social media platform providers to ensure transparency and accountability in the use of social media and will announce some actions regarding the safety of online users soon.

"Insya-Allah, in June I will hold a meeting with all (social media) platforms in Singapore, (in particular) those who manage the 'moderation' aspect and on compliance with (social media) regulations for each country," he said.

He also reiterated the advice issued by MCMC on Sunday, which is for parents to ensure that their children aged 13 and below do not own any social media accounts as that age is inappropriate to use any social media.

"To parents who want to take pictures (of children) and upload them, I ask them to be careful... we are not sure who will misuse the pictures.

"Here, I say it again, not only related to AI but there are several online crimes that prey on social media users, especially children and those who may not be well-versed (about the conditions of owning a social media account)," he said.

Earlier, when delivering his message at the assembly, Fahmi said there were two worrying situations on social media, namely the spread of deviant teachings and the sexual grooming of children through the WhatsApp application.

"This is very troubling especially when we see there is new technology. I was informed that they use DeepNude (application) (which uses a photo of a clothed person and creates a new, naked image of that same person). This is a terrible use of technology. So, try to imagine if our children become victims," he said.

He also stressed that the government will not compromise on the safety of online users, especially children.

-- BERNAMA

Read the latest news here