THERE was the Bollywood star in skin-tight lycra, the Bangladeshi politician filmed in a bikini and the young Pakistani woman snapped with a man.
None was real, but all three images were credible enough to unleash lust, vitriol - and even allegedly a murder, underlining the sophistication of generative artificial intelligence, and the threats it poses to women across Asia.
The two videos and the photo were deepfake, and went viral in a vibrant social mediascape that is struggling to come to grips with the technology that has the power to create convincing copies that can upend real lives.
"We need to address this as a community and with urgency before more of us are affected by such identity theft," Indian actor Rashmika Mandanna said in a post on X, formerly Twitter, that has garnered more than 6.2 million views.
She is not the only Bollywood star to be cloned and attacked on social media, with top actors including Katrina Kaif, Alia Bhatt and Deepika Padukone also targeted with deepfakes.
The lycra video, said Mandanna, was "extremely scary not only for me, but also for each one of us who today is vulnerable to so much harm because of how technology is being misused."
While digitally manipulated images and videos of women were once easy to spot, usually lurking in the dark corners of the internet, the explosion in generative AI tools such as Midjourney, Stable Diffusion and DALL-E has made it easy and cheap to create and circulate convincing deepfakes.
More than 90% of deepfake videos online are pornographic, according to tech experts, and most are of women.
While there are no separate data for South Asian countries, digital rights experts say the issue is particularly challenging in conservative societies, where women have long been harassed online and abuse has gone largely unpunished.
Social media firms are struggling to keep up.
Google's YouTube and Meta Platforms - which owns Facebook, Instagram and WhatsApp - have updated their policies, requiring creators and advertisers to label all AI-generated content.
But the onus is largely on victims - usually girls and women - to take action, said Rumman Chowdhury, an AI expert at Harvard University who previously worked at reducing harms on Twitter.
"Generative AI will regrettably supercharge online harassment and malicious content ... and women are the canaries in the coal mine. They are the ones impacted first, the ones on whom the technologies are tested," she said.
"It is an indication to the rest of the world to pay attention, because it's coming for everyone," Chowdhury told a recent United Nations briefing.
DEEPFAKES AND THE LAW
As deepfakes have proliferated worldwide, there are growing concerns - and rising instances - of their use in harassment, scams and sextortion.
Regulations have been slow to follow.
The U.S. Executive Order on AI touches on dangers posed by deepfakes, while the European Union's proposed AI Act will require greater transparency and disclosure from providers.
Last month, 18 countries - including the United States and Britain - unveiled a non-binding agreement on keeping the wider public safe from AI misuse, including deepfakes.
Among Asian nations, China requires providers to use watermarks and report illegal deepfakes, while South Korea has made it illegal to distribute deepfakes that harm "public interest", with potential imprisonment or fines.
India is taking a tough stance as it drafts new rules.
IT Minister Ashwini Vaishnaw has said social media firms must remove deepfakes within 36 hours of receiving a notification, or risk losing their safe-harbour status that protects them from liability for third-party content.
But the focus should be on "mitigating and preventing incidents, rather than reactive responses," said Malavika Rajkumar at the advocacy group IT for Change.
While the Indian government has indicated it may force providers and platforms to disclose the identity of deepfake creators, "striking a balance between privacy protection and preventing abuse is key," Rajkumar added.
WOMEN TARGETED
Deepfakes of women and other vulnerable communities such as LGBTQ+ people - especially sexual images and videos - can be particularly dangerous in deeply religious or conservative societies, human rights activists say.
In Bangladesh, deepfake videos of female opposition politicians - Rumin Farhana in a bikini and Nipun Roy in a swimming pool - have emerged ahead of an election on Jan. 7.
And last month, an 18-year-old woman was allegedly shot dead by her father and uncle in a so-called honour killing in Pakistan's remote Kohistan province, after a photograph of her with a man went viral. Police say the image was doctored.
Shahzadi Rai, a transgender member of Pakistan's Karachi Municipal Council, who has been the target of abusive trolling with deepfake images, has said they could exacerbate online gender-based violence and "seriously jeopardise" her career.
Even if audiences are able to distinguish between a real image and a deepfake, the woman's integrity is questioned, and her credibility may be damaged, said Nighat Dad, founder of the non-profit Digital Rights Foundation in Pakistan.
"The threat to women's privacy and safety is deeply concerning," she said, particularly as disinformation campaigns gain steam ahead of an election scheduled for Feb. 8.
"Deepfakes are creating an increasingly unsafe online environment for women, even non-public figures, and may discourage women from participating in politics and online spaces," she said.
In several countries including India, entrenched gender biases already affect the ability of girls and young women to use the internet, a recent report found.
Deepfakes of powerful Bollywood stars only underline the risk that AI poses to all women, said Rajkumar.
"Deepfakes have affected women and vulnerable communities for a long time; they have gained widespread attention only after popular actresses were targeted," she said.
The heightened focus now should push "platforms, policymakers, and society at large to create a safer and more inclusive online environment," she added.
Reuters
Fri Dec 22 2023
The explosion in generative AI tools such as Midjourney, Stable Diffusion and DALL-E has made it easy and cheap to create and circulate convincing deepfakes. - FREEPIK
COP29 climate summit draft proposes rich countries pay $250 billion per year
The draft finance deal criticised by both developed and developing nations.
Bomb squad sent to London's Gatwick Airport after terminal evacuation
This was following the discovery of a suspected prohibited item in luggage.
Kelantan urges caution amidst northeast monsoon rains
Kelantan has reminded the public in the state to refrain from outdoor activities with the arrival of the Northeast Monsoon season.
Former New Zealand PM Jacinda Ardern receives UN leadership award
Former New Zealand prime minister Jacinda Ardern was given a global leadership award by the United Nations Foundation.
ICC'S arrest warrants for Netanyahu, Gallant an apt decision - PM
The decision of the ICC to issue arrest warrants against Benjamin Netanyahu and Yoav Gallant is apt, said Datuk Seri Anwar Ibrahim.
KTMB provides two additional ETS trains for Christmas, school holidays
KTMB will provide two additional ETS trains for the KL Sentral-Padang Besar route and return trips in conjunction with the holidays.
BNM'S international reserves rise to USD118 bil as at Nov 15, 2024
Malaysia's international reserves rose to US$118.0 billion as at Nov 15, 2024, up from US$117.6 billion on Oct 30, 2024.
Findings by dark energy researchers back Einstein's conception of gravity
The findings announced are part of a years-long study of the history of the cosmos focusing upon dark energy.
NRES responds to Rimbawatch press release on COP29
The Ministry of Natural Resources and Environmental Sustainability (NRES) wishes to offer the following clarifications to the issues raised.
Online Safety Bill and Anti-Cyberbullying Laws must carefully balance rights and protections
The Online Safety Advocacy Group (OSAG) stands united with people in Malaysia in the fight against serious online harms.
Malaysia's inflation at 1.9 pct in Oct 2024 - DOSM
Malaysia's inflation rate for October 2024 has increased to 1.9 per cent, up from 1.8 per cent in September this year.
Saudi Arabia showcases Vision 2030 goals at Airshow China 2024
For the first time, Saudi Arabia is participating in the China International Aviation & Aerospace Exhibition held recently in Zhuhai.
King Charles' coronation cost GBP 71mil, govt accounts show
The coronation of Britain's King Charles cost taxpayers GBP72 million (US$90 million), official accounts have revealed.
Couple and associate charged with trafficking 51.9 kg of meth
A married couple and a man were charged in the Magistrate's Court here today with trafficking 51.974 kilogrammes of Methamphetamine.
PDRM to consult AGC in completing Teoh Beng Hock investigation
The police may seek new testimony from existing witnesses for additional insights into the investigation of Teoh Beng Hock's death.
Thai court rejects petition over ex-PM Thaksin's political influence
Thailand's Constitutional Court rejects a petition seeking to stop Thaksin Shinawatra from interfering in the running the Pheu Thai party.
Abidin takes oath of office as Sungai Bakap assemblyman
The State Assemblyman for Sungai Bakap, Abidin Ismail, was sworn in today at the State Assembly building, Lebuh Light.
UPNM cadet officer charged with injuring junior, stomping on him with spike boots
A cadet officer at UPNM pleaded not guilty to a charge of injuring his junior by stomping on the victim's stomach with spike boots.
How Indian billionaire Gautam Adani's alleged bribery scheme took off and unraveled
The indictment was unsealed on Nov. 20, prompting a $27 billion plunge in Adani Group companies' market value.
Elon Musk blasts Australia's planned ban on social media for children
Several countries have already vowed to curb social media use by children through legislation, but Australia's policy could become one of the most stringent.