AI Identity Heist: The Dangers of Deep Fakes
Written by: Ashley Budiman
In our digital age, the rise of artificial intelligence is inevitable. Among the most alarming applications of AI are deepfakes. Deepfakes (a portmanteau of 'deep learning' and 'fake') are manipulated images, videos, or audio generated using artificial intelligence tools, depicting both real and fictional individuals. As the technology becomes increasingly accessible, the potential for misuse raises serious ethical and security concerns.
In January, an audio clip surfaced, allegedly featuring what appeared to be a local school principal making derogatory comments, which quickly went viral. The principal, Eric Eiswert, was placed on paid administrative leave while an investigation took place. However, it was revealed that the audio was a deepfake created by the school’s athletics director, Dazhon Darien, who had been under investigation by the principal over an alleged theft of $1,916. But despite knowing Eric had been wrongly accused, the damage had already been done. The clip left a lasting impression on those who had genuine experiences of racism and discrimination, affecting the principal’s reputation and the community’s trust.
Another alarming case happened around the same time involving Arup, the British multinational design and engineering company behind world-famous buildings such as the Sydney Opera House. The company fell victim to a deepfake scam that resulted in one of its Hong Kong employees transferring $25 million to fraudsters. The finance worker was duped into attending a video call with people he believed to be the chief financial officer and other staff members, all of whom turned out to be deepfake recreations. Due to the people in attendance looking and sounding exactly the same as the colleagues he recognized, he was led to send a total of 200 million Hong Kong dollars, showing how effectively technology can manipulate trust.
It is not only individuals in positions of power or institutions that face this problem; celebrities are also subjected to this issue. The record-breaking singer-songwriter Taylor Swift has faced several deepfake scams herself, with the most prominent situation being the inappropriate figurine made from her likeness in Kanye West’s music video “Famous” during their longtime feud. In another instance, the Met Gala photos of Rihanna, Lady Gaga, Dua Lipa, and Katy Perry—all of whom did not attend the 2024 event—circulated online, alluding to their presence at the event. The fabricated images were so realistic that it made sense that the masses were fooled. Even Katy Perry’s mother was tricked, sending her heartfelt congratulations to her daughter, only for Perry to deny her presence.
These situations highlight the dangers of deepfake technology. Deepfakes can weaken trust in digital media, making it difficult for individuals to discern between real and manipulated content. This erodes personal relationships and public confidence in media, institutions, and even democratic processes. Developing tools for detection, implementing strict regulations, and promoting digital literacy are crucial steps in mitigating the dangers posed by deepfakes. As we navigate through this digital era, knowing the consequences of deepfakes will be vital for protecting our identities and preserving trust in our digital relationships.
Sources:
Spring, M. (2024, October 4). The AI clip that convinced - and divided - a Baltimore suburb. https://www.bbc.com/news/articles/ckg9k5dv1zdo
Magramo, K. (2024, May 17). British engineering giant Arup revealed as $25 million deepfake scam victim. CNN. https://edition.cnn.com/2024/05/16/tech/arup-deepfake-scam-loss-hong-kong-intl-hnk/index.html
Mah, E. (2024, August 28). From Taylor Swift to Piers Morgan: Scandals, victims, and shocking celebrity deepfakes. Prestige Online - Malaysia. https://www.prestigeonline.com/my/lifestyle/culture-plus-entertainment/celebrity-deepfakes-victims-scandal-taylor-swift-piers-morgan-oprah-winfrey/#:~:text=Celebrity%20deepfakes%20take%20public%20figures,videos%2C%20images%2C%20or%20audio.