Can You Trust Your Ears? Artificial Intelligence Voice Scams Cause Shockwaves

2023-06-13

The sound on the phone seemed terrifyingly real - an American mother heard her daughter sobbing, followed by a man taking over the call and demanding ransom. The girl was just an AI clone, and the kidnapping was fake. Experts say the biggest danger of artificial intelligence is its ability to blur the line between reality and fiction, providing cybercriminals with a cheap and effective technology to spread false information. In a new type of scam, fraudsters use highly convincing AI voice cloning tools - widely available online - to deceive people by impersonating family members and extorting money from them. "Help me, Mom, please help me," said a voice on the other end of the phone, according to Jennifer DeStefano, a mother from Arizona. DeStefano "100%" believed it was her 15-year-old daughter in deep distress during a skiing trip. "It was completely her voice... that's how she cries," DeStefano told a local TV station in April. "I never doubted it was her." The scammer who answered the call came from an unfamiliar number to DeStefano and demanded a ransom of up to $1 million. After contacting her daughter, DeStefano quickly realized it was a hoax, and the AI-driven scam was exposed within minutes. However, this alarming case highlights the potential for cybercriminals to abuse AI voice cloning. The case is currently under investigation by the authorities. "AI voice cloning is now almost indistinguishable from human voices, enabling threat actors like scammers to extract information and funds more effectively from victims," said Wasim Khaled, CEO of Blackbird.AI. A simple internet search yields various applications, many of which are freely available, that can create AI voices using small samples of a person's real voice, sometimes just a few seconds long. These voices can be easily stolen from content posted online. "With a small audio sample, AI voice cloning can be used for leaving voice messages and voice texts. It can even be used as a real-time voice converter during phone calls," Khaled said. "Scammers can use different accents, genders, and even mimic the speaking patterns of loved ones. This technology can create convincing counterfeits." In a global survey of 7,000 people across nine countries, including the United States, a quarter of respondents said they had experienced AI voice cloning scams or knew someone who had. A survey released last month by McAfee Labs in the United States showed that 70% of respondents said they did not believe they could "tell the difference between cloned voices and real voices." US officials have warned of the rising trend of the "grandparent scam," in which an imposter pretends to be a grandchild in urgent need of money. "You get a call, and you hear a panicked voice on the other end—it's your grandchild. They say they're in trouble—a car accident, or they're locked up in jail. But you can help them, just send money," warned the Federal Trade Commission in a March alert. "It sounds just like them. How could it be a scam?" AI voice cloning is the answer. Multiple testimonies from elderly victims were shared in the comments below the Federal Trade Commission's warning. This also reflects the experience of Eddie, a 19-year-old from Chicago, whose grandfather received a call from someone who sounded just like him, claiming to need money after a car accident. According to McAfee Labs, the scam was so convincing that his grandfather urgently started raising funds before the lie was uncovered, even considering remortgaging his house. "Because it's now easy to generate highly realistic voice clones... almost anyone with an online presence is vulnerable to these attacks," said Hany Farid, a professor at the University of California, Berkeley School of Information. "These scams are gaining attention and spreading." Earlier this year, AI startup ElevenLabs admitted that its voice cloning tool could be abused for "malicious purposes" after a user posted a deepfake audio claiming to be actress Emma Watson reading Adolf Hitler's autobiography, "Mein Kampf." "We're rapidly approaching an era where you can't trust what you see on the internet," said Gal Tal-Hochberg, CTO of venture capital firm Team8. "We need new technologies to verify that the person you think you're talking to is really who you think they are," he said. Source: https://techxplore.com/news/2023-06-ears-ai-voice-scams-rattle.html

RECENT AI NEWS

RECENT AI TOOLS