Yes Scam: Voice Cloning Risks

Written by Alessio on 12/5/2025

The Context

Generative AI has lowered the barrier for voice cloning to the point where it is now a commercially viable tool for scammers. Attackers can mimic the voice of a loved one in distress with high accuracy to bypass skepticism. The most effective defense against this digital threat is a simple human agreement: establishing a Safe Word with your family today that only you know.

My Perspective

The scenario I want to warn you about is a nightmare: the phone rings, and you hear your child or partner crying, claiming they've been in an accident and need an immediate wire transfer for hospital bills. The sheer panic overrides your critical thinking faculties. But the voice is fake, generated by AI models trained on as little as three seconds of audio scraped from Instagram or TikTok.

The Technology of Deception

Modern Text-to-Speech (TTS) models have evolved beyond robotic monotones. They can now capture timbre, cadence, and emotional inflection. This allows criminals to automate the "Grandparent Scam," scaling it from text messages to believable audio impersonations used in financial fraud.

The Analog Defense: Safe Word

Technology created this vulnerability, but paradoxically, it cannot solve it. The solution is human.
Agree on a Safe Word (e.g., "Purple Hippo") with your inner circle. If you receive a distress call, ask for the word. An AI, no matter how advanced, cannot know a secret that exists only in your shared memory. If the caller hesitates or makes excuses ("I can't think right now!"), hang up.

The "Yes" Trap

Separately, automated bots call numbers looking for a human "Yes" that can
be used to fraudulently authorize verbal contracts or charges. To protect
myself, I follow a simple protocol: when answering an unknown number, I
stay silent and wait for the caller to speak first, which usually breaks the
bot's script. If I have any doubt about who is on the other end, I hang up
immediately and call my loved one back on their known number saved in my
contacts to verify their identity.

References