PREDICTIVE TREND INSIGHT
Detecting synthetic voice clones in corporate video call operating procedures Illustration

Detecting synthetic voice clones in corporate video call operating procedures

Direct Summary:

In February 2024, an employee at the engineering firm Arup wired $25 million after joining a video call where every other "colleague" — including a deepfake of the CFO — was AI-generated. That's the real-world bar detection needs to clear: the deepfakes looked and sounded right to someone who knew the people. Software like Pindrop or Resemble AI can flag statistical artifacts in synthetic audio, but the more dependable corporate defense is procedural — treating money-moving or credential-reset requests as "vault actions" that require independent, out-of-band verification regardless of how convincing the call looks or sounds.

"The best way to predict the future is to invent it."

— Alan Kay

Key Insights

  • This already happened at scale: the Arup deepfake scam. A Hong Kong employee of the UK engineering firm Arup made 15 wire transfers totaling $25 million after a video call where every "colleague," including the CFO, was an AI-generated deepfake — confirmed by Arup and reported by CNN and Fortune.
  • Detection software isn't a solved problem. Vendors like Pindrop and Resemble AI use neural networks to flag statistical artifacts (unnatural frequency patterns, inconsistent background noise) in synthetic audio, but detection tools lag generation tools, and compressed phone-quality audio is a known weak point for every tool tested.
  • The reliable defense is procedural, not technical: classify requests by risk (a status check vs. a wire transfer or credential reset) and require independent, out-of-band verification for the high-risk category — a callback on a known number, a second approver — regardless of how convincing the call sounds.

The Arup case is the reference point for why this matters: it wasn't a phishing email with bad grammar, it was a live video call where the fraudsters had recreated the appearance and voice of real colleagues the employee already knew, well enough that he proceeded with 15 separate wire transfers before anyone flagged it. Detection tools exist, but the more durable fix companies are converging on isn't a better detector — it's changing what a convincing call is allowed to do on its own.

What actually stops this

1. Treat detection software as one signal, not a gate. Vendors such as Pindrop and Resemble AI apply neural networks (CNNs, RNNs, transformer-based models) to audio to flag synthetic markers — unnatural frequency patterns, inconsistent breathing or background noise, digital artifacts a human ear misses. These tools report high accuracy on clean audio, but industry testing has found real-world degradation on compressed, phone-quality calls, and detection capability generally trails generation capability. Useful as a layer; not something to rely on alone for a high-stakes decision.

2. Classify requests by risk, not by how the call feels. The practical framework used in contact-center security treats routine requests (status checks, appointment changes) as low-risk and fast, while irreversible or high-value actions — wire transfers, credential resets, account-ownership changes — are "vault actions" that get a mandatory pause and independent verification, no matter how legitimate the caller sounds or how senior they claim to be.

3. Make an independent callback the actual control, not a suggestion. For any request in the high-risk category, the person receiving it should verify it separately — call the requester back on a number already on file, or route it through a second approver — before acting. In the Arup case, the fraud was only caught because someone eventually called Arup's real headquarters to double check; making that step mandatory upfront, rather than optional and after the fact, is the actual fix.

Request type Risk tier Required verification
Status update, meeting scheduling, general Q&A Low None beyond normal call handling
Password reset, minor account change Medium Light verification (existing security question, known device)
Wire transfer, credential reset for financial systems, ownership change High ("vault action") Mandatory independent callback on a known number or a second human approver — required regardless of how convincing the request seems

The uncomfortable but accurate framing from contact-center security research is that most deepfakes on record weren't caught by anyone listening closely enough to notice — they were caught, if at all, by someone noticing the requested action didn't fit the normal pattern and independently double-checking. That's a process a company can actually control, unlike the ongoing arms race between voice generation and voice detection.

Practical Challenge

List your team's five most sensitive recurring requests (wire approvals, credential resets, vendor payment changes) and write down what independent, out-of-band verification step each one currently requires — if the answer is "none," that's the gap to close first.

Concept Check

In the Arup deepfake case, what ultimately allowed $25 million to be transferred before the fraud was caught?
Correct! The deepfakes were convincing enough that the employee acted on the call itself; the fraud was only caught later when someone independently contacted Arup's real headquarters — the verification step that should have happened before the transfers, not after.
Incorrect. Try again! No detection software rejected the call in this case — the case is notable precisely because the deepfakes were convincing enough that the failure was a missing independent-verification step, not a technical alarm being ignored.

Sources & Further Reading

Previous Guide Dashboard Back to Courses