Recently, I received an email from an elderly friend who is quite tech-savvy. The email simply read:

[Subject:] Are you there

Hi,

Can I ask a quick favour from you, please?

Thanks [Person's Name]

Typically, I would expect them to include my name after “Hi”, but that isn’t always the case. At the time, I was preoccupied with work, so I didn't think much of it. The email appeared to come from their address, and my reply also went to that same address, which is my usual precaution against scams.

Initially, it landed in my junk folder, making me question its authenticity. However, since my friend had recently acquired a new computer, I wondered if it was a settings issue. Since my response was directed back to their account, I figured it posed no real risk. After all, they might genuinely need assistance, like taking out their garbage while they were away.

I replied with:

Hi [Person's Name],

Did you send this? It went into my junk folder.

I’m in the office today, but happy to help if I can.

Paddy

The next response raised my suspicions:

Thanks for your quick response. It's my niece’s birthday, and I need to get her a Google Play Voucher as a gift. However, I'm facing issues purchasing online while traveling. Can you help me get it at any supermarket nearby, like Sainsbury's or Tesco? I promise to pay you back as soon as I'm back. Please let me know if you can handle this on my behalf.

Thanks, [Person's Name]

At this point, numerous red flags indicated that this was indeed a scam. I quickly texted my friend, who confirmed that their account had been compromised. Thankfully, I hoped none of their other contacts had fallen victim to this scheme.

Such scams are increasingly common, but this was the first time I encountered one that seemed convincing from the onset. Working in technology, I usually consider myself adept at spotting warning signs. Most scams I receive come from the correct name but a different email address, as was the case here.

It makes me wonder: how many individuals actually fall for these scams? They must yield some profit; otherwise, scammers wouldn’t continue their efforts. This particular scam was for a relatively small amount, but still more than I knew my friend would typically spend on a gift. A request for £20 or £50 might have seemed more plausible, but would it have been worth the scammer’s time?

This experience prompted me to reflect on advancements in Artificial Intelligence, specifically Machine Learning, and how future scams could become even more convincing. My intention isn’t to instill fear but to provoke thought on potential scenarios and how we can better protect ourselves against such threats.

Many of us have likely heard of text messages claiming to be from a loved one who "lost their phone," prompting a different number. While some might fall for this, it often requires specific circumstances to align. For instance, if a message came from a grown child living away, and when you try to call back, they don’t answer (or their phone is off), panic can lead to rash decisions that one wouldn’t normally make. These scenarios are not uncommon. The instinct to help a child in distress can easily override caution.

Most individuals wouldn’t fall for such scams. There are usually clues, or a pre-established emergency "pass-phrase" that could identify a genuine message. I strongly recommend setting this up in advance.

The fact that the message doesn’t come from your child’s number should immediately raise suspicion. However, imagine receiving a voicemail from your child’s actual voice, expressing fear and needing help, unable to answer the phone because "someone might hear it." This is where AI and ML present a concerning possibility. Technologies now exist that can learn and replicate voices. A simple search reveals:

Even if the call comes from a different number, you might believe you’re speaking to your child while someone on the other end is manipulating messages, or even real-time voice changes to sound like them.

This technology is currently available. Looking ahead, real-time video manipulation may soon follow. While deepfake videos exist, they require significant processing power, making them less believable for immediate scenarios. However, in the near future, the ability to see and hear a familiar face asking for help could become a reality. Who wouldn't rush to assist in such a situation?

What does AI think about it?

Out of curiosity, I asked ChatGPT for its perspective on how AI might influence future scams, and here’s what it shared:

> The rise of AI can have both positive and negative effects on the future of people being scammed. On one hand, AI can be used to develop sophisticated fraud detection systems that identify and prevent scams more effectively. These systems can analyze patterns, detect anomalies, and identify fraudulent activities on a scale and speed beyond human capabilities. This can help reduce the number of successful scams and protect individuals from fraudulent schemes.

> On the other hand, scammers can leverage AI to enhance their techniques, creating more advanced scams. AI algorithms can automate the crafting of convincing phishing emails, deepfake videos, or chatbots mimicking real individuals, complicating the ability to distinguish genuine communications from fraudulent ones. Scammers can also exploit AI's capacity to analyze and predict human behavior to manipulate individuals into revealing sensitive information or conducting financial transactions.

> As AI evolves, the battle will continue between those developing fraud detection systems and those seeking to exploit AI for fraudulent purposes. It’s essential for individuals and organizations to stay informed about emerging scams, remain vigilant in protecting personal information, and utilize security measures to mitigate risks associated with AI-powered scams. Additionally, policymakers and tech companies must collaborate to establish robust regulations and ethical guidelines to prevent the misuse of AI technologies for malicious ends.

Uncomfortable reading, wouldn’t you agree?

So what can we do about it?

This isn’t just about being scammed by someone impersonating your bank or a loan company—always treat such calls with skepticism and return the call using the number you have for them (not the one they provide). This information might be on your bank card or a reputable website (and always verify the URL before trusting a site).

This concern extends to your loved ones, especially if they genuinely need help when you're not nearby.

First, attempt to call the number you have—if they answer and are unaware of any request for help, you’ve been contacted by a scammer. They might not answer, their phone could be off, or their device might be lost or stolen.

Security on a phone is just that—on the phone. It’s easy to remove a SIM card and insert it into another device, allowing a scammer to unlock and utilize it with their software (possibly even changing their voice). If the phone/SIM hasn’t been reported lost or stolen, calls can still be made.

Another concern is that some phone and messaging systems allow configurations that can make a call or message appear to come from any number—this is known as spoofing. Thus, a call could seem to originate from your family member’s phone, and with voice manipulation technology, it could sound like them too.

I don’t aim to frighten anyone, but it’s crucial to understand the technologies at play and to maintain a healthy skepticism about whom you’re communicating with. If something seems off, verify it. It may sound like someone you know, but they could use unfamiliar phrases or express things differently. Ask them questions only they would know the answers to. Establish a unique word or phrase for identification that isn’t easily guessable by a scammer.

Encouraging your loved ones to maintain privacy on social media is vital. They should only allow access to trusted individuals. Moreover, never engage with seemingly harmless social media prompts, like “What’s your porn-star name?”—these often ask for personal security information without you realizing it.

While we cannot predict the future of technology, we can be certain that there will always be individuals eager to scam us out of our hard-earned money.