---
title: AI Is Being Used for Phishing. Now What?
description: Recent reports show that cybercriminals are using AI to facilitate phishing attacks. Read on to learn what’s happening and how to protect yourself.
image: https://shardsecure.com/hubfs/Background%20conceptual%20image%20of%20digital%203d%20icons.jpeg
---

- [Home](https://shardsecure.com/)
- [Blog](https://shardsecure.com/blog)

# AI Is Being Used for Phishing. Now What?

![Picture of ShardSecure](https://shardsecure.com/hubfs/ShardSecure%20brand%20assets/Logo%20(2022)/Profile/ShardSecure-Logo__Profile--Purple-Inverted.svg "Picture of ShardSecure")

[ShardSecure](https://shardsecure.com) 

 May 16 2023 

![A dark background with technology symbols and a camera lens to signify futuristic artificial intelligence (AI) technologies.](https://shardsecure.com/hubfs/Background%20conceptual%20image%20of%20digital%203d%20icons.jpeg "A dark background with technology symbols and a camera lens to signify futuristic artificial intelligence (AI) technologies.")

AI Is Being Used for Phishing. Now What?

Email templates. College essays. Song lyrics. Career advice. These are just a few of the things that new tools like OpenAI’s ChatGPT can produce in a matter of seconds.

Now, though, experts are adding a more dubious achievement to ChatGPT’s impressive resume: phishing and social engineering.

What’s going on? Why are cybercriminals getting a boost from ChatGPT and AI, and what can organizations do to protect themselves? Read on to find out more.

## Attackers get chatty with ChatGPT

According to a new report from the security firm NordVPN, the number of new posts about OpenAI’s chatbot ChatGPT on the dark web grew over 600% between January and February this year. NordVPN described these topics as “[the dark web’s hottest topic](https://www.independent.co.uk/tech/chatgpt-dark-web-hackers-ai-b2292846.html).”

That’s because, Europol warns, ChatGPT’s ability to draft highly realistic written text makes it a [useful tool for phishing](https://www.reuters.com/technology/europol-sounds-alarm-about-criminal-use-chatgpt-sees-grim-outlook-2023-03-27/) and social engineering.

In phishing attacks, attackers use social engineering — personalized, authentic-sounding messages — to trick people into downloading malware. This method, while effective, is usually [time-consuming to execute](https://ifamagazine.com/article/dark-web-criminals-plot-chatgpt-takeover-with-625-rise-in-bot-hacking-posts/). 

Now, though, attackers can use chatbots to expedite their efforts, churning out emails and SMS text messages in a matter of moments. This allows them to perpetrate scams on an industrial scale in a fraction of the time.

### Flawless grammar and fake logos

Threat actors aren’t just using ChatGPT to draft messages; they’re also using it to provide improved grammar and a more natural writing style. This enhances their writing and makes their messages more plausible, increasing the chance that their victim will be fooled.

Cybercriminals are also using AI tools to create credible-looking logos and other graphics for their phishing campaigns. It’s now easy to create content featuring fake logos to impersonate trusted organizations and trick users into clicking on malicious links.

## Other AI-assisted cybercrimes

Beyond phishing, there’s a wide range of other cybercrimes that are getting a boost from artificial intelligence. One threat actor described using ChatGPT to help code up features of a dark web marketplace, including a cryptocurrency value monitoring system. Others are using the tool to generate convincing personas and even [automate small talk](https://www.forbes.com/sites/thomasbrewster/2023/01/06/chatgpt-cybercriminal-malware-female-chatbots/?sh=722340a95534) for dating scams.

Below, we’ll cover a few of the top AI-assisted vectors that are emerging.

### Using chatbots to recreate malware

In addition to facilitating social engineering, AI can offer suggestions for creating new malware. This significantly reduces the barrier to entry for threat actors lacking programming abilities or technical expertise.

For instance, even with just a rudimentary knowledge of cybersecurity and computer science, attackers can now use chatbots to create basic malware. Experiments have already shown that [ChatGPT can successfully replicate known malware strains](https://virtualizationreview.com/articles/2023/03/14/chatgpt-dark-web.aspx) pulled from the dark web.

Other experiments have used ChatGPT to replicate malware described in cybersecurity research publications — including a Python-based stealer that conducts searches for common file types, duplicates them into a random folder within the Temp folder, compresses them into a ZIP file, and uploads them to a predetermined FTP server.

### Selling stolen chatbot credentials

Some cybercriminals have taken it a step further and are now trading or selling [stolen ChatGPT account credentials](https://www.csoonline.com/article/3693569/stolen-chatgpt-premium-accounts-up-for-sale-on-the-dark-web.html). Others are giving away the account credentials as free advertising, essentially promoting their own ability to steal login information.

Premium account credentials have been in high demand for attackers, as they enable cybercriminals to get around OpenAI’s geofencing restrictions and get unlimited access to ChatGPT. The practice has been on the rise since March 2023 and shows no signs of slowing down.

### Using deepfakes to perpetrate fraud

Cyber attackers are [increasingly using deepfakes](https://www.fastcompany.com/90829233/deepfakes-get-ready-for-phishing-2-0) — that is, videos, images, and voice recordings that have been digitally created or altered with artificial intelligence — to carry out their aims. We’ve already mentioned that these deepfakes can be useful for creating fake business logos in phishing campaigns, but we’re just scratching the surface.

One tactic involves creating deepfake websites that mimic legitimate ones. These malicious websites are designed to closely resemble the genuine sites of reputable businesses, often incorporating identical logos, layouts, and content. Users may enter personal information like login credentials or credit card numbers into these fraudulent platforms, leading to identity theft, financial loss, and data exposure.

Another tactic uses [AI voice cloning](https://www.cbsnews.com/news/ai-scam-voice-cloning-rising/) to impersonate individuals in positions of authority or trust, such as company executives, customer support agents, or even family members. These convincing deepfake voices can be employed in phone calls, voicemails, or even voice-based authentication systems, deceiving victims into revealing sensitive information or compromising account security.

## Protect your data from AI-assisted cyberattacks

With the world of cybercrime evolving as swiftly as the artificial intelligence tools it relies on, companies need to make sure their data is protected.

ShardSecure’s platform offers advanced data security, preventing access by unauthorized users and third parties. Even if an AI-assisted phishing attempt is successful, our technology can help mitigate the impact of malware and ransomware. Our data integrity checks detect when data is altered, and our self-healing feature transparently reconstructs that data to its earlier state in real-time.

Additionally, with our innovative, agentless approach to file-level protection, we’re able to protect unstructured data with [no performance hit and no agents](https://shardsecure.com/solutions/advanced-file-level-protection). We also offer strong data resilience and high availability for outages, attacks, and other unexpected disruptions.

To learn more about our platform, visit our [solutions page](https://shardsecure.com/solutions/our-solutions).

### Sources

[ChatGPT Is Dark Web’s ‘Hottest Topic’ as Criminals Look To Weaponise AI | The Independent](https://www.independent.co.uk/tech/chatgpt-dark-web-hackers-ai-b2292846.html)

[Europol Sounds Alarm About Criminal Use of ChatGPT, Sees Grim Outlook | Reuters](https://www.reuters.com/technology/europol-sounds-alarm-about-criminal-use-chatgpt-sees-grim-outlook-2023-03-27/)

[Dark Web Criminals Plot ChatGPT Takeover — With 625% Rise in ‘Bot Hacking’ Posts | IFA](https://ifamagazine.com/article/dark-web-criminals-plot-chatgpt-takeover-with-625-rise-in-bot-hacking-posts/)

[Armed With ChatGPT, Cybercriminals Build Malware And Plot Fake Girl Bots | Forbes](https://www.forbes.com/sites/thomasbrewster/2023/01/06/chatgpt-cybercriminal-malware-female-chatbots/)

[Hacking ChatGPT: ‘The Dark Web's Hottest Topic’ | Virtualization Review](https://virtualizationreview.com/articles/2023/03/14/chatgpt-dark-web.aspx)

[Stolen ChatGPT Premium Accounts up for Sale on the Dark Web | CSO Online](https://www.csoonline.com/article/3693569/stolen-chatgpt-premium-accounts-up-for-sale-on-the-dark-web.html)

[Deepfakes: Get Ready for Phishing 2.0 | Fast Company](https://www.fastcompany.com/90829233/deepfakes-get-ready-for-phishing-2-0)

[Cybercriminals Are Using AI Voice Cloning Tools To Dupe Victims | CBS](https://www.cbsnews.com/news/ai-scam-voice-cloning-rising/)

[AI and machine learning](https://shardsecure.com/blog/tag/ai-and-machine-learning)

## Read on

![](https://shardsecure.com/hubfs/Picture2.jpg)

June 15 2026

### [ShardSecure MCP Secure Gateway](https://shardsecure.com/blog/shardsecure-mcp-secure-gateway-identity-aware-data-redaction-and-least-privilege-context-enrichment-for-ai-inference)

[Read more](https://shardsecure.com/blog/shardsecure-mcp-secure-gateway-identity-aware-data-redaction-and-least-privilege-context-enrichment-for-ai-inference)

![](https://shardsecure.com/hubfs/Keyboard%20with%20high%20tech%20user%20map%20icons%20and%20symbols-1.jpeg)

February 18 2026  | [Cloud](https://shardsecure.com/blog/tag/cloud)

### [Unstructured Data Left Exposed: A Cloud Breach That Should Worry Every Enterprise](https://shardsecure.com/blog/unstructured-data-left-exposed-a-cloud-breach-that-should-worry-every-enterprise)

[Read more](https://shardsecure.com/blog/unstructured-data-left-exposed-a-cloud-breach-that-should-worry-every-enterprise)

![](https://shardsecure.com/hubfs/Keyboard%20with%20high%20tech%20user%20map%20icons%20and%20symbols-1.jpeg)

November 12 2025  | [Cloud](https://shardsecure.com/blog/tag/cloud)

### [Can You Really Trust Hyperscalers with Your Data at Rest?](https://shardsecure.com/blog/can-you-really-trust-hyperscalers-with-your-data-at-rest)

[Read more](https://shardsecure.com/blog/can-you-really-trust-hyperscalers-with-your-data-at-rest)

![](https://shardsecure.com/hubfs/AI-Generated%20Media/Images/Acronis%20and%20ShardSecure%20unveil%20a%20groundbreaking%20technology%20partnership%20set%20against%20a%20backdrop%20of%20a%20sleek%20modern%20office%20filled%20with%20digital%20screens%20displaying%20dynamic%20data%20flows%20The%20atmosphere%20buzzes%20with%20excitement%20and%20anticipation%20illuminated%20by%20sof-1.png)

October 16 2025  | [Cloud](https://shardsecure.com/blog/tag/cloud)

### [Acronis + ShardSecure: Stronger data protection for modern threats](https://shardsecure.com/blog/acronis-shardsecure-stronger-data-protection-for-modern-threats)

[Read more](https://shardsecure.com/blog/acronis-shardsecure-stronger-data-protection-for-modern-threats)

![](https://shardsecure.com/hubfs/AI-Generated%20Media/Images/The%20image%20portrays%20a%20hightech%20digital%20landscape%20filled%20with%20abstract%20representations%20of%20data%20security%20concepts%20At%20the%20forefront%20a%20glowing%20vault%20symbolizing%20advanced%20filelevel%20encryption%20stands%20tall%20surrounded%20by%20intricate%20patterns%20of%20fragmented%20data.png)

October 1 2025  | [Data Sensitivity](https://shardsecure.com/blog/tag/data-sensitivity)

### [Revolutionizing Data Security: How Agentless File Level Encryption Makes Stolen Data Useless](https://shardsecure.com/blog/sensitive_data)

[Read more](https://shardsecure.com/blog/sensitive_data)

![unstructured data](https://shardsecure.com/hubfs/Digital%20image%20of%20globe%20with%20conceptual%20icons.%20Globalization%20concept.jpeg)

September 15 2025  | [Cybersecurity News](https://shardsecure.com/blog/tag/cybersecurity-news)

### [Elevating unstructured data security: ShardSecure® and Entrust® Join Forces!](https://shardsecure.com/blog/entrust_partnership)

[Read more](https://shardsecure.com/blog/entrust_partnership)

![](https://shardsecure.com/hubfs/AI-Generated%20Media/Images/scales%20%20ransomware%20attack%20to%20pay%20the%20money%20or%20risk%20the%20attack.jpeg)

July 29 2025  | [Ransomware](https://shardsecure.com/blog/tag/ransomware)

### [CISOs on Strategic Considerations in Ransomware Response](https://shardsecure.com/blog/ransomware-fine)

[Read more](https://shardsecure.com/blog/ransomware-fine)

![](https://shardsecure.com/hubfs/AI-Generated%20Media/Images/Image%20for%20AI%20data%20types-1.jpeg)

July 29 2025  | [Data security](https://shardsecure.com/blog/tag/data-security)

### [The Growth of AI is driving the Imperative of Securing Unstructured Data](https://shardsecure.com/blog/ai-unstructured-data)

[Read more](https://shardsecure.com/blog/ai-unstructured-data)

![](https://shardsecure.com/hubfs/AI-Generated%20Media/Images/The%20image%20depicts%20a%20hightech%20digital%20landscape%20showcasing%20a%20sleek%20modern%20office%20environment%20illuminated%20by%20soft%20blue%20and%20white%20lighting%20In%20the%20foreground%20a%20large%20computer%20screen%20displays%20intricate%20graphs%20and%20charts%20related%20to%20data%20security%20while%20a%20gr.jpeg)

July 22 2025  | [Data security](https://shardsecure.com/blog/tag/data-security)

### [How to make your SharePoint data of zero value in a zero day attack!](https://shardsecure.com/blog/sharepoint_breach)

[Read more](https://shardsecure.com/blog/sharepoint_breach)

[![ShardSecure®](https://shardsecure.com/hubfs/ShardSecure%20brand%20assets/Logo%20(2022)/ShardSecure-Logo__Horizontal--White.svg "ShardSecure®")](https://shardsecure.com/)

101 Avenue of the Americas, 9th Floor, New York, NY 10013, United States of America

[![linkedin](https://shardsecure.com/hubfs/_2023/li.svg) ](https://www.linkedin.com/company/shardsecure) [![tweeter](https://shardsecure.com/hubfs/_2023/tweeter.svg) ](https://www.twitter.com/ShardSecure) [![facebook](https://shardsecure.com/hubfs/_2023/facebook.svg) ](https://www.facebook.com/ShardSecure/) [![facebook](https://shardsecure.com/hubfs/_2023/youtube.svg) ](https://www.youtube.com/@shardsecure877)

© 2026 ShardSecure®. All rights reserved.   
[Privacy Policy](https://shardsecure.com/privacy-policy)

![websights](https://ws.zoominfo.com/pixel/62e7bb6d62a6b2008e071c83) ![](https://px.ads.linkedin.com/collect/?pid=5456580&fmt=gif)

```json
{
  "@context" : "https://schema.org",
  "@type" : "BlogPosting",
  "author" : {
    "@type" : "Person",
    "name" : "ShardSecure",
    "url" : "https://shardsecure.com/blog/author/shardsecure"
  },
  "dateModified" : "2023-05-18T05:08:03.162Z",
  "datePublished" : "2023-05-16T12:06:00.000Z",
  "headline" : "AI Is Being Used for Phishing. Now What?",
  "image" : [ "https://shardsecure.com/hubfs/Background%20conceptual%20image%20of%20digital%203d%20icons.jpeg" ],
  "mainEntityOfPage" : {
    "@id" : "https://shardsecure.com/blog/ai-phishing",
    "@type" : "WebPage"
  },
  "publisher" : {
    "@type" : "Organization",
    "logo" : {
      "@type" : "ImageObject",
      "url" : "https://shardsecure.com/hubfs/ShardSecure-Logo__Horizontal--Purple-Inverted.svg"
    },
    "name" : "ShardSecure"
  }
}
```