Close this search box.

Dark web criminals plot ChatGPT takeover


The race to use ChatGPT for cybercrime has sparked a sevenfold rise in hackers discussing how to manipulate the chatbot online.

The number of new posts on dark web forums about the AI tool surged from 120 in January to 870 in February, 625 per cent increase, according to research by cybersecurity firm NordVPN.

Forum threads on ChatGPT rose 145 per cent from 37 to 91 in a month as exploiting the bot became the dark web’s hottest topic.

Many threads in early January focused on how bad actors could encourage ChatGPT to produce basic malware, a vulnerability its creator OpenAI has since addressed.

A month on, the trend among the hacker community is for more aggressive action, with posts outlining plans to take control of the chatbot and use it to wreak havoc.

Titles on the dark web forum (which is hidden from normal search engines and visited by anonymous hackers across the world) include How to break ChatGPT, ChatGPT jailbreak 2.0, ChatGPT – progression of malware and ChatGPT as a phishing tool. 

With ChatGPT in their corner, criminals could take advantage of its artificial intelligence to conduct fraud, like romance scams, on an industrial scale, targeting multiple victims simultaneously. 

Once a hacker has taken over the chatbot they can remove its safety restrictions, using it to create malware and phishing emails, promote hate speech, or even spread propaganda.

Chatbots like ChatGPT can make our lives easier in many ways, like performing mundane written tasks, summarising complex subjects or suggesting a holiday itinerary,” said Marijus Briedis, a cybersecurity expert at NordVPN. “For cybercriminals, however, the revolutionary AI can be the missing piece of the puzzle for a number of scams.  

“Social engineering, where a target is encouraged to click on a rogue file or download a malicious program through emails, text messaging or online chats, is time-consuming for hackers. Yet once a bot has been exploited, these tasks can be fully outsourced, setting up a production line of fraud.

“ChatGPT’s use of machine learning also means scam attempts like phishing emails, often identifiable through spelling errors, can be improved to be more realistic and persuasive.

“Worryingly, in the last month discussions on the dark web have evolved from simple ‘cheats’ and workarounds designed to encourage ChatGPT to do something funny or unexpected into taking complete control of the tool and weaponising it.”

ChatGPT is the fastest-growing app in the world and reached 100 million users in two months. Its AI technology is being trialled by Microsoft with the aim of enhancing its Bing search engine.

NordVPN recommends the following tips for keeping chatbots in check:

Don’t get personal. AI chatbots are designed to learn from each conversation they have, improving their skills at “human” interaction, but also building a more accurate profile of you that can be stored. If you’re concerned about how your data might be used, avoid telling them personal information.

Plenty of phishing. Artificial intelligence is likely to offer extra opportunities for scammers online and you can expect an increase in phishing attacks as hackers use bots to craft increasingly realistic scams. Traditional phishing hallmarks like bad spelling or grammar in an email may be on the way out,  so instead check the address of the sender and look for any inconsistencies in links or domain names.

Use an antivirus. Hackers have already successfully manipulated chatbots to create basic malware, so it’s worth having a tool like Threat Protection, which can alert you to suspicious files and keep you safe if you download them.  

CTS The industrialisation of IT
CTS - Industrialisation of IT
Related Posts
CTS The industrialisation of IT
Others have also viewed

UK businesses see boosting connectivity as integral to growth

Study reveals a great opportunity for alternative network providers (AltNets) to meet growing demand for ...

Germany Energy Efficiency Act demonstrates importance of data centre supply chain collaboration

Following the signing into law of Germany’s Energy Efficiency Act (EnEfG), energy solutions specialist Aggreko ...

Systemair look to Infor’s cloud solution to deliver more sustainable products

Systemair is moving its core business system to Infor CloudSuite Manufacturing, aiming at smoother integration ...
Data Centre

Vertiv collaborates with Intel on liquid cooled solution

Vertiv is collaborating with Intel to provide a liquid cooling solution that will support the ...