Beyond the Hype: Research on How Cybercriminals Are Really Using GenAI
summary
Trend Micro research finds one genuine criminal LLM attempt — WormGPT trained on GPT‑Neo‑J, launched March–June 2023 then shut down Aug 8 — while most underground “GPT” offers are scams or short-lived. Criminals more often integrate mainstream models (OpenAI) into tools like Go Mail Pro and Predator 2 for phishing, and buy Jailbreak‑as‑a‑Service (EscapeGPT, LoopGPT via FlowGPT UIs). Deepfakes show economics: KYC‑bypass services for ~$70 and professional video services $10–$400/min; audio deepfakes effective for targeted extortion and CEO‑style fraud. Strengthen processes and awareness.
AI-written summary · about
chapters (26)
- 0:00Welcome
- 1:26GenAI hype vs criminal reality
- 3:31Rapid evolution of large language models
- 6:44Criminal AI-generated code
- 8:08Underground criminal LLMs
- 13:08Jailbreak services
- 19:24Top cybercrime activities 2023
- 20:27Pig butchering scam AI
- 21:52State actors using GenAI
- 23:15Deepfakes beyond faces
- 24:20KYC bypass deepfake services
- 26:47Video deepfakes effectiveness
- 27:49Audio deepfakes in scams
- 30:17Criminal tech adoption rules
- 31:43Deepfake and AI threats summary
- 33:59Q&A
- 34:20Fraud prevention with deepfakes
- 35:23Social engineering protection
- 37:27Detecting AI media
- 39:11Executive process strengthening
- 41:42Political deepfake risks
- 43:48Identity verification limits
- 45:35Property deed fraud deepfakes
- 46:58Future threats: poisoning & injection
- 49:24Voice synthesis dangers
- 50:07Closing
related talks
51mThe Great Brain Robbery: Navigating the Dark Future of Online Manipulation
46mGenerative AI: Cyber resiliency and risk
17mWhat You Need to Know and How to Respond to the New Wave of GenAI Identity Attacks
49mChatGPT: A New Generation of Dynamic Machine Based Attacks?
30mBattling the Machine: Cutting-Edge Attacks and Defenses in Generative AI
55mMore Tales from the Dark Side: How AI is the Bad Guys New Friend
11mHow to Navigate Emerging AI-Driven Security
49mGenAI and Cybersecurity: Safeguarding the Digital Age
