{"id":22632,"date":"2023-08-07T05:20:56","date_gmt":"2023-08-07T13:20:56","guid":{"rendered":"https:\/\/www.palada.net\/index.php\/2023\/08\/07\/news-16362\/"},"modified":"2023-08-07T05:20:56","modified_gmt":"2023-08-07T13:20:56","slug":"news-16362","status":"publish","type":"post","link":"http:\/\/www.palada.net\/index.php\/2023\/08\/07\/news-16362\/","title":{"rendered":"SophosAI at DEF CON: Orchestrating large-scale scams using text, audio and image generative AI"},"content":{"rendered":"<p><strong>Credit to Author: gallagherseanm| Date: Mon, 07 Aug 2023 11:00:45 +0000<\/strong><\/p>\n<div class=\"entry-content lg:prose-lg mx-auto prose max-w-4xl\">\n<p>Sophos X-Ops usually focuses on how artificial intelligence technologies can be used to enhance cybersecurity. But for a presentation at DEF CON\u2019s AI Village on Saturday, August 12, SophosAI\u2019s Ben Gelman and Younghoo Lee have taken a turn toward the dark side\u2014demonstrating how generative AI can be used to automate the creation of campaigns to steal users\u2019 credentials and other personal information.<\/p>\n<p>As Gelman and Lee note in their abstract for the talk, large language model (LLM) text generation (such as OpenAI\u2019s ChatGPT, Google\u2019s Bard, and Meta\u2019s Llama 2), speech AI (such as Google\u2019s WaveNet) and image generative technologies (such as DALL-E, Stable Diffusion, and Midjourney) have made it possible to create \u201ca new level of diverse, synthetic content\u201d that can deceive on an unprecedented scale.\u201d\u00a0 Scammers have already been observed <a href=\"https:\/\/news.sophos.com\/en-us\/2023\/08\/02\/sha-zhu-pan-scam-uses-ai-chat-to-target-iphone-and-android-users\/\">using LLMs as part of their toolkit<\/a>, to generate text in conversations with victims where fluency in the target\u2019s language may be a barrier, but LLMs can also be used to generate other content\u2014including not just text, but code for websites. Combined with image and audio creation capabilities of other generative AI tools, it\u2019s possible to use AI to generate entire scam campaigns that blur the boundary between reality and fiction.<\/p>\n<p>Gelman and Lee will present on a proof-of-concept for automatically orchestrating credential-stealing scam campaigns\u2014using AI to create code, text, images, and audio to build dozens of websites, product catalogs, testimonials, and social media advertisements. They will also discuss how the barriers to entry have decreased for criminals with a minimal knowledge of AI, and the scale of automation that can be achieved with AI tools\u2014as well as the limitations of the tools that still require human intervention to complete these tasks.<\/p>\n<p>The talk, entitled <a href=\"https:\/\/aivillage.org\/defcon31\/\">The Sinister Synergy of Advanced AI: Automatically Orchestrating Large-Scale Scam Campaigns with Large Generative Models<\/a>, will be presented at 1:30 PM Pacific Time at the AI Village in Caesar\u2019s Forum.<\/p>\n<\/p><\/div>\n<p><a href=\"https:\/\/news.sophos.com\/en-us\/2023\/08\/07\/sophosai-at-def-con-orchestrating-large-scale-scams-using-text-audio-and-image-generative-ai\/\" target=\"bwo\" >http:\/\/feeds.feedburner.com\/sophos\/dgdY<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p><strong>Credit to Author: gallagherseanm| Date: Mon, 07 Aug 2023 11:00:45 +0000<\/strong><\/p>\n<p>AI Village talk highlights how generative \u00a0can be used to automate the creation of fraud campaigns, generating hundreds of fraudulent sites.<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"colormag_page_container_layout":"default_layout","colormag_page_sidebar_layout":"default_layout","footnotes":""},"categories":[10378,10377],"tags":[29912,27031,13312,29835,28950,29913],"class_list":["post-22632","post","type-post","status-publish","format-standard","hentry","category-security","category-sophos","tag-adversarial-ai","tag-ai-research","tag-def-con","tag-generative-ai","tag-large-language-models","tag-web-scams"],"_links":{"self":[{"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/posts\/22632","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/comments?post=22632"}],"version-history":[{"count":0,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/posts\/22632\/revisions"}],"wp:attachment":[{"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/media?parent=22632"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/categories?post=22632"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/tags?post=22632"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}