{"id":23459,"date":"2023-11-27T05:21:27","date_gmt":"2023-11-27T13:21:27","guid":{"rendered":"https:\/\/www.palada.net\/index.php\/2023\/11\/27\/news-17189\/"},"modified":"2023-11-27T05:21:27","modified_gmt":"2023-11-27T13:21:27","slug":"news-17189","status":"publish","type":"post","link":"http:\/\/www.palada.net\/index.php\/2023\/11\/27\/news-17189\/","title":{"rendered":"The Dark Side of AI: Large-Scale Scam Campaigns Made Possible by Generative AI"},"content":{"rendered":"

Credit to Author: gallagherseanm| Date: Mon, 27 Nov 2023 11:30:18 +0000<\/strong><\/p>\n

\n

Generative artificial intelligence technologies such as OpenAI\u2019s ChatGPT and DALL-E have created a great deal of disruption across much of our digital lives. Creating credible text, images and even audio, these AI tools can be used for both good and ill. That includes their application in the cybersecurity space.<\/p>\n

While Sophos AI has been working on ways to integrate generative AI into cybersecurity tools\u2014work that is now being integrated into how we defend customers\u2019 networks\u2014we\u2019ve also seen adversaries experimenting with generative AI. As we\u2019ve discussed in several recent posts, generative AI has been used by scammers as an assistant to overcome language barriers between scammers and their targets<\/a> generating responses to text messages<\/a> as an assistant to overcome language barriers between scammers and their targets, generating responses to text messages<\/a> in conversations on WhatsApp and other platforms. We have also seen the use of generative AI to create fake \u201cselfie\u201d images sent in these conversations, and there has been some use reported of generative AI voice synthesis in phone scams.<\/p>\n

When pulled together, these types of tools can be used by scammers and other cybercriminals at a larger scale. To be able to better defend against this weaponization of generative AI, the Sophos AI team conducted an experiment to see what was in the realm of the possible.<\/p>\n

As we presented at DEF CON\u2019s AI Village earlier this year (and at CAMLIS in October and BSides Sydney in November), our experiment delved into the potential misuse of advanced generative AI technologies to orchestrate large-scale scam campaigns. These campaigns fuse multiple types of generative AI, tricking unsuspecting victims into giving up sensitive information. And while we found that there was still a learning curve to be mastered by would-be scammers, the hurdles were not as high as one would hope.<\/p>\n