{"id":23941,"date":"2024-02-14T04:30:05","date_gmt":"2024-02-14T12:30:05","guid":{"rendered":"https:\/\/www.palada.net\/index.php\/2024\/02\/14\/news-17671\/"},"modified":"2024-02-14T04:30:05","modified_gmt":"2024-02-14T12:30:05","slug":"news-17671","status":"publish","type":"post","link":"http:\/\/www.palada.net\/index.php\/2024\/02\/14\/news-17671\/","title":{"rendered":"Microsoft and the Taylor Swift genAI deepfake problem"},"content":{"rendered":"

<\/p>\n

The last few weeks have been a PR bonanza for Taylor Swift in both good ways and bad. On the good side, her boyfriend Travis Kelce was on the winning team at the Super Bowl, and her reactions during the game got plenty of air time. On the much, much worse side, generative AI-created fake nude images of her have recently flooded the internet.<\/p>\n

As you would expect, condemnation of the creation and distribution of those images followed swiftly, including from generative AI (genAI) companies and, notably, Microsoft CEO Satya Nadella. In addition to denouncing what happened, Nadella shared his thoughts on a solution<\/a>: \u201cI go back to what I think\u2019s our responsibility, which is all of the guardrails that we need to place around the technology so that there\u2019s more safe content that\u2019s being produced.\u201d<\/p>\n

Microsoft weighed in on the issue of deepfakes again yesterday<\/a> (though without mentioning Swift). In a blog post, Microsoft Vice Chair and President Brad Smith decried the proliferation of deepfakes and said the company is taking steps to limit their spread.\u00a0<\/p>\n

“Tools unfortunately also become weapons, and this pattern is repeating itself,” he wrote. “We\u2019re currently witnessing a rapid expansion in the abuse of these new AI tools by bad actors, including through deepfakes based on AI-generated video, audio, and images. This trend poses new threats for elections, financial fraud, harassment through nonconsensual pornography, and the next generation of cyber bullying.”<\/p>\n

Smith pledged “a robust and comprehensive approach” from Microsoft, adding: “We\u2019re committed to ongoing innovation that will help users quickly determine if an image or video is AI generated or manipulated.”\u00a0<\/p>\n

As far as it goes, the Microsoft view is certainly true, and is the typical all-purpose, knee-jerk response one would expect from the world\u2019s biggest and most influential genAI company. But what Nadella and Smith left out is that there\u2019s evidence the company’s AI tools created the Swift images; even more damning, a Microsoft AI developer says he warned the company ahead of time that proper guardrails didn\u2019t exist, and Microsoft did nothing about it.<\/p>\n

Evidence that Microsoft tools were used to create the deepfakes<\/a> comes from a 404 Media article<\/a>, which claims they originated in a Telegram community dedicated to creating \u201cnon-consensual porn;\u201d it recommends that Microsoft Designer be used to generate the porn images. The article notes that \u201cDesigner theoretically refuses to produce images of famous people, but AI generators are easy to bamboozle, and 404 found you could break its rules with small tweaks to prompts.\u201d<\/p>\n

More damning still, a Microsoft AI engineer allegedly warned Microsoft in December that the safety guardrails of OpenAI\u2019s image generator DALL-E, the brains behind Microsoft Designer, could be bypassed to create explicit and violent images. He claims Microsoft ignored his warnings and tried to get him to not say anything publicly about what he found.<\/p>\n

The engineer, Shane Jones, wrote in a letter<\/a> to US Sens. Patty Murray (D-WA) and Maria Cantwell (D-WA); Rep. Adam Smith (D-WA), and Washington state Attorney General Bob Ferguson that he \u201cdiscovered a security vulnerability that allowed me to bypass some of the guardrails that are designed to prevent the [DALL-E] model from creating and distributing harmful images\u2026. I reached the conclusion that DALL\u00b7E 3 posed a public safety risk and should be removed from public use until OpenAI could address the risks associated with this model.<\/p>\n

\u201cThe vulnerabilities in DALL\u00b7E 3, and products like Microsoft Designer that use DALL\u00b7E 3, makes it easier for people to abuse AI in generating harmful images. Microsoft was aware of these vulnerabilities and the potential for abuse.\u201d<\/p>\n

Jones claimed Microsoft refused to act, posted a public letter about the issue on LinkedIn, and then was told by his manager to delete the letter because Microsoft\u2019s legal department demanded it.<\/p>\n

In his letter, Jones mentions the explicit images of Swift and says, \u201cThis is an example of the type of abuse I was concerned about and the reason why I urged OpenAI to remove DALL\u00b7E 3 from public use and reported my concerns to Microsoft.\u201d<\/p>\n

According to GeekWire<\/a>, Microsoft in a statement said the company \u201cinvestigated the employee\u2019s report and confirmed that the techniques he shared did not bypass our safety filters in any of our AI-powered image generation solutions.\u201d<\/p>\n

All of this is, to a certain extent, circumstantial evidence. There\u2019s no confirmation the images were created with Microsoft Designer, and we don\u2019t know whether to trust Microsoft or Jones. But we do know that Microsoft has a history of downplaying or ignoring the dangers of genAI.<\/p>\n

As I wrote last May<\/a>, Microsoft slashed the staffing of a 30-member team that was responsible for making sure genAI was being developed ethically at the company \u2014 and then eliminated the team entirely. The slashing took place several months before the release of Microsoft\u2019s genAI chatbot; the team\u2019s elimination was several months after.<\/p>\n

Before the release of the chatbot, John Montgomery, Microsoft corporate vice president of AI, told the team why it was being decimated: \u201cThe pressure from [CTO] Kevin [Scott] and [CEO] Satya [Nadella] is very, very high to take these most recent OpenAI models and the ones that come after them and move them into customers\u2019 hands at a very high speed.\u201d<\/p>\n

He added that the ethics team stood in the way of that.<\/p>\n

When a team member responded that there are significant dangers in AI that need to be addressed \u2014 and asked him to reconsider\u2014\u00a0Montgomery answered, \u201cCan I reconsider? I don’t think I will. \u2019Cause unfortunately the pressures remain the same. You don\u2019t have the view that I have, and probably you can be thankful for that. There\u2019s a lot of stuff being ground up into the sausage.\u201d<\/p>\n

Once the team was gone, Microsoft was off and running with genAI. And that accomplished exactly what the company wanted. The company\u2019s stock has skyrocketed, and thanks to AI, it\u2019s become the most valuable company in the world \u2014 the second company (behind Apple) to be valued at more than $3 trillion.<\/p>\n

That\u2019s three trillion reasons you shouldn\u2019t expect Microsoft to change its tune about the potential dangers of AI, whether or not Microsoft Designer was used to create the Taylor Swift deepfakes. And it doesn’t bode well for the chances of a tsunami of deepfakes in the year ahead, especially with a contested presidential election in the US<\/a>.<\/p>\n

http:\/\/www.computerworld.com\/category\/security\/index.rss<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

<\/p>\n

\n
\n

The last few weeks have been a PR bonanza for Taylor Swift in both good ways and bad. On the good side, her boyfriend Travis Kelce was on the winning team at the Super Bowl, and her reactions during the game got plenty of air time. On the much, much worse side, generative AI-created fake nude images of her have recently flooded the internet.<\/p>\n

As you would expect, condemnation of the creation and distribution of those images followed swiftly, including from generative AI (genAI) companies and, notably, Microsoft CEO Satya Nadella. In addition to denouncing what happened, Nadella shared his thoughts on a solution<\/a>: \u201cI go back to what I think\u2019s our responsibility, which is all of the guardrails that we need to place around the technology so that there\u2019s more safe content that\u2019s being produced.\u201d<\/p>\n

To read this article in full, please click here<\/a><\/p>\n<\/section>\n<\/article>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"colormag_page_container_layout":"default_layout","colormag_page_sidebar_layout":"default_layout","footnotes":""},"categories":[11062,10643],"tags":[11113,29835,10516,5897,714],"class_list":["post-23941","post","type-post","status-publish","format-standard","hentry","category-computerworld","category-independent","tag-artificial-intelligence","tag-generative-ai","tag-microsoft","tag-privacy","tag-security"],"_links":{"self":[{"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/posts\/23941","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/comments?post=23941"}],"version-history":[{"count":0,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/posts\/23941\/revisions"}],"wp:attachment":[{"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/media?parent=23941"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/categories?post=23941"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/tags?post=23941"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}