{"id":23667,"date":"2024-01-13T12:32:13","date_gmt":"2024-01-13T20:32:13","guid":{"rendered":"https:\/\/www.palada.net\/index.php\/2024\/01\/13\/news-17397\/"},"modified":"2024-01-13T12:32:13","modified_gmt":"2024-01-13T20:32:13","slug":"news-17397","status":"publish","type":"post","link":"http:\/\/www.palada.net\/index.php\/2024\/01\/13\/news-17397\/","title":{"rendered":"Will super chips disrupt the &#039;everything to the cloud&#039; IT mentality?"},"content":{"rendered":"<p><img decoding=\"async\" src=\"https:\/\/images.idgesg.net\/images\/idge\/imported\/imageapi\/2023\/11\/14\/16\/istock-1724789360-100948525-small.jpg\"\/><\/p>\n<p><strong>Credit to Author: eschuman@thecontentfirm.com| Date: Wed, 10 Jan 2024 03:00:00 -0800<\/strong><\/p>\n<p><span style=\"font-weight: 400;\">Enterprise IT for the last couple of years has grown disappointed in the economics \u2014 not to mention the cybersecurity and compliance impact \u2014 of corporate clouds. In general, with <\/span><a href=\"https:\/\/www.computerworld.com\/article\/3678430\/this-would-be-a-good-time-to-test-your-cloud-roi.html\"><span style=\"font-weight: 400;\">a few exceptions<\/span><\/a><span style=\"font-weight: 400;\">, enterprises have done little about it; most saw the scalability and efficiencies too seductive.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Might that change in 2024 and 2025? <\/span><\/p>\n<p><span style=\"font-weight: 400;\">Apple has begun talking about efforts to add\u00a0<\/span><a href=\"https:\/\/browse.arxiv.org\/html\/2312.11514v2\" rel=\"nofollow\"><span style=\"font-weight: 400;\">higher-end compute capabilities to its chip<\/span><\/a><span style=\"font-weight: 400;\">, following similar efforts from <\/span><a href=\"https:\/\/www.theverge.com\/2023\/12\/14\/23998215\/intel-core-ultra-cpu-specs-availability\" rel=\"nofollow\"><span style=\"font-weight: 400;\">Intel<\/span><\/a><span style=\"font-weight: 400;\"> and <\/span><a href=\"https:\/\/www.nvidia.com\/en-us\/ai-data-science\/workstations\/%5C\" rel=\"nofollow\"><span style=\"font-weight: 400;\">NVIDIA<\/span><\/a><span style=\"font-weight: 400;\">. Although those new capabilities are aimed at enabling more large language model (LLM) capabilities on-device, anything that can deliver that level of data-crunching and analytics can also handle almost every other enterprise IT task.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Given that enterprise CIOs are already less than thrilled with cloud costs \u2014 and the likelihood that Amazon, Google, and Microsoft are unlikely to do anything <\/span><i><span style=\"font-weight: 400;\">other than<\/span><\/i><span style=\"font-weight: 400;\"> raise cloud rates this year \u2014 will these souped-up CPUs be the proverbial straw that broke the cloud camel\u2019s back?\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The percentage of enterprise data moving to the cloud from on-prem steadily and gradually rose every year until roughly February 2020, when COVID-19 forced most companies to shutter offices and left computer rooms empty. Enterprises had to make emergent moves to the cloud, and once they did so, few were willing to meaningfully go back to the on-prem levels of 2019.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cCompanies and their CISOs and their CIOs are recognizing that the cloud has not turned out to be the all-encompassing panacea that some had hoped it would be,\u201d said Brian Levine, the managing director for cybersecurity and data privacy at Ernst &amp; Young, which now prefers to be called EY. \u201cThere are benefits and drawbacks of the cloud, including a lot of efficiencies that come from leveraging the cloud. But it also brings with it a whole new array of security issues, such as that criminals have the opportunity to go after the big cahuna, the big fish. That\u2019s a really big bulls-eye on your back.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Levine\u2019s point is that the cloud creates a single point of failure. That\u2019s a good thing to the extent that cloud security is top\u2013notch, which is true for the major cloud environments. But it also means that if an attacker can break through, the bad guy has access to the top corporate secrets of hundreds, if not thousands, of major firms. That&#8217;s an attractive target, making it worth substantial effort and investment on the part of the attackers \u2014 especially if the secrets would interest state actors.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Another factor involves cloud economics. The initial cloud sales pitches argued that enterprises could turn over their data needs to the cloud provider and reinvest \u00a0IT dollars elsewhere.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Not only have cloud costs consistently grown, but the efficiencies didn\u2019t materialize. Because enterprises typically have multiple cloud environments for different purposes (backup, disaster recovery, geographic issues dealing with data soverignty, etc.), they typically need to hire specialists in each cloud flavor, such as in AWS, Google and Azure.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">To be fair, that tradeoff might make fiscal sense for a small business without the ability to deliver the high-end security big cloud providers offer. But in the enterprise space, especially among the Fortune 100, companies often can deliver powerful security on their own.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cI have a lot of clients who are unhappy with the amounts they are spending on cloud. They are, in fact, surprised by the amount it has cost over time,\u201d Levine said. \u201cYou need a lot of specialists in your environment and you often are going to run into the \u2018too many cooks\u2019 problem, where the one hand doesn\u2019t necessarily know what the other hand is doing.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">This can happen because enterprise IT works to make sure all settings and configurations precisely align with their needs. And yet, cloud staffers can make a universal change for clients that messes up that IT implementation. Even worse, not only do cloud teams often <em>not<\/em> ask permission from corporate customers before making a settings change, they typically don&#8217;t even tell them of the change.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cThis delivers a situation where your IT team is taking actions and then spending time checking to see if someone didn\u2019t undo their actions. It\u2019s a complexity problem,\u201d Levine said, noting that the very efforts to secure an environment can inadvertently undermine protections. \u201cShrinking your environment (by bringing data in house, such as on-prem and on-device) makes it easier to secure your environment. Sometimes when you think you have created a better mousetrap such as running LLMs on a chip, it creates blindspots because you are not thinking about it as much.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Barry Scannell, a technology law and data protection attorney with the William Fry law firm in Ireland, said he&#8217;s intrigued by the Apple move for security and compliance reasons, especially with the EU\u2019s rules on privacy and AI.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cOn-device AI processing offers notable privacy benefits over cloud-based methods and enables offline functionality,\u201d Scannell said. \u201cThis approach not only enhances user privacy in accordance with GDPR&#8217;s requirements, but also emphasizes the need for stringent data security protocols at the device level to safeguard against data breaches and unauthorized access.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Scannell\u2019s argument is certainly not necessarily limited to Apple&#8217;s generative AI efforts. The same is true for any data-handling on the device. If it doesn\u2019t leave the device \u2014 or at least if it never leaves the enterprise environment \u2014 it is a much smaller target. Even better, that environment is controlled by enterprise IT. (That may or may not make it secure, but if IT is going to get hit with compliance violations and fines, it avoids the issue where the fault lies with a cloud staffer.)<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Another perspective was best articulated by Malcolm Harkins, the chief security and trust officer at HiddenLayer. Harkins argued that while cybersecurity and compliance considerations are important, budget concerns will underlie the decision.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cAt the end of the day, I am a strong believer that economics always wins,&#8221; Harkins said. &#8220;And if it ends up being economically more efficient\/effective on-device, it will happen there and, if not, it will be in the cloud. I also think you have to look beyond the processing location. If I just process locally, how do I get the benefit of the broader AI advancements and flow of data?\u00a0 So for some items, I think even if data is processed locally, the value \u2014 yes, the economics again \u2014 of having the data shared\/leveraged with other information will still mean a lot of information will flow into the cloud.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The issue really isn\u2019t about whether enterprise IT is going to bring things back from the cloud. IT has always had the ability to do that (other than during the pandemic) and they, for the most part, have not. And I doubt that will happen. But what <\/span><i><span style=\"font-weight: 400;\">may very well<\/span><\/i><span style=\"font-weight: 400;\"> happen is a small reduction in how much new data is sent to the cloud.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Instead of sending 95%-plus of new data to the cloud, which is what appears to be happening with most enterprises, that figure might drop to perhaps 75% or 80%. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">The key question: Will these new promised chip capabilities make a difference?<\/span><\/p>\n<p><a href=\"https:\/\/www.computerworld.com\/article\/3712120\/will-super-chips-disrupt-the-everything-to-the-cloud-it-mentality.html#tk.rss_security\" target=\"bwo\" >http:\/\/www.computerworld.com\/category\/security\/index.rss<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p><img decoding=\"async\" src=\"https:\/\/images.idgesg.net\/images\/idge\/imported\/imageapi\/2023\/11\/14\/16\/istock-1724789360-100948525-small.jpg\"\/><\/p>\n<p><strong>Credit to Author: eschuman@thecontentfirm.com| Date: Wed, 10 Jan 2024 03:00:00 -0800<\/strong><\/p>\n<article>\n<section class=\"page\">\n<p><span style=\"font-weight: 400;\">Enterprise IT for the last couple of years has grown disappointed in the economics \u2014 not to mention the cybersecurity and compliance impact \u2014 of corporate clouds. In general, with <\/span><a href=\"https:\/\/www.computerworld.com\/article\/3678430\/this-would-be-a-good-time-to-test-your-cloud-roi.html\"><span style=\"font-weight: 400;\">a few exceptions<\/span><\/a><span style=\"font-weight: 400;\">, enterprises have done little about it; most saw the scalability and efficiencies too seductive.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Might that change in 2024 and 2025? <\/span><\/p>\n<p><span style=\"font-weight: 400;\">Apple has begun talking about efforts to add\u00a0<\/span><a href=\"https:\/\/browse.arxiv.org\/html\/2312.11514v2\" rel=\"nofollow\"><span style=\"font-weight: 400;\">higher-end compute capabilities to its chip<\/span><\/a><span style=\"font-weight: 400;\">, following similar efforts from <\/span><a href=\"https:\/\/www.theverge.com\/2023\/12\/14\/23998215\/intel-core-ultra-cpu-specs-availability\" rel=\"nofollow\"><span style=\"font-weight: 400;\">Intel<\/span><\/a><span style=\"font-weight: 400;\"> and <\/span><a href=\"https:\/\/www.nvidia.com\/en-us\/ai-data-science\/workstations\/%5C\" rel=\"nofollow\"><span style=\"font-weight: 400;\">NVIDIA<\/span><\/a><span style=\"font-weight: 400;\">. Although those new capabilities are aimed at enabling more large language model (LLM) capabilities on-device, anything that can deliver that level of data-crunching and analytics can also handle almost every other enterprise IT task.\u00a0<\/span><\/p>\n<p class=\"jumpTag\"><a href=\"\/article\/3712120\/will-super-chips-disrupt-the-everything-to-the-cloud-it-mentality.html#jump\">To read this article in full, please click here<\/a><\/p>\n<\/section>\n<\/article>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"colormag_page_container_layout":"default_layout","colormag_page_sidebar_layout":"default_layout","footnotes":""},"categories":[11062,10643],"tags":[11064,29835,714,12747],"class_list":["post-23667","post","type-post","status-publish","format-standard","hentry","category-computerworld","category-independent","tag-cloud-computing","tag-generative-ai","tag-security","tag-technology-industry"],"_links":{"self":[{"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/posts\/23667","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/comments?post=23667"}],"version-history":[{"count":0,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/posts\/23667\/revisions"}],"wp:attachment":[{"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/media?parent=23667"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/categories?post=23667"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/tags?post=23667"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}