{"id":15462,"date":"2019-05-31T11:00:13","date_gmt":"2019-05-31T19:00:13","guid":{"rendered":"http:\/\/www.palada.net\/index.php\/2019\/05\/31\/news-9211\/"},"modified":"2019-05-31T11:00:13","modified_gmt":"2019-05-31T19:00:13","slug":"news-9211","status":"publish","type":"post","link":"http:\/\/www.palada.net\/index.php\/2019\/05\/31\/news-9211\/","title":{"rendered":"Getting it Right &#8211; How Much Air Containment is Enough in Your Data Center? &#8211; Closing Remarks"},"content":{"rendered":"<p><strong>Credit to Author: Victor Avelar| Date: Fri, 31 May 2019 14:40:00 +0000<\/strong><\/p>\n<p>In <a href=\"https:\/\/blog.schneider-electric.com\/datacenter\/2019\/03\/19\/getting-it-right-how-much-air-containment-is-enough-in-your-data-center\/\" target=\"_blank\" rel=\"noopener noreferrer\">Part 1<\/a> I explained the problem with the \u201cpercent leakage\u201d term and I proposed more practical metrics. In <a href=\"https:\/\/blog.se.com\/datacenter\/2019\/04\/25\/results-are-in-our-study-measuring-the-different-levels-of-data-center-air-containment\/\">Part 2<\/a>, I got into the actual testing we did in our St. Louis cooling lab with the help of Scott Buell and his awesome team! Now in Part 3, I share closing remarks and best practices for your <a href=\"https:\/\/www.schneider-electric.com\/en\/work\/solutions\/for-business\/data-centers-and-networks\/reference-designs\/\">data center design<\/a> that you can use based on the data and findings from our testing.<\/p>\n<h2>Best practices for data center containment<\/h2>\n<p>I can\u2019t emphasize enough that our test setup is much different than the data center or data room you may have. \u00a0However, based on these findings, I do think the following best practices (in priority order) are those you can replicate in your own data center:<\/p>\n<h3>1. Use blanking panels<\/h3>\n<p>The primary reason I\u2019m listing blanking panels as #1 is because whenever 100% blanking panels were installed, we saw significant reduction in temperature variation, regardless of the containment configuration. The secondary reason is because <a href=\"https:\/\/www.apc.com\/shop\/us\/en\/products\/1U-19-Black-Modular-Toolless-Airflow-Management-Blanking-Panel-Qty-10\/P-AR8136BLK?switchCountry=true\" target=\"_blank\" rel=\"noopener noreferrer\">blanking panels<\/a> are a \u201ccheap\u201d fix with fast payback.<\/p>\n<p>Here\u2019s a quick financial analysis based on one of our tests:<\/p>\n<p><strong>\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 100% blanking panels\u00a0<\/strong>\u2013 With 100% blanking panels installed and no other containment (no doors or diffuser), we were able to reach an average IT supply temperature of <u>21.0<\/u><u>\u00b0C\/69.8<\/u><u>\u00b0F<\/u> with a standard deviation of <u>0.9<\/u><u>\u00b0C\/1.7<\/u><u>\u00b0F<\/u>, by increasing the CRAH fan to 1.32kW and chilled water valve to 62%.<\/p>\n<p><strong>\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 78% blanking panels<\/strong> \u2013 In same exact test setup with only 78% panels, we increased the CRAH fan 100% (6.1kW) and chilled water valve to 100%. \u00a0Yet still, we were only able to get the average IT supply temperature of <u>22.1<\/u><u>\u00b0C\/71.8<\/u><u>\u00b0F<\/u> with a standard deviation of <u>3.7<\/u><u>\u00b0C\/6.7<\/u><u>\u00b0F<\/u>. That\u2019s an extra 4.78kW of power x 8760 hours\/year x $0.10\/kWhr or $4,187\/year in energy cost.<\/p>\n<p>It would have cost us $500 to $900 for the 186 blanking panels to fill the gaps in our 8-rack pod.<\/p>\n<h3>2. Diffuse the CRAH supply jets<\/h3>\n<p>It\u2019s amazing how much jets influence the air temperatures at the rack fronts.<\/p>\n<p>We had this pod completely sealed with tape and cardboard, yet we still measured temperature differences of <u>2.1<\/u><u>\u00b0C\/3.8<\/u><u>\u00b0F<\/u> between the maximum and minimum temperature reading. Why? Because our CRAH had a turning vane which sent powerful jets smashing into the end of the pod. These jets cause turbulent air vortices which create temperature differences. If possible, remove the CRAH turning vane, so that the jet smashes against the floor. Otherwise, try placing some type of barrier in front of the CRAH. This is an issue regardless of the distribution architecture, but I believe it\u2019s a bigger issue for hard floor architectures.<\/p>\n<p> <img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-57198\" src=\"https:\/\/blog.se.com\/wp-content\/uploads\/2019\/05\/containment_3_thumbnail_jpg_VEuBcT4H.jpg\" alt=\"measuring air containment in data center design\" width=\"495\" height=\"372\" srcset=\"https:\/\/blog.se.com\/wp-content\/uploads\/2019\/05\/containment_3_thumbnail_jpg_VEuBcT4H.jpg 495w, https:\/\/blog.se.com\/wp-content\/uploads\/2019\/05\/containment_3_thumbnail_jpg_VEuBcT4H-300x225.jpg 300w\" sizes=\"auto, (max-width: 495px) 100vw, 495px\" \/> <\/p>\n<p>We experimented with a \u201cT\u201d diffuser directly in front of the CRAH as well as with a \u201cV\u201d shaped diffuser. Based on the data, the \u201cV\u201d diffuser performed best in reducing standard deviation.<\/p>\n<p> <img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-57201\" src=\"https:\/\/blog.se.com\/wp-content\/uploads\/2019\/05\/1559219484426.jpeg\" alt=\"\" width=\"1048\" height=\"1397\" srcset=\"https:\/\/blog.se.com\/wp-content\/uploads\/2019\/05\/1559219484426.jpeg 1048w, https:\/\/blog.se.com\/wp-content\/uploads\/2019\/05\/1559219484426-225x300.jpeg 225w, https:\/\/blog.se.com\/wp-content\/uploads\/2019\/05\/1559219484426-768x1024.jpeg 768w\" sizes=\"auto, (max-width: 1048px) 100vw, 1048px\" \/> <img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-57202\" src=\"https:\/\/blog.se.com\/wp-content\/uploads\/2019\/05\/1559219484550.jpeg\" alt=\"\" width=\"1000\" height=\"750\" srcset=\"https:\/\/blog.se.com\/wp-content\/uploads\/2019\/05\/1559219484550.jpeg 1000w, https:\/\/blog.se.com\/wp-content\/uploads\/2019\/05\/1559219484550-300x225.jpeg 300w, https:\/\/blog.se.com\/wp-content\/uploads\/2019\/05\/1559219484550-768x576.jpeg 768w\" sizes=\"auto, (max-width: 1000px) 100vw, 1000px\" \/> <\/p>\n<h3>3. Duct hot aisle to cooling units<\/h3>\n<p>The main reason I chose this as a third priority, has more to do with the higher cost of materials and installation (relative to 1 and 2), than it does with our measured data. What I can say is that when we held the chilled water valve % and CRAH fan % constant, the duct alone (with missing blanking panels) appears to provide average IT supply temperatures closer to <u>70\u00b0F<\/u>, but 100% blanking panels alone (no duct) appear to provide a lower standard deviation. The bottom line is that both practices work together as a system, and you should strive to implement both if your temperature tolerances warrant it.<\/p>\n<h2>Finding the optimal setting for data center design efficiency<\/h2>\n<p>After implementing the best practices in an existing data center, what would I do to keep my IT equipment cool and my energy bills low? Just like how we found the optimal chilled water position and CRAH fan airflow in our testing, I would do the same for a production data center. But this requires that you have temperature sensors on every rack. Maybe six per rack is too much, but if you don\u2019t have any way of measuring the rack-front temperatures, you\u2019re flying blind. In other words, you won\u2019t know the impact your changes have, until you reach the point where your servers report high temperatures and potentially shut down. Bottom line is you need to invest in some sort of temperature monitoring.<\/p>\n<p><u>1. Decrease chilled water valve setpoint<\/u><\/p>\n<p>It\u2019s likely a good assumption that the chilled water valve % opening settings were high prior to best practices. If this is true, then it\u2019s likely that my average IT inlet temperature has significantly decreased after the implementing the best practices. So, I would begin closing the valve for each CRAH unit slowly, wait for steady state, and calculate the average IT temperature across the data center. Continue this until you get close to your target IT inlet temperature.<\/p>\n<p><u>2. Decrease CRAH fan speed \/ airflow setpoint<\/u><\/p>\n<p>Again, it\u2019s likely that the CRAH airflow settings were high prior to best practices. \u00a0If true, then it\u2019s likely that my standard deviation has significantly decreased after the best practices. So again, I would slowly decrease the fan speed for each CRAH, wait for steady state, and calculate the standard deviation of the temperatures across the data center. Continue this until you get close to your target standard deviation.<\/p>\n<p>What I\u2019ve just gone through is easy enough for a small data center with only a few CRAHs, but with many CRAHs, it\u2019s impractical to manually do what I\u2019m suggesting. There are solutions in the marketplace that automatically change CRAH fan airflow to minimize energy while maintaining an IT temperature range. \u00a0If you want to save more than just fan energy, you need to increase your chilled water supply temperature, but this can get complicated and is outside of the scope of this blog. This is likely one reason why Google invested in a <a href=\"https:\/\/deepmind.com\/blog\/deepmind-ai-reduces-google-data-centre-cooling-bill-40\/\" target=\"_blank\" rel=\"noopener noreferrer\">machine-learning-based control system<\/a> to minimize the energy consumption of their data center.<\/p>\n<h2>Closing remarks \u2013 get it right for <em>your<\/em> data center<\/h2>\n<p>Now let\u2019s bring this home to the original point of this blog \u2013 how much temperature variation can your IT equipment tolerate or are you comfortable with? If you set your tolerance too narrow, how much CRAH energy are you willing to give up getting there?<\/p>\n<p>Case 5 gave us a standard deviation of roughly 50% higher than the ideal \u201cairtight\u201d case of 0.4\u00b0C\/0.8\u00b0F. However, if we increase the fan speed, we can decrease this standard deviation. How much are you willing to spend on extra fan energy to decrease deviation? Or, are you willing to bust out the gaff tape and cardboard? Based on our specific configuration and measured data, here\u2019s a table that shows how much we needed to increase fan power (For Case 5), to bring the standard deviation closer to the ideal case of cardboard and gaff tape<\/p>\n<p> <img decoding=\"async\" style=\"width: 496px;\" src=\"https:\/\/coschedule.s3.amazonaws.com\/167392\/f02bc61d-49dd-4c27-975e-ac421a9e590c\/1559219616352.png\" \/> <\/p>\n<p>The moral of the story is, if your equipment can tolerate a higher temperature variation, then perhaps it\u2019s not worth spending the extra money on fan power to lower the standard deviation (or for that matter on doors, or gaskets).<\/p>\n<p>Please leave a comment to let me know what you think about this blog or if you have any questions the <a href=\"https:\/\/blog.se.com\/tag\/data-center-science-center\/\" target=\"_blank\" rel=\"noopener noreferrer\">Science Center<\/a> can help answer for you.<\/p>\n<p>The post <a rel=\"nofollow\" href=\"https:\/\/blog.se.com\/datacenter\/2019\/05\/31\/getting-it-right-how-much-air-containment-is-enough-in-your-data-center-closing-remarks\/\">Getting it Right &#8211; How Much Air Containment is Enough in Your Data Center? &#8211; Closing Remarks<\/a> appeared first on <a rel=\"nofollow\" href=\"https:\/\/blog.se.com\">Schneider Electric Blog<\/a>.<\/p>\n<p><a href=\"https:\/\/blog.se.com\/datacenter\/2019\/05\/31\/getting-it-right-how-much-air-containment-is-enough-in-your-data-center-closing-remarks\/\" target=\"bwo\" >http:\/\/blog.schneider-electric.com\/feed\/<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p><strong>Credit to Author: Victor Avelar| Date: Fri, 31 May 2019 14:40:00 +0000<\/strong><\/p>\n<p>In Part 1 I explained the problem with the \u201cpercent leakage\u201d term and I proposed more practical metrics. In Part 2, I got into the actual testing we did in&#8230;  <a href=\"https:\/\/blog.se.com\/datacenter\/2019\/05\/31\/getting-it-right-how-much-air-containment-is-enough-in-your-data-center-closing-remarks\/\" title=\"ReadGetting it Right &#8211; How Much Air Containment is Enough in Your Data Center? &#8211; Closing Remarks\">Read more &#187;<\/a><\/p>\n<p>The post <a rel=\"nofollow\" href=\"https:\/\/blog.se.com\/datacenter\/2019\/05\/31\/getting-it-right-how-much-air-containment-is-enough-in-your-data-center-closing-remarks\/\">Getting it Right &#8211; How Much Air Containment is Enough in Your Data Center? &#8211; Closing Remarks<\/a> appeared first on <a rel=\"nofollow\" href=\"https:\/\/blog.se.com\">Schneider Electric Blog<\/a>.<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"colormag_page_container_layout":"default_layout","colormag_page_sidebar_layout":"default_layout","footnotes":""},"categories":[12389,12388],"tags":[21297,12391,12459,12500,13483,14591,21298],"class_list":["post-15462","post","type-post","status-publish","format-standard","hentry","category-scadaics","category-schneider","tag-containment","tag-data-center","tag-data-center-design","tag-data-center-planning","tag-data-center-planning-and-design","tag-data-center-science-center","tag-percent-leakage"],"_links":{"self":[{"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/posts\/15462","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/comments?post=15462"}],"version-history":[{"count":0,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/posts\/15462\/revisions"}],"wp:attachment":[{"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/media?parent=15462"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/categories?post=15462"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.palada.net\/index.php\/wp-json\/wp\/v2\/tags?post=15462"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}