AWS Announces New Data Center Components to Support AI Innovation and Further Improve Energy Efficiency
AWS announced new data center components designed to support next-generation AI innovation and improve efficiency. Key improvements include simplified electrical and mechanical design achieving 99.9999% infrastructure availability, innovative cooling systems with liquid-to-chip capabilities, and enhanced power delivery supporting a 6x increase in rack power density. The updates will provide 12% more compute power while reducing mechanical energy consumption by 46% and concrete embodied carbon by 35%. Implementation will begin in early 2025 across AWS's global infrastructure, including 34 Regions and 108 Availability Zones.
AWS ha annunciato nuovi componenti per i data center progettati per supportare l'innovazione AI di prossima generazione e migliorare l'efficienza. I principali miglioramenti includono un design elettrico e meccanico semplificato che raggiunge il 99,9999% di disponibilità dell'infrastruttura, sistemi di raffreddamento innovativi con capacità di raffreddamento liquido a chip, e una consegna di energia potenziata che supporta un aumento di 6 volte nella densità di potenza dei rack. Gli aggiornamenti forniranno il 12% di potenza di calcolo in più riducendo al contempo il consumo di energia meccanica del 46% e il carbonio incorporato nel cemento del 35%. L'implementazione inizierà all'inizio del 2025 in tutta l'infrastruttura globale di AWS, che include 34 regioni e 108 zone di disponibilità.
AWS anunció nuevos componentes para centros de datos diseñados para apoyar la innovación en IA de próxima generación y mejorar la eficiencia. Las mejoras clave incluyen un diseño eléctrico y mecánico simplificado que logra una disponibilidad de infraestructura del 99.9999%, sistemas de refrigeración innovadores con capacidades de refrigeración líquido-a-chip, y una entrega de energía mejorada que soporta un aumento de 6 veces en la densidad de potencia de los racks. Las actualizaciones proporcionarán un 12% más de potencia de cálculo mientras reducen el consumo de energía mecánica en un 46% y el carbono incorporado del concreto en un 35%. La implementación comenzará a principios de 2025 en toda la infraestructura global de AWS, incluyendo 34 regiones y 108 zonas de disponibilidad.
AWS는 차세대 AI 혁신을 지원하고 효율성을 향상시키기 위해 설계된 새로운 데이터 센터 구성 요소를 발표했습니다. 주요 개선 사항으로는 인프라 가용성을 99.9999% 달성하는 간소화된 전기 및 기계 설계, 칩에 액체 냉각 기능을 갖춘 혁신적인 냉각 시스템, 그리고 랙 전력 밀도의 6배 증가를 지원하는 향상된 전력 공급이 포함됩니다. 이 업데이트는 12% 더 많은 컴퓨팅 파워를 제공하면서 기계 에너지 소비를 46% 줄이고 콘크리트에 포함된 탄소를 35% 감소시킵니다. 구현은 2025년 초에 AWS의 전 세계 인프라 전역에 걸쳐 시작될 예정이며, 34개의 지역과 108개의 가용성 영역을 포함합니다.
AWS a annoncé de nouveaux composants de centre de données conçus pour soutenir l'innovation IA de nouvelle génération et améliorer l'efficacité. Les améliorations clés incluent un design électrique et mécanique simplifié atteignant 99,9999% de disponibilité de l'infrastructure, des systèmes de refroidissement innovants avec des capacités de refroidissement liquide à puce, et une livraison d'énergie améliorée soutenant une augmentation de 6 fois de la densité de puissance des racks. Les mises à jour fourniront 12% de puissance de calcul en plus tout en réduisant la consommation d'énergie mécanique de 46% et le carbone incorporé du béton de 35%. L'implémentation commencera début 2025 dans l'ensemble de l'infrastructure mondiale d'AWS, qui comprend 34 régions et 108 zones de disponibilité.
AWS hat neue Rechenzentrums-Komponenten angekündigt, die dazu konzipiert sind, die AI-Innovation der nächsten Generation zu unterstützen und die Effizienz zu verbessern. Zu den wichtigsten Verbesserungen gehören ein vereinfachtes elektrisches und mechanisches Design, das eine Infrastrukturverfügbarkeit von 99,9999% erreicht, innovative Kühlsysteme mit Flüssig-zu-Chip-Funktionalität sowie eine verbesserte Stromversorgung, die eine 6-fache Erhöhung der Rack-Leistungsdichte unterstützt. Die Updates bieten 12% mehr Rechenleistung, während der mechanische Energieverbrauch um 46% und der im Beton gebundene Kohlenstoff um 35% reduziert wird. Die Umsetzung beginnt Anfang 2025 in der globalen Infrastruktur von AWS, die 34 Regionen und 108 Verfügbarkeitszonen umfasst.
- 12% increase in compute power per site
- 46% reduction in mechanical energy consumption
- 35% reduction in embodied carbon in concrete
- 6x increase in rack power density over next two years
- 99.9999% infrastructure availability
- 89% reduction in potential rack impact from electrical issues
- None.
Insights
This announcement represents a significant leap in AWS's data center capabilities, with three major implications for investors: operational efficiency, AI readiness and cost optimization.
The
Most critically, the ability to support 6x increase in rack power density over two years positions AWS strongly against competitors like Microsoft Azure and Google Cloud in the race to capture the growing AI infrastructure market. The liquid cooling innovations and flexible multimodal design specifically target high-value AI workloads, indicating strong potential for revenue growth in this sector.
The sustainability improvements in these data center components represent meaningful progress in AWS's environmental commitments and cost structure. The
These improvements will likely result in reduced carbon taxation exposure and increased appeal to ESG-focused investors. The ability to achieve higher efficiency without increasing water usage is particularly notable, as water consumption has been a critical concern for data center operators. These advancements should strengthen AWS's competitive position in regions with strict environmental regulations.
New set of flexible data center components will support the next generation of generative AI innovation and provide
“AWS continues to relentlessly innovate its infrastructure to build the most performant, resilient, secure, and sustainable cloud for customers worldwide,” said Prasad Kalyanaraman, vice president of Infrastructure Services at AWS. “These data center capabilities represent an important step forward with increased energy efficiency and flexible support for emerging workloads. But what is even more exciting is that they are designed to be modular, so that we are able to retrofit our existing infrastructure for liquid cooling and energy efficiency to power generative AI applications and lower our carbon footprint.”
AWS has been building large-scale data centers for 18 years and GPU-based servers for AI workloads for 13 years. Today, AWS’s data centers support millions of active customers worldwide, including hundreds of thousands of customers using AWS AI and machine learning services, and tens of thousands of global customers using Amazon Bedrock to build their generative AI applications. As use of generative AI continues to grow and GPU capacity demands increase, AWS data centers are adapting to support increasingly higher power densities. Key improvements include:
1. Simplified electrical and mechanical design for high availability
AWS continuously focuses on offering customers the most reliable infrastructure. Simplified electrical and mechanical designs are more reliable and easier to maintain, ensuring that customers enjoy the benefits of high reliability that AWS has offered from the beginning.
AWS’s latest data center design improvements include simplified electrical distribution and mechanical systems, which enable infrastructure availability of
In a data center, electricity goes through multiple conversion and distribution systems before reaching the IT equipment. Each step naturally introduces inefficiency, energy loss, and potential failure points. As one new design example, AWS simplified the electrical distribution and in doing so, reduced the number of potential failure points by
2. Innovations in cooling, rack design, and control systems
AWS has built a number of new and enhanced capabilities to offer customers the most performant, highly available, and energy efficient infrastructure possible. New data center innovations include:
- Liquid cooling: Newer AI servers benefit from liquid cooling to more efficiently cool high density compute chips. AWS has developed novel mechanical cooling solutions providing configurable liquid-to-chip cooling in both its new and existing data centers. Some AWS technologies utilize network and storage infrastructure that does not require liquid cooling, so updated cooling systems will seamlessly integrate air and liquid cooling capabilities for the most powerful AI chipsets, like AWS Trainium2 and rack-scale AI supercomputing solutions like NVIDIA GB200 NVL72, as well as AWS’s network switches and storage servers. This flexible, multimodal cooling design allows AWS to provide maximum performance and efficiency at the lowest cost, whether running traditional workloads or AI models. The unique liquid cooling rack design was developed in collaboration with leading chip manufacturers to accelerate time to market for AI workloads.
- Support for high-density AI workloads: AWS is maximizing how power is used by optimizing how it positions racks in a data center. This was achieved through software, powered by data and generative AI, that predicts the most efficient way to land servers. AWS will now reduce the amount of stranded power – energy that is available but unused or underutilized – and make more efficient use of the energy available.
This design will support the next generation of hardware and high-density racks required for AI workloads, but is flexible enough to accommodate a wide range of other hardware types. AWS infrastructure offers the broadest and deepest compute platform with more than 750 Amazon Elastic Cloud Compute (Amazon EC2) instances, giving customers choice of the latest processor, storage, networking, operating system, and purchase model for any workload. In addition to the flexible multimodal cooling design, AWS has developed engineering innovations in its power delivery systems, which enable AWS to support a 6x increase in rack power density over the next two years, and another 3x increase in the future. This is delivered in part by a new power shelf, which efficiently delivers data center power throughout the rack, reducing electrical conversion losses.
Taken together, these innovations enable AWS to deliver
-
Updated control systems: The rollout of an Amazon-owned control system across AWS’s electrical and mechanical devices provides the ability to standardize monitoring, alarming, and operational sequences. For example, AWS’s internally built telemetry tools use AWS technologies to provide real-time diagnostics and troubleshooting services, both of which enable AWS to maintain optimal operating conditions on behalf of customers. In addition, AWS has increased the redundancy in its controls systems, while reducing complexity. These benefits result in AWS designing for infrastructure availability of
99.9999% .
3. Increased energy efficiency and sustainability, including
For many years, AWS has been a pioneer in improving energy efficiency and sustainability across its infrastructure. Research estimates AWS’s infrastructure is currently up to 4.1 times more efficient than on-premises infrastructure, and when workloads are optimized on AWS, the associated carbon footprint can be reduced by up to
AWS continuously reevaluates how its data centers operate and determines ways to help its infrastructure use energy more efficiently through ongoing innovation. The new components include the following upgrades for energy efficiency and sustainability:
-
A more efficient cooling system that is expected to reduce mechanical energy consumption by up to
46% compared to its previous design during peak cooling conditions, without increasing water usage on a per-megawatt basis. Design changes include a new single-sided cooling system, reduction in cooling equipment, and introduction of liquid cooling capabilities. -
Reduction of embodied carbon in the concrete of the data center building shell by up to
35% , compared to industry average. AWS is adopting specifications for lower-carbon steel and concrete, and optimizing the structural design to use less steel overall. -
Backup generators will be able to run on renewable diesel, a biodegradable and non-toxic fuel that can reduce greenhouse gas emissions by up to
90% over the fuel’s lifecycle when compared to fossil diesel. AWS has already started transitioning to renewable diesel to power backup generators at existing data centers inEurope and in America.
“Data centers must evolve to meet AI’s transformative demands,” said Ian Buck, vice president of hyperscale and HPC at NVIDIA. “By enabling advanced liquid cooling solutions, AI infrastructure can be efficiently cooled while minimizing energy use. Our work with AWS on their liquid cooling rack design will allow customers to run demanding AI workloads with exceptional performance and efficiency.”
“As Anthropic develops our leading foundation models, having access to secure, performant, and energy-efficient infrastructure is crucial to our success,” said James Bradbury, distinguished engineer, Compute, at Anthropic. “AWS’s commitment to building cutting-edge data centers is one of the key reasons we’ve chosen them as our primary cloud provider and training partner. Their design improvements represent a significant step forward in providing secure, scalable, and efficient infrastructure to power AI models and drive innovation in this field.”
“AWS’s continuous infrastructure advancements allow us to concentrate on innovating new services that help our customers make more informed financial decisions rather than the undifferentiated heavy lifting of running data centers,” said Alex Lintner, CEO of Technology, Software Solutions and Innovation, Experian. “Security and regulatory compliance are fundamental for us, and working with AWS helps to fortify our position as a trusted technology provider, supporting businesses across a variety of industries. With their energy-efficient and AI-optimized facilities, we can dedicate more resources to the rapid delivery of new data-driven products rather than data center management.”
“Our customers depend on us to deliver reliable and highly secure generative AI innovation in a trusted, private environment,” said Jeff Reihl, chief technology officer, LexisNexis Legal & Professional. “Our longstanding partnership with AWS and their leading infrastructure enable us to deliver this, and also meet our goal of increasing our positive environmental impact while striving to reduce our environmental footprint.”
The new data center components are built to scale across all of AWS’s infrastructure worldwide, including its 34 Regions, 108 Availability Zones, and other infrastructure offerings like AWS Local Zones. Construction on new AWS data centers with the full set of components is expected to begin in early 2025 in
To learn more about AWS Infrastructure, visit https://aws.amazon.com/about-aws/global-infrastructure/.
About Amazon Web Services
Since 2006, Amazon Web Services has been the world’s most comprehensive and broadly adopted cloud. AWS has been continually expanding its services to support virtually any workload, and it now has more than 240 fully featured services for compute, storage, databases, networking, analytics, machine learning and artificial intelligence (AI), Internet of Things (IoT), mobile, security, hybrid, media, and application development, deployment, and management from 108 Availability Zones within 34 geographic regions, with announced plans for 18 more Availability Zones and six more AWS Regions in
About Amazon
Amazon is guided by four principles: customer obsession rather than competitor focus, passion for invention, commitment to operational excellence, and long-term thinking. Amazon strives to be Earth’s Most Customer-Centric Company, Earth’s Best Employer, and Earth’s Safest Place to Work. Customer reviews, 1-Click shopping, personalized recommendations, Prime, Fulfillment by Amazon, AWS, Kindle Direct Publishing, Kindle, Career Choice, Fire tablets, Fire TV, Amazon Echo, Alexa, Just Walk Out technology, Amazon Studios, and The Climate Pledge are some of the things pioneered by Amazon. For more information, visit amazon.com/about and follow @AmazonNews.
View source version on businesswire.com: https://www.businesswire.com/news/home/20241201928268/en/
Amazon.com, Inc.
Media Hotline
Amazon-pr@amazon.com
www.amazon.com/pr
Source: Amazon.com, Inc.
FAQ
When will AWS implement its new data center components announced in 2023?
What efficiency improvements will AWS's new data center components deliver?
How will AWS's new data centers support AI workloads?
What is the infrastructure availability target for AWS's new data center design?
