News/AI Infrastructure
Major Tech Companies Explore Nuclear Power to Meet AI’s Energy Demands
Nuclear power emerges as solution for AI's energy appetite: Major cloud providers are exploring nuclear energy to meet the growing power demands of AI data centers, signaling a significant shift in the tech industry's approach to sustainable energy. The big picture: As artificial intelligence and cloud computing continue to expand, hyperscalers like AWS, Microsoft, and Google are turning to nuclear power as a carbon-free alternative to fuel their massive data centers and meet sustainability goals. AWS has made a bold move by purchasing a 960-megawatt nuclear-powered data center site from Talen Energy for $650 million, demonstrating the company's commitment to...
read Aug 14, 2024The Reciprocal Influence of AI and Data Centers — and the Future of Each
Artificial intelligence is rapidly transforming the digital landscape, with data centers at the forefront of this technological revolution. The AI market is projected to reach trillions in value by 2030, fundamentally altering how we work and interact with technology. The AI explosion: The growth of AI adoption has been unprecedented, with platforms like ChatGPT reaching a million users in just five days. AI's rapid growth is creating enormous demand for computational power and data processing capabilities. This surge in demand is placing significant pressure on existing data center infrastructure to evolve and adapt quickly. Data centers as evolving ecosystems: Modern...
read Aug 13, 2024AI-Driven Data Centers Embrace Liquid Cooling to Beat the Heat
Liquid cooling emerges as a critical solution for data centers grappling with the heat generated by AI workloads and increasingly powerful processors, marking a significant shift in cooling technology adoption. The big picture: As AI spending continues to rise, data centers are facing unprecedented thermal challenges, making liquid cooling a necessity rather than a luxury for maintaining operational efficiency and reliability. A Spring 2024 survey of 812 IT professionals revealed that 38.3% expect to implement liquid cooling in their data centers by 2026, nearly doubling the percentage from early 2024. This rapid adoption trend is driven by the need to...
read Aug 12, 2024U.S. Readies Power Grid for AI Surge, Energy Secretary Assures
U.S. Energy Secretary Jennifer Granholm has reassured the public that the United States is prepared to meet the increasing electricity demands driven by the rapid growth of artificial intelligence and data centers. The big picture: The surge in AI development is raising concerns about the ability to provide sufficient power for data centers, but Granholm emphatically states that the U.S. will be able to meet these growing energy needs. The Department of Energy projects that electricity demand in the U.S. will double by midcentury, driven by manufacturing growth, electrification of vehicles and appliances, and the expansion of data centers for...
read Aug 10, 2024xAI’s New Data Center is Making a lot of People in Memphis Very Unhappy
Elon Musk's ambitious new xAI data center in Memphis, Tennessee, touted as the "most powerful AI training cluster in the world," is stirring up both excitement and concern among local residents and officials due to its significant energy and water requirements. Massive power demands: The xAI facility is requesting 150 megawatts of electricity from the local utility, equivalent to the power consumption of 25,000-30,000 homes. While awaiting infrastructure upgrades, the data center is currently relying on on-site natural gas generators to meet its substantial energy needs. The local utility has assured that the facility's power demands will not affect other...
read Aug 8, 2024Microsoft and Pivot Energy Launch 500MW Solar Project to Power AI
A major renewable energy investment: Microsoft has announced a significant partnership to develop 500 megawatts of community-scale solar power projects across the United States, marking a substantial commitment to renewable energy and local community development. The tech giant is collaborating with Pivot Energy, a renewable energy company, in a 5-year partnership to construct approximately 150 mid-sized, ground-mounted solar projects. These projects will be distributed across up to 100 communities in 20 different states, demonstrating a wide-reaching approach to renewable energy development. Microsoft has committed to purchasing renewable energy credits from these projects for a 20-year term, providing long-term support for...
read Aug 6, 2024An AI-Powered Data Center is Heating the Olympic Pool
Innovative heat recycling at the Olympics: A new data center in Paris is being utilized to heat the Olympic Aquatics Center, demonstrating a novel approach to energy efficiency in the face of increasing power demands from artificial intelligence. The PA10 data center, owned by Equinix, channels its waste heat into a local energy system operated by French utility company Engie. At full capacity, the data center is expected to export 6.6 thermal megawatts of heat, sufficient to warm over 1,000 homes. This initiative is part of a broader European trend to repurpose data center heat for building warmth, as AI...
read Aug 6, 2024AI Infrastructure Takes Center Stage at Upcoming Ars Technica Events
Upcoming AI and infrastructure events: Ars Technica, in collaboration with IBM, is hosting two in-person events this fall focusing on artificial intelligence, infrastructure, and related technological challenges. The first event, "Beyond the Buzz: An Infrastructure Future with GenAI and What Comes Next," is scheduled for September 18 in San Jose, California, at the Computer History Museum. Topics to be discussed include infrastructure requirements for AI workloads, identifying vulnerabilities, and the environmental impacts of AI technologies. The second event, "AI in DC: Privacy, Compliance, and Making Infrastructure Smarter," will take place on October 29 in Washington, DC, at the International Spy...
read Aug 1, 2024GenAI Strains Data Centers, Highlights Urgent Need for Modernization
The rapid rise of generative AI is straining data centers and driving urgent modernization efforts, while budgets remain tight. As CIOs rush to bring genAI capabilities online, they face the daunting challenge of providing the immense power, cooling, and processing required to support these demanding workloads. The staggering energy demands of genAI: The scale of resources needed to support genAI is hard to comprehend, with ChatGPT alone estimated to consume enough daily energy to power 33,000 US homes. Data centers accounted for 4% of US energy consumption in 2022, and this figure is projected to reach 6% by 2026, according...
read Jul 31, 2024AMD’s Data Center Boom Overshadows Gaming Woes
The revenue growth and strong market position of AMD is driven by its data center business, while gaming segment faces challenges due to the maturing console cycle. The company is investing heavily in AI and expects significant growth opportunities across its business. Record data center revenue fuels AMD's growth: AMD's Q2 revenue increased 9% year-over-year to $5.8 billion, surpassing analyst expectations, primarily driven by the data center segment: Data center revenue reached a record $2.8 billion, a 115% increase compared to the previous year, powered by strong demand for AMD Instinct GPUs and 4th Gen Epyc processors. Client segment revenue...
read Jul 31, 2024Generative AI is Straining Aging US Power Grid
The rapid rise of generative AI is straining the aging US power grid, raising concerns about its ability to meet the technology's growing energy demands. Power grid challenges: The United States' electrical infrastructure is struggling to keep up with the power-hungry nature of generative AI models: Transformers, which convert raw electricity into usable power, are on average 38 years old and have become a major cause of power outages. Building new transmission lines has faced resistance due to the increased costs that are often passed on to local residents in the form of higher electric bills. Water scarcity and data...
read Jul 31, 2024Data Center and AI Chip Demand Fuel AMD Q2 Earnings Boost
A resurgent AMD proves its AI mettle in strong Q2, boosting hopes for continued growth in a challenging environment for chip stocks. Key financial highlights: AMD's second-quarter results exceeded expectations, driven by strong performance in its data center and artificial intelligence businesses: Revenue grew 9% year-over-year to $5.84 billion, surpassing estimates of $5.72 billion. Adjusted earnings per share (EPS) increased 19% year-over-year to $0.69, beating estimates by a penny. AI chip success: AMD's MI300X AI chip is gaining traction in the rapidly growing AI market, contributing significantly to the company's data center revenue: Sales of MI300 chips exceeded $1 billion...
read Jul 27, 2024AI Computing Means Doubling Data Center Electricity Demand by 2026
The increasing deployment of AI is leading to significant environmental concerns due to its heavy emissions footprint. A recent report from Google highlighted a 13% rise in its emissions in 2023, primarily attributed to increased electricity consumption in its data centers driven by greater AI usage. As AI becomes more widely adopted, its impact on global energy consumption is expected to grow substantially, potentially doubling the electricity demand of data centers by 2026. AI's energy-intensive nature: AI models require significantly more computational power and generate more heat compared to traditional searches, leading to higher electricity consumption and cooling needs in...
read Jul 26, 2024Data Centre Boom Strains Australian Power Grid, Threatens Price Hikes
The rapid growth of data centres in Australia is straining the electricity grid and could lead to higher power prices, according to energy experts. Soaring demand for data centres: Australia is a top hub for data centres globally, with 214 facilities nationwide. The explosive growth of cloud computing and AI is expected to drive exponential expansion in the coming years: One large data centre can consume as much electricity as 50,000 homes. Data centres currently use an estimated 5% of Australia's grid power, projected to rise to 8-15% by 2030. David Dzienciol of data centre operator NEXTDC believes electricity demand...
read Jul 25, 2024New Jersey Gambles $500M to be the Next AI Epicenter
New Jersey is enacting a hefty new tax credit program to attract AI companies, aiming to establish itself as a hub for AI innovation. However, the true economic impact and job creation potential remain uncertain. Key details of the AI tax credit program: New Jersey's governor signed a law offering up to $500 million in tax credits for AI companies and data centers that operate at large scales in the state: AI companies and data centers can qualify for the credits by diverting unspent funds from two other state tax credit programs enacted in response to the Covid-19 pandemic. To...
read Jul 25, 2024Inadequate Infrastructure and Talent Threaten to Leave Africa Behind in the AI Revolution
The AI revolution threatens to leave Africa behind, as the continent faces significant infrastructure gaps that create a new digital divide. Two key factors are hindering Africa's ability to capitalize on the transformative potential of AI: Inadequate digital infrastructure: Africa lacks the necessary foundation to support widespread AI adoption and development: Only a third of Africans have access to 4G mobile networks, compared to 90% in rich countries, limiting the ability to use data-hungry AI applications. Less than 1% of African homes have a fixed broadband connection, further constraining access to high-speed internet crucial for AI development and deployment. Electricity...
read Jul 22, 2024xAI Powers Up Massive Memphis Supercomputer, Sparking Local Excitement and Environmental Concerns
Elon Musk's xAI startup has powered up a massive supercomputing facility in Memphis, Tennessee to train its next AI model, Grok, with over 100,000 Nvidia H100 GPUs, sparking both excitement and concerns among locals. Key details about xAI's Memphis supercomputing cluster: The facility, dubbed the "Gigafactory of Compute," is now operational and began training models at 4:20am local time on Monday morning, according to Musk. It leverages 100,000 liquid-cooled Nvidia H100 GPUs on a single RDMA fabric, which Musk touts as "the most powerful AI training cluster in the world." The H100 GPUs are designed specifically for training large AI...
read Jul 18, 2024Bitcoin Miners Pivot to AI: The New Frontier in West Texas
The race to power AI is accelerating, with bitcoin miners in West Texas shifting their focus to meet the growing demand for artificial intelligence infrastructure: Lancium and Crusoe Energy Systems announced a multibillion-dollar deal to build a 200-megawatt data center near Abilene, Texas, designed to cater to the unique needs of AI companies, with plans to expand to 1.2 gigawatts. At full capacity, this will be one of the largest AI data center campuses in the world, underscoring the rapid evolution of data centers to support modern AI workloads. Bitcoin miners embrace AI: Following the recent bitcoin halving, which has...
read Jul 10, 2024Musk’s xAI Opts for In-House Data Center, Prioritizing Speed and Control
Elon Musk's artificial intelligence startup, xAI, has decided to build its own data center rather than partnering with Oracle, due to disagreements over the speed of construction and the availability of power at the proposed site. Musk's desire for rapid development: xAI's decision to go solo reflects Musk's belief in the importance of moving quickly and maintaining control over critical infrastructure: In a post on X, Musk explained, "When our fate depends on being the fastest by far, we must have our own hands on the steering wheel." The talks between Oracle and xAI stalled because Musk demanded the facility...
read Jun 26, 2024Intel’s Optical Chiplet Promises AI Boost, Transforming Data Centers
Intel has developed a small chiplet that uses light instead of electricity to transmit data between processors, potentially improving the bandwidth and efficiency of data centers tasked with intense AI processing. The OCI chiplet was recently demonstrated by Intel at the Optical Fiber Communication Conference, integrated with one of its CPUs. By using laser light traveling through fiber optic connections, the chiplet enables processors to communicate over distances nearly 100 times longer than traditional copper cables, allowing for more flexible and distributed data center architectures. Addressing AI's computational demands: The OCI chiplet is designed to help data centers cope with...
read Jun 26, 2024AI Data Center Boom: Powering Growth, Benefiting REITs, Energy, and Mining Sectors
The AI data center boom is set to drive significant growth in electricity demand and benefit a range of sectors, according to Jefferies analysts: Key takeaways: The increasing use of GPUs for AI investments has led to a surge in demand for data center space and power, with growth exceeding 30% in most markets over the past two years and showing no signs of slowing down. While Jefferies expects data center growth to remain robust, power generation constraints, supply chain issues, and labor market limitations may limit the acceleration rate. As the data center market expands, electricity demand is expected...
read