Specials

AI Is Changing the Landscape of Data Centers

A lot has been written about the way artificial intelligence is changing the way we live, work, and learn. It may also change the physical landscape around us.

That is because AI is set to spur the construction of new data centers, those large, warehouse-like facilities filled with servers that form the backbone of the internet.

The demand for AI and data center capacity is already apparent, with prices rising at existing data centers due to AI use. According to Data Bridge Market Research, the market for AI infrastructure is expected to hit $422 billion by 2029, growing at a compound annual rate of 44%.

“AI will stimulate additional data center use, expansion of current data centers and creation of new data centers,” said 2024 IEEE President Tom Coughlin.

India is fast emerging as a data center hub with the explosion of data. Robust growth in data consumption has catapulted the industry to its current position. The current numbers and future estimates both are promising and look real going by the fledgling industry trend. Every digital interaction creates new data which is stored in Data Centers.

WHAT ARE DATA CENTERS?

A typical data center is about 100,000 square feet, which is a little bigger than an 81,000 square-foot soccer field, and a little smaller than two football fields, which total about 114,000 square feet. But the largest are more than 2 million square feet. Inside, they are filled with rows and rows of servers. Companies lease computing time and data storage to run their IT operations, their e-commerce sites and more. Every time you choose a movie on your favorite streaming service, that movie streams from a data center.

The facilities can use large quantities of water to keep the servers cool, so they tend to have large structures on the roof to act as chillers.

Then there are the energy sources. A data center can consume 10 to 50 times more energy per square foot than a comparable office building.

That has placed intense focus on the source of power used by facilities and their carbon footprint. Solar and wind power are frequently used, which means that in addition to a large warehouse, renewable energy facilities tend to be built nearby.

In fact, the pace of data center construction, and the related energy demands, has driven construction of new solar farms nearby, creating solar energy hotspots in some regions.

Because of their large physical footprint, the energy demands and water consumption, data centers have drawn some opposition over concerns that they are not sustainable. Operators of these facilities are under intense pressure to increase their sustainability.

WHERE ARE THE DATA CENTERS LOCATED?

Why are data centers built in some places and not others? The decision on where to build involves many factors.

The largest cluster of data centers in the world, located in Northern Virginia, has its roots in the 1990s, when several giants of the early internet located there and built fiber optic networks. Data centers arrived later because of the large availability of fiber optic cable.

Today, communications infrastructure is just one of many factors data center operators consider when scouting new locations.

“Good high performance communication infrastructure is important as is relatively low power costs and reliability of those power sources,” Coughlin said. “Thus, weather and climate can be important factors. Operators look at major events and ask, ‘Could this knock out power for a considerable period of time?’ Water for cooling is also important, as is availability of an IT workforce.”

HOW MUCH ENERGY DOES AI USE?

AI processing is more intense than traditional computing because it relies on more data to make its outputs. As a result, it has higher energy requirements. The leading GPUs used for AI may consume as much as 700W of power, which is roughly equivalent to a microwave.

Coughlin notes that GPUs that consume twice as much energy may be available in the not-too-distant future. And because computing power generates heat, that will in turn drive greater use of liquid cooling to bring heat out of data centers.

From train tickets to airlines, from gas connections to local grocery stores to patient files, more data is generated every microsecond. The average consumer data consumption is ~ 37 GB per month in India according to the Ericsson’s data traffic outlook.

According to the report from DataReportals / Kepios Analysis, India’s data centers, accounting for 2% of the nation’s total power consumption, rely mainly on fossil fuels and pose a formidable environmental challenge with a substantial carbon footprint.

POWERING AI

The developers of the largest data centers, called hyperscalers, are acutely aware of the electricity needs of their facilities. Their reliance on wind and solar solves two challenges: it provides resiliency in the event of a local power outage.

“These organizations depend upon power,” Coughlin said. “Many of them have built their own solar power systems and even wind power systems. Some are planning modular nuclear power as part of their zero-carbon emission plans.”

In one recent trend, data centers have begun locating near other industrial facilities. That process takes advantage of wastewater used in industrial processes for cooling. As a result, some data centers have wastewater treatment facilities on premises.