Liquid Cooling vs Air Cooling in Data Centers: The Real Economics

Liquid cooling is cheaper to operate than air cooling at scale for one dominant reason: every megawatt moved from air to liquid escapes the chiller – the most expensive component in the cooling chain. But air cooling never disappears entirely. This guide explains the real economics of the air/liquid split in an AI-era data center, based on our experience planning new builds at DELSKA.

Key takeaways

  • Direct-to-chip liquid cooling captures roughly 70–85% of rack heat; memory, NICs, power supplies and optics still reject to air, creating a structural floor of about 15–20% air cooling in any large deployment.
  • Air and liquid are different thermodynamic worlds: the air loop runs on low-temperature water (about 7°C to low-20s°C) and needs chillers; the high-temperature liquid loop returns water at 60–70°C and can reject heat with dry coolers alone, year-round, almost anywhere in Europe.
  • The “chiller tax” is the economic core: chillers carry the highest capex, maintenance, F-gas regulatory exposure and compressor energy – hitting PUE directly. Liquid megawatts do not pay it.
  • At 60–70°C, return water is near-ready district heating supply – in Germany a permitting argument and a potential revenue line under the Energy Efficiency Act.
  • Design conclusion: fix the power blocks, not the cooling ratio. Make power infrastructure technology-agnostic and let the cooling mix follow tenant demand.

Definitions

  • Direct-to-chip (DLC) liquid cooling – cold plates on CPUs/GPUs transfer heat to a liquid loop, removing the majority of rack heat without moving air.
  • Chiller – a compressor-based refrigeration machine producing chilled water for the air-cooling loop; the most expensive element of the chain in capex, maintenance and energy.
  • Dry cooler – a heat exchanger rejecting heat to ambient air without compressors or refrigerants; works alone when loop temperatures are high enough.
  • PUE (Power Usage Effectiveness) – total facility power divided by IT power; compressor energy is one of its biggest drivers.
  • Chiller tax – our shorthand for the combined capex, opex, F-gas exposure and PUE penalty that every air-cooled megawatt carries and liquid-cooled megawatts avoid.

Air vs liquid: the comparison

DimensionAir cooling loopHigh-temp liquid loop (DLC)
Working temperature~7°C to low-20s°C water60–70°C return water
Heat rejectionChillers required (at least for peak trimming)Dry coolers alone, 365 days, virtually anywhere in Europe
Compressors / refrigerantsYes – capex, maintenance, F-gas exposureNone
PUE impactCompressor energy hits PUE directlyMinimal mechanical cooling energy
Share of rack heat (AI hall)Structural floor of ~15–20%~70–85% via direct-to-chip
Heat reuse readinessNeeds heat pump upgrade to be usefulNear district-heating grade as-is
Scaling behaviourShare shrinks as facility growsShare grows with rack density

Why the air share shrinks as facilities scale

When we started planning our new builds we assumed roughly 20% air / 80% liquid. Then we noticed the larger the facility gets, the smaller the air percentage becomes – not by choice, but because physics and economics push it there. Every air-cooled megawatt pays the chiller tax; every liquid megawatt escapes it into dry cooler economics. At scale, that difference compounds.

And yet air never reaches zero. Even in a “fully liquid” AI hall, the residual heat from memory, NICs, power supplies and optics – plus network cores, storage and support infrastructure – lands at about 15–20% air. That is not a design choice. That is physics, at least until chip makers eliminate air-cooled components entirely.

Two loops, not one

One shared water system is not realistic: the loops live at completely different temperatures. What you can share is the top layer – the heat rejection field masterplan, water treatment, and BMS. The hydraulic circuits stay separate.

Waste heat: from cost to revenue

At high-temperature DLC return levels you are sitting on near-ready district heating supply. In Germany, where the Energy Efficiency Act requires heat reuse readiness for large data centers, 60–70°C return water stops being an ESG talking point and becomes a permitting argument – and potentially a revenue line. Lower-temperature loops need a heat pump in between. See the EU Data Centre Regulation Tracker for country-by-country heat reuse rules.

The design conclusion: fix the power blocks

Do not fix the air/liquid ratio in concrete. Design transformers, distribution and UPS topology to be technology-agnostic. Oversize pipes, headers and pump capacity in phase one – cheap now, brutally expensive later – and pre-reserve dry cooler positions in the field masterplan. Then let the cooling mix follow tenant demand, phase by phase. Only one thing in the building is permanent: power.

Frequently asked questions

Can a data center be 100% liquid cooled?

Not today. Direct-to-chip captures 70–85% of rack heat, but memory, power supplies, optics, network and storage still reject heat to air – a structural floor of roughly 15–20% until component design changes.

Does liquid cooling improve PUE?

Yes, primarily by removing compressor energy: high-temperature loops reject heat through dry coolers without chillers, and chiller compressor energy is one of the largest PUE drivers in air-cooled facilities.

Is liquid cooling worth it for existing facilities?

Retrofits are far more expensive than new builds designed for it. The economical path is hybrid: keep the air loop as a service layer and add liquid capacity where rack density demands it – if the pipes and pumps were sized for it in phase one.

Related articles

EU Data Centre Regulation Tracker: Energy, Heat Reuse and PUE Rules by Country

Data centre operators in the EU are now subject to binding energy and heat reuse rules, and the requirements differ sharply by country. This tracker summarises what applies where: the EU-wide framework, each national transposition, thresholds, quotas, deadlines and penalties – in one place. Last updated: 27 July 2026.

Key takeaways

  • The EU Energy Efficiency Directive (EED, 2023/1791) requires annual public reporting for data centres with ≥500 kW IT power and waste heat reuse for facilities >1 MW unless technically or economically infeasible.
  • Germany is the strictest market: waste heat reuse quotas of 10/15/20% from July 2026/2027/2028, 100% renewable electricity by 2027, PUE ceilings, and fines up to €100,000 – applying from just 300 kW.
  • National approaches diverge widely: France regulates from 100 kW, Austria has obligations without quotas, the Nordics rely on voluntary district heating partnerships, the Netherlands and Ireland use moratoriums and grid connections as the lever.
  • A second EU regulatory wave lands in 2026: the Data Centre Energy Efficiency Package, an EU-wide sustainability rating scheme, and an expected Cloud and AI Development Act.
  • Site selection economics are shifting from “cheap power + cool climate” to “cheap power + cool climate + heat off-taker”.

The EU-wide framework

Three instruments form the federal layer. The recast Energy Efficiency Directive (EED, Directive (EU) 2023/1791, in force since 2023) created the first EU-wide obligations: annual public reporting of energy performance for data centres with an installed IT power demand of 500 kW or more, and a soft mandate for facilities above 1 MW to reuse waste heat unless it is technically or economically infeasible. The Renewable Energy Directive (REDIII) adds renewable energy obligations, and a March 2024 Delegated Regulation established a common EU rating scheme for data centre sustainability reporting.

Definitions

  • EED – the EU Energy Efficiency Directive (2023/1791), the primary EU law regulating data centre energy performance.
  • PUE (Power Usage Effectiveness) – total facility energy divided by IT energy; 1.0 is theoretically perfect, and regulatory ceilings typically target 1.2–1.5.
  • Waste heat reuse – capturing heat rejected by IT equipment and supplying it to consumers such as district heating networks, instead of venting it to the atmosphere.
  • Heat off-taker – a customer (city network, industrial site, campus) that accepts and uses a data centre’s waste heat.

Country-by-country tracker

CountryApplies fromKey obligationsEnforcement
Germany (EnEfG, 2023)300 kWPUE ceilings; hard waste heat reuse quotas of 10/15/20% from July 2026, 2027, 2028; 100% renewable electricity by 2027Fines up to €100,000 per violation
France100 kW (reporting)Energy reporting from 100 kW; waste heat recovery obligations from 1 MWNational energy authority oversight
Austria (EEffG, April 2024)Reporting thresholds per EEDReporting plus a general waste heat utilisation obligation; no tiered quotasAdministrative penalties
NetherlandsCase-by-caseMoratoriums and grid connection conditions used as primary lever; hyperscale permits restrictedPermitting and grid access
IrelandCase-by-caseDe facto moratorium in Dublin region via grid connection policyGrid operator (EirGrid) conditions
Nordics (SE, FI, DK, NO)VoluntaryHeat reuse driven by mature district heating markets and commercial partnerships rather than mandatesMarket-based
Switzerland (non-EU)>2 GWh waste heatData centres above 2 GWh must supply waste heat to third parties at costCantonal implementation

The 2026 second wave

The European Commission has confirmed a Data Centre Energy Efficiency Package alongside the Strategic Roadmap on Digitalisation and AI for the Energy Sector (Q1–Q2 2026), plus an EU-wide sustainability rating scheme adopted in Q2 2026. Minimum performance standards and a Cloud and AI Development Act are expected to follow. For operators this means the reporting-only phase is ending: performance floors and rating-linked obligations are next.

What this means for operators and investors

  • Site selection now has a third variable: proximity to a heat off-taker is becoming as important as power price and climate.
  • High-temperature liquid cooling (60–70°C return water) turns compliance into revenue: it is near-ready district heating supply, while low-temperature loops need heat pumps in between.
  • Germany rewards early movers: facilities designed for heat reuse gain a permitting argument, not just an ESG talking point.
  • Retrofitting heat reuse into an existing air-cooled facility is far more expensive than designing for it – oversize pipes and reserve dry cooler positions in phase one.

Frequently asked questions

Do the EU rules apply to small server rooms?

No. The EED reporting obligation starts at 500 kW installed IT power. Germany goes further, applying national obligations from 300 kW, and France requires reporting from 100 kW.

Is waste heat reuse mandatory everywhere in the EU?

Not unconditionally. The EED requires reuse for facilities above 1 MW unless technically or economically infeasible – the feasibility test is the operative clause. Germany is the exception, with hard quotas that apply regardless.

Which EU country is hardest for data centre compliance?

Germany, by a distance: the lowest threshold (300 kW), hard reuse quotas, a renewable electricity mandate from 2027, PUE ceilings and six-figure fines.

Related articles

The Only Constant in a Modern Data Center Is Power

Key takeaways

  • Direct-to-chip liquid cooling captures 70–85% of rack heat; the rest still rejects to air – a structural floor of about 15–20% air in any large deployment.
  • Air and liquid loops run at completely different temperatures (about 7–20°C vs 60–70°C) and cannot realistically share one water system.
  • Every megawatt moved from air to liquid escapes the “chiller tax” – the capex, maintenance, F-gas exposure and PUE penalty of compressor-based cooling.
  • Design conclusion: keep power infrastructure technology-agnostic and let the cooling mix follow tenant demand.

Everything else – especially cooling – is a variable.

Air cooling vs liquid cooling loops in a modern AI data center

When we started planning our new data center builds, we began with what felt like a safe assumption: roughly 20% air cooling, 80% liquid. A reasonable split for an AI-era facility.

Then we noticed something. The larger the facility gets, the smaller the air percentage becomes – not because we decided so, but because the physics and the economics push it there. And yet air never reaches zero. Here’s what we’ve learned designing around that tension.

Air cooling doesn’t disappear – it becomes a service layer.

Even in a “fully liquid” AI hall, direct-to-chip cooling captures roughly 70–85% of rack heat. The rest – memory, NICs, power supplies, optics – still rejects to air. Add network cores, storage, and support infrastructure, and you land at a structural floor of about 15–20% air in any large deployment. That’s not a design choice. That’s physics, at least until chip makers eliminate air-cooled components entirely.

These are two different thermodynamic worlds.

Here’s what gets glossed over in most “hybrid cooling” discussions: air and liquid loops don’t just differ in medium – they live at completely different temperatures.

The air-cooling loop is a low-temperature water system, typically operating anywhere from about 7°C up to the low-20s°C depending on facility design and economization strategy – which means chillers, at least for peak trimming. By contrast, the high-temperature liquid-cooling loop can return water at 60–70°C – and at those temperatures, dry coolers alone handle heat rejection year-round, virtually anywhere in Europe. No compressors. No refrigerants. Free cooling, 365 days.

One shared water system? Not realistically. What you can share is the top layer: the heat rejection field masterplan, water treatment, BMS. The hydraulic circuits themselves stay separate.

Every megawatt you move from air to liquid escapes the chiller tax. This is the economic insight hiding inside the ratio question. Chillers are the most expensive component of the cooling chain – capex, maintenance, F-gas regulatory exposure, and above all compressor energy that hits your PUE directly.

Shift a megawatt from air to liquid, and it doesn’t just change cooling technology. It moves from chiller economics to dry cooler economics. That’s why the air percentage naturally shrinks as facilities scale: every air-cooled megawatt carries a chiller tax that liquid megawatts don’t pay.

70°C return water isn’t waste – it’s an asset. At high-temperature DLC return levels, you’re sitting on near-ready district heating supply. In Germany, where the Energy Efficiency Act already requires heat reuse readiness for large data centers, this stops being an ESG talking point and becomes a permitting argument – and potentially a revenue line. Lower-temperature liquid loops need a heat pump in between; at 60–70°C, you’re much closer to plug-and-play.

So what does this mean for design? Our conclusion: don’t fix the air/liquid ratio in concrete. Fix the power blocks.

Design power infrastructure – transformers, distribution, UPS topology – to be technology-agnostic. Oversize the pipes, headers, and pump capacity in phase one (cheap now, brutally expensive later). Then let the cooling mix follow tenant demand, phase by phase, with dry cooler positions pre-reserved in the field masterplan.

Because in the end, only one thing in the building is permanent: power. Everything downstream of the busbar should be ready to change.

How are you approaching the air/liquid split in your new builds? Curious whether others are seeing the same structural floor around 15–20% air.

#DataCenters #LiquidCooling #AIInfrastructure #Sustainability #DistrictHeating #PUE

https://www.linkedin.com/pulse/only-constant-modern-data-center-power-andris-gailitis-jayrf

Related articles:

Data Centre Waste Heat Reuse Regulation in the EU

Key takeaways

  • The EU Energy Efficiency Directive (2023/1791) requires annual public reporting from 500 kW IT power and waste heat reuse above 1 MW unless infeasible.
  • Germany is the strictest: reuse quotas of 10/15/20% from July 2026/2027/2028, 100% renewable electricity by 2027, fines up to €100,000 – from just 300 kW.
  • National rules diverge: France regulates from 100 kW, Austria has no quotas, the Nordics rely on voluntary district heating partnerships, the Netherlands and Ireland use moratoriums and grid access.
  • A second EU wave arrives in 2026 – site selection is shifting to “cheap power + cool climate + heat off-taker”.

Heat reuse from data centres is no longer purely voluntary in Europe. The 2023 recast Energy Efficiency Directive (EED, Directive (EU) 2023/1791) created the first EU-wide framework: annual public reporting for facilities ≥500 kW IT power, and a soft mandate for facilities >1 MW to reuse waste heat unless technically or economically infeasible. The Renewable Energy Directive (REDIII) and a March 2024 Delegated Regulation establishing a common EU rating scheme complete the federal layer.

Map and overview of EU data centre waste heat reuse regulation by country

National transpositions diverge sharply. Germany’s Energy Efficiency Act (EnEfG, 2023) is the strictest: PUE ceilings, hard waste heat reuse quotas (10/15/20% from July 2026, 2027, 2028), 100% renewable electricity by 2027, and fines up to €100,000 per violation, applied from 300 kW. France imposes reporting from 100 kW and waste heat recovery from 1 MW. Austria’s EEffG (April 2024) introduces reporting and a general waste heat utilisation obligation but no tiered quotas. Switzerland (non-EU) requires data centres >2 GWh waste heat to supply third parties at cost. The Nordics drive heat reuse mostly through voluntary partnerships with mature district heating networks rather than mandates. The Netherlands and Ireland have used moratoriums and grid connection conditions as their primary lever.

A second EU regulatory wave is now imminent. The Commission has confirmed a Data Centre Energy Efficiency Package alongside the Strategic Roadmap on Digitalisation and AI for the Energy Sector in Q1–Q2 2026, plus an EU-wide sustainability rating scheme adopted in Q2 2026. Minimum performance standards and a Cloud and AI Development Act are expected to follow. Site selection economics across the bloc are shifting from ‘cheap power + cool climate’ to ‘cheap power + cool climate + heat off-taker’.

#DataCenters #WasteHeatRecovery #EnergyEfficiency #DistrictHeating #EUPolicy #EnEfG #Sustainability #GreenIT #Colocation #DigitalInfrastructure

https://www.linkedin.com/pulse/data-centre-waste-heat-reuse-regulation-eu-andris-gailitis-o4igf

Related articles:

I Ran the Numbers: If You Filled a 1MW Data Center With iPhones – Here’s the Theoretical Compute Power You’d Get

Key takeaways

  • A 1MW data center could power about 250,000 iPhone 16 Pro Max units (~4W each under sustained load).
  • On paper that is ~1 ExaFLOP of FP32 GPU compute – exascale territory, rivaling the Frontier supercomputer.
  • Mobile chips are ~10x more power-efficient than data-center GPUs (~1 TFLOPS/W vs ~0.1 TFLOPS/W for an NVIDIA H100).
  • Reality check: thermal throttling, interconnect bandwidth and sustained-load limits make this a thought experiment, not a build plan.

Great thought experiment! Let me work through this. The newest iPhone is the iPhone 16 Pro Max (A18 Pro chip, released Sept 2024).

Server racks filled with iPhones in a 1MW data center thought experiment

How many iPhones? Under sustained heavy computational load, an iPhone 16 Pro Max draws roughly ~4 watts. That means 1,000,000W ÷ 4W = ~250,000 iPhones.

The A18 Pro chip has three compute engines.

GPU – ~4 TFLOPS (FP32) per device. 250,000 × 4 TFLOPS = 1 ExaFLOP – that’s exascale territory, matching the world’s most powerful supercomputers.

Neural Engine – 35 TOPS (INT8) per device. 250,000 × 35 TOPS = 8.75 PetaOPS for AI/ML inference workloads.

CPU – ~0.6 TFLOPS per device. 250,000 × 0.6 TFLOPS = ~150 PetaFLOPS.

Efficiency is actually impressive. The A18 Pro delivers roughly ~1 TFLOPS/W (GPU), while a data center-grade NVIDIA H100 GPU delivers ~0.1 TFLOPS/W (FP32). Mobile chips are extraordinarily power-efficient by comparison – they just can’t run continuously at peak without throttling.

Physical reality check: each iPhone 16 Pro Max is about 163 × 78 × 8.3 mm. 250,000 of them occupy roughly 26 cubic meters – filling only about 18 standard server racks physically, though cooling all those densely packed devices would be an engineering nightmare.

MetricValue
iPhones needed~250,000
GPU compute~1 ExaFLOP (FP32)
AI inference~8.75 PetaOPS (INT8)
Physical volume~26 m³ (~18 racks)
Cost (at ~$1,200/unit)~$300 million

The compute number is genuinely staggering – on paper it rivals Frontier, the world’s first exascale supercomputer – but of course real-world use would be limited by thermal throttling, interconnect bandwidth, and the fact that iPhones aren’t designed for sustained 100% load.

#DataCenters #AIInfrastructure #Compute #iPhone #HPC #EnergyEfficiency

https://www.linkedin.com/pulse/i-ran-numbers-you-filled-1mw-data-center-iphones-heres-gailitis-0rvtc

Related articles:

When Energy-Saving Climate Control Puts Drivers to Sleep: The Hidden CO₂ Problem in Modern Cars

Key takeaways

  • CO₂ buildup in car cabins – often caused by automatic HVAC recirculation – causes drowsiness: with four occupants, levels can reach 2,500 ppm within five minutes.
  • Outdoors CO₂ is about 420 ppm; above 1,500–2,000 ppm most people feel distinctly heavy-eyed. This is a road safety issue, not just comfort.
  • Modern cars flip into recirculation automatically to save energy, often without any clear dashboard indicator.
  • Awareness is near zero on mainstream driver forums; only niche EV and RV communities discuss cabin CO₂.
EV car
Eletric car
Green car

A few weeks ago, a Latvian TV segment by journalist Pauls Timrots caught my attention. He talked about that strange heaviness drivers sometimes feel on long trips — not quite fatigue, not quite boredom, but a foggy drowsiness that creeps in, especially at night or in stop-and-go traffic.

What struck me is that most people know the feeling but don’t have a name for it. We assume it’s just “tiredness.” Yet the culprit, in many cases, is something more invisible: carbon dioxide (CO₂) buildup inside the cabin.

I first learned about this years ago in tropical cities, where taxis often ran their air conditioning permanently in recirculation mode. With the fresh-air intake closed and windows up, CO₂ levels in those cabs would climb to levels I’d normally only expect in a packed lecture hall with no ventilation. I once measured 5,000 ppm in a taxi — a concentration known to cause drowsiness, headaches, and sluggish thinking.

Show the driver the “fresh air” button, and within minutes the numbers fell, along with the yawns.

Fast forward to today. The difference is that the “driver” making that decision in your car is often not you — it’s the HVAC algorithm. To save energy, modern cars (whether ICE, hybrid, or EV) lean heavily on recirculation. Some models even flip into recirc automatically, without a clear dashboard indicator, sometimes even in manual climate mode. Unless you’re carrying a CO₂ sensor (like an Aranet), you may never know why you suddenly feel like nodding off.


What the Science Shows

Outdoors, CO₂ sits at about 420 ppm. Most building standards aim to keep indoor levels below 1,000 ppm, because research links higher levels to impaired concentration and increased fatigue. By 1,500–2,000 ppm, many people feel distinctly heavy-eyed.

And in cars? Levels climb shockingly fast. One Swedish study found that with four people in a closed cabin, CO₂ reached 2,500 ppm within five minutes — and 6,000 ppm within 20 minutes — even with some ventilation. In real-world driving tests, single-occupant vehicles often cross 1,500 ppm in less than half an hour when the HVAC is favoring recirculation.

That’s not just an air quality number. That’s a road safety issue.


What AI Tools Reveal About Awareness

I ran this topic through a few AI-powered trend analysis tools and forum scans, and the pattern was striking:

  • On mainstream driver forums, there’s almost zero discussion of CO₂. People talk about foggy glass, stale air, or “feeling tired,” but rarely connect it to cabin CO₂.
  • In niche communities — Tesla owners, Rivian forums, overlanders, and RV groups — the conversation is growing. These are the people who buy CO₂ meters and post screenshots of 2,000+ ppm.
  • Academic research is solid and ongoing, but mostly locked away in journals. Few car magazines or mainstream outlets ever reference it.
  • Automakers? Silent. Some premium brands include CO₂ sensors, but they’re marketed as “air quality features” (to block pollution), not as safety tools.

What AI essentially shows is a disconnect: the science is mature, the user experience is common, but the public conversation is minimal.


Practical Fixes for Drivers

The good news is that once you know what’s happening, it’s not hard to fix:

  • Prefer fresh air over recirculation when cruising.
  • If your car insists on switching back to recirc, try toggling it off manually (some Toyotas respond to this reset trick).
  • In stubborn systems, crack the window 1–2 cm. Noisy, yes. Effective, absolutely.
  • Keep your cabin filter clean — a clogged filter nudges the HVAC to favor recirc.
  • Consider carrying a small CO₂ meter. Once you’ve seen a cabin climb past 1,500 ppm, you’ll never unsee it.

For Automakers and Fleets

This is an easy win for safety and trust.

  • Show recirculation state clearly in the UI. Don’t override it without a visible cue.
  • Add a basic CO₂ sensor and bias toward fresh air when levels rise.
  • Offer a persistent “Fresh Air Priority” setting.
  • For fleets: train drivers to recognize drowsiness linked to air quality, not just lack of sleep.

Why It Matters

Older cars did what you told them: fan on, recirc off, end of story. Newer vehicles are smarter, but their logic is mostly about efficiency and temperature comfort — not human alertness. Energy savings are important. But alert drivers are non-negotiable.

This is one of those invisible safety issues that deserves daylight. Just as we take seat belts, ABS, and air filters for granted, we should start treating fresh air as a core safety feature, not a luxury setting.

Until then, the responsibility is on us as drivers: know the signs, press the button, crack the window.

Because the next time you feel a wave of unexplained drowsiness behind the wheel, it may not be your body telling you to sleep. It may just be the air you’re breathing.


Curious to hear from others: Have you ever noticed this effect? Have you measured CO₂ in your car? And should automakers be more transparent about it?

Subscribe & Share now if you are building, operating, and investing in the digital infrastructure of tomorrow.

#RoadSafety #DriverSafety #AutomotiveInnovation #VehicleSafety #AirQuality #CarbonDioxide #CabinAir #HealthAndSafety #HumanFactors #TransportationSafety #FutureOfMobility #SustainableTransport #SmartCars #ConnectedCars #AutomotiveEngineering #ArtificialIntelligence #AIInsights #DataDriven #SafetyFirst #LinkedInThoughtLeadership

https://www.linkedin.com/pulse/when-energy-saving-climate-control-puts-drivers-sleep-andris-gailitis-4rlif

Related articles:

AI Inside AI: How Data Centers Can Use AI to Run AI Workloads Better

Key takeaways

  • AI can run the AI data center: instant temperature and airflow forecasting, predictive maintenance from sensor data, and energy-aware scheduling of training jobs.
  • Real-time monitoring of PUE, WUE and carbon intensity turns efficiency into an operational discipline.
  • AI also covers security anomaly detection, GPU health forecasting, incident “fire drills” and automated compliance reporting.
  • If you host AI workloads, your operations should be AI-driven too – a necessity, not a choice.

AI Inside AI: How Data Centers Can Use AI to Run AI Workloads Better

This is a high-stakes AI workload host challenge—the machinery has a dense GPU cluster but also hard-to-predict demand and extreme cooling demands. However, the same technology pushing this sort of workload in the future will also help the center run more smoothly, safely, and environmentally friendly.

How to use AI to manage the AI data center in 10 steps:

1. AI models instantly forecast temperature changes. These models can render instant forecasts of airflow patterns to compensate for hot areas by, for example, fitting a contained LC unit that translates recycling air with an independent refrigeration system into cooling power delivered directly on top of electronic parts needing it.

2. Use vibration, power draw, and sensor data from chillers, UPSes, and PDUs to target those pieces of equipment that are likely to break long before they do.

3. Energy-Aware Scheduler for AI Training Jobs. Run the workloads at times when there is a cleaner grid and send those on out to areas with more wind turbines.

4. Optimizing Scheduling of AI Workloads. Spreading GPU-heavy jobs across clusters in order to even out the load saves one region from overloading while others wait.

5. Real-time Adaptive Efficiency Monitoring constantly observes PUE, WUE, and Carbon intensity with real-time recommendations to operations—if everything looks efficient, let’s not get hasty and take a risk that could put us out of business.

6. Building-Intelligence Video-Surveillance Security Anomaly Detection. Scans access logs, security cameras, and network traffic for signs of someone trying to break in.

7. Feature: GPU/TPU Hardware-Health Forecasting. Identifies symptoms of degeneration—error rates increasing, components overheating or running slow—for replacement before training jobs fail entirely.

8. Incident simulation and response planning. Running digital “fire drills” to see what the plant would do when: cooling failed, power was lost, or if there were a cyber attack.

9. Real-time automated compliance reporting ISO, SOC, etc. Using the operational logs of the facility to onboard customers faster. Pulls from system/operational logs for audit reports on-demand (reliable and consistent & audit-ready).

10. Automated GPU node on/off with Intelligent Resource Scaling. It won’t turn on GPU nodes just because you’re using them, it will also try to keep energy costs down through effective management.

In the end, if you have an AI host, then your business should be AI-driven too. It is not a matter of choice, but of necessity in order to deal with the scale and complexity of these modern AI workloads, that we begin using machine intelligence for both heating control and cooling spot-by-spot because it simply has become routine everywhere else.

Subscribe & Share now if you are building, operating, and investing in the digital infrastructure of tomorrow.

#DataCenter #CloudComputing #HostingSolutions #GreenTech #SustainableHosting #AI #ArtificialIntelligence #EcoFriendly #RenewableEnergy #DataStorage #TechForGood #SmartInfrastructure #DigitalTransformation #CloudHosting #GreenDataCenter #EnergyEfficiency #FutureOfTech #Innovation #TechSustainability #AIForGood

https://www.linkedin.com/pulse/ai-inside-how-data-centers-can-use-run-workloads-better-gailitis-1hjzf

Related articles:

Proudly powered by WordPress | Theme: Baskerville 2 by Anders Noren.

Up ↑