Data Center Heat Exchanger Cold Plates: Types, Sizing and Integration

Pumping raw facility water directly through $400,000 AI servers is a guaranteed path to catastrophic failure. Facility water systems suffer from pressure spikes, biological fouling, and particulate contamination that will instantly clog or burst delicate microchannel cooling hardware. To protect your IT investment, you must isolate the pristine server loop from the building infrastructure. To understand how this isolation fits into the broader shift toward high-performance thermal architecture, start with our core guide, AI server liquid cooling: the complete guide.

The barrier that provides this isolation is the data center heat exchanger. Housed inside the Coolant Distribution Unit (CDU) or mounted at the rack level, it transfers heat from the servers to the building without ever mixing the fluids. This guide breaks down how to select a facility water heat exchanger, compare competing geometries, calculate approach temperatures, and integrate the unit into your liquid cooling loop.

1. The Bridge Between IT and Facility Water

A liquid to liquid heat exchanger data center architecture relies on two completely distinct fluid circuits passing thermal energy through a highly conductive metal barrier.

1.1 The Primary vs. Secondary Loop

· Primary Loop (Facility Side): Supplies cold water from chillers, dry coolers, or cooling towers. This water operates at high pressures (often exceeding 100 PSI) and contains varying levels of chemical treatments and debris.

· Secondary Loop (IT Side): Supplies clean, treated coolant (usually a precise water and propylene glycol mixture) directly to the server cold plates. It operates at lower pressures tailored specifically for the server chassis.

The heat exchanger sits between them. Hot fluid from the IT loop enters one side of the exchanger, rejects its heat into the cold fluid on the facility side, and returns to the servers cooled. For a macro-level look at how these loops integrate across the entire server room, see our AI liquid cooling overview.

2. Types of Data Center Heat Exchangers

You must match the mechanical design of the heat exchanger to your facility's water quality and spatial constraints.

2.1 Brazed Plate Heat Exchangers (BPHE)

Brazed plate heat exchangers consist of dozens of corrugated stainless steel plates stacked together and vacuum-brazed with a copper or nickel filler. The corrugations create high turbulence, maximizing heat transfer in a tiny physical footprint.

· Use BPHE when: You are designing compact in-rack or in-row CDUs, require maximum thermal efficiency, and can guarantee filtered facility water.

· Avoid BPHE when: Your facility uses untreated, highly particulate-heavy grey water. The narrow, turbulent channels in a BPHE clog rapidly if debris bypasses the strainers.

2.2 Shell-and-Tube Heat Exchangers

This legacy design features a large cylindrical shell containing a bundle of smaller tubes. One fluid flows through the tubes, while the other flows over them inside the shell.

· Use shell-and-tube when: You are installing massive facility-level CDUs in a mechanical room, or your primary water source is extremely dirty. Shell-and-tube exchangers are much easier to open and mechanically clean with brushes.

· Avoid shell-and-tube when: Space is constrained. They are significantly larger, heavier, and less thermally efficient per cubic inch than plate exchangers.

2.3 Cold Plate Heat Exchangers

A cold plate heat exchanger utilizes a thick, machined metal block (similar to a massive server cold plate) where facility water flows through embedded tubes while secondary coolant flows through a parallel set of tubes, transferring heat through the solid metal block.

· Use cold-plate style when: You require absolute zero risk of cross-fluid contamination, or you are bridging direct-die heat pipes to a facility water loop.

· Avoid cold-plate style when: You need to transfer hundreds of kilowatts. Solid-block thermal transfer is less efficient than the thin-wall direct fluid interactions of a BPHE.

3. Heat Exchanger Sizing and Approach Temperature

Specifying heat exchanger sizing data center professionals rely on requires more than simply declaring a kilowatt capacity. You must define the operational temperatures.

3.1 Understanding Approach Temperature

The most critical metric in heat exchanger sizing is the approach temperature. This is the temperature difference between the warm IT coolant leaving the heat exchanger (heading to the servers) and the cold facility water entering the heat exchanger.

· Formula: $T_{approach} = T_{IT\_Supply} - T_{Facility\_Supply}$

· Example: If your facility supplies water at 25°C, and the heat exchanger cools the IT fluid down to 28°C, your approach temperature is 3°C.

A tighter approach temperature (e.g., 2°C) means your IT servers receive colder water, allowing processors to boost clocks higher. However, forcing a tight approach temperature requires exponentially more surface area inside the heat exchanger, drastically increasing its size and cost.

3.2 A 100kW Sizing Example

If you need to reject 100kW of heat from an AI rack, you must calculate the required mass flow rate on both sides of the exchanger using the thermodynamic equation: $Q = \dot{m} \times C_p \times \Delta T$.

1. Define the IT Side: To absorb 100kW of heat from the servers while allowing a 10°C temperature rise across the rack, the CDU pump must push approximately 100 Liters Per Minute (LPM) of secondary coolant through the heat exchanger.

2. Define the Facility Side: If the facility provides 30°C water and allows a 5°C return temperature rise (exiting at 35°C), the facility must supply roughly 200 LPM to the primary side of the exchanger.

3. Size the Exchanger: You submit these flow rates, the 100kW load, and your target approach temperature to the manufacturer, who selects a plate count that provides sufficient wetted surface area to achieve the transfer.

4. Managing Pressure Drop on Both Sides

Pushing fluid through a heat exchanger creates resistance, known as pressure drop ($\Delta P$). You must balance thermal efficiency against hydraulic strain.

4.1 Primary Loop (Facility Side) Pressure Drop

Facility pumps are typically massive and can overcome significant resistance. However, designing a heat exchanger with a high primary pressure drop forces the building's chiller plant pumps to work harder, degrading your facility's Power Usage Effectiveness (PUE).

· Target: Keep primary side $\Delta P$ below 10 PSI (70 kPa) to ensure compatibility with legacy facility pump curves.

4.2 Secondary Loop (IT Side) Pressure Drop

The CDU pumps are smaller and must reserve their pressure-pushing capacity for the restrictive microchannels inside the server cold plates. If the heat exchanger consumes too much of the CDU's pressure budget, the pumps will fail to deliver enough fluid to the top of the rack.

· Target: Keep secondary side $\Delta P$ as low as possible, ideally under 5 PSI (35 kPa).

· Decision guidance: If your calculated pressure drop is too high, specify a heat exchanger with more plates. Adding plates increases the cross-sectional flow area, slowing fluid velocity and reducing pressure drop, though it increases unit cost.

5. Fouling, Water Quality, and Material Constraints

Data center heat exchangers operate continuously for a decade. The primary threat to their lifespan is poor water quality on the facility side.

5.1 Clean-Water vs. Grey-Water Sites

Many modern hyperscale data centers utilize "grey water" (treated municipal wastewater) in their cooling towers to reduce environmental impact. Grey water is highly corrosive, contains heavy minerals, and fosters biological scaling.

When grey water enters a standard copper-brazed stainless steel plate heat exchanger, the minerals precipitate out of the warm fluid and coat the corrugated plates. This scaling acts as a thermal insulator, rapidly destroying the exchanger's efficiency.

5.2 Filtration and Material Selection

You must engineer defenses into the facility water heat exchanger loop:

· Specify Nickel Brazing: If using grey water or aggressive facility coolants, do not use copper-brazed plates. Specify nickel-brazed stainless steel or even titanium plates to resist aggressive corrosion.

· Install Y-Strainers: Always install 50-micron Y-strainers on the facility inlet pipe immediately before the heat exchanger. This catches large particulates before they permanently lodge inside the narrow plate channels.

· Chemical Dosing: Ensure the facility utilizes automated biocide and anti-scaling chemical dosing in the primary loop.

6. Integration Rules for High-Density AI

As rack densities push past 100kW, the heat exchanger dictates the limits of your facility. For a deep dive into the upper boundaries of these limits, consult our guide on high-density data center cooling.

If your facility cannot deliver enough chilled water to support a tight approach temperature on a sensible-heat BPHE, you may need to pivot away from single-phase liquid entirely. Advanced architectures utilize phase-change cooling to leverage the latent heat of vaporization, which requires specialized condensers rather than standard liquid-to-liquid exchangers. If you are exploring these extremes, review the mechanics of two-phase cooling for AI data centers.

Integration checklist for procurement:

1. Verify the maximum operating pressure (MOP) of the heat exchanger exceeds your facility's peak transient pressure spikes.

2. Ensure the exchanger ports match the internal diameter of your CDU piping to avoid localized velocity bottlenecks.

3. Include physical isolation valves on both the primary and secondary connections so the heat exchanger can be bypassed and flushed without draining the entire IT rack.

7. Conclusion

The data center heat exchanger is the definitive firewall protecting your high-performance AI infrastructure from the harsh realities of building-level water plants. Selecting the right unit requires balancing the thermal efficiency of brazed plates against the fouling risks of facility grey water. By mandating a tight approach temperature and strictly managing pressure drops on both the primary and secondary loops, procurement engineers can maximize compute performance without artificially inflating chiller plant operating costs.

Do not guess on plate counts or approach temperatures when specifying liquid cooling hardware. Contact our thermal engineering team

 to review your flow rates, thermal requirements, fluid chemistry, and operating conditions, then recommend a suitable heat exchanger configuration for your high-density AI cluster.

Frequently Asked Questions

What happens if a brazed plate heat exchanger clogs?

Because the plates are permanently brazed together, a BPHE cannot be disassembled for mechanical cleaning. If it clogs with biological growth or scaling, it must be isolated and flushed with aggressive chemical descaling agents. If chemicals fail to clear the blockage, the entire unit must be replaced.

How does fluid viscosity affect heat exchanger sizing?

Coolants like Propylene Glycol (PG) are more viscous than pure water. Higher viscosity reduces turbulent flow (lowering heat transfer efficiency) and increases pressure drop. When sizing an exchanger, you must clearly define the glycol percentage so the manufacturer can evaluate its impact on heat transfer performance, flow resistance, and pressure drop.

Can I run dielectric fluid through a standard liquid-to-liquid heat exchanger?

Yes, but with extreme caution. Dielectric fluids (used in immersion or direct-to-chip systems) have vastly different specific heat capacities and lower surface tensions than water. The heat exchanger must be specifically sized for the dielectric's thermal properties, and all internal gaskets must be chemically compatible to prevent leaks.

What is a gasketed plate-and-frame heat exchanger?

Unlike brazed plates, a gasketed plate-and-frame heat exchanger uses rubber gaskets and heavy steel bolts to clamp the corrugated plates together. They are larger and more prone to minor leaks than BPHEs, but they can be unbolted, taken apart, and mechanically scrubbed, making them ideal for massive facility-level deployments using dirty water.

Why is counter-current flow important in a data center heat exchanger?

Heat exchangers are plumbed so the hot IT fluid and the cold facility fluid flow in opposite directions (counter-current). This maintains a consistent temperature difference between the two fluids across the entire length of the plates, maximizing the amount of heat transferred.