Hiring nowAI data centre networks and facilities

AI Thermal Systems Engineer

Also called AI Cooling Engineer · Liquid Cooling / Thermal Engineer · Data centre Mechanical Engineer

An AI Thermal Systems Engineer designs and validates the cooling for dense accelerator racks. Good cooling keeps expensive compute inside temperature limits, running reliably, and without wasting energy on heat removal.

What they do

Designs the cooling for high-density accelerator halls, usually with liquid loops alongside air. Sizes cold plates, manifolds, coolant distribution units and heat rejection against the rack load. Builds thermal and flow models, then tests them against real telemetry. Plans commissioning and runs load tests with the compute and electrical teams. Reads rack, power and temperature data to find hot spots and drifting flow. Writes the response for leaks, pump faults and sudden load swings. Reviews vendor equipment and signs off changes before they reach the floor.

What a strong hire delivers

In the first months, a strong hire delivers a cooling design that matches the real rack load and a validation plan the team trusts. They produce a thermal model checked against measured data. They find and fix the worst hot spots. They set clear alarm and response procedures for cooling faults, and give the compute team an honest view of how much load each hall can safely take.

How you can tell they are good

Ask them to walk through a cooling design they owned, from load assumptions to commissioning results. Strong people explain what the model got wrong and how they found out. Ask how they would test a liquid loop before live load. Worry if they only talk about components, ignore failure modes, or cannot link temperature limits to compute reliability.

Why it is hard to fill

Few people have designed and validated liquid cooling at accelerator densities. Titles are inconsistent, so the same person may be called a mechanical, thermal, facilities or data centre engineer. Most come from air-cooled sites and need to prove liquid experience. Competition from hyperscalers and colos is strong, and the wider shortage of skilled trades makes delivery harder even after the hire is made.

Where to find them

Look first at mechanical and thermal engineers in hyperscale and colocation data centres, especially those who have commissioned liquid-cooled halls. Other good sources are HPC facilities engineers, cooling equipment makers, and electrical or network engineers who moved into facilities. Adjacent fields such as power electronics, process engineering and high-performance computing sites also produce capable people who can learn the accelerator side.

Indicative pay

Not enough published evidence yet to give a fair range for this role, which is common for work this new. We benchmark it for you as part of a search.

Interview questions for an AI Thermal Systems Engineer

  1. Describe a cooling design you owned for high-density racks. What load assumptions did you start with, and what changed?

    A strong answer names the rack load, coolant approach and constraints, then admits where assumptions failed and how data corrected them. Worry about vague ownership, copied vendor designs, or no mention of measured results.

  2. How would you validate a new liquid loop before accelerators go live?

    Look for staged flushing, pressure and leak testing, flow balancing, then load banks and gradual real load, with clear acceptance criteria. Worry if testing waits for live compute or relies on design calculations alone.

4 more questions, with what a strong answer covers, are in the Role Kit.

Job description you can post

We run large accelerator clusters and need a thermal engineer to design and validate the cooling that keeps them reliable. You will work with electrical, network and compute teams to turn rack-level demands into cooling that works on the floor and stays efficient.

What you will do

  • Design liquid and air cooling for high-density accelerator halls
  • Build and maintain thermal and flow models checked against telemetry
  • Plan and run commissioning and load testing for cooling systems
  • Investigate hot spots, flow problems and temperature drift
  • Define alarms and response procedures for cooling faults
  • Review vendor equipment and approve changes to the cooling plant
  • Advise compute teams on safe load per hall

What you will bring

  • Cooling design delivered for high-density compute or similar thermal-critical sites
  • Hands-on validation of liquid loops, including flushing, pressure testing and flow balancing
  • Experience building thermal models and testing them against measured data
  • Clear understanding of how temperature affects hardware reliability
  • Ability to work with electrical, network and facilities teams on shared capacity
  • Evidence of handling a cooling failure or near miss

Nice to have

  • Experience in HPC or hyperscale facilities
  • Familiarity with power and cooling monitoring data
  • Commissioning experience with coolant distribution units

Free to use and adapt. If it saves you time, a link back to this page is appreciated.

Skills that matter

  • Hardware and computer architectureAdvancedDesign computing structures and hardware interfaces
  • Cloud and orchestrationAdvancedProvision and operate scalable compute services
  • Distributed systemsWorkingDesign reliable work across networked machines
  • Reliability and incident responseWorkingDetect failures, restore service and prevent recurrence

Other roles in aI data centre networks and facilities

Hiring nowAI Cluster Network EngineerAn AI Cluster Network Engineer designs and runs the network that links accelerators during distributed training. A well-built fabric keeps expensive…Hiring nowAI Data Centre Power EngineerAn AI Data Centre Power Engineer plans the electrical capacity and resilience of AI compute sites. They make sure GPU clusters get safe, reliable…Hiring nowAI Compute Scheduler EngineerAn AI Compute Scheduler Engineer decides which model workloads get which cluster resources, and when. Good scheduling keeps expensive GPUs busy…Hiring nowAI Data Centre Programme ManagerAn AI Data Centre Programme Manager delivers gigawatt-scale compute sites, covering land, power, cooling and schedule. They turn a company's compute…Hiring nowAI Power and Energy StrategistThe AI Power and Energy Strategist secures the electricity that AI compute sites run on. Without firm power on a workable schedule, GPUs sit idle…

Related roles in other families

Hiring nowMLOps EngineerMLOps and AI platform engineeringAn MLOps Engineer builds the pipeline that packages, tests and releases models in a repeatable way. It matters because releases become predictable…Hiring nowAI Platform EngineerMLOps and AI platform engineeringAn AI Platform Engineer builds the shared services that let teams use models and build AI applications without each reinventing the plumbing. It…EmergingLLMOps EngineerMLOps and AI platform engineeringAn LLMOps Engineer runs prompt, model and retrieval changes as controlled releases. It matters because language model features break quietly, and…Hiring nowModel Registry and Release EngineerMLOps and AI platform engineeringA Model Registry and Release Engineer keeps every model artefact traceable and every deployment approved. It matters because a company that cannot…

How we wrote this

Role definitions are our own editorial work, checked against occupational classifications, standards, research and employer pages. Titles vary by company, and this is a description of the work, not a job advert.

← AI data centre networks and facilitiesAll new job families

Start a search

Hiring an AI Thermal Systems Engineer?

Tell us the work. We find the people already doing it, whatever their job title says, and you meet them already interviewed for your role.