
浏览全部资源
扫码关注微信
1.华中科技大学能源与动力工程学院 武汉 430074
2. 中国移动通信集团设计院有限公司 北京 100080
3. 北京大学力学与工程科学学院能源与资源工程系 北京 100871
杨荣贵,男,讲席教授,北京大学力学与工程科学学院能源与资源工程系,13336606588,E-mail:ronggui@pku.edu.cn。研究方向:电子器件与能源系统的热管理,微纳尺度电-热耦合输运,相变传热与液冷技术,储能与多能融合, 算-电协同等。
收稿:2025-10-11,
修回:2025-11-04,
录用:2025-11-04,
纸质出版:2026-02-16
移动端阅览
邹启凡,刘洪,罗海亮等.高功率大面积AI芯片液冷技术进展[J].制冷学报,2026,47(01):20-36.
Zou Qifan,Liu Hong,Luo Hailiang,et al.Research Progress on Liquid Cooling Technologies for High-Power and Large-Area AI Chips[J].Journal of Refrigeration,2026,47(01):20-36.
邹启凡,刘洪,罗海亮等.高功率大面积AI芯片液冷技术进展[J].制冷学报,2026,47(01):20-36. DOI: 10.12465/issn.0253-4339.20251011001. CSTR: XXXXX.XX.XXX.20251011001.
Zou Qifan,Liu Hong,Luo Hailiang,et al.Research Progress on Liquid Cooling Technologies for High-Power and Large-Area AI Chips[J].Journal of Refrigeration,2026,47(01):20-36. DOI: 10.12465/issn.0253-4339.20251011001. CSTR: XXXXX.XX.XXX.20251011001.
随着人工智能(artificial intelligence,AI)技术的升级迭代,巨大的算力需求推动了AI芯片的发展,特别是近年来开发的芯粒(Chiplet)技术,为人工智能提供了高计算性能、高良品率、低成本的先进芯片封装集成方案,为AI发展提供了坚实的硬件支撑。Chiplet型芯片具有大面积、高发热功率的特征,其3D的芯片堆叠设计带来了热流分布不均匀、多层芯片导热路径长、填充热界面材料较厚等散热难题,成为了芯片性能提升的关键瓶颈,Chiplet型芯片的高效热管理成了人工智能发展的关键挑战。本文综述了芯片热管理的先进液冷技术进展,包括单相与两相液冷方案,基于冷却架构分为冷板式液冷、近结区液冷与浸没式液冷,并针对2.5D、3D Chiplet型芯片中的散热问题与冷却方案进行了总结,为高功率大面积AI芯片的液冷方案的应用与发展提供参考。
With advances in artificial intelligence (AI), massive computing demands have driven the development of AI chips. In particular, the recently proposed chiplet technology provides an advanced chip packaging and integration solution that offers high computing performance at a high yield rate and low cost, thus delivering solid hardware support for AI development. Chiplet-based chips are characterized by large area and high heat power, and their 3D chip stacking design leads to cooling challenges such as non-uniform heat flux distribution, long heat conduction paths for multilayer chips, and relatively thick thermal interface materials. These thermal issues are key bottlenecks limiting chip performance, making efficient chiplet thermal management a critical challenge in AI development. The progress in advanced liquid cooling technologies, including single- and two-phase liquid cooling solutions, is reviewed. Based on the cooling architecture, liquid cooling solutions can be categorized as cold-plate, near-junction-region, and immersion liquid cooling. In addition, the heat dissipation challenges and cooling strategies in 2.5D and 3D chiplets are summarized, providing a reference for the application and development of liquid cooling technologies for high-power, large-area AI chips.
LECUN Y , BENGIO Y , HINTON G . Deep learning [J]. Nature , 2015 , 521 ( 7553 ): 436 - 444 .
MIRHOSEINI A , GOLDIE A , YAZGAN M , et al . A graph placement methodology for fast chipdesign [J]. Nature , 2021 , 594 ( 7862 ): 207 - 212 .
FELDMANN J , YOUNGBLOOD N , KARPOV M , et al . Parallel convolutional processing using an integrated photonic tensor core [J]. Nature , 2021 , 589 ( 7840 ): 52 - 58 .
NVIDIA . NVIDIA blackwell datasheet [R/OL]. [ 2025-10-01 ]. https://resources.nvidia.com/en-us-blackwell-architecture/datasheet https://resources.nvidia.com/en-us-blackwell-architecture/datasheet .
IEA . Energy and AI [R/OL]. [ 2025-10-01 ]. https://www.iea.org/reports/energy-and-ai https://www.iea.org/reports/energy-and-ai .
国家互联网数据中心产业技术创新战略联盟 , 曙光数据基础设施创新技术(北京)股份有限公司 , 曙光信息产业股份有限公司 . 绿色节能液冷数据中心白皮书 [R]. 2023 .
National Internet Data Center Industry Technology Innovation Strategic Alliance , Sugon Data Infrastructure Innovation Technology (Beijing) Co. , Ltd. , Sugon Information Industry Co. , Ltd . Green and energy-efficient liquid-cooled data center white paper [R]. 2023 .
JALILI M , MANOUSAKIS I , GOIRI I , et al . Cost-efficient overclocking in immersion-cooled datacenters [C]// 2021 ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA) . Valencia, Spain : IEEE , 2021 : 623 - 636 .
HEYDARI A , ESLAMI B , RADMARD V , et al . Power usage effectiveness analysis of a high-density air-liquid hybrid cooled data center [C]// ASME 2022 International Technical Conference and Exhibition on Packaging and Integration of Electronic and Photonic Microsystems . Garden Grove, California, USA : American Society of Mechanical Engineers , 2022 : V001T01A014 .
YEH L T . Review of heat transfer technologies in electronic equipment [J]. Journal of Electronic Packaging , 1995 , 117 ( 4 ): 333 - 339 .
MURALIDHAR R , BOROVICA-GAJIC R , BUYYA R . Energy efficient computing systems: architectures, abstractions and modeling to techniques and standards [J]. ACM Computing Surveys , 2022 , 54 ( 11 s): 1 - 37 .
SOHEL MURSHED S M , NIETO DE CASTRO C A . A critical review of traditional and emerging techniques and fluids for electronics cooling [J]. Renewable and Sustainable Energy Reviews , 2017 , 78 : 821 - 833 .
NVIDIA . NVIDIA H100 PCIe GPU product brief [R/OL]. [ 2025-10-01 ]. https://www.nvidia.com/content/dam/en-zz/Solutions/gtcs22/data-center/h100/PB-11133-001_v01.pdf https://www.nvidia.com/content/dam/en-zz/Solutions/gtcs22/data-center/h100/PB-11133-001_v01.pdf .
DEL VALLE P G , ATIENZA D . Emulation-based transient thermal modeling of 2D/3D systems-on-chip with active cooling [J]. Microelectronics Journal , 2011 , 42 ( 4 ): 564 - 571 .
9.9 ASHRAE Technical Committee (TC) . Emergence and expansion of liquid cooling in mainstream data centers white paper [R/OL]. [ 2025-10-01 ]. https://www.ashrae.org/file%20library/technical%20resources/bookstore/emergence-and-expansion-of-liquid-cooling-in-mainstream-data-centers_wp.pdf https://www.ashrae.org/file%20library/technical%20resources/bookstore/emergence-and-expansion-of-liquid-cooling-in-mainstream-data-centers_wp.pdf .
RAMAKRISHNAN B , TURNER C , ALISSA H , et al . Understanding the impact of data center liquid cooling on energy and performance of machine learning and artificial intelligence workloads [J]. Journal of Electronic Packaging , 2025 , 147 ( 2 ): 021003 .
LIU Xiuliang , YANG Jianye , ZOU Qifan , et al . Enhancing liquid-vapor phase-change heat transfer with micro/nano-structured surfaces [J]. ACS Nano , 2025 , 19 ( 10 ): 9513 - 9589 .
BAR-COHEN A , MAURER J J , FELBINGER J G . DARPA's intra/interchip enhanced cooling (ICECool) program [C]// CS MANTECH Conference . US , 2013 : 171 - 174 .
AZARIFAR M , ARIK M , CHANG J Y . Liquid cooling of data centers: a necessity facing challenges [J]. Applied Thermal Engineering , 2024 , 247 : 123112 .
WANG Hongtao , CHEN Zhihua , GAO Jianguo . Influence of geometric parameters on flow and heat transfer performance of micro-channel heat sinks [J]. Applied Thermal Engineering , 2016 , 107 : 870 - 879 .
ALIHOSSEINI Y , AZADDEL M R , MOSLEMI S , et al . Effect of liquid cooling on PCR performance with the parametric study of cross-section shapes of microchannels [J]. Scientific Reports , 2021 , 11 : 16072 .
OSMAN O S , EL-ZOHEIRY R M , ELSHARNOBY M , et al . Performance enhancement and comprehensive experimental comparative study of cold plate cooling of electronic servers using different configurations of mini-channels flow [J]. Alexandria Engineering Journal , 2021 , 60 ( 5 ): 4451 - 4459 .
ZHOU Jiandong , HATAMI M , SONG Dongxing , et al . Design of microchannel heat sink with wavy channel and its time-efficient optimization with combined RSM and FVM methods [J]. International Journal of Heat and Mass Transfer , 2016 , 103 : 715 - 724 .
WANG Zixing , TAO Wenquan . Heat transfer and pressure drop characteristics of microchannel cold plate in commercial CPU-package cooling system [J]. International Journal of Heat and Mass Transfer , 2025 , 246 : 127060 .
JI Xinyu , YANG Xiaoping , ZHANG Yuantong , et al . Experimental study of ultralow flow resistance fractal microchannel heat sinks for electronics cooling [J]. International Journal of Thermal Sciences , 2022 , 179 : 107723 .
ZHU Qifeng , WANG Zezhong , ZENG Jingwei , et al . Numerical study on flow and heat transfer in a novel symmetric sinusoidal wavy microchannel heat sink with rectangular rib prisms [J]. International Journal of Thermal Sciences , 2024 , 197 : 108807 .
HEYDARI A , GHARAIBEH A R , TRADAT M , et al . Experimental evaluation of direct-to-chip cold plate liquid cooling for high-heat-density data centers [J]. Applied Thermal Engineering , 2024 , 239 : 122122 .
ZHOU Fang , ZHOU Wei , ZHANG Chenying , et al . Experimental and numerical studies on heat transfer enhancement of microchannel heat exchanger embedded with different shape micropillars [J]. Applied Thermal Engineering , 2020 , 175 : 115296 .
GUI Chenglong , WANG Yulong , SHEN Chen , et al . Research of operation reliability on cold plate liquid solution based on data center deployment [C]// 2024 23rd IEEE Intersociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems (ITherm) . Aurora, CO, USA : IEEE , 2024 .
SHIA D , YANG Jin , SIVAPALAN S , et al . Corrosion study on single-phase liquid cooling cold plates with inhibited propylene glycol/water coolant for data centers [J]. Journal of Manufacturing Science and Engineering , 2021 , 143 ( 11 ): 111012 .
SARVEY T E , ZHANG Yang , CHEUNG C , et al . Monolithic integration of a micropin-fin heat sink in a 28-nm FPGA [J]. IEEE Transactions on Components , Packaging and Manufacturing Technology , 2017 , 7 ( 10 ): 1617 - 1624 .
VAN ERP R , SOLEIMANZADEH R , NELA L , et al . Co-designing electronics with microfluidics for more sustainable cooling [J]. Nature , 2020 , 585 ( 7824 ): 211 - 216 .
YANG Yuchi , DU Jianyu , LI Motong , et al . Embedded microfluidic cooling with compact double H type manifold microchannels for large-area high-power chips [J]. International Journal of Heat and Mass Transfer , 2022 , 197 : 123340 .
FENG Jianyu , CHEN Chuan , FU Rong , et al . Embedded cooling to meet the 2 kW thermal design power of HPC chips in the future [C]// 2024 23rd IEEE Intersociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems (ITherm) . Aurora, CO, USA : IEEE , 2024 .
WALSH S M , MALOUIN B A , BROWNE E A , et al . Embedded microjets for thermal management of high power-density electronic devices [J]. IEEE Transactions on Components , Packaging and Manufacturing Technology , 2019 , 9 ( 2 ): 269 - 278 .
JUNG K W , KHARANGATE C R , LEE H , et al . Embedded cooling with 3D manifold for vehicle power electronics application: single-phase thermal-fluid performance [J]. International Journal of Heat and Mass Transfer , 2019 , 130 : 1108 - 1119 .
WEI T W , OPRINS H , CHERMAN V , et al . Experimental characterization and model validation of liquid jet impingement cooling using a high spatial resolution and programmable thermal test chip [J]. Applied Thermal Engineering , 2019 , 152 : 308 - 318 .
WANG Chenxu , YU Hang , XIAN Lei , et al . Study on the operation strategy of the water cooling system in the single-phase immersion cooling data center considering cooling tower performance [J]. Energy and Buildings , 2024 , 324 : 114890 .
CHEN Xi , HUANG Yongping , XU Shijie , et al . Thermal performance evaluation of electronic fluorinated liquids for single-phase immersion liquid cooling [J]. International Journal of Heat and Mass Transfer , 2024 , 220 : 124951 .
HUANG Yongping , GE Junlei , CHEN Yongping , et al . Natural and forced convection heat transfer characteristics of single-phase immersion cooling systems for data centers [J]. International Journal of Heat and Mass Transfer , 2023 , 207 : 124023 .
DING Bo , XIA Feifan , HE Lin , et al . A novel concept for performance enhancement of immersion-cooled data center servers [J]. International Communications in Heat and Mass Transfer , 2024 , 159 : 107980 .
WANG Huijuan , YUAN Xuejun , ZHANG Kun , et al . Performance evaluation and optimization of data center servers using single-phase immersion cooling [J]. International Journal of Heat and Mass Transfer , 2024 , 221 : 125057 .
MUNEESHWARAN M , LIN Y C , WANG C C . Performance analysis of single-phase immersion cooling system of data center using FC-40 dielectric fluid [J]. International Communications in Heat and Mass Transfer , 2023 , 145 : 106843 .
KIM J , CHOI H , LEE S , et al . Computational study of single-phase immersion cooling for high-energy density server rack for data centers [J]. Applied Thermal Engineering , 2025 , 264 : 125476 .
SHRIGONDEKAR H , LIN Y C , WANG C C . Investigations on performance of single-phase immersion cooling system [J]. International Journal of Heat and Mass Transfer , 2023 , 206 : 123961 .
SHAH J M , PADMANABAN K , SINGH H , et al . Evaluating the reliability of passive server components for single-phase immersion cooling [J]. Journal of Electronic Packaging , 2021 : 021109 .
KULKARNI D , GULICK J , KING J , et al . Thermal performance of common cold plate for pumped single- and two-phase direct liquid cooling for next generation high power server processors [C]// ASME 2024 International Technical Conference and Exhibition on Packaging and Integration of Electronic and Photonic Microsystems . San Jose, California, USA : American Society of Mechanical Engineers , 2024 : V001T02A013 .
RAMAKRISHNAN B , HOANG C H , KHALILI S , et al . Experimental characterization of two-phase cold plates intended for high-density data center servers using a dielectric fluid [J]. Journal of Electronic Packaging , 2021 , 143 ( 2 ): 020904 .
WANG Qingyang , NARAYANAN A , OZGUC S , et al . Performance comparison of RI233zd (E) and R515B for two-phase direct-to-chip cooling [C]// Proceedings of the 2025 24th IEEE Intersociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems (ITherm) . 2025 .
WU H Y , CHENG Ping . Boiling instability in parallel silicon microchannels at different heat flux [J]. International Journal of Heat and Mass Transfer , 2004 , 47 ( 17/18 ): 3631 - 3641 .
LI D , WU G S , WANG W , et al . Enhancing flow boiling heat transfer in microchannels for thermal management with monolithically-integrated silicon nanowires [J]. Nano Letters , 2012 , 12 ( 7 ): 3385 - 3390 .
DRUMMOND K P , BACK D , SINANIS M D , et al . A hierarchical manifold microchannel heat sink array for high-heat-flux two-phase cooling of electronics [J]. International Journal of Heat and Mass Transfer , 2018 , 117 : 319 - 330 .
FENG Huicheng , TANG Gongyue , ZHANG Xiaowu , et al . Two-phase liquid cooling for high-power microelectronics via embedded micro-pin fin heat sink [J]. IEEE Transactions on Components , Packaging and Manufacturing Technology , 2024 , 14 ( 3 ): 397 - 405 .
SHI Hongyuan , GRALL S , YANAGISAWA R , et al . Chip cooling with manifold-capillary structures enables 105 COP in two-phase systems [J]. Cell Reports Physical Science , 2025 , 6 ( 4 ): 102520 .
SCHULTZ M , YANG Fanghao , COLGAN E , et al . Embedded two-phase cooling of large three-dimensional compatible chips with radial channels [J]. Journal of Electronic Packaging , 2016 , 138 ( 2 ): 021005 .
NASR M H , GREEN C E , KOTTKE P A , et al . Hotspot thermal management with flow boiling of refrigerant in ultrasmall microgaps [J]. Journal of Electronic Packaging , 2017 , 139 : 011006 .
LIANG Gangtao , MUDAWAR I . Review of pool boiling enhancement by surface modification [J]. International Journal of Heat and Mass Transfer , 2019 , 128 : 892 - 933 .
BAR-COHEN A , SIMON T W . Wall superheat excursions in the boiling incipience of dielectric fluids [J]. Heat Transfer Engineering , 1988 , 9 ( 3 ): 19 - 31 .
HO J Y , WONG K K , LEONG K C . Saturated pool boiling of FC-72 from enhanced surfaces produced by Selective Laser Melting [J]. International Journal of Heat and Mass Transfer , 2016 , 99 : 107 - 121 .
RAMAKRISHNAN B , ALISSA H , MANOUSAKIS I , et al . CPU overclocking: a performance assessment of air, cold plates, and two-phase immersion cooling [J]. IEEE Transactions on Components , Packaging and Manufacturing Technology , 2021 , 11 ( 10 ): 1703 - 1715 .
SUN Xiaoqing , HAN Zongwei , LI Xiuming . Simulation study on cooling effect of two-phase liquid-immersion cabinet in data center [J]. Applied Thermal Engineering , 2022 , 207 : 118142 .
ZHOU Guohui , ZHOU Jingzhi , HUAI Xiulan , et al . A two-phase liquid immersion cooling strategy utilizing vapor chamber heat spreader for data center servers [J]. Applied Thermal Engineering , 2022 , 210 : 118289 .
LIN Poyao , KUO Shengliang , YAN K , et al . Advanced thermal integration for HPC packages with two-phase immersion cooling [C]// 2022 IEEE 72nd Electronic Components and Technology Conference (ECTC) . San Diego, CA, USA : IEEE , 2022 : 566 - 573 .
BIRBARAH P , GEBRAEL T , FOULKES T , et al . Water immersion cooling of high power density electronics [J]. International Journal of Heat and Mass Transfer , 2020 , 147 : 118918 .
FUSELIER M , BAIR L , KULKARNI D , et al . Advancing AI with energy-efficient architectures: innovations in fab process, packaging, and system integration [C]// 2024 IEEE International Electron Devices Meeting (IEDM) . San Francisco, CA, USA : IEEE , 2024 .
NIE Chuanjun , XU Qinzhi , WANG Chenghan , et al . Efficient transient thermal analysis of chiplet heterogeneous integration [J]. Applied Thermal Engineering , 2023 , 229 : 120609 .
CHUNG E , BAKIR M S . Integrated microfluidic cooling of heterogeneous HBM-GPU package with die height difference [J]. IEEE Transactions on Components , Packaging and Manufacturing Technology , 2025 , 99 : 1 .
AMD . INTRODUCING AMD CDNA TM 4 ARCHITECTURE white paper [R/OL]. [ 2025-10-10 ]. https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/white-papers/amd-cdna-4-architecture-whitepaper.pdf https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/white-papers/amd-cdna-4-architecture-whitepaper.pdf .
FENG Jianyu , ZHOU Minghao , CHEN Chuan , et al . Thermal interaction and cooling of electronic device with chiplet 2.5D integration [J]. Applied Sciences , 2024 , 14 ( 18 ): 8114 .
SIKKA K , WAKIL J , TOY H , et al . An efficient lid design for cooling stacked flip-chip 3D packages [C]// 13th InterSociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems . San Diego, CA, USA : IEEE , 2012 : 606 - 611 .
RAJAN S K , KAUL A , SARVEY T E , et al . Monolithic microfluidic cooling of a heterogeneous 2.5-D FPGA with low-profile 3-D printed manifolds [J]. IEEE Transactions on Components , Packaging and Manufacturing Technology , 2021 , 11 ( 6 ): 974 - 982 .
PATEL A , YOGI K , SAHU G , et al . Multi-chip Jet impingement cooling for heat dissipation in 2.5D integrated system with 1 kW+ thermal design power [J]. International Journal of Heat and Mass Transfer , 2025 , 244 : 126978 .
PATEL A , YOGI K , SAHU G , et al . Direct-on-chip two-phase jet impingement cooling of multichip packages: distributed inlet-outlet nozzles [J]. International Journal of Heat and Mass Transfer , 2025 , 252 : 127514 .
ZHANG Nan , JIAO Binbin , YE Yuxin , et al . Embedded cooling method with configurability and replaceability for multi-chip electronic devices [J]. Energy Conversion and Management , 2022 , 253 : 115124 .
BACK D , DRUMMOND K P , SINANIS M D , et al . Design, fabrication, and characterization of a compact hierarchical manifold microchannel heat sink array for two-phase cooling [J]. IEEE Transactions on Components , Packaging and Manufacturing Technology , 2019 , 9 ( 7 ): 1291 - 1300 .
SEKAR D , KING C , DANG Bing , et al . A 3D-IC technology with integrated microchannel cooling [C]// 2008 International Interconnect Technology Conference . Burlingame, CA, USA : IEEE , 2008 : 13 - 15 .
BRUNSCHWILER T , PAREDES S , DRECHSLER U , et al . Validation of the porous-medium approach to model interlayer-cooled 3D-chip stacks [C]// 2009 IEEE International Conference on 3D System Integration . San Francisco, CA, USA : IEEE , 2009 : 1 - 10 .
ZHAO Xiaoliang , SHU Penghuai , LI Wei , et al . The embedded cooling silicon 3D stacking thermal test vehicle [C]// 2023 22nd IEEE Intersociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems (ITherm) . Orlando, FL, USA : IEEE , 2023 .
YAN Geyu , CHUNG E , MASSELINK E , et al . Toward TSV-compatible microfluidic cooling for 3D ICs [J]. IEEE Transactions on Components , Packaging and Manufacturing Technology , 2025 , 15 ( 1 ): 104 - 112 .
0
浏览量
376
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621