Reinforcement Learning for Submodel Assignment in Adaptive Modeling of Turbulent Flames | |
Yang TW(杨天威)1; Yin,Yu2; Liu QL(刘起立)3; Yu,Tao4; Wang,Yuwang4; Zhou,Hua5; Ren,Zhuyin5 | |
Corresponding Author | Ren, Zhuyin([email protected]) |
Source Publication | AIAA JOURNAL |
2024-11-22 | |
Pages | 9 |
ISSN | 0001-1452 |
Abstract | Reinforcement learning (RL), an unsupervised machine learning approach, is innovatively introduced to turbulent combustion modeling and demonstrated through the automated construction of submodel assignment criteria within the framework of zone-adaptive combustion modeling (AdaCM). In AdaCM, the appropriate combustion submodel-whether the cost-effective species transport model or the advanced transported probability density function (TPDF) method-is adaptively assigned to different regions based on a criterion crucial for performance. The use of RL avoids the extensive manual optimization that involves repetitive calculations and struggles to account for multiple factors. Specifically, RL agents observe local variables as the state and determine the appropriate submodel through a policy. The policy is refined to maximize a reward measuring both accuracy and efficiency through the interaction between RL agents and the AdaCM solver. The methodology is demonstrated for a turbulent non-premixed jet flame, and a sophisticated RL criterion exhibiting a nonlinear and nonmonotonic dependency on the two-dimensional state of mixture fraction and Damk & ouml;hler number is learned. The AdaCM with the trained criterion provides predictions that are nearly indistinguishable from those obtained using the TPDF method for the whole computational domain, while substantially reducing the computational cost with the speedup of 3.4 and only 22% of cells for TPDF. |
Keyword | Reinforcement Learning Thermoacoustic Combustion Instabilities Computational Fluid Dynamics Artificial Neural Network Propulsion and Power Turbulent Reacting Flow High Performance Computing Diffusion Flames Numerical Combustion |
DOI | 10.2514/1.J064213 |
Indexed By | SCI ; EI |
Language | 英语 |
WOS ID | WOS:001362179000001 |
WOS Keyword | CONVOLUTIONAL NEURAL-NETWORKS ; LARGE-EDDY SIMULATION ; REACTION-MECHANISMS ; COMBUSTION ; CHEMISTRY ; CLOSURE ; BURNER ; FLOWS ; LES |
WOS Research Area | Engineering |
WOS Subject | Engineering, Aerospace |
Funding Project | National Natural Science Foundation of Chinahttp://dx.doi.org/10.13039/501100001809[52306149] ; National Natural Science Foundation of Chinahttp://dx.doi.org/10.13039/501100001809[52025062] ; National Natural Science Foundation of China[2022TQ0180] ; China Postdoctoral Science Foundation |
Funding Organization | National Natural Science Foundation of Chinahttp://dx.doi.org/10.13039/501100001809 ; National Natural Science Foundation of China ; China Postdoctoral Science Foundation |
Classification | 一类/力学重要期刊 |
Ranking | 3 |
Contributor | Ren, Zhuyin |
Citation statistics | |
Document Type | 期刊论文 |
Identifier | http://dspace.imech.ac.cn/handle/311007/97554 |
Collection | 高温气体动力学国家重点实验室 |
Affiliation | 1.Tsinghua Univ, Beijing Natl Res Ctr InformationScience & Technol, Beijing 100084, Peoples R China; 2.Beijing Inst Spacecraft Syst Engn, Natl Key Lab Spacecraft Thermal Control, Beijing 100094, Peoples R China; 3.Chinese Acad Sci, Inst Mech, State Key Lab High Temp Gas Dynam, Beijing 100190, Peoples R China; 4.Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Beijing 100084, Peoples R China; 5.Tsinghua Univ, Inst Aero Engine, Beijing 100084, Peoples R China |
Recommended Citation GB/T 7714 | Yang TW,Yin,Yu,Liu QL,et al. Reinforcement Learning for Submodel Assignment in Adaptive Modeling of Turbulent Flames[J]. AIAA JOURNAL,2024:9.Rp_Au:Ren, Zhuyin |
APA | 杨天威.,Yin,Yu.,刘起立.,Yu,Tao.,Wang,Yuwang.,...&Ren,Zhuyin.(2024).Reinforcement Learning for Submodel Assignment in Adaptive Modeling of Turbulent Flames.AIAA JOURNAL,9. |
MLA | 杨天威,et al."Reinforcement Learning for Submodel Assignment in Adaptive Modeling of Turbulent Flames".AIAA JOURNAL (2024):9. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment