| Control of quasi-equilibrium state of annular flow through reinforcement learning | |
Chen Y(陈一); Duan L(段俐) ; Kang Q(康琦)
| |
| Source Publication | PHYSICS OF FLUIDS
 |
| 2022-09 | |
| Volume | 34Issue:9Pages:94105 |
| ISSN | 1070-6631 |
| Abstract | Stability control of the convection flow field has always been a focal issue. The annular flow discussed in this work is a typical research model of microgravity fluid physics, which is extracted from the industrial crystal growth by the Czochralski method. It is believed that the instability of thermal convection is the key factor affecting the quality of crystal growth. Combining the reinforcement learning algorithm with the neural network, this paper proposes a control policy that makes forced convection compete with thermocapillary convection by changing the dynamic boundary conditions of the system. This control policy is successfully applied to the control of the quasi-equilibrium state of annular flow, and the global stability of the flow field is well maintained. It first experimentally makes the annular flow field under low and medium M a numbers achieve a quasi-equilibrium state, which is different from that before the onset of flow oscillations. Then, a simulation environment is created to imitate the experimental conditions. After training in the simulation environment, with the self-optimized algorithm, the machine learning approach can successfully maintain the simulation environment in a quasi-equilibrium state for a long period of time. Finally, the learning method is validated in the experimental environment, and a quasi-equilibrium state control policy is completely optimized by using the same optimization policy and similar neural network structure. This work demonstrates that the model can understand the physical environment and the author's control objectives through reinforcement learning. It is an important application of reinforcement learning in the real world and a clear demonstration of the research value of microgravity fluid physics. |
| Subject Area | Mechanics ; Physics, Fluids & Plasmas |
| DOI | 10.1063/5.0102668 |
| Indexed By | SCI ; EI |
| Language | 英语 |
| WOS ID | WOS:000859713100010 |
| Classification | 一类/力学重要期刊 |
| Ranking | 1 |
| Contributor | Duan, L ; Kang, Q (corresponding author), Chinese Acad Sci, Inst Mech, Natl Micrograv Lab, Beijing 100190, Peoples R China. ; Duan, L ; Kang, Q (corresponding author), Univ Chinese Acad Sci, Sch Engn Sci, Beijing 100049, Peoples R China. |
| Citation statistics | |
| Document Type | 期刊论文 |
| Identifier | http://dspace.imech.ac.cn/handle/311007/90212 |
| Collection | 微重力重点实验室 |
| Affiliation | 1.Chinese Acad Sci, Inst Mech, Natl Micrograv Lab, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Sch Engn Sci, Beijing 100049, Peoples R China |
| Recommended Citation GB/T 7714 | Chen Y,Duan L,Kang Q. Control of quasi-equilibrium state of annular flow through reinforcement learning[J]. PHYSICS OF FLUIDS,2022,34,9,:94105.Rp_Au:Duan, L, Kang, Q (corresponding author), Chinese Acad Sci, Inst Mech, Natl Micrograv Lab, Beijing 100190, Peoples R China., Duan, L, Kang, Q (corresponding author), Univ Chinese Acad Sci, Sch Engn Sci, Beijing 100049, Peoples R China. |
| APA | 陈一,段俐,&康琦.(2022).Control of quasi-equilibrium state of annular flow through reinforcement learning.PHYSICS OF FLUIDS,34(9),94105. |
| MLA | 陈一,et al."Control of quasi-equilibrium state of annular flow through reinforcement learning".PHYSICS OF FLUIDS 34.9(2022):94105. |
| Files in This Item: | Download All | |||||
| File Name/Size | DocType | Version | Access | License | ||
| Jp2022FA168.pdf（5272KB） | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | View Download | |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment