Safe Reinforcement Learning-based Controller for Disruption Free Regulation of Plasma Density in Next-generation Tokamaks

S. T. Paruchuri, H. Al Khawaldeh, V. Graber, E. Schuster, A. Pajares, J-W. Juhn

33rd Symposium on Fusion Technology (SOFT)

Dublin, Ireland, September 22-27, 2024

Abstract

Achieving high particle density is desirable in fusion reactors because of its direct correlation to the fusion power. However, operational limits constrain the maximum achievable particle density. Several density control algorithms have been designed to inject particles using gas puffing and pellet injection to track carefully selected safe targets. However, a controller unaware of these operational limits may modulate the particle densities beyond the safe limits during transients caused by changing operating conditions. Designing plasma control algorithms that recognize these operational limits and ensure that the particle density remains within the safe operational space is desirable. This work focuses on the safe regulation of deuterium, tritium, alpha-particle and impurity densities. Under the assumption of quasi-neutrality, these particle densities can be related to the electron density, which is constrained by the well-known Greenwald's limit. To regulate the particle densities within the safe operational space defined by Greenwald's limit, a novel safe reinforcement learning-based controller is developed in this work. Such control-design approach can be critical in designing learning-based safe plasma control algorithms for next-generation tokamaks. The performance of the controller is evaluated through one-dimensional nonlinear simulations in COTSIM. The results demonstrate the controller's effectiveness under various operating conditions and in the presence of uncertainties.

*Supported by the US DOE (DE-SC0010661, DE-SC0010537).