Accelerating the Construction of Neural Network Potential Energy Surfaces: A Fast Hybrid Training Algorithm |
| |
| Authors: | Yao-long Zhang Xue-yao Zhou Bin Jiang |
| |
| Affiliation: | Department of Chemical Physics, University of Science and Technology of China, Hefei 230026, China |
| |
| Abstract: | Machine learning approaches have been promising in constructing high-dimensional potential energy surfaces (PESs) for molecules and materials. Neural networks (NNs) are one of the most popular such tools because of its simplicity and efficiency. The training algorithm for NNs becomes essential to achieve a fast and accurate fit with numerous data. The Levenberg-Marquardt (LM) algorithm has been recognized as one of the fastest and robust algorithms to train medium sized NNs and widely applied in recent NN based high quality PESs. However, when the number of ab initio data becomes large, the efficiency of LM is limited, making the training time consuming. Extreme learning machine (ELM) is a recently proposed algorithm which determines the weights and biases of a single hidden layer NN by a linear solution and is thus extremely fast. It, however, does not produce sufficiently small fitting error because of its random nature. Taking advantages of both algorithms, we report a generalized hybrid algorithm in training multilayer NNs. Tests on H+H2 and CH4+Ni(111) systems demonstrate the much higher efficiency of this hybrid algorithm (ELM-LM) over the original LM. We expect that ELM-LM will find its widespread applications in building up high-dimensional NN based PESs. |
| |
| Keywords: | Potential energy surface Reaction dynamics Neural networks |
|
| 点击此处可从《化学物理学报(中文版)》浏览原始摘要信息 |
|
点击此处可从《化学物理学报(中文版)》下载免费的PDF全文 |
