Nonlinear Theory and Its Applications, IEICE
Online ISSN : 2185-4106
ISSN-L : 2185-4106
Special Section on Recent Progress in Nonlinear Theory and Its Applications
Inertial Cubic regularized Newton for acceleration of second-order optimization
Shahrzad Mahboubi, Hiroshi Ninomiya
著者情報
ジャーナル オープンアクセス

2026 年 17 巻 3 号 p. 896-911

詳細
抄録

This paper proposes the Inertial Cubic regularized Newton (ICN) method, which incorporates inertial terms into the Cubic regularized Newton (CN) framework to accelerate convergence while preserving numerical stability. With the rapid growth of data-driven applications, conventional Newton-type methods have increasingly suffered from instability caused by indefinite or ill-conditioned Hessian matrices. The CN method addresses these issues by employing cubic regularization, ensuring global convergence to stationary points under standard assumptions and improved robustness. However, its convergence speed can still be limited in practice. To overcome this limitation, the proposed ICN method introduces inertial terms, originally developed for accelerating first-order optimization methods, into the second-order CN framework. This integration enhances convergence efficiency without compromising solution accuracy or stability. The effectiveness of the proposed method is demonstrated through extensive computational experiments on benchmark function optimization, logistic regression, and pattern classification problems. The results show that the ICN method consistently achieves faster convergence and improved robustness compared to existing second-order optimization algorithms.

著者関連情報
© 2026 The Institute of Electronics, Information and Communication Engineers

This article is licensed under a Creative Commons [Attribution-NonCommercial-NoDerivatives 4.0 International] license.
https://creativecommons.org/licenses/by-nc-nd/4.0/
前の記事 次の記事
feedback
Top