Fixed-Time Gradient Flows for Solving Constrained Optimization:A Unified ApproachOACSTPCDEI
Fixed-Time Gradient Flows for Solving Constrained Optimization:A Unified Approach
The accelerated method in solving optimization problems has always been an absorbing topic.Based on the fixed-time(FxT)stability of nonlinear dynamical systems,we provide a unified approach for designing FxT gradient flows(FxTGFs).First,a general class of nonlinear functions in designing FxTGFs is provided.A unified method for designing first-order FxTGFs is shown under Polyak-Łjasiewicz inequality assumption,a weaker condition than strong convexity.When there exist both bounded and vanishing disturbances in the gradient flow,a specific class of nonsmooth robust FxTGFs with disturbance rejection is pre-sented.Under the strict convexity assumption,Newton-based FxTGFs is given and further extended to solve time-varying opti-mization.Besides,the proposed FxTGFs are further used for solving equation-constrained optimization.Moreover,an FxT proximal gradient flow with a wide range of parameters is pro-vided for solving nonsmooth composite optimization.To show the effectiveness of various FxTGFs,the static regret analyses for sev-eral typical FxTGFs are also provided in detail.Finally,the pro-posed FxTGFs are applied to solve two network problems,i.e.,the network consensus problem and solving a system linear equa-tions,respectively,from the perspective of optimization.Particu-larly,by choosing component-wisely sign-preserving functions,these problems can be solved in a distributed way,which extends the existing results.The accelerated convergence and robustness of the proposed FxTGFs are validated in several numerical examples stemming from practical applications.
Xinli Shi;Xiangping Xu;Guanghui Wen;Jinde Cao
School of Cyber Science and Engineering,Southeast University,Nanjing 210096,ChinaSchool of Mathematics,Southeast University,Nanjing 210096,China
Consensusconstrained optimizationdisturbance rejectionlinear equationsfixed-time gradient flow(FxTGF)
《自动化学报(英文版)》 2024 (008)
1849-1864 / 16
This work was supported by the National Key Research and Development Program of China(2020YFA0714300),the National Natural Science Foundation of China(62003084,62203108,62073079),the Natural Science Foundation of Jiangsu Province of China(BK20200355),the General Joint Fund of the Equipment Advance Research Program of Ministry of Education(8091B022114),Jiangsu Province Excellent Postdoctoral Prog-ram(2022ZB131),and China Postdoctoral Science Foundation(2022M72 0720,2023T160105).
评论