首页 | 本学科首页   官方微博 | 高级检索  
     检索      

无中心优化的算子分裂方法
引用本文:印卧涛.无中心优化的算子分裂方法[J].计算数学,2019,41(3):225-241.
作者姓名:印卧涛
作者单位:阿里巴巴(美国)达摩院
摘    要:在某些多智能体系统中,由于受到通讯等因素的限制,单个智能体只能进行本地计算,再与相邻智能体交换数据.与传统的并行和分布式计算不同,这种数据交换方式不再使用中心节点或者共享内存,而仅限于相邻节点之间.这种通过局部数据交换而实现全网目标的方式叫做无中心计算.比如,从任意的多个数开始,所有智能体通过不断地计算其局部平均,就都能收敛到这些数的平均值.无中心计算有不易形成通讯和计算瓶颈的优点,更适合分布的节点,因此受到一些应用的欢迎. 本文介绍求解一致最优化问题的若干无中心算法.一致最优化问题的目标是全网所有节点的变量收敛到同一个、并使所有目标函数之和最小的值.我们可以通过推广求平均的无中心方法去实现这个目标,但是得到算法比普通(有中心的)优化算法收敛得更慢,有阶数差距.近年来,一些新的无中心算法弥补了这个阶数差距.本文采用算子分裂的统一框架,以比这些算法原文更为简单的形式介绍这些方法.

关 键 词:无中心算法  一致优化  算子分裂  单调算子  
收稿时间:2019-07-09

OPERATOR SPLITTING METHODS FOR DECENTRALIZED OPTIMIZATION
Yin Wotao.OPERATOR SPLITTING METHODS FOR DECENTRALIZED OPTIMIZATION[J].Mathematica Numerica Sinica,2019,41(3):225-241.
Authors:Yin Wotao
Institution:DAMO Academy, Alibaba US;(on leave from) Department of Mathematics, University of California, Los Angeles US
Abstract:Many problems in multi-agent systems, due to communication restrictions, need to be solved in a decentralized manner. There is no data fusion center, so we must rely on shortdistance communication between adjacent nodes to achieve the goal of the whole network. Compared with traditional (centralized) computing, decentralized computing is more suitable for distributed data, less subject to communication and computing bottlenecks, and easier to realize in some applications. This article overviews the formulations and methods of decentralized consensus optimization. The objective of consensus optimization is that all the variables of the nodes converge to the same vector that minimizes the sum of their objective functions. This problem is solved by calculations at each node and data exchanges between adjacent nodes. Naive decentralized algorithms are much slower than their centralized counterparts. In order to make up for this gap, we review some recent methods through a unified framework of operator splitting.
Keywords:decentralized algorithms  consensus optimization  operator splitting  monotone operator  
本文献已被 CNKI 等数据库收录!
点击此处可从《计算数学》浏览原始摘要信息
点击此处可从《计算数学》下载免费的PDF全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号