journal article
Dec 11, 2019
Distributed Optimization for Smart Cyber-Physical Networks
Abstract
The presence of embedded electronics and communication capabilities as well as sensing and control in smart devices has given rise to the novel concept of cyber-physical networks, in which agents aim at cooperatively solving complex tas s by local computation and communication. Numerous estimation, learning, decision and control tasks in smart networks involve the solution of large-scale, structured optimization problems in which network agents have only a partial knowledge of the whole problem. Distributed optimization aims at designing local computation and communication rules for the ne work processors allowing them to cooperatively solve the global optimization problem without relying on any central unit. The purpose of this survey is to provide an introduction to distributed optimization methodologies. Principal approaches, namely (primal) consensus-based, duality-based and constraint exchange methods, are formalized. An analysis of the basic schemes is supplied, and state-of-the-art extensions are reviewed.
Topics
No keywords indexed for this article. Browse by subject →
References
163
[1]
Agarwal "Randomized algorithms for geometric optimization problems" Combinatorial Optimization Dordrecht
[2]
Alizadeh "Demand-side management in the smart grid: Information pro- cessing for the power switch" IEEE Signal Processing Magazine
[3]
Amenta "Helly-type theorems and generalized linear programming" Discrete & Computational Geometry
[4]
Bastianello "A Partition-Based Implementation of the Relaxed ADMM for Distributed Convex Optimization over Lossy Networks" IEEE Conference on Decision and Control (CDC)
[5]
Beck First-order methods in optimization
[6]
Beck "An O(1/k) Gradient Method for Network Resource Allocation Prob- lems" IEEE Transactions on Control of Network Systems
[7]
Bénézit "Weighted gossip: Distributed averaging using non-doubly stochastic matrices" IEEE International Symposium on In- formation Theory (ISIT)
[8]
Bertsekas Network optimization: continuous and discrete models
[9]
Bertsekas Nonlinear programming
[10]
Bertsekas Convex Optimization Algorithms
[11]
Bertsekas "Gradient convergence in gradient methods with errors" SIAM Journal on Optimization
[12]
Bertsekas Parallel and dis- tributed computation: numerical methods
[13]
Bertsimas Introduction to linear optimization
[14]
Bianchi "A coordinate descent primal-dual algorithm and application to distributed asynchronous optimization" IEEE Transactions on Automatic Control
[15]
Bianchi "Convergence of a multi- agent projected stochastic gradient algorithm for non-convex optimization" IEEE Transactions on Automatic Control
[16]
Bof "Multi-Agent Newton-Raphson Optimization Over Lossy Networks" IEEE Transactions on Automatic Control
[17]
Boser "A training algorithm for optimal margin classifiers" Proceedings of the fifth annual workshop on Computational learning theory
[18]
Boyd "Distributed optimization and statistical learning via the alternating direction method of multipliers" et al.
[19]
Bürger "A Poly- hedral Approximation Framework for Convex and Robust Dis- tributed Optimization" IEEE Transactions on Automatic Con- trol
[20]
Bürger "A distributed simplex algorithm for degenerate linear programs and multi-agent assignments" Automatica
[21]
Camisa "A Pri- mal Decomposition Method with Suboptimality Bounds for Dis- tributed Mixed-Integer Linear Programming" IEEE Confer- ence on Decision and Control (CDC)
[22]
Carli "Distributed partition-based optimization via dual decomposition" IEEE Conference on Decision and Control (CDC)
[23]
Carli "Analysis of Newton-Raphson Consensus for multi-agent convex optimization under asynchronous and lossy communications" IEEE Conference on Decision and Control (CDC)
[24]
Cattivelli "Diffusion LMS strategies for distributed estimation" IEEE Transactions on Signal Processing
[25]
Chamanbaz "Ran- domized Constraints Consensus for Distributed Robust Linear Programming" IFAC-PapersOnLine
[26]
Chang "A proximal dual consensus ADMM method for multi-agent constrained optimization" IEEE Transactions on Signal Processing
[27]
Chang "Multi-agent dis- tributed optimization via inexact consensus ADMM" IEEE Transactions on Signal Processing
[28]
Chang "Distributed constrained optimization by consensus-based primal-dual per- turbation method" IEEE Transactions on Automatic Control
[29]
Chen "Diffusion adaptation strategies for distributed optimization and learning over networks" IEEE Transactions on Signal Processing
[30]
Cherukuri "Distributed generator coor- dination for initialization and anytime optimization in economic dispatch" IEEE Transactions on Control of Network Systems
[31]
Cherukuri "Initialization-free distributed coordination for economic dispatch under varying loads and generator commitment" Automatica
[32]
Di Lorenzo "Distributed Nonconvex Optimization over Networks" IEEE Intern. Conf. on Comput. Advances in Multi-Sensor Adaptive Process. (CAMSAP)
[33]
Di Lorenzo "Next: In-network nonconvex optimization" IEEE Transactions on Signal and Information Processing over Networks
[34]
Dinh "A dual decompo- sition algorithm for separable nonconvex optimization using the penalty function framework" IEEE Conference on Decision and Control (CDC)
[35]
Doan "A Jacobi decomposition algorithm for distributed convex opti- mization in distributed model predictive control" IFAC-Papers- OnLine
[36]
Duchi "Dual averaging for distributed optimization: Convergence analysis and network scaling" IEEE Transactions on Automatic control
[37]
Ebenbauer "Distributed optimization over directed graphs with the help of Lie brackets" IFAC-PapersOnLine
[38]
Eisen "Decentralized quasi-Newton methods" IEEE Transactions on Signal Process- ing
[39]
Erseghe "A Distributed and Scalable Processing Method Based Upon ADMM" IEEE Signal Processing Letters
[40]
Falsone "Dual decomposition for multi-agent distributed optimization with coupling constraints" Automatica
[41]
Farina "Distributed Interpolatory Algorithms for Set Membership Estimation" IEEE Transactions on Automatic Control
[42]
Farina "A Distributed Asynchronous Method of Multipliers for Constrained Nonconvex Optimization" Automatica
[43]
Gharesifard "Distributed continuous- time convex optimization on weight-balanced digraphs" IEEE Transactions on Automatic Control
[44]
Giselsson "Accelerated gradient methods and dual decom- position in distributed model predictive control" Automatica
[45]
Giselsson Large-scale and Distributed Optimization
[46]
Hadjicostis "Distributed Averaging and Balancing in Network Systems: with Applications to Coordination and Control" Foundations and Trends
[47]
Hale "Asynchronous multiagent primal-dual optimization" IEEE Transactions on Automatic Control
[48]
Hatanaka "Passivity- based distributed optimization with communication delays using PI consensus algorithm" IEEE Transactions on Automatic Con- trol
[49]
Hochhaus "Asynchronous Distributed Optimization with Heterogeneous Regularizations and Normal- izations" IEEE Conference on Decision and Control (CDC)
[50]
Iutzeler "Ex- plicit convergence rate of a distributed alternating direction method of multipliers" IEEE Transactions on Automatic Con- trol
Showing 50 of 163 references
Metrics
87
Citations
163
References
Details
- Published
- Dec 11, 2019
- Vol/Issue
- 7(3)
- Pages
- 253-383
Authors
Cite This Article
Giuseppe Notarstefano, Ivano Notarnicola, Andrea Camisa (2019). Distributed Optimization for Smart Cyber-Physical Networks. Foundations and Trends® in Systems and Control, 7(3), 253-383. https://doi.org/10.1561/2600000020
Related
You May Also Like
Port-Hamiltonian Systems Theory: An Introductory Overview
Arjan van der Schaft, Dimitri Jeltsema · 2014
487 citations