TY - GEN
T1 - Data-driven Distributionally Robust Optimization for Edge Intelligence
AU - Zhang, Zhaofeng
AU - Lin, Sen
AU - Dedeoglu, Mehmet
AU - Ding, Kemi
AU - Zhang, Junshan
N1 - Funding Information:
This work is supported in part by NSF under Grant CPS-1739344, ARO under grant W911NF-16-1-0448, and the DTRA under Grant HDTRA1-13-1-0029.
Publisher Copyright:
© 2020 IEEE.
PY - 2020/7
Y1 - 2020/7
N2 - The past few years have witnessed the explosive growth of Internet of Things (IoT) devices. The necessity of real-time edge intelligence for IoT applications demands that decision making must take place right here right now at the network edge, thus dictating that a high percentage of the IoT created data should be stored and analyzed locally. However, the computing resources are constrained and the amount of local data is often very limited at edge nodes. To tackle these challenges, we propose a distributionally robust optimization (DRO)-based edge intelligence framework, which is based on an innovative synergy of cloud knowledge transfer and local learning. More specifically, the knowledge transfer from the cloud learning is in the form of a reference distribution and its associated uncertainty set. Further, based on its local data, the edge device constructs an uncertainty set centered around its empirical distribution. The edge learning problem is then cast as a DRO problem subject to the above two distribution uncertainty sets. Building on this framework, we investigate two problem formulations for DRO-based edge intelligence, where the uncertainty sets are constructed using the Kullback-Leibler divergence and the Wasserstein distance, respectively. Numerical results demonstrate the effectiveness of the proposed DRO-based framework.
AB - The past few years have witnessed the explosive growth of Internet of Things (IoT) devices. The necessity of real-time edge intelligence for IoT applications demands that decision making must take place right here right now at the network edge, thus dictating that a high percentage of the IoT created data should be stored and analyzed locally. However, the computing resources are constrained and the amount of local data is often very limited at edge nodes. To tackle these challenges, we propose a distributionally robust optimization (DRO)-based edge intelligence framework, which is based on an innovative synergy of cloud knowledge transfer and local learning. More specifically, the knowledge transfer from the cloud learning is in the form of a reference distribution and its associated uncertainty set. Further, based on its local data, the edge device constructs an uncertainty set centered around its empirical distribution. The edge learning problem is then cast as a DRO problem subject to the above two distribution uncertainty sets. Building on this framework, we investigate two problem formulations for DRO-based edge intelligence, where the uncertainty sets are constructed using the Kullback-Leibler divergence and the Wasserstein distance, respectively. Numerical results demonstrate the effectiveness of the proposed DRO-based framework.
KW - Edge intelligence
KW - Kullback-Leibler divergence
KW - Wasserstein distance
KW - collaborative learning
KW - distributionally robust optimization
UR - http://www.scopus.com/inward/record.url?scp=85090295900&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85090295900&partnerID=8YFLogxK
U2 - 10.1109/INFOCOM41043.2020.9155440
DO - 10.1109/INFOCOM41043.2020.9155440
M3 - Conference contribution
AN - SCOPUS:85090295900
T3 - Proceedings - IEEE INFOCOM
SP - 2619
EP - 2628
BT - INFOCOM 2020 - IEEE Conference on Computer Communications
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 38th IEEE Conference on Computer Communications, INFOCOM 2020
Y2 - 6 July 2020 through 9 July 2020
ER -