journal article
Oct 04, 2021
Machine Learning at the Network Edge: A Survey
Abstract
Resource-constrained IoT devices, such as sensors and actuators, have become ubiquitous in recent years. This has led to the generation of large quantities of data in real-time, which is an appealing target for AI systems. However, deploying machine learning models on such end-devices is nearly impossible. A typical solution involves offloading data to external computing systems (such as cloud servers) for further processing but this worsens latency, leads to increased communication costs, and adds to privacy concerns. To address this issue, efforts have been made to place additional computing devices at the edge of the network, i.e., close to the IoT devices where the data is generated. Deploying machine learning systems on such edge computing devices alleviates the above issues by allowing computations to be performed close to the data sources. This survey describes major research efforts where machine learning systems have been deployed at the edge of computer networks, focusing on the operational aspects including compression techniques, tools, frameworks, and hardware used in successful applications of intelligent edge systems.
Topics
No keywords indexed for this article. Browse by subject →
References
165
[1]
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Amina Adadi, Mohammed Berrada
IEEE Access
10.1109/access.2018.2870052
[2]
Adafruit. 2019. Micro Speech Demo. Retrieved from https://learn.adafruit.com/tensorflow-lite-for-edgebadge-kit-quickstart/micro-speech-demo. Adafruit. 2019. Micro Speech Demo. Retrieved from https://learn.adafruit.com/tensorflow-lite-for-edgebadge-kit-quickstart/micro-speech-demo.
[3]
M. Ali , A. Anjum , M. U. Yaseen , A. R. Zamani , D. Balouek-Thomert , O. Rana , and M. Parashar . 2018. Edge enhanced deep learning system for large-scale video stream analytics . In IEEE 2nd International Conference on Fog and Edge Computing (ICFEC). 1–10 . DOI:https://doi.org/10.1109/CFEC. 2018 .8358733 M. Ali, A. Anjum, M. U. Yaseen, A. R. Zamani, D. Balouek-Thomert, O. Rana, and M. Parashar. 2018. Edge enhanced deep learning system for large-scale video stream analytics. In IEEE 2nd International Conference on Fog and Edge Computing (ICFEC). 1–10. DOI:https://doi.org/10.1109/CFEC.2018.8358733
[4]
Alasdair Allan. 2018. Deep Learning at the Edge on an Arm Cortex-powered Camera Board. Retrieved from https://blog.hackster.io/deep-learning-at-the-edge-on-an-arm-cortex-powered-camera-board-3ca16eb60ef7. Alasdair Allan. 2018. Deep Learning at the Edge on an Arm Cortex-powered Camera Board. Retrieved from https://blog.hackster.io/deep-learning-at-the-edge-on-an-arm-cortex-powered-camera-board-3ca16eb60ef7.
[5]
Alasdair Allan. 2019. Benchmarking Edge Computing. Retrieved from https://medium.com/@aallan/benchmarking-edge-computing-ce3f13942245. Alasdair Allan. 2019. Benchmarking Edge Computing. Retrieved from https://medium.com/@aallan/benchmarking-edge-computing-ce3f13942245.
[6]
Alasdair Allan. 2019. Benchmarking the Xnor AI2GO Platform on the Raspberry Pi. Retrieved from https://blog.hackster.io/benchmarking-the-xnor-ai2go-platform-on-the-raspberry-pi-628a82af8aea. Alasdair Allan. 2019. Benchmarking the Xnor AI2GO Platform on the Raspberry Pi. Retrieved from https://blog.hackster.io/benchmarking-the-xnor-ai2go-platform-on-the-raspberry-pi-628a82af8aea.
[7]
Alasdair Allan. 2019. Hands-on with the SmartEdge Agile. Retrieved from https://blog.hackster.io/hands-on-with-the-smartedge-agile-b7b7f02b5d4b. Alasdair Allan. 2019. Hands-on with the SmartEdge Agile. Retrieved from https://blog.hackster.io/hands-on-with-the-smartedge-agile-b7b7f02b5d4b.
[8]
Alasdair Allan. 2019. Measuring Machine Learning. Retrieved from https://towardsdatascience.com/measuring-machine-learning-945a47bd3750. Alasdair Allan. 2019. Measuring Machine Learning. Retrieved from https://towardsdatascience.com/measuring-machine-learning-945a47bd3750.
[11]
Andrej Karpathy. 2019. PyTorch at Tesla. Retrieved from https://www.youtube.com/watch?v=oBklltKXtDE. Andrej Karpathy. 2019. PyTorch at Tesla. Retrieved from https://www.youtube.com/watch?v=oBklltKXtDE.
[12]
ARM Limited . Machine Learning ARM ML Processor . Retrieved on July 25, 2021 from https://developer.arm.com/ip-products/processors/machine-learning. ARM Limited. Machine Learning ARM ML Processor. Retrieved on July 25, 2021 from https://developer.arm.com/ip-products/processors/machine-learning.
[13]
Asha Barbaschow. 2018. VMware looking towards IoT and the edge. Retrieved from https://www.zdnet.com/article/vmware-looking-towards-iot-and-the-edge/. Asha Barbaschow. 2018. VMware looking towards IoT and the edge. Retrieved from https://www.zdnet.com/article/vmware-looking-towards-iot-and-the-edge/.
[14]
M. Barnell , C. Raymond , C. Capraro , D. Isereau , C. Cicotta , and N. Stokes . 2018. High-performance computing (HPC) and machine learning demonstrated in flight using Agile Condor . In IEEE High Performance Extreme Computing Conference (HPEC). 1–4. M. Barnell, C. Raymond, C. Capraro, D. Isereau, C. Cicotta, and N. Stokes. 2018. High-performance computing (HPC) and machine learning demonstrated in flight using Agile Condor. In IEEE High Performance Extreme Computing Conference (HPEC). 1–4.
[15]
[19]
Andrew A. Borkowski , Catherine P. Wilson , Steven A. Borkowski , Lauren A. Deland , and Stephen M. Mastorides . 2019 . Using Apple machine learning algorithms to detect and subclassify non-small cell lung cancer . Arxiv E-prints 1808 . 08230 (January 2019). Andrew A. Borkowski, Catherine P. Wilson, Steven A. Borkowski, Lauren A. Deland, and Stephen M. Mastorides. 2019. Using Apple machine learning algorithms to detect and subclassify non-small cell lung cancer. Arxiv E-prints 1808.08230 (January 2019).
[20]
Brandon Butler . 2017. What is edge computing and how it’s changing the network. Network World ( 2017 ). DOI:https://www.networkworld.com/article/3224893/what-is-edge-computing-and-how-it-s-changing-the-network.html. Brandon Butler. 2017. What is edge computing and how it’s changing the network. Network World (2017). DOI:https://www.networkworld.com/article/3224893/what-is-edge-computing-and-how-it-s-changing-the-network.html.
[23]
X. Chang , W. Li , C. Xia , J. Ma , J. Cao , S. U. Khan , and A. Y. Zomaya . 2018. From insight to impact: Building a sustainable edge computing platform for smart homes . In IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS). 928–936 . DOI:https://doi.org/10.1109/PADSW. 2018 .8644647 X. Chang, W. Li, C. Xia, J. Ma, J. Cao, S. U. Khan, and A. Y. Zomaya. 2018. From insight to impact: Building a sustainable edge computing platform for smart homes. In IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS). 928–936. DOI:https://doi.org/10.1109/PADSW.2018.8644647
[24]
G. Chen , C. Parada , and G. Heigold . 2014. Small-footprint keyword spotting using deep neural networks . In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 4087–4091 . DOI:https://doi.org/10.1109/ICASSP. 2014 .6854370 G. Chen, C. Parada, and G. Heigold. 2014. Small-footprint keyword spotting using deep neural networks. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 4087–4091. DOI:https://doi.org/10.1109/ICASSP.2014.6854370
[29]
Yu Cheng , Duo Wang , Pan Zhou , and Tao Zhang . 2017. A survey of model compression and acceleration for deep neural networks. Arxiv E-prints 1710.09282 ( 2017 ). Yu Cheng, Duo Wang, Pan Zhou, and Tao Zhang. 2017. A survey of model compression and acceleration for deep neural networks. Arxiv E-prints 1710.09282 (2017).
[30]
Sandeep Chinchali , Apoorva Sharma , James Harrison , Amine Elhafsi , Daniel Kang , Evgenya Pergament , Eyal Cidon , Sachin Katti , and Marco Pavone . 2021. Network offloading policies for cloud robotics: a learning-based approach. Autonomous Robots ( 2021 ), 1–16. https://doi.org/10.1007/s10514-021-09987-4 Sandeep Chinchali, Apoorva Sharma, James Harrison, Amine Elhafsi, Daniel Kang, Evgenya Pergament, Eyal Cidon, Sachin Katti, and Marco Pavone. 2021. Network offloading policies for cloud robotics: a learning-based approach. Autonomous Robots (2021), 1–16. https://doi.org/10.1007/s10514-021-09987-4
[31]
Tejalal Choudhary Vipul Mishra Anurag Goswami and Jagannathan Sarangapani. 2020. A comprehensive survey 1109 on model compression and acceleration. Artif. Intell. Rev. (2020) 1–43. Tejalal Choudhary Vipul Mishra Anurag Goswami and Jagannathan Sarangapani. 2020. A comprehensive survey 1109 on model compression and acceleration. Artif. Intell. Rev. (2020) 1–43.
[32]
Christine Long. 2019. BeagleBone AI Makes a Sneak Preview. Retrieved from https://beagleboard.org/blog/2019-05-16-beaglebone-ai-preview. Christine Long. 2019. BeagleBone AI Makes a Sneak Preview. Retrieved from https://beagleboard.org/blog/2019-05-16-beaglebone-ai-preview.
10.1080/14432471.2019.1623158
[33]
N. Curukogle and B. M. Ozyildirim . 2018. Deep learning on mobile systems . In Innovations in Intelligent Systems and Applications Conference (ASYU). 1–4. DOI:https://doi.org/10 .1109/ASYU. 2018 .8554039 N. Curukogle and B. M. Ozyildirim. 2018. Deep learning on mobile systems. In Innovations in Intelligent Systems and Applications Conference (ASYU). 1–4. DOI:https://doi.org/10.1109/ASYU.2018.8554039
[34]
A. Das , M. Degeling , X. Wang , J. Wang , N. Sadeh , and M. Satyanarayanan . 2017. Assisting users in a world full of cameras: A privacy-aware infrastructure for computer vision applications . In IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 1387–1396 . DOI:https://doi.org/10.1109/CVPRW. 2017 .181 A. Das, M. Degeling, X. Wang, J. Wang, N. Sadeh, and M. Satyanarayanan. 2017. Assisting users in a world full of cameras: A privacy-aware infrastructure for computer vision applications. In IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 1387–1396. DOI:https://doi.org/10.1109/CVPRW.2017.181
[35]
[38]
SparkFun Electronics . SparkFun Edge Hookup Guide . Retreived July 25, 2021 from https://learn.sparkfun.com/tutorials/sparkfun-edge-hookup-guide/all. SparkFun Electronics. SparkFun Edge Hookup Guide. Retreived July 25, 2021 from https://learn.sparkfun.com/tutorials/sparkfun-edge-hookup-guide/all.
[41]
Z. Feng , S. George , J. Harkes , P. Pillai , R. Klatzky , and M. Satyanarayanan . 2018. Edge-based discovery of training data for machine learning . In IEEE/ACM Symposium on Edge Computing (SEC). 145–158 . Z. Feng, S. George, J. Harkes, P. Pillai, R. Klatzky, and M. Satyanarayanan. 2018. Edge-based discovery of training data for machine learning. In IEEE/ACM Symposium on Edge Computing (SEC). 145–158.
[42]
E. Flamand , D. Rossi , F. Conti , I. Loi , A. Pullini , F. Rotenberg , and L. Benini . 2018. GAP-8: A RISC-V SoC for AI at the edge of the IoT . In IEEE 29th International Conference on Application-specific Systems, Architectures and Processors (ASAP). 1–4. DOI:https://doi.org/10 .1109/ASAP. 2018 .8445101 E. Flamand, D. Rossi, F. Conti, I. Loi, A. Pullini, F. Rotenberg, and L. Benini. 2018. GAP-8: A RISC-V SoC for AI at the edge of the IoT. In IEEE 29th International Conference on Application-specific Systems, Architectures and Processors (ASAP). 1–4. DOI:https://doi.org/10.1109/ASAP.2018.8445101
[43]
David Floyer. 2015. The Vital Role of Edge Computing in the Internet of Things. Retrieved from https://wikibon.com/the-vital-role-of-edge-computing-in-the-internet-of-things. David Floyer. 2015. The Vital Role of Edge Computing in the Internet of Things. Retrieved from https://wikibon.com/the-vital-role-of-edge-computing-in-the-internet-of-things.
[44]
The Linux Foundation . Accessed:. The Open Platform for the IoT Edge . Retrieved on July 25, 2021 from https://www.edgexfoundry.org. The Linux Foundation. Accessed:. The Open Platform for the IoT Edge. Retrieved on July 25, 2021 from https://www.edgexfoundry.org.
[47]
Robin C. Geyer , Tassilo Klein , and Moin Nabi . 2017. Differentially private federated learning: A client level perspective. CoRR abs/1712.07557 ( 2017 ). Robin C. Geyer, Tassilo Klein, and Moin Nabi. 2017. Differentially private federated learning: A client level perspective. CoRR abs/1712.07557 (2017).
Showing 50 of 165 references
Cited By
348
Composite human activity recognition utilizing knowledge distillation and sensor fusion focusing on resource constrained microcontrollers
Expert Systems with Applications
Athar Noor Mohammad Rafee, John Clear · 2026
Edge-AI: A systematic review on architectures, applications, and challenges
Journal of Network and Computer App...
Himanshu Gauttam, Garima Nain · 2026
Adaptive ensemble optimization for memory-related hyperparameters in retraining DNN at edge
Future Generation Computer Systems
Yidong Xu, Rui Han · 2025
A Survey on Trustworthy Edge Intelligence: From Security and Reliability to Transparency and Sustainability
IEEE Communications Surveys & T...
Xiaojie Wang, Beibei Wang · 2025
Federated Learning for 6G Networks: Navigating Privacy Benefits and Challenges
IEEE Open Journal of the Communicat...
Chamara Sandeepa, Engin Zeydan · 2025
Metrics
348
Citations
165
References
Details
- Published
- Oct 04, 2021
- Vol/Issue
- 54(8)
- Pages
- 1-37
- License
- View
Authors
Cite This Article
M. G. Sarwar Murshed, Christopher Murphy, Daqing Hou, et al. (2021). Machine Learning at the Network Edge: A Survey. ACM Computing Surveys, 54(8), 1-37. https://doi.org/10.1145/3469029
Related
You May Also Like
A Survey on Bias and Fairness in Machine Learning
Ninareh Mehrabi, Fred Morstatter · 2021
3,466 citations