Abstract
Resource-constrained IoT devices, such as sensors and actuators, have become ubiquitous in recent years. This has led to the generation of large quantities of data in real-time, which is an appealing target for AI systems. However, deploying machine learning models on such end-devices is nearly impossible. A typical solution involves offloading data to external computing systems (such as cloud servers) for further processing but this worsens latency, leads to increased communication costs, and adds to privacy concerns. To address this issue, efforts have been made to place additional computing devices at the edge of the network, i.e., close to the IoT devices where the data is generated. Deploying machine learning systems on such edge computing devices alleviates the above issues by allowing computations to be performed close to the data sources. This survey describes major research efforts where machine learning systems have been deployed at the edge of computer networks, focusing on the operational aspects including compression techniques, tools, frameworks, and hardware used in successful applications of intelligent edge systems.
Topics

No keywords indexed for this article. Browse by subject →

References
165
[1]
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)

Amina Adadi, Mohammed Berrada

IEEE Access 10.1109/access.2018.2870052
[2]
Adafruit. 2019. Micro Speech Demo. Retrieved from https://learn.adafruit.com/tensorflow-lite-for-edgebadge-kit-quickstart/micro-speech-demo. Adafruit. 2019. Micro Speech Demo. Retrieved from https://learn.adafruit.com/tensorflow-lite-for-edgebadge-kit-quickstart/micro-speech-demo.
[3]
M. Ali , A. Anjum , M. U. Yaseen , A. R. Zamani , D. Balouek-Thomert , O. Rana , and M. Parashar . 2018. Edge enhanced deep learning system for large-scale video stream analytics . In IEEE 2nd International Conference on Fog and Edge Computing (ICFEC). 1–10 . DOI:https://doi.org/10.1109/CFEC. 2018 .8358733 M. Ali, A. Anjum, M. U. Yaseen, A. R. Zamani, D. Balouek-Thomert, O. Rana, and M. Parashar. 2018. Edge enhanced deep learning system for large-scale video stream analytics. In IEEE 2nd International Conference on Fog and Edge Computing (ICFEC). 1–10. DOI:https://doi.org/10.1109/CFEC.2018.8358733
[4]
Alasdair Allan. 2018. Deep Learning at the Edge on an Arm Cortex-powered Camera Board. Retrieved from https://blog.hackster.io/deep-learning-at-the-edge-on-an-arm-cortex-powered-camera-board-3ca16eb60ef7. Alasdair Allan. 2018. Deep Learning at the Edge on an Arm Cortex-powered Camera Board. Retrieved from https://blog.hackster.io/deep-learning-at-the-edge-on-an-arm-cortex-powered-camera-board-3ca16eb60ef7.
[5]
Alasdair Allan. 2019. Benchmarking Edge Computing. Retrieved from https://medium.com/@aallan/benchmarking-edge-computing-ce3f13942245. Alasdair Allan. 2019. Benchmarking Edge Computing. Retrieved from https://medium.com/@aallan/benchmarking-edge-computing-ce3f13942245.
[6]
Alasdair Allan. 2019. Benchmarking the Xnor AI2GO Platform on the Raspberry Pi. Retrieved from https://blog.hackster.io/benchmarking-the-xnor-ai2go-platform-on-the-raspberry-pi-628a82af8aea. Alasdair Allan. 2019. Benchmarking the Xnor AI2GO Platform on the Raspberry Pi. Retrieved from https://blog.hackster.io/benchmarking-the-xnor-ai2go-platform-on-the-raspberry-pi-628a82af8aea.
[7]
Alasdair Allan. 2019. Hands-on with the SmartEdge Agile. Retrieved from https://blog.hackster.io/hands-on-with-the-smartedge-agile-b7b7f02b5d4b. Alasdair Allan. 2019. Hands-on with the SmartEdge Agile. Retrieved from https://blog.hackster.io/hands-on-with-the-smartedge-agile-b7b7f02b5d4b.
[8]
Alasdair Allan. 2019. Measuring Machine Learning. Retrieved from https://towardsdatascience.com/measuring-machine-learning-945a47bd3750. Alasdair Allan. 2019. Measuring Machine Learning. Retrieved from https://towardsdatascience.com/measuring-machine-learning-945a47bd3750.
[11]
Andrej Karpathy. 2019. PyTorch at Tesla. Retrieved from https://www.youtube.com/watch?v=oBklltKXtDE. Andrej Karpathy. 2019. PyTorch at Tesla. Retrieved from https://www.youtube.com/watch?v=oBklltKXtDE.
[12]
ARM Limited . Machine Learning ARM ML Processor . Retrieved on July 25, 2021 from https://developer.arm.com/ip-products/processors/machine-learning. ARM Limited. Machine Learning ARM ML Processor. Retrieved on July 25, 2021 from https://developer.arm.com/ip-products/processors/machine-learning.
[13]
Asha Barbaschow. 2018. VMware looking towards IoT and the edge. Retrieved from https://www.zdnet.com/article/vmware-looking-towards-iot-and-the-edge/. Asha Barbaschow. 2018. VMware looking towards IoT and the edge. Retrieved from https://www.zdnet.com/article/vmware-looking-towards-iot-and-the-edge/.
[14]
M. Barnell , C. Raymond , C. Capraro , D. Isereau , C. Cicotta , and N. Stokes . 2018. High-performance computing (HPC) and machine learning demonstrated in flight using Agile Condor . In IEEE High Performance Extreme Computing Conference (HPEC). 1–4. M. Barnell, C. Raymond, C. Capraro, D. Isereau, C. Cicotta, and N. Stokes. 2018. High-performance computing (HPC) and machine learning demonstrated in flight using Agile Condor. In IEEE High Performance Extreme Computing Conference (HPEC). 1–4.
[19]
Andrew A. Borkowski , Catherine P. Wilson , Steven A. Borkowski , Lauren A. Deland , and Stephen M. Mastorides . 2019 . Using Apple machine learning algorithms to detect and subclassify non-small cell lung cancer . Arxiv E-prints 1808 . 08230 (January 2019). Andrew A. Borkowski, Catherine P. Wilson, Steven A. Borkowski, Lauren A. Deland, and Stephen M. Mastorides. 2019. Using Apple machine learning algorithms to detect and subclassify non-small cell lung cancer. Arxiv E-prints 1808.08230 (January 2019).
[20]
Brandon Butler . 2017. What is edge computing and how it’s changing the network. Network World ( 2017 ). DOI:https://www.networkworld.com/article/3224893/what-is-edge-computing-and-how-it-s-changing-the-network.html. Brandon Butler. 2017. What is edge computing and how it’s changing the network. Network World (2017). DOI:https://www.networkworld.com/article/3224893/what-is-edge-computing-and-how-it-s-changing-the-network.html.
[23]
X. Chang , W. Li , C. Xia , J. Ma , J. Cao , S. U. Khan , and A. Y. Zomaya . 2018. From insight to impact: Building a sustainable edge computing platform for smart homes . In IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS). 928–936 . DOI:https://doi.org/10.1109/PADSW. 2018 .8644647 X. Chang, W. Li, C. Xia, J. Ma, J. Cao, S. U. Khan, and A. Y. Zomaya. 2018. From insight to impact: Building a sustainable edge computing platform for smart homes. In IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS). 928–936. DOI:https://doi.org/10.1109/PADSW.2018.8644647
[24]
G. Chen , C. Parada , and G. Heigold . 2014. Small-footprint keyword spotting using deep neural networks . In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 4087–4091 . DOI:https://doi.org/10.1109/ICASSP. 2014 .6854370 G. Chen, C. Parada, and G. Heigold. 2014. Small-footprint keyword spotting using deep neural networks. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 4087–4091. DOI:https://doi.org/10.1109/ICASSP.2014.6854370
[29]
Yu Cheng , Duo Wang , Pan Zhou , and Tao Zhang . 2017. A survey of model compression and acceleration for deep neural networks. Arxiv E-prints 1710.09282 ( 2017 ). Yu Cheng, Duo Wang, Pan Zhou, and Tao Zhang. 2017. A survey of model compression and acceleration for deep neural networks. Arxiv E-prints 1710.09282 (2017).
[30]
Sandeep Chinchali , Apoorva Sharma , James Harrison , Amine Elhafsi , Daniel Kang , Evgenya Pergament , Eyal Cidon , Sachin Katti , and Marco Pavone . 2021. Network offloading policies for cloud robotics: a learning-based approach. Autonomous Robots ( 2021 ), 1–16. https://doi.org/10.1007/s10514-021-09987-4 Sandeep Chinchali, Apoorva Sharma, James Harrison, Amine Elhafsi, Daniel Kang, Evgenya Pergament, Eyal Cidon, Sachin Katti, and Marco Pavone. 2021. Network offloading policies for cloud robotics: a learning-based approach. Autonomous Robots (2021), 1–16. https://doi.org/10.1007/s10514-021-09987-4
[31]
Tejalal Choudhary Vipul Mishra Anurag Goswami and Jagannathan Sarangapani. 2020. A comprehensive survey 1109 on model compression and acceleration. Artif. Intell. Rev. (2020) 1–43. Tejalal Choudhary Vipul Mishra Anurag Goswami and Jagannathan Sarangapani. 2020. A comprehensive survey 1109 on model compression and acceleration. Artif. Intell. Rev. (2020) 1–43.
[32]
Christine Long. 2019. BeagleBone AI Makes a Sneak Preview. Retrieved from https://beagleboard.org/blog/2019-05-16-beaglebone-ai-preview. Christine Long. 2019. BeagleBone AI Makes a Sneak Preview. Retrieved from https://beagleboard.org/blog/2019-05-16-beaglebone-ai-preview. 10.1080/14432471.2019.1623158
[33]
N. Curukogle and B. M. Ozyildirim . 2018. Deep learning on mobile systems . In Innovations in Intelligent Systems and Applications Conference (ASYU). 1–4. DOI:https://doi.org/10 .1109/ASYU. 2018 .8554039 N. Curukogle and B. M. Ozyildirim. 2018. Deep learning on mobile systems. In Innovations in Intelligent Systems and Applications Conference (ASYU). 1–4. DOI:https://doi.org/10.1109/ASYU.2018.8554039
[34]
A. Das , M. Degeling , X. Wang , J. Wang , N. Sadeh , and M. Satyanarayanan . 2017. Assisting users in a world full of cameras: A privacy-aware infrastructure for computer vision applications . In IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 1387–1396 . DOI:https://doi.org/10.1109/CVPRW. 2017 .181 A. Das, M. Degeling, X. Wang, J. Wang, N. Sadeh, and M. Satyanarayanan. 2017. Assisting users in a world full of cameras: A privacy-aware infrastructure for computer vision applications. In IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 1387–1396. DOI:https://doi.org/10.1109/CVPRW.2017.181
[38]
SparkFun Electronics . SparkFun Edge Hookup Guide . Retreived July 25, 2021 from https://learn.sparkfun.com/tutorials/sparkfun-edge-hookup-guide/all. SparkFun Electronics. SparkFun Edge Hookup Guide. Retreived July 25, 2021 from https://learn.sparkfun.com/tutorials/sparkfun-edge-hookup-guide/all.
[41]
Z. Feng , S. George , J. Harkes , P. Pillai , R. Klatzky , and M. Satyanarayanan . 2018. Edge-based discovery of training data for machine learning . In IEEE/ACM Symposium on Edge Computing (SEC). 145–158 . Z. Feng, S. George, J. Harkes, P. Pillai, R. Klatzky, and M. Satyanarayanan. 2018. Edge-based discovery of training data for machine learning. In IEEE/ACM Symposium on Edge Computing (SEC). 145–158.
[42]
E. Flamand , D. Rossi , F. Conti , I. Loi , A. Pullini , F. Rotenberg , and L. Benini . 2018. GAP-8: A RISC-V SoC for AI at the edge of the IoT . In IEEE 29th International Conference on Application-specific Systems, Architectures and Processors (ASAP). 1–4. DOI:https://doi.org/10 .1109/ASAP. 2018 .8445101 E. Flamand, D. Rossi, F. Conti, I. Loi, A. Pullini, F. Rotenberg, and L. Benini. 2018. GAP-8: A RISC-V SoC for AI at the edge of the IoT. In IEEE 29th International Conference on Application-specific Systems, Architectures and Processors (ASAP). 1–4. DOI:https://doi.org/10.1109/ASAP.2018.8445101
[43]
David Floyer. 2015. The Vital Role of Edge Computing in the Internet of Things. Retrieved from https://wikibon.com/the-vital-role-of-edge-computing-in-the-internet-of-things. David Floyer. 2015. The Vital Role of Edge Computing in the Internet of Things. Retrieved from https://wikibon.com/the-vital-role-of-edge-computing-in-the-internet-of-things.
[44]
The Linux Foundation . Accessed:. The Open Platform for the IoT Edge . Retrieved on July 25, 2021 from https://www.edgexfoundry.org. The Linux Foundation. Accessed:. The Open Platform for the IoT Edge. Retrieved on July 25, 2021 from https://www.edgexfoundry.org.
[47]
Robin C. Geyer , Tassilo Klein , and Moin Nabi . 2017. Differentially private federated learning: A client level perspective. CoRR abs/1712.07557 ( 2017 ). Robin C. Geyer, Tassilo Klein, and Moin Nabi. 2017. Differentially private federated learning: A client level perspective. CoRR abs/1712.07557 (2017).

Showing 50 of 165 references

Cited By
348
Journal of Network and Computer App...
Future Generation Computer Systems
IEEE Communications Surveys & T...
IEEE Open Journal of the Communicat...
Metrics
348
Citations
165
References
Details
Published
Oct 04, 2021
Vol/Issue
54(8)
Pages
1-37
License
View
Cite This Article
M. G. Sarwar Murshed, Christopher Murphy, Daqing Hou, et al. (2021). Machine Learning at the Network Edge: A Survey. ACM Computing Surveys, 54(8), 1-37. https://doi.org/10.1145/3469029
Related

You May Also Like

Data clustering

A. K. Jain, M. N. Murty · 1999

9,568 citations

Anomaly detection

Varun Chandola, Arindam Banerjee · 2009

8,799 citations

Machine learning in automated text categorization

Fabrizio Sebastiani · 2002

5,027 citations

Object tracking

Alper Yilmaz, Omar Javed · 2006

3,632 citations

A Survey on Bias and Fairness in Machine Learning

Ninareh Mehrabi, Fred Morstatter · 2021

3,466 citations