BishtRef
Articles Journals Publishers Authors Subjects Most Cited New Papers Year Stats Open Access
journal article Open Access Jun 22, 2024

A Review on the emerging technology of TinyML

Vasileios Tsoukas ORCID Anargyros Gkogkidis ORCID Eleni Boumpa ORCID Athanasios Kakarountas ORCID
ACM Computing Surveys Vol. 56 No. 10 pp. 1-37 · Association for Computing Machinery (ACM)
View at Publisher Save 10.1145/3661820
Abstract
Tiny Machine Learning (TinyML) is an emerging technology proposed by the scientific community for developing autonomous and secure devices that can gather, process, and provide results without transferring data to external entities. The technology aims to democratize AI by making it available to more sectors and contribute to the digital revolution of intelligent devices. In this work, a classification of the most common optimization techniques for Neural Network compression is conducted. Additionally, a review of the development boards and TinyML software is presented. Furthermore, the work provides educational resources, a classification of the technology applications, and future directions and concludes with the challenges and considerations.
Topics

No keywords indexed for this article. Browse by subject →

References
237
[1]
TinyML in Publications - Dimensions. 2022. Retrieved from https://app.dimensions.ai/discover/publication?search_mode=content&search_text=TinyML&search_type=kws&search_field=full_search
[4]
Adafruit. 2021. Adafruit EdgeBadge - TensorFlow Lite for Microcontrollers. Retrieved from https://www.adafruit.com/product/4400
[6]
Amazon. 2022. Amazon Alexa. Retrieved from https://www.amazon.com/b?ie=UTF8&node=21576558011
[7]
AmbiQmicro. 2019. Apollo3 Blue Datasheet. Retrieved from https://cdn.sparkfun.com/assets/learn_tutorials/9/0/9/Apollo3_Blue_MCU_Data_Sheet_v0_9_1.pdf
[10]
Apache TVM. 2020. Apache TVM. Retrieved from https://tvm.apache.org/
[11]
Apple. 2022. HomePod Mini. Retrieved from https://www.apple.com/homepod-mini/
[12]
Arducam. 2021. Arducam Pico4ML TinyML Dev Kit. Retrieved from https://www.arducam.com/docs/pico/arducam-pico4mltinymldevkit/
[13]
ArduCam. 2022. ArduCam 0.3MP: OV7675. Retrieved from https://www.arducam.com/products/camera-breakout-board/0-3mp-ov7675/
[14]
Arduino. 2021. Arduino Nano 33 BLE Sense. Retrieved from https://store-usa.arduino.cc/products/arduino-nano-33-ble-sense
[15]
Arduino. 2021. Portenta H7. Retrieved from https://www.arduino.cc/pro/hardware/product/portenta-h7
[16]
Arduino 2022. Arduino. Retrieved from https://www.arduino.cc/
[17]
Arduino Project Hub. 2019. Cough Detection with TinyML on Arduino. Retrieved from https://create.arduino.cc/projecthub/edge-impulse/cough-detection-with-tinyml-on-arduino-417f37
[18]
Arduino Project Hub. 2021. TinyML-Language Detector-based on Edge Impulse and Arduino MIT. Retrieved from https://create.arduino.cc/projecthub/enzo2/tinyml-language-detector-based-on-edge-impulse-arduino-f5cfa8?ref=part&ref_id=107215&offset=0
[19]
Arduino Project Hub. 2021. TinyML: Speech Commands Detection. Retrieved from https://create.arduino.cc/projecthub/ugotan/tinyml-speech-commands-detection-a3b51b?ref=part&ref_id=107215&offset=1
[20]
Arm. 2022. Retrieved from https://www.arm.com/
[21]
Aruba Networks. 2019. Secure Wi-Fi For Healthcare Applications. Retrieved from https://www.arubanetworks.com/assets/wp/WPHealthcareWLAN.pdf
[22]
Shaojie Bai, J. Zico Kolter, and Vladlen Koltun. 2019. Deep equilibrium models. arXiv preprint arXiv:1909.01377 (2019).
[23]
Colby Banbury, Chuteng Zhou, Igor Fedorov, Ramon Matas, Urmish Thakker, Dibakar Gope, Vijay Janapa Reddi, Matthew Mattina, and Paul Whatmough. 2021. MicroNets: Neural network architectures for deploying TinyML applications on commodity microcontrollers. Proc. Mach. Learn. Syst. 3 (2021).
[24]
Colby R. Banbury Vijay Janapa Reddi Max Lam William Fu Amin Fazel Jeremy Holleman Xinyuan Huang Robert Hurtado David Kanter Anton Lokhmotov David Patterson Danilo Pau Jae-sun Seo Jeff Sieracki Urmish Thakker Marian Verhelst and Poonam Yadav. 2021. Benchmarking TinyML Systems: Challenges and Direction. 10.48550/arXiv.2003.04821 10.48550/arxiv.2003.04821
[26]
Ron Banner Yury Nahshan Elad Hoffer and Daniel Soudry. 2018. ACIQ: Analytical clipping for integer quantization of neural networks. arXiv (September 2018). Retrieved May 3 2024 from https://www.semanticscholar.org/paper/ACIQ%3A-Analytical-Clipping-for-Integer-Quantization-Banner-Nahshan/41c987b8a7e916d56fed2ea7311397e0f2286f3b
[29]
Oliver Bringmann Wolfgang Ecker Ingo Feldner Adrian Frischknecht Christoph Gerum Timo Hämäläinen Muhammad Abdullah Hanif Michael J. Klaiber Daniel Mueller-Gritschneder Paul Palomero Bernardo Sebastian Prebeck and Muhammad Shafique. 2021. Automated HW/SW Co-design for edge AI: State challenges and steps ahead: Special session paper. In 2021 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS) October 2021. 11–20. Retrieved May 3 2024 from https://ieeexplore.ieee.org/document/9603364 10.1145/3478684.3479261
[30]
Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell Sandhini Agarwal Ariel Herbert-Voss Gretchen Krueger Tom Henighan Rewon Child Aditya Ramesh Daniel M. Ziegler Jeffrey Wu Clemens Winter Christopher Hesse Mark Chen Eric Sigler Mateusz Litwin Scott Gray Benjamin Chess Jack Clark Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever and Dario Amodei. 2020. Language Models are Few-Shot Learners. 10.48550/arXiv.2005.14165 10.48550/arxiv.2005.14165
[31]
Alessio Burrello Angelo Garofalo Nazareno Bruschi Giuseppe Tagliavini Davide Rossi and Francesco Conti. 2021. DORY: Automatic end-to-end deployment of real-world DNNs on low-cost IoT MCUs. IEEE Trans. Comput. 70 8 (2021) 1253–1268. 10.1109/TC.2021.3066883 10.1109/tc.2021.3066883
[33]
Léopold Cambier, Anahita Bhiwandiwalla, Ting Gong, Mehran Nekuii, Oguz H. Elibol, and Hanlin Tang. 2020. Shifted and squeezed 8-bit floating point format for low-precision training of deep neural networks. arXiv preprint arXiv:2001.05674 (2020).
[35]
Anomaly detection

Varun Chandola, Arindam Banerjee, Vipin Kumar

ACM Computing Surveys 10.1145/1541880.1541882
[36]
Wenlin Chen, James Wilson, Stephen Tyree, Kilian Weinberger, and Yixin Chen. 2015. Compressing neural networks with the hashing trick. In International Conference on Machine Learning. PMLR, 2285–2294.
[39]
PRIME

Ping Chi, Shuangchen Li, Cong XU et al.

ACM SIGARCH Computer Architecture News 10.1145/3007787.3001140
[40]
Blockchains and Smart Contracts for the Internet of Things

Konstantinos Christidis, Michael Devetsikiotis

IEEE Access 10.1109/access.2016.2566339
[41]
Codelabs. 2020. AI Speech Recognition with TensorFlow Lite for Microcontrollers and SparkFun Edge. Retrieved from https://codelabs.developers.google.com/codelabs/sparkfun-tensorflow/#0
[42]
Coursera. 2022. Computer Vision with Embedded Machine Learning. Retrieved from https://www.coursera.org/learn/computer-vision-with-embedded-machine-learning
[43]
Coursera. 2022. Retrieved from https://www.coursera.org/
[44]
Coursera. 2022. Introduction to Embedded Machine Learning. Retrieved from https://www.coursera.org/learn/introduction-to-embedded-machine-learning
[45]
Giulia Crocioni, Giambattista Gruosso, Danilo Pau, Davide Denaro, Luigi Zambrano, and Giuseppe Di Giore. 2021. Characterization of neural networks automatically mapped on automotive-grade microcontrollers. arXiv preprint arXiv:2103.00201 (2021).
[47]
Bin Dai, Chen Zhu, Baining Guo, and David Wipf. 2018. Compressing neural networks using the variational information bottleneck. In International Conference on Machine Learning. PMLR, 1135–1144.
[48]
DaleGia 2020. The Hacky Super Loop Arduino Nano 33 BLE Sense Example You Have Been Waiting For. Retrieved from https://dalegi.com/2020/06/09/the-hacky-super-loop-arduino-nano-33-ble-sense-example-you-have-been-waiting-for/
[49]
Robert David Jared Duke Advait Jain Vijay Janapa Reddi Nat Jeffries Jian Li Nick Kreeger Ian Nappier Meghna Natraj Shlomi Regev Rocky Rhodes Tiezhen Wang and Pete Warden. 2021. TensorFlow Lite Micro: Embedded Machine Learning on TinyML Systems. 10.48550/arXiv.2010.08678 10.48550/arxiv.2010.08678

Showing 50 of 237 references

Cited By
72
Composite human activity recognition utilizing knowledge distillation and sensor fusion focusing on resource constrained microcontrollers

Athar Noor Mohammad Rafee, John Clear · 2026

Expert Systems with Applications
Tiny Machine Learning and On-Device Inference: A Survey of Applications, Challenges, and Future Directions

Soroush Heydari, Qusay H. Mahmoud · 2025

Sensors
Metrics
72
Citations
237
References
Details
Published
Jun 22, 2024
Vol/Issue
56(10)
Pages
1-37
License
View
Authors
V
Vasileios Tsoukas

Computer Science and Biomedical Informatics, University of Thessaly School of Science, Lamia, Greece and Intelligent Systems Laboratory, University of Thessaly School of Science, Lamia, Greece

A
Anargyros Gkogkidis

Computer Science and Biomedical Informatics, University of Thessaly School of Science, Lamia, Greece and Intelligent Systems Laboratory, University of Thessaly School of Science, Lamia, Greece

E
Eleni Boumpa

Computer Science and Biomedical Informatics, University of Thessaly School of Science, Lamia, Greece and Intelligent Systems Laboratory, University of Thessaly School of Science, Lamia, Greece

A
Athanasios Kakarountas

Computer Science and Biomedical Informatics, University of Thessaly School of Science, Lamia, Greece and Intelligent Systems Laboratory, University of Thessaly School of Science, Lamia, Greece

Funding
Greece and the European Union
Operational Programme “Competitiveness, Entrepreneurship and Innovation” Award: NSRF 2014-2020
Cite This Article
Vasileios Tsoukas, Anargyros Gkogkidis, Eleni Boumpa, et al. (2024). A Review on the emerging technology of TinyML. ACM Computing Surveys, 56(10), 1-37. https://doi.org/10.1145/3661820
Related

You May Also Like

Data clustering

A. K. Jain, M. N. Murty · 1999

9,568 citations

Anomaly detection

Varun Chandola, Arindam Banerjee · 2009

8,799 citations

Machine learning in automated text categorization

Fabrizio Sebastiani · 2002

5,027 citations

Object tracking

Alper Yilmaz, Omar Javed · 2006

3,632 citations

A Survey on Bias and Fairness in Machine Learning

Ninareh Mehrabi, Fred Morstatter · 2021

3,466 citations