IoT Embedded Smart Monitoring System with Edge Machine Learning for Beehive Management
DOI:
https://doi.org/10.15837/ijccc.2024.4.6632Keywords:
Machine Learning, Monitoring Solution, Beehive Support, Internet of Things (IoT)Abstract
The need of an automated support system that helps beekeepers maintain and improve beehive population was always a very stressing aspect of their work considering the importance of a healthy bee population. This paper presents a proof of concept, further referred as a PoC solution, based on the Internet of Things technology which proposes a smart monitoring system using machine learning processes, diligently combining the power of edge computing by means of communication and control. Beehive maintenance is improved, having an optimal state of health due to the Deep Learning inference triggered at the edge level of devices which processes hive’s noises. All this is achieved by using IoT sensors to collect data, extract important features and a Tiny ML network for decision support. Having Machine Learning inference to be performed on low-power microcontroller devices leads to significant improvements in the autonomy of beekeeping solutions.
References
Abadade, Y.; Temouden, A.; Bamoumen, H.; Benamar, N.; Chtouki, Y.; Hafid, A. S.; (2023). A comprehensive survey on tinyml, 2023 IEEE Access
[Online]. Arduino, Available: https://store.arduino.cc/arduino-nano-33-ble-sense. [Accessed 9 April 2024]
Balas, V. E., Kumar, R., & Srivastava, R. (Eds.). (2020). Recent trends and advances in artificial intelligence and internet of things. Cham: Springer International Publishing. ISBN 978-3-030- 32644-9. 2020.
Banner, R., Hubara, I., Hoffer, E. & Soudry, D. (2018). Scalable methods for 8-bit training of neural networks. Advances in neural information processing systems
Bencsik, M., Bencsik, J., Baxter, M., Lucian, A., Romieu, J., & Millet, M. (2011). Identification of the honey bee swarming process by analysing the time course of hive vibrations. Computers and electronics in agriculture 76(1), 44-50. 2011. https://doi.org/10.1016/j.compag.2011.01.004
Berkeley, U. o. C. (2006). Pollinators Help One-third Of The World's Food Crop Production. ScienceDaily. [Online]. Available: www.sciencedaily.com/releases/2006/10/061025165904.htm, [Accessed 9 April 2024]
Bromenshenk, J. J., Henderson, C. B., Seccomb, R. A., Rice, S. D., & Etter, R. T. (2009). U.S. Patent and Trademark Office. Patent US20070224914A1 U.S. Patent No. 7, 549,907.Washington, DC
Cecchi, S., Spinsante, S., Terenzi, A., & Orcioni, S. (2020). A smart sensor-based measurement system for advanced bee hive monitoring. Sensors. 20(9), 2726. 2020. https://doi.org/10.3390/s20092726
Cecchi, S., Terenzi, A., Orcioni, S., Riolo, P., Ruschioni, S., & Isidoro, N. (2018, May). A preliminary study of sounds emitted by honey bees in a beehive. 2018 In Audio Engineering Society Convention 144. Audio Engineering Society.
Cejrowski, T., Szymański, J., Mora, H., & Gil, D. (2018). Detection of the bee queen presence using sound analysis. Proceedings of Intelligent Information and Database Systems 10th Asian Conference, ACIIDS 2018, Dong Hoi City, Vietnam, March 19-21, 2018, Part II 10 (pp. 297-306). Springer International Publishing. 2018. https://doi.org/10.1007/978-3-319-75420-8_28
Edge Impulse Democratizes Machine Learning for All Developers on NVIDIA Jetson Edge AI Platform, Edge Impulse. [Online]. Available: https://www.prnewswire.com/news-releases/edgeimpulse-democratizes-machine-learning-for-all-developers-on-nvidia-jetson-edge-ai-platform- 301269308.html. [Accessed 9 April 2024]
Europa.eu, "What's behind the decline in bees and other pollinators?," [Online]. Available: https://www.europarl.europa.eu/news/en/headlines/society/20191129STO67758/what-sbehind-the-decline-in-bees-and-other-pollinators-infographic. [Accessed 18 April 2024]
Feed Forward Neural Webpage - "Deep Learning: Feedforward Neural Network. [Online]. Available: https://medium.com/hackernoon/deep-learning-feedforward-neural-networksexplained- c34ae3f084f1. [Accessed 9 April 2024]
Ferrari, S., Silva, M., Guarino, M., & Berckmans, D. (2008). Monitoring of swarming sounds in bee hives for early detection of the swarming period. Computers and electronics in agriculture 64(1), 72-77. 2008. https://doi.org/10.1016/j.compag.2008.05.010
Géron, A. (2022). Hands-on machine learning with Scikit-Learn, Keras, and TensorFlow. O'Reilly Media, Inc.. Release Date: September 2019, ISBN: 9781492032649. 2022.
Gholami, Amir; Kim, Sehoon; Zhen, Dong; Yao, Zhewei; Mahoney, Michael; Keutzer, Kurt. (2022). A Survey of Quantization Methods for Efficient Neural Network Inference. Low-Power Computer Vision 36 pg., eISBN 9781003162810, doi: 10.1201/9781003162810-13. https://doi.org/10.1201/9781003162810-13
Green, M.; Murphy, D. (2020). Environmental sound monitoring using machine learning on mobile devices. Applied Acoustics. 159, 107041, 2020.
Google A.I. Cloud. [Online]. Available: https://cloud.google.com/ai-platform. [Accessed 21 March 2024]
Honey Bee Queens: Evaluating the Most Important Colony Member. BEE-HEALTH, 18 August 2015. [Online]. Available: https://bee-health.extension.org/honey-bee-queens-evaluatingthe-most-important-colony-member/. [Accessed 21 March 2024]
Howard, D. Duran, O. Hunter G. and Stebel K. (2013). Signal processing the acoustics of honeybees (APIS MELLIFERA) to identify the "queen less" state in Hives. Proceedings of the Institute of Acoustics. 35. 290-297.
Khamparia, A.; Gupta, D.; Nguyen, N. G.; Khanna, A.; Pandey, B.; Tiwari, P. (2019). Sound classification using convolutional neural network and tensor deep stacking network. IEEE Access 7, 7717-7727., Date of Publication: 08 January 2019, Electronic ISSN: 2169-3536. 2019.
Kirchner, W. H. (1993). Acoustical communication in honeybees Apidologie 24(3), 1993.
Koul, A., Ganju, S.; Kasam, M. (2019). Practical deep learning for cloud, mobile, and edge: realworld AI & computer-vision projects using Python, Keras & Tensorflow. O'Reilly Media Release Date: October 2019, ISBN: 9781492034865.
Liang, J., Zhao, X., Li, M., Zhang, Z., Wang, W., Liu, H.,; Liu, Z. (2023, April). MMMLP: multi-modal multilayer perceptron for sequential recommendations. Proceedings of the ACM Web Conference (pp. 1109-1117). 2023.
Mao, X.; Xiang, Y.; Lu, J. (2024). An efficient nonlinear adaptive filter algorithm based on the rectified linear unit. Digital Signal Processing 104373. 2024 https://doi.org/10.1016/j.dsp.2023.104373
MQTT: The Standard for IoT Messaging. [Online]. Available: https://mqtt.org/. [Accessed 28 March 2024]
Murphy, F. E., Magno, M., Whelan, P.; Vici, E. P. (2015). b+ WSN: Smart beehive for agriculture, environmental, and honey bee health monitoring-Preliminary results and analysis. In 2015 IEEE sensors applications symposium (SAS) pp. 1-6, IEEE 2015 https://doi.org/10.1109/SAS.2015.7133587
Murphy, F. E., Popovici, E., Whelan, P.; Magno, M. (2015). Development of an heterogeneous wireless sensor network for instrumentation and analysis of beehives. In Proceedings 2015 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) pp. 346-351. IEEE. 2015 https://doi.org/10.1109/I2MTC.2015.7151292
Nettleton, D. F., Orriols-Puig, A., Fornells, A. (2010). A study of the effect of different types of noise on the precision of supervised learning techniques. Artificial intelligence review 33, 275-306. 2010. https://doi.org/10.1007/s10462-010-9156-z
Nolasco, I.; Benetos, E. (2018). To bee or not to bee: An annotated dataset for beehive sound recognition. [Data set], Zenodo https://doi.org/10.5281/zenodo.1321278, 2018.
Nolasco, I., Benetos, E. (2018). To bee or not to bee: Investigating machine learning approaches for beehive sound recognition. Workshop on Detection and Classification of Acoustic Scenes and Events
Online Doc for A.I. Cloud, [Online]. Available: https://cloud.google.com/aiplatform/ docs/technical-overview. [Accessed 16 April 2024]
Park, J., Yoo, T., Lee, S., Kim, T. (2023). Urban Noise Analysis and Emergency Detection System using Lightweight End-to-End Convolutional Neural Network. INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL Vol. 18(5), DOI: 10.15837/ijccc.2023.5.5814 https://doi.org/10.15837/ijccc.2023.5.5814
Perry, L. (2020). IoT and Edge Computing for Architects: Implementing edge and IoT systems from sensors to clouds with communication systems, analytics and security. Packt. Packt Publishing Ltd 2020.
Qandour, A., Ahmad, I., Habibi, D.; Leppard, M. (2014). Remote beehive monitoring using acoustic signals. Australian Acoustical Society 42. 204-209.
Ruck, D. W., Rogers, S. K.; Kabrisky, M. (1990). Feature selection using a multilayer perceptron. Journal of neural network computing 2(2), 40-48. 1990.
Sarton, G. (1943). The Feminine Monarchie of Charles Butler, 1609 The University of Chicago Press Vol. 34(6), 469-472. 1943
SparkFun Load Cell Amplifier - HX711, [Online]. Available: https://www.sparkfun.com/products/13879. [Accessed 21 March 2024]
Spectrogram, Edge Impulse, [Online]. Available: https://docs.edgeimpulse.com/docs/spectrogram. [Accessed 11 March 2024]
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I.; Salakhutdinov, R. (2014). Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research. 15(1), 1929-1958., ISSN 1532-4435. 2014.
TensorFlow. [Online]. Available: https://www.tensorflow.org/. [Accessed 21 March 2024]
TensorFlow Model Optimization Toolkit - Pruning API. Tensorflow, [Online]. Available: https://blog.tensorflow.org/2019/05/tf-model-optimization-toolkit-pruning-API.html. [Accessed 9 March 2024]
Varol, E.; Yücel, B. (2019). The effects of environmental problems on honey bees in view of sustainable life. Mellifera. Vol. 19(2), 23-32. 2019
Venkatesan, R.; Li, B. (2017). Convolutional neural networks in visual computing: a concise guide. CRC Press. ISBN 978-1-351-65032-8. 2017 https://doi.org/10.4324/9781315154282
Vladimir K., Sarbajit M., Prakhar A. (2018). Toward Audio Beehive Monitoring: Deep Learning vs. Standard Machine Learning in Classifying Beehive Audio Samples. APPLIED SCIENCESBASEL. Vol 8(9). eISSN: 2076-3417
Warden, P.; Situnayake, D. (2019). Tinyml: Machine learning with tensorflow lite on arduino and ultra-low-power microcontrollers. O'Reilly Media. ISBN: 9781492052043. 2019
Woods, E. F. (1957). Means for Detecting and Indicating the Activities of Bees and Conditions in Beehives. U.S. Patent and Trademark Office. Patent US2806082A, 10 September 1957.
Yu, D., Zhan, X., Yang, L. J.; Jia, Y. (2023). Theoretical description of logical stochastic resonance and its enhancement: Fast Fourier transform filtering method. Physical Review E. Vol. 108(1), 014205. 2023 https://doi.org/10.1103/PhysRevE.108.014205
Zgank, A. (2020). Bee Swarm Activity Acoustic Classification for an IoT-Based Farm Service. Sensors Vol. 20(1); https://doi.org/10.3390/s20010021. https://doi.org/10.3390/s20010021
Zhao, T., Li, Y., Zuo, L.; Zhang, K. (2021). Machine-learning optimized method for regional control of sound fields. Extreme Mechanics Letters. Vol. 45, 101297, 2021.
Zhao, Y., Deng, G., Zhang, L., Di, N., Jiang, X.; Li, Z. (2021). Based investigate of beehive sound to detect air pollutants by machine learning. Ecological Informatics. Vol. 61, 101246, 2021.
Zou, Z., Jin, Y., Nevalainen, P., Huan, Y., Heikkonen, J.; Westerlund, T. (2019). Edge and fog computing enabled AI for IoT-an overview. Proceedings of 2019 IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) pp. 51-56. IEEE. doi: 10.1109/AICAS.2019.8771621. 2019 https://doi.org/10.1109/AICAS.2019.8771621
Additional Files
Published
Issue
Section
License
Copyright (c) 2024 Mihai Doinea, Ioana Trandafir, Cristian-Valeriu Toma, Marius Popa, Alin Zamfiroiu
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
ONLINE OPEN ACCES: Acces to full text of each article and each issue are allowed for free in respect of Attribution-NonCommercial 4.0 International (CC BY-NC 4.0.
You are free to:
-Share: copy and redistribute the material in any medium or format;
-Adapt: remix, transform, and build upon the material.
The licensor cannot revoke these freedoms as long as you follow the license terms.
DISCLAIMER: The author(s) of each article appearing in International Journal of Computers Communications & Control is/are solely responsible for the content thereof; the publication of an article shall not constitute or be deemed to constitute any representation by the Editors or Agora University Press that the data presented therein are original, correct or sufficient to support the conclusions reached or that the experiment design or methodology is adequate.
