Proposed Fuzzy Real-Time HaPticS Protocol Carrying Haptic Data and Multisensory Streams
Keywords:
multi-sensorial, haptics, transport protocols, real-time protocols, communication networks, fuzzy logic based decisionsAbstract
Sensory and haptic data transfers to critical real-time applications over the Internet require better than best effort transport, strict timely and reliable ordered deliveries. Multi-sensory applications usually include video and audio streams with real-time control and sensory data, which aggravate and compress within real-time flows. Such real-time are vulnerable to synchronization to synchronization problems, if combined with poor Internet links. Apart from the use of differentiated QoS and MPLS services, several haptic transport protocols have been proposed to confront such issues, focusing on minimizing flows rate disruption while maintaining a steady transmission rate at the sender. Nevertheless, these protocols fail to cope with network variations and queuing delays posed by the Internet routers. This paper proposes a new haptic protocol that tries to alleviate such inadequacies using three different metrics: mean frame delay, jitter and frame loss calculated at the receiver end and propagated to the sender. In order to dynamically adjust flow rate in a fuzzy controlled manners, the proposed protocol includes a fuzzy controller to its protocol structure. The proposed FRTPS protocol (Fuzzy Real-Time haPticS protocol), utilizes crisp inputs into a fuzzification process followed by fuzzy control rules in order to calculate a crisp level output service class, denoted as Service Rate Level (SRL). The experimental results of FRTPS over RTP show that FRTPS outperforms RTP in cases of congestion incidents, out of order deliveries and goodput.References
Al-Saadi, R.; Armitage, G.; But, J.; Branch, P. (2019). A Survey of Delay-Based and Hybrid TCP Congestion Control Algorithms, IEEE Communications Surveys Tutorials, 21(4), 3609- 3638, 2019. https://doi.org/10.1109/COMST.2019.2904994
Akács, Ã.; Kovács, L.; Rudas, I. J.; Precup, R. E.; Haidegger, T. (2015). Models for force control in telesurgical robot systems, Acta Polytechnica Hungarica, 12(8), 95-114, ISSN: 1785-8860, 2015.
Antonakoglou, K.; Xu, X.; Steinbach, E.; Mahmoodi, T.; Dohler, M. (2018). Toward Haptic Communications Over the 5G Tactile Internet, IEEE Communications, 20(4), 3034-3059, 2018. https://doi.org/10.1109/COMST.2018.2851452
Attiya, G. (2012). New Strategy for Congestion Control based on Dynamic Adjustment of Congestion Window, International Journal of Computer Science Issues, 9(2), 368-377, 2012.
Awang N. S.; Alubady, R.; Abduladeem, K. W. (2017). Simulated performance of TCP, SCTP, DCCP and UDP protocols over 4G network, The 8th International Conference on Advances in Information Technology, 111(2017), 2-7, 2017. https://doi.org/10.1016/j.procs.2017.06.002
BenÃtez-Pérez, H.; Ortega-Arjona, J.; Esquivel-Flores, O.; Rojas-Vargas, J. A.; Ãlvarez-Cid, A. (2016). A Fuzzy Networked Control System Following Frequency Transmission Strategy, International Journal of Computers Communications & Control, 11(1), 11-25, 2016. https://doi.org/10.15837/ijccc.2016.1.2158
Bermejo, C.; Hui, P. (2017). A survey on haptic technologies for mobile augmented reality, arXiv:1709.00698 [cs]
Boukerche, A.; Maamar, H.; Hossain, A. (2008). An efficient hybrid multicast transport protocol for collaborative virtual environment with networked haptic, Multimedia Systems, 13(4), 78-83, 2008. https://doi.org/10.1007/s00530-007-0104-y
Chatterjee, A.; Chatterjee, R.; Matsuno, F.; Endo, T. (2008). Augmented Stable Fuzzy Control for Flexible Robotic Arm Using LMI Approach and Neuro-Fuzzy State Space Modeling, IEEE Transactions on Industrial Electronics, 55(3), 1256-1270, 2008. https://doi.org/10.1109/TIE.2007.896439
Chowdhury, I.S.; Lahiry, J.; Hasan, S. F. (2009). Performance analysis of Datagram Congestion Control Protocol (DCCP), 12th International Conference on Computers and Information Technology, 454-459, 2009. https://doi.org/10.1109/ICCIT.2009.5407282
Clark, A.; Qu, Q. (2012). RTCP XR Packet Delay Variation, [Online]. Available: https://ietf.org/rfc/rfc6798.html.
Dapeng, W.; Hou, Y.T.; Wenwu, Z.; Ya-Qin, Z.; Peha, J.M. (2001). Streaming video over the Internet: approaches and directions, IEEE Transactions on Circuits and Systems for Video Technology, 11(3), 282-300, 2001. https://doi.org/10.1109/76.911156
Dodeller, S.; Georganas, N. D. (2004) Transport Layer Protocols for Telehaptics Update Messages, Proceedings of the 22nd Biennial Symposium on Communications, 1(1), 112-118, 2004.
Dzitac, I.; Filip, F.G.; Manolescu, M.J. (2017). Fuzzy Logic Is Not Fuzzy: World-renowned Computer Scientist Lotfi A. Zadeh, International Journal of Computers Communications & Control, 12(6), 748-789, 2017. https://doi.org/10.15837/ijccc.2017.6.3111
Even, R.; Xia, F. (2012). RTP Control Protocol (RTCP) Extension for a Third-Party Loss Report, [Online]. Available: https://tools.ietf.org/html/rfc6642. Accessed on: Mar. 2014
Floyd, S.; Handley, M.; Kohler, E. (2006). Datagram Congestion Control Protocol (DCCP), [Online]. Available: https://tools.ietf.org/html/rfc4340, 2006. https://doi.org/10.17487/rfc4336
Gagolewski, M.; Caha, J. (2012). A Guide to the FuzzyNumbers Package for R, [Online]. Available: https://cran.r-project.org/web/packages/FuzzyNumbers/vignettes/FuzzyNumbersTutorial.pdf. Accessed on: Feb. 2016.
Ghassan, A. A.; Mahamod, I.; Kasmiran, J. (2011). A Survey on Performance of Congestion Control Mechanisms for Standard TCP Versions, Australian Journal of Basic and Applied Sciences, 5(12), 1345-1352, ISSN: 1991-8178, 2011.
Gil, R.P.A.; Johanyak, Z.C.; Kovacs, P. (2018). Surrogate model based optimization of traffic lights cycles and green period ratios using microscopic simulation and fuzzy rule interpolation, International Journal of Artificial Intelligence, 16(1), 20-40, 2018.
Gupta, R.; Tanwar, S.; Tyagi, S.; Kumar, N. (2019). Tactile-Internet-Based Telesurgery System for Healthcare 4.0: An Architecture, Research Challenges, and Future Directions, IEEE Network, 33(6), 22-29, 2019. https://doi.org/10.1109/MNET.001.1900063
Ha, J.S.; Kim, S.-T.; Koh, S. J. (2005). Performance Comparison of SCTP and TCP over Linux Platform, Advances in Intelligent Computing, 396-404, 2005. https://doi.org/10.1007/11538356_41
Hemminger, S. (2005). Network emulation with Netem, [Online]. Available: http://developer.osdl.org/shemminger/netem, Accessed on Jun. 2016.
Ickin, S.; Wac, K.; Fiedler, M.; Janowski, L.; Hong, J.-H.; Dey, A. K. (2012). Factors influencing quality of experience of commonly used mobile applications, IEEE Communications Magazine, 50(4), 48-56, 2012. https://doi.org/10.1109/MCOM.2012.6178833
iPerf, [Online]. Available: https://iperf.fr/iperf-doc.php, Accessed on May 2016.
Jacobson, V. (1988). Congestion avoidance and control, Symposium proceedings on Communications architectures and protocols, 314-329, 1988. https://doi.org/10.1145/52325.52356
Jacobson, V. ; Frederick, R. ; Casner, S. ; Schulzrinne, H. (2003). RTP: A Transport Protocol for Real-Time Applications, [Online]. Available: https://tools.ietf.org/html/rfc3550.
Jurgelionis, A.; Laulajainen, J-P.; Hirvonen, M.; Wang, A. I. (2011). An Empirical Study of NetEm Network Emulation Functionalities, Proceedings of 20th International Conference on Computer Communications and Networks (ICCCN), 1-6, 2011. https://doi.org/10.1109/ICCCN.2011.6005933
Kawazoe, A.; Luca, M. D.; Visell, Y. (2019). Tactile Echoes: A Wearable System for Tactile Augmentation of Objects, IEEE World Haptics Conference (WHC), 359-364, 2019. https://doi.org/10.1109/WHC.2019.8816099
Khalid, M.; Said, H.; Asad, A.; Abubakr, E.S. (2018). Studying the TCP Flow and Congestion Control Mechanisms Impact on Internet Environment, IJCSIS, 16(11), 174-179, 2018.
Kokkonis, G.; Kontogiannis, S.; Tomtsis, D. (2016). An open source architecture of a wireless body area network in a medical environment, International Journal of Digital Information and Wireless Communications, 6(2), 63-78, 2016. https://doi.org/10.17781/P001975
Kokkonis, G.; Psannis, K.; Roumeliotis, M.; Kontogiannis, S. (2012). A Survey of Transport Protocols for Haptic Applications, 16th Panhellenic Conference on Informatics, 192-197, 2012. https://doi.org/10.1109/PCi.2012.54
Kovács, L. ; Haidegger, T. ; Rudas, I. (2013). Surgery from a distance-Application of intelligent control for telemedicine, IEEE 11th International Symposium on Applied Machine Intelligence and Informatics (SAMI), 125-129, 2013. https://doi.org/10.1109/SAMI.2013.6480959
Kukolj, D. (2002). Design of adaptive Takagi-Sugeno-Kang fuzzy models, Applied Soft Computing, 2(2), 89-103, 2002. https://doi.org/10.1016/S1568-4946(02)00032-7
Li, P.; Lu, W.; Sun, Z. (2005). Transport layer protocol reconfiguration for network-based robot control system, 1049-1053, 2005.
Linux Advanced Routing & Traffic Control HOWTO, [Online]. Available: https://lartc.org/, Accessed on Sep. 2011.
Madhuri, D.; Reddy, P.C. (2016). Performance comparison of TCP, UDP and SCTP in a wired network, International Conference on Communication and Electronics Systems (ICCES), 1-6, 2016. https://doi.org/10.1109/CESYS.2016.7889934
Masse, R. A. C.; Ochoa-Zezzatti, A.; GarcÃa, V.; MejÃa, J.; Gonzalez, S. (2019). Application of IoT with haptics interface in the smart manufacturing industry, International Journal of Combinatorial Optimization Problems and Informatics, 10(2), 17-25, 2019.
Mauve, M.; Hilt, V.; Kuhmunch, C.; Effelsberg, W. (2001). RTP/I-toward a common application level protocol for distributed interactive media, IEEE Transactions on Multimedia, 3(1), 151-161, 2001. https://doi.org/10.1109/6046.909602
Molia, H. K.; Kothari, Amit D. (2019). Fuzzy Logic Systems for Transmission Control Protocol, Proceedings of the 2nd International Conference on Communication, Devices and Computing, 553-565, 2019. https://doi.org/10.1007/978-981-15-0829-5_53
Morton, A.; Claise, B. (2009). Packet Delay Variation Applicability Statement, [Online]. Available: https://tools.ietf.org/html/rfc5481. https://doi.org/10.17487/rfc5481
Nagy, T. D.; Haidegger, T. (2019). A DVRK-based Framework for Surgical Subtask Automation, Acta Polytechnica Hungarica, 16(8), 61-78, 2019. https://doi.org/10.12700/APH.16.8.2019.8.5
Osman, H. A.; Eid, M.; Saddik, A. E. (2008). Evaluating ALPHAN: A Communication Protocol for Haptic Interaction, Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 361-366, 2008. https://doi.org/10.1109/HAPTICS.2008.4479972
OTT: Beyond Entertainment Consumer Survey Report (2017). [Online]. Available: https://www.conviva.com/research/ott-beyond-entertainment/. Accessed on: Sep. 2019.
Paulo R. (2013). Accenture video-over-internet-consumer-survey-2013, [Online]. Available: https://www.slideshare.net/ratinecas/accenture-videooverinternetconsumersurvey2013. Accessed on: May 2018.
Phung, M. D.; Van Thi Nguyen, T.; Quach, C. H.; Tran, Quang Vinh (2010). Development of a tele-guidance system with fuzzy-based secondary controller, 11th International Conference on Control Automation Robotics Vision, 2010. https://doi.org/10.1109/ICARCV.2010.5707338
Precup, R. E.; Tomescu, M. L.; Dragos, C. A. (2014). Stabilization of Rössler chaotic dynamical system using fuzzy logic control algorithm, International Journal of General Systems, 43(5), 413-433, 2014. https://doi.org/10.1080/03081079.2014.893299
Reiter, U.; Brunnström, K.; De Moor, K. et al. (2014). Factors Influencing Quality of Experience Quality of Experience: Advanced Concepts, Applications and Methods 55-72, 2014. https://doi.org/10.1007/978-3-319-02681-7_4
RTPLIB, [Online]. Available: https://research.edm.uhasselt.be/jori/page/CS/Jrtplib.html, Accessed Oct. 2018
Shirmohammadi, S.; Georganas, N.D. (2000). Collaborating in 3D virtual environments: a synchronous architecture, Proceedings IEEE 9th International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises (WET ICE 2000), 35-42, 2000.
Skurowski, P.; Gruca, A. (2008). SMPDV - A new jitter estimator proposal, Studia Informatica, 29(81), 1-16, 2008.
Tabash, I.; Beg, M.S.; Ahmad, N. (2013). Improving TCP Performance based on Fuzzy-Logic for Mobile Ad hoc Networks, International Journal of Computer Applications, 78(2), 11-16, 2013. https://doi.org/10.5120/13460-0479
Takács, Ã.; Rudas, I.; Bösl, D.; Haidegger, T. (2018). Highly Automated Vehicles and Self-Driving Cars [Industry Tutorial, IEEE Robotics Automation Magazine, 25(4), 106-112, 2018. https://doi.org/10.1109/MRA.2018.2874301
Takagi, T.; Sugeno, M. (1993). Fuzzy Identification of Systems and Its Applications to Modeling and Control, Readings in Fuzzy Sets for Intelligent Systems, 387-403, 1993. https://doi.org/10.1016/B978-1-4832-1450-4.50045-6
Taylor, T.; Schwarzbauer, H. J.; Kalla, M. et al. (2000). Stream Control Transmission Protocol, [Online]. Available: https://tools.ietf.org/html/rfc2960.
Trang, S. Q. V.; Lochin, E. (2016). FLOWER, an innovative Fuzzy Lower-than-Best-Effort transport protocol, Computer Networks, 110, 18-30, 2016. https://doi.org/10.1016/j.comnet.2016.09.008
Uchimura, Y.; Ohnishi, K.; Yakoh, T. (2002). Bilateral robot system on the real time network structure, 7th International Workshop on Advanced Motion Control. Proceedings, 51(5), 63-68, 2002.
Vilela R. J. (2016). The FuzzyLite Libraries for Fuzzy Logic Control, [Online]. Available: https://www.fuzzylite.com/. Accessed on: Sep. 2016.
Wang, D.; Ohnishi, K.; Xu, W. (2020). Multimodal Haptic Display for Virtual Reality: A Survey, IEEE Transactions on Industrial Electronics, 67(1), 610-623, 2020 https://doi.org/10.1109/TIE.2019.2920602
Wirz, R.; Ferre, M.; MarÃn, R.; Barrio, J. et al. (2008). Efficient Transport Protocol for Networked Haptics Applications, Haptics: Perception, Devices and Scenarios, Springer, 3-12, 2008. https://doi.org/10.1007/978-3-540-69057-3_1
Wirz, R.; Marin, R.; Ferre, M. et al. (2009). Bidirectional Transport Protocol for Teleoperated Robots, IEEE Transactions on Industrial Electronics, 56(9), 3772-3781, 2009. https://doi.org/10.1109/TIE.2009.2025291
Published
Issue
Section
License
ONLINE OPEN ACCES: Acces to full text of each article and each issue are allowed for free in respect of Attribution-NonCommercial 4.0 International (CC BY-NC 4.0.
You are free to:
-Share: copy and redistribute the material in any medium or format;
-Adapt: remix, transform, and build upon the material.
The licensor cannot revoke these freedoms as long as you follow the license terms.
DISCLAIMER: The author(s) of each article appearing in International Journal of Computers Communications & Control is/are solely responsible for the content thereof; the publication of an article shall not constitute or be deemed to constitute any representation by the Editors or Agora University Press that the data presented therein are original, correct or sufficient to support the conclusions reached or that the experiment design or methodology is adequate.
