Iot Data Processing and Scheduling Based on Deep Reinforcement Learning
DOI:
https://doi.org/10.15837/ijccc.2023.6.5998Abstract
With the continuous integration of IoT technology and information technology, edge computing, as an emerging computing paradigm, makes full use of terminals to process and analyse real-time data. The explosion of Internet of Things (IoT) devices has created challenges for traditional cloud-based data processing models due to high latency and availability requirements. This paper proposes a new edge computation-based framework for iot data processing and scheduling using deep reinforcement learning. The system architecture incorporates distributed iot data access, realtime processing, and an intelligent scheduler based on Deep q networks (DQN). A large number of experiments show that compared with traditional scheduling methods, the average task completion time is reduced by 20% and resource utilization is increased by 15%. The unique integration of edge computing and deep reinforcement learning provides a flexible and efficient platform for lowlatency iot applications. Key results obtained from testing the proposed system, such as reduced task completion time and increased resource utilization.References
P Ladosz, L Weng, M Kim, H Oh. Exploration in deep reinforcement learning: A survey. Information Fusion, 2022, 85(9): 1-22.
https://doi.org/10.1016/j.inffus.2022.03.003
C A Rufino Junior, E R Sanseverino, P Gallo, D Koch, H G Schweiger, H Zanin. Blockchain review for battery supply chain monitoring and battery trading. Renew. Sust. Energ. Rev., 2022,157(4): 2-26.
https://doi.org/10.1016/j.rser.2022.112078
A Patra, A Barg. Node Repair on Connected Graphs. IEEE T INFORM THEORY, 2022, 68(5): 3081-3095.
https://doi.org/10.1109/TIT.2022.3145824
C Li, P Zheng, Y Yin, B Wang, L Wang. Deep reinforcement learning in smart manufacturing: A review and prospects. CIRP Journal of Manufacturing Science and Technology, 2023, 40(1): 75-101.
https://doi.org/10.1016/j.cirpj.2022.11.003
P R Wurman, S Barrett, K Kawamoto, M James. Outracing champion Gran Turismo drivers with deep reinforcement learning. Nature, 2022, 602(7): 223-228.
https://doi.org/10.1038/s41586-021-04357-7
B Li, R S Chen, C Y Liu. Using intelligent technology and real-time feedback algorithm to improve manufacturing process in loT semiconductor industry. J SUPERCOMPUT, 2021, 77(5): 4639-4658.
https://doi.org/10.1007/s11227-020-03457-x
J Yue, M Xiao. Coding for Distributed Fog Computing in Internet of Mobile Things. IEEE Trans Mob Comput, 2021, 20(4): 1337-1350.
https://doi.org/10.1109/TMC.2019.2963668
C Kannan, M Dakshinamoorthy, M Ramachandran, R Patan, H Kalyanarman, A Kumar. Cryptography-based deep artificial structure for secure communication using IoT nabled cyber, hysical system. IET COMMUN, 2021, 15(6): 771-779.
https://doi.org/10.1049/cmu2.12119
P Yangy, Y Yang, P Zhang, D Wu, R Wang. Sensitivity Enhanced Edge-Cloud Collaborative Trust Evaluation in Social Internet of Things. IEICE T COMMUN, 2022, 105(7): 2-10.
https://doi.org/10.1587/transcom.2021EBP3130
Y Xu, Z G Chen, J Wu, G Yu. MNSRQ: Mobile node social relationship quantification algorithm for data transmission in Internet of things. IET COMMUN, 2021, 15(5): 748-761.
https://doi.org/10.1049/cmu2.12117
A Asghari, M K Sohrabi, F Yaghmaee. Task scheduling, resource provisioning, and load balancing on scientific workflows using parallel SARSA reinforcement learning agents and genetic algorithm. J SUPERCOMPUT, 2021, 77(3): 2800-2828.
https://doi.org/10.1007/s11227-020-03364-1
C G Wu, L Wang, J J Wang. A path relinking enhanced estimation of distribution algorithm for direct acyclic graph task scheduling problem. KBS, 2021, 228(27): 2-15.
https://doi.org/10.1016/j.knosys.2021.107255
S Y Huang, H H Cho, Y C Chang, J Y Yuan, H C Chao. An efficient spectrum scheduling mechanism using Markov decision chain for 5G mobile network. IET COMMUN, 2021, 16(11): 1268-1278.n(w)
https://doi.org/10.1049/cmu2.12263
D Wang, W Zhang, H He, Y C Tian. Efficient Hybrid Central Processing Unit/ Input-Output Resource Scheduling for Virtual Machines. TIE, 2021, 68(3): 2714-2724.
https://doi.org/10.1109/TIE.2020.2975466
A Messing, G Neville, S Chernova, S Hutchinson, H Ravichandar. GRSTAPS: Graphically Recursive Simultaneous Task Allocation, Planning, and Scheduling. IJRR, 2022, 41(2): 232-256.
https://doi.org/10.1177/02783649211052066
N Chen, W Kang, N Kang, Y Qi, H Hu. Order processing task allocation and scheduling for E-order fulfilment. INT J PROD RES, 2022, 60(13): 4253-4267.
https://doi.org/10.1080/00207543.2021.2018140
D L Freire, R Z Frantz, F Roos-Frantz, V Basto-Fernandes. Queue-priority optimized algorithm: a novel task scheduling for runtime systems of application integration platforms. J SUPERCOMPUT, 2022, 78(1): 1501-1531.
https://doi.org/10.1007/s11227-021-03926-x
J Gao, X Zhu, R Zhang. Optimization of parallel test task scheduling with constraint satisfaction. J SUPERCOMPUT, 2023, 79(7): 7206-7227.
https://doi.org/10.1007/s11227-022-04943-0
Y Yang, X Song. Research on face intelligent perception technology integrating deep learning under different illumination intensities. JCCE, 2022, 1(1): 32-36.
https://doi.org/10.47852/bonviewJCCE19919
I Hidayat, M Z Ali, A Arshad. Machine Learning-Based Intrusion Detection System: An Experimental Comparison. JCCE, 2022, 2(2):88-97.
https://doi.org/10.47852/bonviewJCCE2202270
K Kim, J Lee, H Lim, S Oh, W Y Han. Deep RNN-Based Network Traffic Classification Scheme in Edge Computing System. Computer Science and Information Systems, 2022, 19(1): 165-184.
https://doi.org/10.2298/CSIS200424038K
Z Sun, G Liao, C Zeng, Z Lv, C Xu. MEC-MS: A Novel Optimized Coverage Algorithm with Mobile Edge Computing of Migration Strategy in WSNs. Computer Science and Information Systems, 2022, 19(2): 829-856.
https://doi.org/10.2298/CSIS210930017S
W Shuang, D Xiaomeng, Z Ting, W Xiaodong. Task Scheduling Based on Grey Wolf Optimizer Algorithm for Smart Meter Embedded Operating System. Tehnički vjesnik, 2022, 29(5): 1629- 1636.
https://doi.org/10.17559/TV-20220518055833
D Taşkin, C Taşkin, S Yazar. Container-Based Virtualization for Bluetooth Low Energy Sensor Devices in Internet of Things Applications. Tehnički vjesnik, 2021, 28(1): 13-19.
https://doi.org/10.17559/TV-20180528134139
S Gurumurthy, K L Hemalatha, D Pamela, U Roy, P Vishwanath. Hybrid pigeon inspired optimizer-gray wolf optimization for network intrusion detection. Journal of System and Management Sciences, 2022, 12(4): 383-397.
A.N Fajar, R Jayadi, J Halim, B Robertson. Mobile application for agrotechnology systems using internet of things. Journal of System and Management Sciences, 2022, 12(3): 104-116.
Additional Files
Published
Issue
Section
License
Copyright (c) 2023 ZhiXiong Jin, Yuchuan Jiang, Zhangjun Wang
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
ONLINE OPEN ACCES: Acces to full text of each article and each issue are allowed for free in respect of Attribution-NonCommercial 4.0 International (CC BY-NC 4.0.
You are free to:
-Share: copy and redistribute the material in any medium or format;
-Adapt: remix, transform, and build upon the material.
The licensor cannot revoke these freedoms as long as you follow the license terms.
DISCLAIMER: The author(s) of each article appearing in International Journal of Computers Communications & Control is/are solely responsible for the content thereof; the publication of an article shall not constitute or be deemed to constitute any representation by the Editors or Agora University Press that the data presented therein are original, correct or sufficient to support the conclusions reached or that the experiment design or methodology is adequate.
