Special Issue on Computer Application

Research on Enhanced Routing for Reinforcement Learning in Wireless Sensor Networks

Expand
  • 1. School of Data Science and Computer, Guangdong Peizheng College, Guangzhou 510830, Guangdong, China;
    2. School of Computer, Wuhan University, Wuhan 430072, Hubei, China;
    3. School of Computer Science and Information Engineering, Hubei University, Wuhan 430062, Hubei, China

Received date: 2023-06-30

  Online published: 2024-02-02

Abstract

The classical problem of finding the optimal parent node in wireless network tree routing is discussed in this study. Various indexes affecting the decision rules of tree routing are analyzed, such as weighted average received signal strength, buffer occupation rate and power consumption ratio. A system model of enhanced tree routing protocol and reinforcement learning algorithm based on reinforcement learning is proposed in wireless sensor networks. The basic operation of the proposed tree-based routing protocol is described in detail, and the algorithm is updated for cyclic detection of parent node. In order to make adaptive decisions in complex scenarios, a state space, an action set and an excitation function are defined. The optimal parent node with the highest excitation is identified through trial and error. Through simulation and comparative study, it is verified that the parent node selection scheme achieves reasonable tradeoff among the performance indicators such as end-to-end delay, reliability and energy consumption. Through simulation and comparative analysis, the efficacy of the parent node selection scheme is validated, demonstrating a judicious tradeoff among performance indicators such as end-to-end delay, reliability, and energy consumption.

Cite this article

ZHANG Huanan, LI Shijun, JIN Hong . Research on Enhanced Routing for Reinforcement Learning in Wireless Sensor Networks[J]. Journal of Applied Sciences, 2024 , 42(1) : 83 -93 . DOI: 10.3969/j.issn.0255-8297.2024.01.007

References

[1] Liu X X. Atypical hierarchical routing protocols for wireless sensor networks: a review [J]. IEEE Sensors Journal, 2015, 15(10): 5372-5383.
[2] Delaney D T, Higga R, O'hare G M P. A stable routing framework for tree-based routing structures in WSNs [J]. IEEE Sensor, 2014, 14(10): 3533-3547.
[3] Baccour N, Koubaa A, Youssef H, et al. Reliable link quality estimation in low-power wireless networks and its impact on tree-routing [J]. Ad Hoc Networks, 2015, 27: 1-25.
[4] Bashir N, Boudjit S, Zeadally S. A closed-loop control architecture of UAV and WSN for traffic surveillance on highways [J]. Computer Communications. 2022, 190: 78-86.
[5] Avokh A, Mirjalily G. Load-balanced multicast tree routing in multi channel multi radio wireless mesh networks using a new cost function [J]. Wireless Personal Communications, 2013, 69(1): 75-106.
[6] Liu Y, Qian K Y. A novel tree-based routing protocol in ZigBee wireless networks [C]//IEEE International Conference on Communication Software and Networks (ICCSN), 2016: 469-473.
[7] Sinfh M, Sethi M, Lai N, Poonia S. A tree based routing protocol for mobile sensor networks [J]. International Journal of Computational Science and Engineering, 2010, 2, 55-60.
[8] Han Z, Wu J, Zhang J, et al. A general self-organized tree-based energy-balance routing protocol for wireless sensor network [J]. IEEE Transactions on Nuclear Science, 2014, 61(2): 732-740.
[9] Mittal N, Singh U, Salgotra R. Tree-based threshold-sensitive energy-efficient routing approach for wireless sensor networks [J]. Wireless Personal Communications, 2019, 108(1): 473-492.
[10] Lu J Y, Hu K F, Yang X C, et al. A cluster-tree-based energy-efficient routing protocol for wireless sensor networks with a mobile sink [J]. The Journal of Supercomputing, 2021, 77(6): 6078-6104.
[11] Mazinani S M, Naderi A, Jalali M. A tree-based reliable routing protocol in wireless sensor networks [C]//International Symposium on Computer, Consumer and Control, 2012, 7: 491-494.
[12] Gnana P O S, Varalakshmi P. Decision tree based routing protocol (DTRP) for reliable path in MANET [J]. Wireless Personal Communications, 2019, 109(1): 257-270.
[13] Hasheminejad E, Barati H. A reliable tree-based data aggregation method in wireless sensor networks [J]. Peer-to-Peer Networking and Applications, 2021, 14(2): 873-887.
[14] Narayan V, Daniel A K, Chaturvedi P. E-FEERP: enhanced fuzzy based energy efficient routing protocol for wireless sensor network [J]. Wireless Personal Communications, 2023, 131(1): 371-398.
[15] Al-Kiyumi R M, Foh C H, Vural S, et al. Fuzzy logic-based routing algorithm for lifetime enhancement in heterogeneous wireless sensor networks [J]. IEEE Transactions on Green Communications and Networking, 2018, 2(2): 517-532.
[16] Bagci H, Yazici A. An energy aware fuzzy approach to unequal clustering in wireless sensor networks [J]. Applied Soft Computing, 2013, 13(4): 1741-1749.
[17] Jiang Y, Li X Y, Qin C, et al. Improved particle swarm optimization based selective harmonic elimination and neutral point balance control for three-level inverter in low-voltage ride-through operation [J]. IEEE Transactions on Industrial Informatics, 2022, 18(1): 642-652.
[18] Yue C, Qin Z R, Lang Y P, et al. Determination of thin metal film's thickness and optical constants based on SPR phase detection by simulated annealing particle swarm optimization [J]. Optics Communications, 2019, 430: 238-245.
Outlines

/