基于强化学习的M2M网络自适应媒体接入控制协议

doi:10.3969/j.issn.0255-8297.2017.03.005

Abstract

Abstract:

An adaptive medium access control (MAC) protocol Q-learning hybrid MAC (QH-MAC) is proposed for data collection application in machine-to-machine (M2M) networks. The QH-MAC enhances hybrid group MAC (HG-MAC) with an adaptive Q-learning based mechanism, in which the central node dynamically adjusts the COP duration according to the network load. The adaptive learning mechanism improves flexibility and the adaptability of the MAC protocol. QH-MAC is compared with carrier sense multiple access with collision avoidance (CSMA/CA), time division multiple address (TDMA) and HG-MAC by optimized network engineering tool (OPNET) simulations. The results show that HG-MAC is better than the others in terms of data rate, energy efciency and channel utilization.

Key words: medium access control (MAC), energy efciency, Q-learning, machine-tomachine (M2M) network

CLC Number:

TP393

XU Chang, WANG Cong, LIU Ling-ya, LI Ning. Self-Adaption MAC Protocol for M2M Network Based on Q-Learning[J]. Journal of Applied Sciences, 2017, 35(3): 317-325.

References

[1] Akyildiz I F, Su W L, Sankarasubramaniam Y, Cayirci E. A survey on sensor networks[J]. IEEE Communications Magazine, 2002, 40(8):102-114.
[2] Wei Y, Heidemann J, Estrin D. An energy-efcient MAC protocol for wireless sensor networks[C]//International Conference on Computer Communicatims, 2002:1567-1576.
[3] Xu C, Wang C, Liu L Y, Li N. HG-MAC:a energy-efcient protocol for M2M network[C]//International Conference on Information Technology and Management Innovation, 2015:964-973.
[4] Huang P, Xiao L, Mutka M W, Xi N. The evolution of MAC protocols in wireless sensor networks:a survey[J]. IEEE on Communications Surveys & Tutorials, 2013, 15(1):101-120.
[5] Liu Z Z, Elhanany I. RL-MAC:a QoS-aware reinforcement learning based MAC protocol for wireless sensor networks[C]//IEEE Information Conference on Networking Sensing and Control, 2006:768-773.
[6] Misra S, Tiwari V, Obaidat M S. Lacas:learning automata-based congestion avoidance scheme for healthcare wireless sensor networks[J]. IEEE Journal on Selected Areas in Communications, 2009, 27(4):466-479.
[7] Yu C, Mitchell P D, Grace D. Reinforcement learning based ALOHA for multi-hop wireless sensor networks with informed receiving[C]//IET Conference on Wireless Sensor Systems, 2012:1-6.
[8] Zhang W Z, Qin Z Q, Xin J J, Wang L, Zhu M, Sun L, Shu L. UPMAC:a localized load-adaptive MAC protocol for underwater acoustic networks[J]. IEEE Sensors Journal, 2015, 16(11):4110-4118.
[9] Azzem R, Seoud A. TMAC:an automated text mining tool for construction of an annotated corpus to support protein-protein interaction information extraction[C]//Information Computer Technology and Development, 2010:75-79.
[10] Pan L, Wu H, Zeng N F. An efcient and scalable prioritized MAC protocol (PMAC) for backbone communication in wireless sensor networks[C]//International Conference on Sensor Technologies and Applications, 2009:508-513.
[11] Bertsekas B D P. Dynamic programming and optimal control[M]. Nashua:Athena Scientifc, 2010.
[12] Kong L F, Wu J. Dynamic single machine scheduling using Q-learning agent[C]//International Conference on Machine Learning & Cybernetics, 2005, 5(5):3237-3241.
[13] Bianchi G. Performance analysis of the IEEE 802.11 distributed coordination function[J]. IEEE Journal on Selected Areas in Communications, 2000, 18(3):535-547.

[1]	CHEN Jun, LI Ya, ZHANG Jie. Data Center Energy Consumption Measurement Based on Virtual Machine [J]. Journal of Applied Sciences, 2020, 38(3): 488-495.
[2]	WANG Yan, CHANG Xiaopeng, ZHANG Jianping. Hybrid Moving Object Localization with EKF Based on Measurement Techniques of UWB and ZigBee [J]. Journal of Applied Sciences, 2019, 37(6): 815-824.
[3]	SUN Zhongjun, ZHAI Jiangtao, DAI Yuewei. An Encrypted Traffic Identification Method Based on DPI and Load Randomness [J]. Journal of Applied Sciences, 2019, 37(5): 711-720.
[4]	LI Guo-rui, TIAN Li, CUI Hao, CHEN Hao-bo. An Autoencoder-Based Data Collection Scheme for Wireless Sensor Networks [J]. Journal of Applied Sciences, 2018, 36(3): 411-419.
[5]	SHI Jin, LI Qian-kun, LIU Wei-wei, LIU Guang-jie, DAI Yue-wei. Adaptive Network Flow Watermarking Detection Scheme Based on Joint Centroid Entropy [J]. Journal of Applied Sciences, 2018, 36(2): 383-392.
[6]	SUN Mao-xin, QIAN Hong-yan, CHEN Bing, ZHANG Xuan. Handover Management Based on MPTCP in SDN Environment [J]. Journal of Applied Sciences, 2017, 35(1): 117-127.
[7]	LI Xiao-ge, WANG Hui, ZHANG Bin, QIN Dong-hong. Fast Topology Discovery for Campus Network [J]. Journal of Applied Sciences, 2016, 34(6): 768-777.
[8]	LU Jing1,2,3, YU Xiao-qing1,2, WAN Wang-gen1,2. ISSR Model of Message Propagation in Microblog Networks [J]. Journal of Applied Sciences, 2015, 33(2): 194-202.
[9]	WANG Chong-xia1, DING Yan2, LIU Qian2, ZHOU Xian-wei2. Design of Alliance Identity Authentication Scheme in Cloud Computing Environment [J]. Journal of Applied Sciences, 2015, 33(2): 215-222.
[10]	WU Wen, MENG Xiang-ru, MA Zhi-qiang, LIANG Xiao. Strategy Selection for Network Survivability Based on Three-Players’ Dynamic Game [J]. Journal of Applied Sciences, 2014, 32(4): 365-371.
[11]	ZHAO Yun-long1, WANG Bo-shi1, ZHANG Kai1, DONG Zhao1, ZHANG Lei2. Coding-Aware Routing by Fully Considering Coding Opportunity [J]. Journal of Applied Sciences, 2014, 32(1): 7-12.
[12]	YU Xu-tao1, BI Guang-guo2, ZHANG Zai-chen2. Conflict Matrix Random Sort Based Channel Allocation for Multi-channel Wireless Networks [J]. Journal of Applied Sciences, 2013, 31(4): 338-344.
[13]	WANG Yu, WANG Zhen-xing, MIAO Fu, LIU Hui-sheng, ZHANG Lian-cheng. Monte Carlo-Based Network Traffic Camouflage [J]. Journal of Applied Sciences, 2013, 31(4): 361-367.
[14]	LI Jun-huai, ZHANG Guo-mou, YU Lei, ZHANG Jing. Environmental-Adaptive Localization Method Based on Virtual Reference Tags [J]. Journal of Applied Sciences, 2013, 31(4): 402-410.
[15]	WANG Zhen-xing1, ZHANG Lian-cheng1, GUO Yi1, LI Shuo2. Multi-flow Attack Resistance Based on Reordering of Watermark Bits [J]. Journal of Applied Sciences, 2013, 31(3): 278-284.

Self-Adaption MAC Protocol for M2M Network Based on Q-Learning

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments