A Q-learning Weighted Cluster Based Routing Protocol for VANETs

Abstract

Vehicular Ad-Hoc Networks are an emerging paradigm within Intelligent Transportation Systems (ITS), enabling communication between vehicles (V2V) and/or vehicles and infrastructure (V2I). These networks aim to enhance road safety and improve the driving experience. However, due to the high mobility of vehicles and frequent changes in their geographical positions, ensuring reliable data delivery remains a significant challenge. Clustering has emerged as a promising technique to improve scalability, reduce overhead, and enhance routing stability in VANETs. This paper first introduces a new classification framework for clustering-based routing protocols according to their operational and decision parameters. It then proposes the Q-learning Weighted ClusterBased Routing Protocol (Q-WeCBR), which combines clustering with reinforcement learning. Q-WeCBR improves cluster head (CH) selection through a weighted selection function and a maintenance phase that ensures cluster stability. In addition, the integration of Q-learning enables the protocol to adapt intelligently to topology changes by selecting the most reliable routes.Simulation results obtained with OMNeT++ and SUMO demonstrate that Q-WeCBR outperforms CBR, DSDV, and GPSR in terms of packet delivery ratio and throughput, confirming the effectiveness of clustering combined with learning-based routing for dynamic vehicular networks.

Keywords

• VANETs
• Cluster Based Routing
• Q-learning

References

1. Hannes Hartenstein and L.P. Laberteaux. A tutorial survey on vehicular ad hoc networks. IEEE Communications Magazine, 46(6):164–171, 2008.
2. Fabio Arena, Giovanni Pau, and Alessandro Severino. A Review on IEEE 802.11p for Intelligent Transportation Systems. Journal of Sensor and Actuator Networks, 9(2):22, 2020.
3. Anna Maria Vegni and Valeria Loscrí. A Survey on Vehicular Social Networks. IEEE Communications Surveys & Tutorials, 17(4):2397–2419, 2015.
4. Rezoan Ahmed Nazib and Sangman Moh. Reinforcement Learning-Based Routing Protocols for Vehicular Ad Hoc Networks: A Comparative Survey. IEEE Access, 9:27552–27587, 2021.
5. Oussama Senouci, Saad Harous, and Zibouda Aliouat. Survey on vehicular ad hoc networks clustering algorithms: Overview, taxonomy, challenges, and open research issues. International Journal of Communication Systems, 33(11):e4402, 2020.
6. Amir Masoud Rahmani, Rizwan Ali Naqvi, Efat Yousefpoor, Mohammad Sadegh Yousefpoor, Omed Hassan Ahmed, Mehdi Hosseinzadeh, and Kamran Siddique. A Q-Learning and Fuzzy Logic-Based Hierarchical Routing Scheme in the Intelligent Transportation System for Smart Cities. Mathematics, 10(22):4192, 2022.
7. M. Saeid HaghighiFard and Sinem Coleri. Hierarchical Federated Learning in Multi-Hop Cluster-Based VANETs. IEEE Transactions on Vehicular Technology, 74(10):15371–15385, 2025.
8. Yuyi Luo, Wei Zhang, and Yangqing Hu. A New Cluster Based Routing Protocol for VANET. In 2010 Second International Conference on Networks Security, Wireless Communications and Trusted Computing, volume 1, pages 176–180, 2010.

9. AIndra Venkatesh and R Murali. Routing protocols for vehicular adhoc networks (vanets): A review. Journal of Emerging Trends in Computing and Information Sciences, 5(1):25–43, 2014.
10. Charles E. Perkins and Pravin Bhagwat. Highly dynamic Destination-Sequenced Distance-Vector routing (DSDV) for mobile computers. ACM SIGCOMM Computer Communication Review, 24(4):234–244, 1994.
11. Brad Karp and H. T. Kung. GPSR: greedy perimeter stateless routing for wireless networks. In Proceedings of the 6th Annual International Conference on Mobile Computing and Networking, pages 243–254, 2000.
12. Jyotsna RaoDawande, Sanjay Silakari, and Anjna Deen. A Survey of all Existing Clustering Protocols in VANETS but Main Emphasis of Survey Laid on Currently using Protocol i. e TCDGP. International Journal of Computer Applications, 118(6):22–31, 2015.
13. Reza Purtoosi, Hassan Taheri, Abbas Mohammadi, and Foroohar Foroozan. A light-weight contention-based clustering algorithm for wireless ad hoc networks. In The Fourth International Conference on Computer and Information Technology, 2004. CIT ’04., pages 627–632, 2004.
14. George J. Klir, Ute SaintClair, and Bo Yuan. Fuzzy Set Theory: Foundations and Applications. Prentice Hall, 1997.