Bayesian network and sentiment analysis for evaluating online hotel reviews under multiple criteria

Abstract

Online travel agency platforms provide extensive hotel reviews that reflect customer perceptions on multiple criteria. A novel multi--criterion decision--making approach is introduced that integrates Bayesian networks and the graph theory matrix approach to rank hotels based on online customer reviews. A sentiment analysis algorithm is developed to extract sentiment orientations from textual reviews. A Bayesian network is trained using both numerical ratings and sentiment scores to capture probabilistic dependencies among criteria and generate relative importance weights. The derived weights are embedded into the graph theory matrix approach ranking process. A case study on ski hotels in Turkey demonstrates that the Bayesian network graph theory matrix approach integration reflects customer preferences more effectively than conventional multi--criteria decision--making approaches that assume criterion independence. The results indicate that price--performance is a dominant factor in recommending ski hotels. Service quality and food quality are also important criteria that directly affect recommendation decisions and indirectly influence them through price-performance.

Keywords

• Bayesian network
• graph theory matrix approach
• hotel ranking
• multi-criteria decision-making
• online hotel reviews
• sentiment analysis

References

1. [1] A.G. Aggarwal, S. Aggarwal and V. Jindal, Ranking of hotels using customer reviews: an LDA-picture fuzzy TOPSIS approach, Int. J. Syst. Assur. Eng. Manag. 16 (5), 1885-1898, 2025, doi:10.1007/s13198-025-02742-3.
2. [2] A. Baykasoglu, A review and analysis of graph theoretical-matrix permanent approach to decision making with example applications, Artif. Intell. Rev. 42, 573-605, 2014, doi:10.1007/s10462-012-9354-y.
3. [3] A. Baykasoglu, "Graph theory" and "matrix method" based approach for business process modeling/simulation software selection, J. Fac. Eng. Archit. Gazi Univ. 28 (3), 555-566, 2013.
4. [4] J.-W. Bi, T.-Y. Han, Y. Yao and H. Li, Ranking hotels through multi-dimensional hotel information: a method considering travelers preferences and expectations, Inf. Technol. Tour. 24, 127-155, 2022, doi:10.1007/s40558-022-00223-y.
5. [5] M. Birjali, M. Kasri and A. Beni-Hssane, A comprehensive survey on sentiment analysis: approaches, challenges and trends, Knowl.-Based Syst. 226, 107134, 2021, doi:10.1016/j.knosys.2021.107134.
6. [6] L. Bonnefoy-Claudet and N. Ghantous, Emotions’ impact on tourists’ satisfaction with ski resorts: the mediating role of perceived value, J. Travel Tour. Mark. 30 (6), 624-637, 2013, doi:10.1080/10548408.2013.810999.
7. [7] S. Çal and .Y. Balaman, Improved decisions for marketing, supply and purchasing: mining big data through an integration of sentiment analysis and intuitionistic fuzzy multi criteria assessment, Comput. Ind. Eng. 129, 315-332, 2019, doi:10.1016/j.cie.2019.01.051.
8. [8] S. Chakraborty, K. Mengersen, C. Fidge, L. Ma and D. Lassen, A Bayesian Networkbased customer satisfaction model: a tool for management decisions in railway transport, Decis. Anal. 3, 4, 2016, doi:10.1186/s40165-016-0021-2.

9. [9] C.W. Churchman and R.L. Ackoff, An approximate measure of value, J. Oper. Res. Soc. Am. 2, 172-187, 1954, doi:10.1287/opre.2.2.172.
10. [10] J.S. Clark and J.K. Maher, If you have their minds, will their bodies follow? factors effecting customer loyalty in a ski resort setting, J. Vacat. Mark. 13 (1), 59-71, 2007, doi:10.1177/1356766706071209.
11. [11] R. Daly, Q. Shen and S. Aitken, Learning Bayesian networks: approaches and issues, Knowl. Eng. Rev. 26, 99-157, 2011, doi:10.1017/S0269888910000251.
12. [12] M. Darvish, M. Yasaei and A. Saeedi, Application of the graph theory and matrix methods to contractor ranking, Int. J. Proj. Manag. 27 (6), 610-619, 2009, doi:10.1016/j.ijproman.2008.10.004.
13. [13] R. Dehkharghani, Y. Saygin, B. Yanikoglu and K. Oflazer, SentiTurkNet: a Turkish polarity lexicon for sentiment analysis, Lang. Resour. Eval. 50, 667-685, 2016, doi:10.1007/s10579-015-9307-6.
14. [14] S. Dogan, M.A. Basaran and K. Kantarci, Determination of attributes affecting priceperformance using fuzzy rule-based systems: online ratings of hotels by travel 2.0 users, J. Hosp. Tour. Technol. 11 (2), 291-311, 2020, doi:10.1108/JHTT-07-2018- 0067.
15. [15] G. Eryiit, ITU Turkish NLP web service, in: Proceedings of the Demonstrations at the 14th Conference of the European Chapter of the Association for Computational Linguistics, 1-4, Gothenburg, Sweden, 2014.
16. [16] G. Eryiit, J. Nivre and K. Oflazer, Dependency parsing of Turkish, Comput. Linguist. 34 (3), 357-389, 2008, doi:10.1162/coli.2008.07-017-R1-06-83.
17. [17] Z.-P. Fan, G.-M. Li and Y. Liu, Processes and methods of information fusion for ranking products based on online reviews: an overview, Inf. Fusion 60, 8797, 2020, doi:10.1016/j.inffus.2020.02.007.
18. [18] P. Giri, S. Paul and B.K. Debnath, A hybrid graph-theoretic solution of Delphi and graph theory matrix approach (GTMA) to the challenges of sustainable lithium-ion battery (LIB) supply chains in electric vehicles in India, J. Energy Storage 97, 112702, 2024, doi:10.1016/j.est.2024.112702.
19. [19] S. Goyal and S. Grover, Manufacturing systems effectiveness measurement by using combined approach of ANP and GTMA, Int. J. Syst. Assur. Eng. Manag. 4 (4), 404- 423, 2013, doi:10.1007/s13198-012-0129-2.
20. [20] A. Gupta, A. Dwivedi and S.K. Paul, Developing a sustainability index for implementing big data analytics in the logistics sector, Sustain. Dev. 33 (S1), 1271-1291, 2025, doi:10.1002/sd.70024.
21. [21] A. Gupta, R.K. Singh and M.M. Kamal, Blockchain technology adoption for secured and carbon neutral logistics operations: barrier intensity index framework, Ann. Oper. Res., 1-34, 2024, doi:10.1007/s10479-024-05824-w.
22. [22] S. Hosseini and D. Ivanov, Bayesian networks for supply chain risk, resilience and ripple effect analysis: a literature review, Expert Syst. Appl. 161, 113649, 2020, doi:10.1016/j.eswa.2020.113649.
23. [23] C. Hwang and K. Yoon, Multiple Attribute Decision Making: Methods and Applications, Springer, Berlin Heidelberg, 1981.
24. [24] C. Kahraman, U. Cebeci and Z. Ulukan, Multi-criteria supplier selection using fuzzy AHP, Logist. Inf. Manag. 16 (6), 382-394, 2003, doi:10.1108/09576050310503367.
25. [25] E.G. Kavilal, S. Prasanna Venkatesan and J. Sanket, An integrated interpretive structural modeling and a graph-theoretic approach for measuring the supply chain complexity in the Indian automotive industry, J. Manuf. Technol. Manag. 29 (3), 478-514, 2018, doi:10.1108/JMTM-03-2017-0032.
26. [26] D. Koller and N. Friedman, Probabilistic Graphical Models: Principles and Techniques, MIT Press, Cambridge, 2009.
27. [27] D.-E. Koulouriotis and M.-K. Ketipi, A fuzzy digraph method for robot evaluation and selection, Expert Syst. Appl. 38 (9), 11901-11910, 2011, doi:10.1016/j.eswa.2011.03.082.
28. [28] X. Liang, P. Liu and Z.Wang, Hotel selection utilizing online reviews: a novel decision support model based on sentiment analysis and DL-VIKOR method, Technol. Econ. Dev. Econ. 25 (6), 1139-1161, 2019, doi:10.3846/tede.2019.10766.
29. [29] Y. Liu, J.-W. Bi and Z.-P. Fan, Ranking products through online reviews: a method based on sentiment analysis technique and intuitionistic fuzzy set theory, Inf. Fusion 36, 149-161, 2017, doi:10.1016/j.inffus.2016.11.012.
30. [30] M. Ma, B. Yu and Z. Xu, A scalable framework for ranking integration in large-scale online reviews: integrating clustering and multi-attribute decision-making, Electron. Commer. Res. Appl. 45, 101570, 2026, doi:10.1016/j.elerap.2025.101570.
31. [31] L.M. Maiyar, S.J. Cho, M.K. Tiwari, K.D. Thoben and D. Kiritsis, Optimising online review inspired product attribute classification using the self-learning particle swarm-based Bayesian learning approach, Int. J. Prod. Res. 57 (10), 3099-3120, 2019, doi:10.1080/00207543.2018.1535724.
32. [32] C.E. Metz, Basic principles of ROC analysis, Semin. Nucl. Med. 8 (4), 283-298, 1978.
33. [33] H. Minc, Permanents, Addison-Wesley, Reading, 1978.
34. [34] R.E. Neapolitan, Learning Bayesian Networks, Pearson Prentice Hall, Upper Saddle River, 2004.
35. [35] R.-X. Nie, Z.-P. Tian, J.-Q. Wang and K.S. Chin, Hotel selection driven by online textual reviews: applying a semantic partitioned sentiment dictionary and evidence theory, Int. J. Hosp. Manag. 88, 102495, 2020, doi:10.1016/j.ijhm.2020.102495.
36. [36] D.L. Olson, Comparison of weights in TOPSIS models, Math. Comput. Model. 40 (7-8), 721-727, 2004, doi:10.1016/j.mcm.2004.10.003.
37. [37] E. Park, H.-J. Chang and H.-S. Nam, A Bayesian network model for predicting post-stroke outcomes with available risk factors, Front. Neurol. 9, 1-11, 2018, doi:10.3389/fneur.2018.00699.
38. [38] J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufmann, San Francisco, 1988.
39. [39] H.-G. Peng, H.-Y. Zhang and J.-Q. Wang, Cloud decision support model for selecting hotels on TripAdvisor.com with probabilistic linguistic information, Int. J. Hosp. Manag. 68, 124-138, 2018, doi:10.1016/j.ijhm.2017.10.001.
40. [40] Y. Peng, G. Kou, G. Wang and Y. Shi, FAMCDM: A fusion approach of MCDM methods to rank multiclass classification algorithms, Omega 39 (6), 677-689, 2011, doi:10.1016/j.omega.2011.01.009.
41. [41] L.D. Pietro, R.G. Mugion, F. Musella, M.F. Renzi and P. Vicard, Reconciling internal and external performance in a holistic approach: a Bayesian network model in higher education, Expert Syst. Appl. 42 (5), 2691-2702, 2015, doi:10.1016/j.eswa.2014.11.019.
42. [42] R.V. Rao, A decision-making framework model for evaluating flexible manufacturing systems using digraph and matrix methods, Int. J. Adv. Manuf. Technol. 30 (11), 1101-1110, 2006, doi:10.1007/s00170-005-0150-6.
43. [43] P. Ren, B. Zhu, L. Ren and N. Ding, Online choice decision support for consumers: data-driven analytic hierarchy process based on reviews and feedback, J. Oper. Res. Soc. 74 (10), 2227-2240, 2023, doi:10.1080/01605682.2022.2129491.
44. [44] H.J. Ryser, Combinatorial Mathematics, 14th ed., Math. Assoc. of America, New York, 1963.
45. [45] T.L. Saaty, Decision-making with the AHP: why is the principal eigenvector necessary, Eur. J. Oper. Res. 145 (1), 85-91, 2003, doi:10.1016/S0377-2217(02)00227-8.
46. [46] S. Sagnika, A. Pattanaik, B.S.P Mishra and S.K. Meher, A review on multi-lingual sentiment analysis by machine learning methods, J. Eng. Sci. Technol. Rev. 13 (2), 154-166, 2020, doi:10.25103/jestr.132.19.
47. [47] M. Scutari, Learning Bayesian networks with the bnlearn R Package, J. Stat. Softw. 35, 122, 2010, doi:10.18637/jss.v035.i03.
48. [48] M. Scutari and J.-B. Denis, Bayesian Networks with Examples in R, CRC Press, Boca Raton, FL, 2015.
49. [49] Z. Shang, J.M. Luo and A. Kong, Topic modelling for ski resorts: an analysis of experience attributes and seasonality, Sustainability 14 (6), 3533, 2022, doi:10.3390/su14063533.
50. [50] C.E. Shannon and W. Weaver, The Mathematical Theory of Communication, Univ. of Illinois Press, Urbana, 1949.
51. [51] Y.A. Singgalen, Hotel customer satisfaction: a comprehensive analysis of perceived cleanliness, location, service, and value, J. Bus. Econ. Res. 5 (3), 352-369, 2024, doi:10.47065/jbe.v5i3.6016.
52. [52] J.A. Swets, Measuring the accuracy of diagnostic systems, Science 240 (4857), 1285- 1293, 1988, doi:10.1126/science.3287615.
53. [53] L.-L. Tao and T.-H. You, A multi-criteria decision-making model for hotel selection by online reviews: considering the traveller types and the interdependencies among criteria, Appl. Intell. 52, 12436-12456, 2022, doi:10.1007/s10489-021-03151-2.
54. [54] K. Topuz, H. Uner, A. Oztekin and M.B. Yildirim, Predicting pediatric clinic noshows: a decision analytic framework using elastic net and Bayesian belief network, Ann. Oper. Res. 263, 479-499, 2018, doi:10.1007/s10479-017-2489-0.
55. [55] D. Tuljak-Suban and P. Bajec, Integration of AHP and GTMA to make a reliable decision in complex decision-making problems: application of the logistics provider selection problem as a case study, Symmetry 12 (5), 766, 2020, doi:10.3390/sym12050766.
56. [56] G.-H. Tzeng and J.-J. Huang, Multiple Attribute Decision Making: Methods and Applications, CRC Press, New York, 2011.
57. [57] L.G. Valiant, The complexity of computing the permanent, Theor. Comput. Sci. 8 (2), 189-201, 1979, doi:10.1016/0304-3975(79)90044-6.
58. [58] V. Vargas-Calderón, A. Moros Ochoa, G.Y. Castro Nieto and J.E. Camargo, Machine learning for assessing quality of service in the hospitality sector based on customer reviews, Inf. Technol. Tour. 23, 351-379, 2021, doi:10.1007/s40558-021-00207-4.
59. [59] N. Virmani, R.K. Singh, V. Agarwal and E. Aktas, Artificial intelligence applications for responsive healthcare supply chains: a decision-making framework, IEEE Trans. Eng. Manag. 71, 8591-8605, 2024, doi:10.1109/TEM.2024.3370377.
60. [60] L. Wang, X.-K. Wang, J.-J. Peng and J.-Q. Wang, The differences in hotel selection among various types of travellers: a comparative analysis with a useful bounded rationality behavioural decision support model, Tour. Manag. 76, 103961, 2020, doi:10.1016/j.tourman.2019.103961.
61. [61] J. Wu, C. Fu, E. Zhao, S. Sun and S. Wang, What makes a better hotel selection? a hybrid approach considering tourists preference and review helpfulness, Curr. Issues Tour. 28 (10), 1570-1594, 2025, doi:10.1080/13683500.2024.2343098.
62. [62] W. Xie, W. Zhao and Z. Xu, Comparative analysis of multi-platform e-commerce online reviews based LDA and sentiment dictionary, Int. J. Intell. Comput. Cybern. 18 (2), 298-325, 2025, doi:10.1108/IJICC-08-2024-0384.
63. [63] S.-M. Yu, Z.-J. Du, X.-D. Lin, H.-J. Luo and J.-Q. Wang, A stochastic dominancebased approach for hotel selection under probabilistic linguistic environment, Mathematics 8 (9), 1525, 2020, doi:10.3390/math8091525.
64. [64] S.-M. Yu, J. Wang, J.-Q. Wang and L. Li, A multi-criteria decision-making model for hotel selection with linguistic distribution assessments, Appl. Soft Comput. 67, 741-755, 2018, doi:10.1016/j.asoc.2017.08.009.
65. [65] J. Zheng, M.Y. Li, D.N. Yuan and S. Xie, Product ranking considering differences across online review platforms: a method based on intuitionistic fuzzy soft sets, J. Oper. Res. Soc. 76 (6), 1252-1275, 2025, doi:10.1080/01605682.2024.2417727.
66. [66] E. Zhao, S. Sun, C. Fu, J. Wu and S. Wang, How user-generated content influence different types of travelers to select hotels? a perspective with prospect theory, Inf. Process. Manag. 62 (3), 104049, 2025, doi:10.1016/j.ipm.2024.104049.