Product Performance Measurement with a Multidimensional Approach: An Empirical Study

Year 2024, , 1250 - 1266, 31.07.2024

Muhammet Enis Bulak , Fatma Serra Çiftçi , Tuğba Yasemin Karagöz , Selin Taşer , Adeeb A. Kutty

https://doi.org/10.29130/dubited.1092747

Abstract

Usability is considered an important issue that ensures successful product design and use. Today, usability is of critical subject for smartphones that enable users to perform many tasks with software and hardware aspects. In this study, a conceptual usability evaluation model including design, customer focus, quality, innovation, usability, and user perception variables is proposed considering the expectations of smartphone users. The reliability and validity of the proposed model were tested using the structural equation model (SEM) with survey data collected from 417 smartphone users. The findings and results lead smartphone designers and marketing professionals to identify users' needs for smartphone usability. Moreover, this study provides users with strategic information in observing critical aspects of smartphones based on the index scores revealed by the model.

Keywords

Smart phones, Usability, Structural equation model, Measurement model, Product design

Çok Boyutlu Yaklaşım ile Ürün Performans Ölçümü: Deneysel Bir Çalışma

Abstract

Kullanılabilirlik, ürün tasarımının ve kullanımının başarılı olmasını sağlayan önemli bir konu olarak kabul edilir. Günümüzde kullanıcıların birçok görevi yerine getirmelerini sağlayan ve yazılım ile donanımsal yönleri olan akıllı telefonlar için ise kullanılabilirlik son derece kritik bir öneme sahiptir. Bu çalışmada akıllı telefon kullanıcılarının beklentileri dikkate alınarak tasarım, müşteri odaklılık, kalite, inovasyon, kullanılabilirlik ve kullanıcı algısı değişkenlerini içeren kavramsal bir kullanılabilirlik değerlendirme modeli önerilmiştir. Önerilen modelin güvenilirliği ve geçerliliği, 417 akıllı telefon kullanıcısından toplanan anket verileri ile yapısal eşitlik modeli (YEM) kullanılarak test edilmiştir. Bulgular ve sonuçlar, akıllı telefon tasarımcıları ve pazarlama çalışanlarına akıllı telefonların kullanılabilirliği için kullanıcıların ihtiyaçlarını tespit etmelerini sağlarken; kullanıcılara ise modelin oluşturduğu indeks puanlarına göre akıllı telefonlara ait kritik yönleri gözlemlemede stratejik bilgiler sağlamaktadır.

Keywords

Akıllı Telefonlar, Kullanılabilirlik, Yapısal Eşitlik Modeli, Ölçüm Modeli, Ürün Tasarımı

References

• [1] R. G. Cooper, “The drivers of success in new-product development,” Industrial Marketing Management, vol. 76, pp. 36-47, 2019.
• [2] R. Inostroza, C. Rusu, S. Roncagliolo, V. Rusu, and C. A. Collazos, “Developing SMASH: A set of smartphone's usability heuristics, “Computer Standards & Interfaces, vol. 43, pp. 40-52, 2016.
• [3] M. H. Eslami, and L. Melander, “Exploring uncertainties in collaborative product development: Managing customer-supplier collaborations,” Journal of Engineering and Technology Management, vol. 53, pp. 49-62, 2019.
• [4] Gartner. (2016). Gartner Hype Cycle for Emerging Technologies, [Online]. Available: https://www.gartner.com/smarterwithgartner/3-trends-appear-in-the-gartner-hype-cycle-foremerging-technologies-2016/
• [5] J. Martins, C. Costa, T. Oliveira, R. Gonçalves, and F. Branco, “How smartphone advertising influences consumers' purchase intention,” Journal of Business Research, vol. 94, pp. 378-387, 2019.
• [6] K., Hermann, and S. Wilfried, "Internet of things." In Real-time systems: design principles for distributed embedded applications, pp. 325-341. Cham: Springer International Publishing, 2022.
• [7] P. J. Danaher, and M. Cardona, “Consumer preferences for product features: The case of technology-intensive products,” MIT Sloan Management Review, vol. 60, no. 3, pp. 1-7, 2019.
• [8] A., Zafer, C. Fatma, and K. Masood, "A study of smartphone companies: do innovation culture and radical innovation affect institutionalization and sustainable competition positively?" International Journal of Innovation, vol.10, no. 1, pp. 95-117, 2022.
• [9] Li, S., Zhang, Y., Li, Y, and Yu, Z, “The user preference identification for product improvement based on online comment patch,” Electronic Commerce Research, vol. 21, pp. 423-444, 2021.
• [10] Ilham, H., Wijayanto, B, and Rahayu, S.P, “Analysis and Design of User Interface/User Experience With the Design Thinking Method in the Academic Information System of Jenderal Soedirman University,” Jurnal Teknik Informatika (Jutif), vol. 2 no.1, pp.17-26, 2021.
• [11] J. Boyle, S. Barnes, and H. Thimbleby, “Designing for usability: User experience in context,” John Wiley & Sons, 2014.
• [12] M. Durucu, M. Isik, and F. Calisir, “What is more important to internet banking website users: usability or functionality?” International Journal of Business Information Systems (IJBIS), vol. 30, no. 2, pp. 232-251, 2019.
• [13] Dopp, A.R., Parisi, K.E., Munson, S.A. and Lyon, A.R. “A glossary of user-centered design strategies for implementation experts,” Translational behavioral medicine, vol. 9 no.6, pp.1057-1064. 2019.
• [14] F. Hernández, “A Study of Smartphones in the Market: Challenges for Manufacturers,” Global Journal of Business & Social Science Review, vol. 3, no. 2, pp. 23-26, 2018.
• [15] W. Zhang, Z. Gao, and Y. Ma, “Usability evaluation of mobile phone interface,” International Journal of Human-Computer Interaction, vol. 26, no. 6, pp. 514-537, 2010.
• [16] X. Faulkner, and Y. Jones, “Usability in the post-2020 Context: A Review of the Current Literature,” International Journal of Human-Computer Interaction, vol. 32, no. 2, pp. 123-143, 2020.
• [17] M. Kang, and S. Kim, “Usability: A Growing Field of Technology,” Journal of Technology, vol. 15, no. 2, pp. 221-235, 2020.
• [18] Sun, Y, “Research on the Usability Evaluation Model of Mobile Application Interface Design for Active Senior,” Art and Society, vol. 2, no. 1, pp.61-66, 2023.
• [19] M. Crawford, “Human-Centered Design: Harnessing the Power of Usability and User Experience,” Computer, vol. 50, no. 9, pp. 48-55, 2017.
• [20] M. Regan, “Human-Centered Design: A Holistic Approach to Usability,” Interactions, vol. 25, no. 3, pp. 24-29, 2018.
• [21] E. L. C. Law, and E. T. Hvannberg, “Understanding usability: A definition and five dimensions,” Interacting with Computers, vol. 22, no. 3, pp. 209-221, 2010.
• [22] ISO. 2011. ISO 9241-11. International Organization for Standardization (2011). Ergonomics of human-system interaction – Part 11: Usability: Definitions and Concepts, [Online]. Available: https://www.iso.org/standard/43602.html
• [23] K. Mazuz, S. Biswas, and U. Lindner, “Developing Self-Management Application of Fall Prevention Among Older Adults: A Content and Usability Evaluation,” Frontiers in Digital Health, vol. 2, pp. 11, 2020.
• [24] H. García-González, I. Boneva, S. Staworko, J. E. Labra-Gayo, and J. M. C. Lovelle, “ShExML: improving the usability of heterogeneous data mapping languages for first-time users,” PeerJ Computer Science, vol. 6, pp. 318, 2020.
• [25] O. Gordieiev, “A models and assessment of quality of human-computer interaction software interface usability,” Radioelectronic and Computer Systems, vol. 3 no.95, pp. 84-96, 2020.
• [26] M. N. H. Al-Kinani, S. B. Adetunmbi and A. Hussain, “Usability Testing of Mobile Flipboard Application on both Non-Users and Novice Users,” International Journal of Interactive Mobile Technologies, vol. 14, no. 5, pp. 47–56, 2020.
• [27] A. Sánchez-Morales, J. A. Durand-Rivera, and C. L. Martínez-González, “Usability evaluation of a tangible user interface and serious game for identification of cognitive deficiencies in preschool children,” International Journal of Advanced Computer Science and Applications, vol. 11, no. 6, pp. 486-493, 2020.
• [28] S. Hanghøj, K. A. Boisen, M. Hjerming, A. Elsbernd, and H. Pappot “Usability of a Mobile Phone App Aimed at Adolescents and Young Adults During and After Cancer Treatment: Qualitative Study,” JMIR Cancer, vol. 6, no. 1, pp. 15008, 2020.
• [29] M. Hassenzahl, M. Burmester, and F. Koller, “Usability of mobile phones: Toward an integrated conceptual model,” International Journal of Human Computer Interaction, vol. 26, no. 1, pp. 64-84, 2010.
• [30] N. R. Sanders, Supply Chain Management: Global Perspective, NJ: Wiley, 2012.
• [31] L. Feng, and T. Ching, “Design factor: A critical element in user experience,” International Journal of Human-Computer Interaction, vol. 26, no. 5, pp. 407-423, 2010.
• [32] M. Bilal, and S. Hussain, “Customer Orientation: The Key to Successful Business,” International Journal of Business and Management, vol. 20, no. 7, pp. 83-90, 2012.
• [33] K. S. Yogi, “An empirical and fuzzy logic approach to product quality and purchase intention of customers in two wheelers,” Pacific Science Review B: Humanities and Social Sciences, vol. 1, no. 1, pp. 57-69, 2015.
• [34] F. Damanpour, “Organizational innovation: A meta-analysis of effects of determinants and moderators,” Academy of Management Journal, vol. 55, no. 3, pp. 745–778, 2012.
• [35] S. Valle, and L. Avella, “Cross‐ functionality and leadership of the new product development teams,” European Journal of Innovation Management, vol. 6, no. 1, pp. 32-47, 2003.
• [36] S. Sezer, and M. Uysal, “User perception of trust and satisfaction,” International Journal of Human-Computer Interaction, vol. 32, no. 7, pp. 517–529, 2016.
• [37] R. B. Kline, “Principles and practice of structural equation modeling,” Guilford Press, 2013.
• [38] Y. Liu, and H. Li, “Measurement accuracy and reliability: A comparison of mean values,” Measurement Science, vol. 8, no. 4, pp. 558-564, 2015.
• [39] D. Maxwell, and R. van der Vorst, “Developing sustainable products and services,” Journal of Cleaner Production, vol. 11, no. 8, pp. 883-895, 2003.
• [40] J. Brezet, A. Bijima, and S. Silvester, “Innovative electronics as a opportunityfor eco-efficient services,” Electronics goes green conference, Berlin, Germany, 2000.
• [41] K. Geiser, “Materials matter: Toward a sustainable materials policy,” Cambridge, MA, USA: MIT Press, 2001.
• [42] I. S. Jawahir, O. W. Dillon, K. E. Rouch, K. J. Joshi, A. Venkatachalam, and I. H. Jaafar, “Total life-cycle considerations in product design for sustainability: A framework for comprehensive evaluation,” 10th International Research/Expert Conference, Barcelona, Spain, 2006.
• [43] K. Chang, Y. Chen, and C. Wang, “Ergonomic design and its relationship with workplace safety, comfort, and efficiency,” The International Journal of Industrial Ergonomics, vol. 67, pp. 1-10, 2017.
• [44] B. Kirwan, and L. Ainsworth, “A Guide to Task Analysis,” Taylor & Francis, 2012.
• [45] S. S. M. Mokhtar, “The effects of customer focus on new product performance,” Business Strategy Series, vol. 14, no. 2-3, pp. 67–71, 2013.
• [46] E. den Ouden, L. Yuan, , P. J. M. Sonnemans, and A. C. Brombacher, “Quality and Reliability Problems from a Consumer’s Perspective: an Increasing Problem Overlooked by Businesses?” Quality Reliability Engineering International, vol. 22, no.7, pp. 821–838, 2006.
• [47] P. A. O. Ophuis, and H. C. Van Trijp, “Perceived quality: A market driven and consumer oriented approach,” Food quality and Preference, vol. 6, no. 3, pp. 177-183, 1995.
• [48] J. Alegre, R. Lapiedra, and R. Chiva, “A measurement scale for product innovation performance,” European Journal of Innovation Management, vol. 9, no. 4, pp. 333 – 346, 2006.
• [49] S. Zou, “How do consumers evaluate product innovation? A qualitative research,” International Journal of Innovation Management, vol. 18, no. 2, pp. 1-21, 2014.
• [50] C. Tynan, and S. McKechnie “Consumption symbolism: A review and research agenda,” International Journal of Research in Marketing, vol. 32, no. 1, pp. 1-14, 2015.
• [51] M. J. G. J. Houben, M. Wetzels and G. H. van Bruggen, “Adapting internal processes to customer needs: The role of customer data collection and customer experience management,” Journal of Business Research, vol. 69, no. 7, pp. 2548-2554, 2016.
• [52] J. Nielsen. (2012). Usability 101: Introduction to Usability, [Online]. Available: http://www. nngroup. com/articles/usability-101-introduction-to-usability
• [53] R. Molich, and J. S. Dumas, “Improving the Usability of Products with Measurable Targets,” Interactions, vol. 19, no. 3, pp. 28-35, 2012