A Conceptual Process Model Proposal for Visual Perception (VP) and Cognition in User-Product Interaction

Year 2023, Volume: 11 Issue: 1, 105 - 119, 29.03.2023

Mahmut Ferit Aydın , H. Güçlü Yavuzcan

Abstract

Interaction design is defined in general as the creation of physical and emotional conversations with a product, system, or service as a result of the experiences of actions and reactions between form, function, and new technology (Morshedzadeh, Ono, & Watanabe, 2016). User-product interaction refers to the behavioral connections between the user and the product that are examined to comprehend the concrete actions and use that understanding in product design. The designers are expected to have a versatile, dynamic and interdisciplinary knowledge as well as interpreting professional requirements with their subjective notions to address better product designs yet better user-product interactions. This versatile design knowledge is ultimately appeal to a visual world that reveals cognitive, structural and functional interactions of the users with products. Visual perception (VP) is one of the key but the most important prerequisites of the user-product interaction since it directs cognitive and behavioral actions of the users. Current studies explore various dimensions on the user-product interaction design process but it is needed to further explore its inclusive context, VP and cognition. to generate new perspectives within a holistic approach. In this study, we discussed the visual perceptive and cognitive dynamics of the user-product interaction process and proposed a conceptual process model that can give product designers more thorough and trustworthy interaction data while ultimately assisting them in redesigning and enhancing user-product interaction.

Keywords

User-product interaction process, Interaction design, Interaction process model, Visual perception (VP) and cognition in design, Behavior and cognition in interaction design

References

• [1] Morshedzadeh, E., Ono, K., & Watanabe, M., “A new model for improving user-product interaction evaluation, based on affordance and factor analysis”, Bulletin of Japanese Society for the Science of Design, 62(5), (2016). DOI:10.11247/jssdj.62.5_41
• [2] Saffer, D., Designing for Interaction: Creating Smart Applications and Clever Devices (2 ed.). Indianapolis, IN: New Riders Press, (2010).
• [3] Winograd, T., From Computing Machinery to Interaction Design. In P. Denning & R. Metcalfe (Eds.), Beyond Calculation: The Next Fifty Years of Computing (pp. 149-162). Amsterdam: Springer-Verlag, (1997).
• [4] Sharp, H., Rogers, Y., & Preece, J., Interaction Design: Beyond Human-Computer Interaction (5 ed.): John Wiley & Sons, (2019).
• [5] Picard, R. W., Affective Computing. London, England: MIT Press, (2000).
• [6] Tractinsky, N., Katz, A. S., & Ikar, D., “What is beautiful is usable”, Interacting with Computers, 13(2), 127-145, (2000).
• [7] Jordan, P. W., Pleasure with products: Human factors for body. In W. Green & P. W. Jordan (Eds.), Human factors in product design: Current practice and future trends (Vol. 1, pp. 206-217). London: CRC Press, (1999).
• [8] Forlizzi, J., & Ford, S., “The building blocks of experience: an early framework for interaction designers”, Paper presented at the Proceedings of the 3rd conference on Designing interactive systems: Processes, practices, methods, and techniques, (2000).
• [9] You, H.C., & Deng, Y.S., “The role of actions in user-product interaction”, Paper presented at the Int.Assoc.of Soc. of Design Res.-Emerging Trends in Design Research (IASDR07), Hong Kong Polytechnic University, (2007, 12-15 Nov. 2007).
• [10] Kolko, J., Thoughts on interaction design (2 ed.). Massachusetts: Morgan Kaufmann, (2010).
• [11] Rosenholtz, R., Twarog, N. R., Schinkel-Bielefeld, N., & Wattenberg, M., “An intuitive model of perceptual grouping for HCI design”, Paper presented at the Proceedings of the SIGCHI Conf. on Human Factors in Computing Systems, (2009).
• [12] Ware, C., Information Visualization: Perception For Design, (3 ed.). China: Elsevier, (2013).
• [13] Keil, F. C., Rozenblit, L., & Mills, C. M., What lies beneath? Understanding the limits of understanding. In Daniel T. Levin (Ed.), Thinking and seeing: Visual metacognition in adults and children, 227-249. MIT Press, (2004).
• [14] Bainbridge, W. S., & Roco, M. C., (Eds.). Handbook of science and technology convergence. Switzerland: Springer, (2016).
• [15] Council, National Research, A framework for K-12 science education: Practices, crosscutting concepts, and core ideas. USA: National Academies Press, (2012).
• [16] Samigulina, G., Shayakhmetova, A., & Nuysuppov, A., “Innovative intelligent technology of distance learning for visually impaired people”, Open Engineering, 7(1), 444, (2017). DOI: https://doi.org/10.1515/eng-2017-0046
• [17] Schooler, J. W., Reichle, E., & Halpern, D., Zoning out while reading: evidence for dissociations between experience and metaconsciousness. In D. T. Levin (Ed.), Thinking and seeing: Visual metacognition in adults and children (pp. 203-226). England, London: MIT Press, (2004).
• [18] Moulding, B., Songer, N., & Brenner, K., Science and engineering for grades 6-12: Investigation and design at the Center. Consensus Study Report. National Academies Press, (2018).
• [19] Les, M., & Les, M., Thinking, visual thinking and shape understanding. In Shape Understanding System: The First Steps toward the Visual Thinking Machines (pp. 1-45 ): Springer, (2008).
• [20] Levin, D. T., “Change blindness blindness as visual metacognition”, Journal of Consciousness Studies, 9(5-6), 111-130, (2002).
• [21] Scholl, B. J., Simons, D. J., & Levin, D. T., Change Blindness Blindness: An Implicit Measure of a Metacognitive Error. In D. T. Levin (Ed.), Visual metacognition in adults and children. London, England: MIT Press, (2004).
• [22] Diana, R. A., & Reder, L. M., Visual versus verbal metacognition: Are they really. In D. T. Levin (Ed.), Thinking and seeing: Visual metacognition in adults and children. England, London: MIT Press, (2004).
• [23] Moore, G. T., & Golledge, R. G., (Eds.) Environmental knowing: Theories, research and methods: Dowden, (1976).
• [24] Rand, Y., Deficient cognitive functions and non-cognitive determinants-an integrating model: assessment and intervention. In R. Feuerstein, P. S. Klein & A. J. Tannenbaum (Eds.), Mediated learning experience: Theoretical, psychosocial and learning Implications. London: Freund, (1991).
• [25] Swan, J., “Using cognitive mapping in management research: decisions about technical innovation”, British Journal of Management, 8(2), 183-198, (1997).
• [26] Siau, K., & Tan, X., “Use of cognitive mapping techniques in information systems development”, Journal of Computer Information Systems, 48(4), 49-57, (2008).
• [27] Downs, R. M., & Stea, D., Cognitive maps and spatial behaviour: Process and products. In R. M. Downs & D. Stea (Eds.), Image and Environment: Cognitive Mapping and Spatial Behavior. Chicago, IL: Transaction Publishers, (1973).
• [28] Flavell, J. H., Development of knowledge about vision thinking and seeing. . In D. T. Levin (Ed.), Visual metacognition in adults and children. London, England: MIT Press, (2004).
• [29] Milner, D., & Goodale, M., The visual brain in action (Vol. 27): OUP Oxford, (2006).
• [30] Gordon, A., Forssberg, H., Johansson, R., & Westling, G., “Visual size cues in the programming of manipulative forces during precision grip”, Experimental Brain Research, 83, 477-482, (1991a).
• [31] Gordon, A., Forssberg, H., Johansson, R., & Westling, G., The integration of haptically acquired size information in the programming of precision grip. Experimental Brain Research, 83, 483-488, (1991b).
• [32] Johansson, R., How is grasping modified by somatosensory input. In D. R. Humphrey & H.-J. Freund (Eds.), Motor control: Concepts and issues (pp. 331-335). Chichester, UK: Wiley, (1991).
• [33] John-Steiner, V., Notebooks of the mind: Explorations of thinking: USA: Oxford University Press, (1997).
• [34] McKim, R. H., Experiences in visual thinking. Boston: PWS, (1972).
• [35] Brasseur, L. E., “Visual thinking in the English department”, Journal of Aesthetic Education, 27(4), 129-141, (1993).
• [36] Goldschmidt, G., “On visual design thinking: The vis kids of architecture”, Design Studies, 15(2), 158-174, (1994).
• [37] Laseau, P., Graphic problem solving for architects and designers: USA: John Wiley & Sons, (1986).
• [38] Brumberger, E. R., “Making the strange familiar: A pedagogical exploration of visual thinking” Journal of Business and Technical Communication, 21(4), 376-401, (2007).
• [39] Landa, R., Thinking creatively: New ways to unlock your visual imagination (2. Ed): North Light Books. ISBN: 978-0891348436, (1998).
• [40] Marr, D., Representing the image: zero-crossings and the raw primal sketch. In Vision. San Francisco, CA: WH Freeman, 54-68, (1982).
• [41] Arnheim, R., Visual thinking. Berkeley; Los Angeles; London: Univ. of California Press, (2004).
• [42] Barry, A. M. S., Visual intelligence: Perception, image, and manipulation in visual communication. USA: State Univ. of New York Press, (1997).
• [43] Kaufman‐Scarborough, C., “Accessible advertising for visually‐disabled persons: The case of color‐deficient consumers”, Journal of Consumer Marketing, 18(4), 303-318, (2001).
• [44] Hummel, J. E., & Biederman, I., “Dynamic binding in a neural network for shape recognition”, Psychological Review, 99(3), 480, (1992).
• [45] Jacko, J. A., Dixon, M. A., Rosa Jr, R. H., Scott, I. U., & Pappas, C. J., “Visual profiles: a critical component of universal access”, Paper presented at the Proceedings of the SIGCHI Conf. on Human Factors in Computing Systems, (1999).
• [46] Corn, A. L., “Visual function: A theoretical model for individuals with low vision”, Journal of Visual Impairment & Blindness, 77(8), 373-377, (1983).
• [47] Kline, D. W., & Schieber, F. “Vision and aging”, In J. E. Birren & K. W. Schaie (Eds.), Handbook of the psychology of aging (pp. 296–331). Van Nostrand Reinhold Co, (1985).
• [48] Wood, J. M., & Troutbeck, R. J. “Effect of age and visual impairment on driving and vision performance”, Transportation research record, 1438, 84-90, (1994).
• [49] Kraut, J. A., & McCabe, C. P. “The problem of low vision. Definition and common problems”, In D. M. Albert (Ed.), Principles and practice of ophthalmology: Clinical Practice (Vol. 2, pp. 3664-3666). Philadelphia: WB Saunders, (1994).
• [50] Dini, S., Ferlino, L., Gettani, A., Martinoli, C., & Ott, M., “Educational software and low vision students: Evaluating accessibility factors”, Universal Access in the Information Society, 6(1), 15-29, (2007).
• [51] Jackson, M. C., Systems thinking: Creative holism for managers: UK: John Wiley & Sons, (2016).
• [52] Ulrich, W., “Systems thinking, systems practice, and practical philosophy: A program of research”, Systems practice, 1(2), 137-163, (1988). DOI:10.1007/bf01059855
• [53] Smith, R. P., & Morrow, J. A., “Product development process modeling”, Design Studies, 20(3), 237-261, (1999). DOI:https://doi.org/10.1016/S0142-694X(98)00018-0
• [54] Oxman, R., “The thinking eye: visual re-cognition in design emergence” Design Studies, 23(2), 135-164, (2002).
• [55] Schön, D. A., The reflective practitioner: How professionals think in action: Routledge, (2017).
• [56] Schön, D. A., & Wiggins, G., “Kinds of seeing and their functions in designing”, Design Studies, 13(2), 135-156, (1992).
• [57] Stiny, G., How to calculate with shapes. In E. K. Antonsson, Jonathan C. (Eds.), Formal Engineering Design Synthesis, Cambridge Univ. Press, 20-64, (2001).
• [58] Nakayama, K., He, Z. J., & Shimojo, S., Visual surface representation: A critical link between lower-level and higher-level vision In S. M. Kosslyn & D. N. Osherson (Eds.), An Invitation to Cognitive Science: Visual cognition (Vol. 2, pp. 1-70). Cambridge, MA: MIT Press, (1995).
• [59] Kosslyn, S. M., & Osherson, D. N. (Eds.). An invitation to cognitive science: Visual cognition (Vol. 2). London, England: MIT Press, (1995).
• [60] Oxman, R., “Design by re-representation: a model of visual reasoning in design”, Design Studies, 18(4), 329-347, (1997).
• [61] Oxman, R., “Precedents in design: a computational model for the organization of precedent knowledge”, Design Studies, 15(2), 141-157, (1994).
• [62] Howard, T. J., Culley, S. J., & Dekoninck, E., “Describing the creative design process by the integration of engineering design and cognitive psychology literature”, Design Studies, 29(2), 160-180, (2008).
• [63] Gericke, K., & Blessing, L., “An analysis of design process models across disciplines”, Paper presented at the DS 70: Proceedings of DESIGN 2012, The 12th Int. Design Conf., Dubrovnik, Croatia, (2012).
• [64] Basadur, M., Pringle, P., Speranzini, G., & Bacot, M., “Collaborative problem solving through creativity in problem definition: Expanding the pie” Creativity and Innovation Management, 9(1), 54-76, (2000).
• [65] Hall, E. T., The hidden dimension (Vol. 609): Garden City, NY: Doubleday, (1966).
• [66] Gero, J. S., & Kannengiesser, U., “The situated function–behaviour–structure framework”, Design Studies, 25(4), 373-391, (2004).
• [67] Finney, G. R., “Perceptual-motor dysfunction”, Continuum: Lifelong Learning in Neurology, 21(3), 678-689, (2015).
• [68] Kryssanov, V. V., Tamaki, H., & Kitamura, S., “Understanding design fundamentals: How synthesis and analysis drive creativity, resulting in emergence”, Artificial Intelligence in Engineering, 15(4), 329-342, (2001).
• [69] Alben, L., “Quality of experience: Defining the criteria for effective interaction design”, Interactions, 3(3), 11-15, (1996). DOI:10.1145/235008.235010
• [70] Ghosh, S., Shruthi, C. S., Bansal, H., & Sethia, A., “What is user’s perception of naturalness? An exploration of natural user experience”, Paper presented at the IFIP Conf. on Human-Computer Interaction. (2017).
• [71] Chandler, D., Semiotics: The basics (2 ed.). Taylor & Francis e-Library: Routledge, (2007).
• [72] Brooks, P., & Hestnes, B., “User measures of quality of experience: Why being objective and quantitative is important”, IEEE network, 24(2), 8-13, (2010).
• [73] Allen, G. L., “Spatial abilities, cognitive maps, and wayfinding: Bases for individual differences in spatial cognition and behavior”, In R. G. Golledge (Ed.), Wayfinding behavior: Cognitive mapping and other spatial processes. Baltimore & London: The Johns Hopkins Uinversity Press, (1999).