Research Article
BibTex RIS Cite

Evaluation of Visualisation of Scanpath Trend Analysis (ViSTA) Tool

Year 2019, Volume: 7 Issue: 4, 373 - 383, 30.10.2019
https://doi.org/10.17694/bajece.490601

Abstract

Eye tracking plays a key role in user behaviour understanding and usability studies. We previously proposed an algorithm called STA (Scanpath Trend Analysis) that analyses multiple individual scanpaths on a web page to discover their trending path in terms of the areas of interest (AOIs). This algorithm provides the most representative path of multiple users and compared to other algorithms (i.e., provides the most similar path to individual scanpaths). However, its current implementation has no graphical user interface and provides a sequence of characters that represent AOIs. Some external modules should also be installed in advance to run it. In our previous work, we presented the first web-based visualisation tool for the STA algorithm called ViSTA along with its initial evaluation. This tool allows to visualise individual scanpaths on a particular web page with gaze plots, visually draw AOIs, apply the STA algorithm, and visualise the result of the algorithm. In this paper, we present the extended version of ViSTA with a follow up user evaluation. The first version of ViSTA uses the STA algorithm which identifies trending AOIs based on all individual scanpaths. However, the extended one uses the STA algorithm with the tolerance level parameter which means trending elements can be identified based on a subset of individual scanpaths for discovering a more representative path. Both of our initial and follow up evaluations show that the workload in terms of NASA Task Load Index (TLX) is lower with ViSTA compared to the current implementation of the STA algorithm.

References

  • Y. Yesilada, S. Harper and S. Eraslan, “Experiential Transcoding: An EyeTracking Approach,” in Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility, New York, NY, USA, 2013.
  • T. Blascheck, K. Kurzhals, M. Raschke, M. Burch, D. Weiskopf and T. Ertl, “Visualization of Eye Tracking Data: A Taxonomy and Survey,” Computer Graphics Forum, vol. 36, pp. 260-284, 2017.
  • M. E. Akpınar and Y. Yeşilada, “Vision Based Page Segmentation Algorithm: Extended and Perceived Success,” in Current Trends in Web Engineering: ICWE 2013 International Workshops ComposableWeb, QWE, MDWE, DMSSW, EMotions, CSE, SSN, and PhD Symposium, Aalborg, Denmark, July 8-12, 2013. Revised Selected Papers, Q. Z. Sheng and J. Kjeldskov, Eds., Cham, Springer International Publishing, 2013, pp. 238-252.
  • S. Eraslan, Y. Yesilada and S. Harper, “Eye tracking scanpath analysis techniques on web pages: A survey, evaluation and comparison,” Journal of Eye Movement Research, vol. 9, 2015.
  • S. Eraslan, Y. Yesilada and S. Harper, “Scanpath Trend Analysis on Web Pages: Clustering Eye Tracking Scanpaths,” ACM Trans. Web, vol. 10, pp. 20:1--20:35, 11 2016.
  • C. Tablatin and M. M. Rodrigo, “Identifying Common Code Reading Patterns using Scanpath Trend Analysis with a Tolerance,” in Proceedings of thee 26th International Conference for Computers in Education (ICCE 2018), Metro Manila, Philippines, 2018.
  • Ş. Eraslan, S. Karabulut, M. C. Atalay and Y. Yeşilada, “ViSTA: Visualisation of Scanpath Trend Analysis (STA) / Scanpath Trend Analysis (STA)'in Görselleştirilmesi,” in Proceedings of the 12th Turkish National Symposium on Software Engineering (12. Ulusal Yazılım Mühendisligi Sempozyumu, UYMS 2018), İstanbul, Turkey, 2018.
  • Tobii Technology AB, “Tobii Studioᵀᴹ 2.X User Manual (Sep. 2010),” 2010.
  • K. Holmqvist, J. Holsanova, M. Barthelson and D. Lundqvist, “Reading or scanning? A study of newspaper and net paper reading.,” J. R. In Hyönä and H. Deubel, Eds., Elsevier, 2003, pp. 657-670.
  • L. Herman, S. Popelka and V. Hejlova, “Eye-tracking Analysis of Interactive 3D Geovisualization,” Journal of Eye Movement Research, vol. 10, 2017.
  • J. Dolezalova and S. Popelka, “ScanGraph: A Novel Scanpath Comparison Method Using Visualisation of Graph Cliques,” Journal of Eye Movement Research, vol. 9, 2016.
  • G. Topić, A. Yamaya, A. Aizawa and P. Martínez-Gómez, “FixFix: Fixing the Fixations,” in Proceedings of the Ninth Biennial ACM Symposium on ETRA, New York, NY, USA, 2016.
  • S. Eraslan, Y. Yesilada and S. Harper, “Engineering web-based interactive systems: trend analysis in eye tracking scanpaths with a tolerance,” in Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS 2017, New York, NY, USA, 2017.
  • A. Santella and D. DeCarlo, “Robust Clustering of Eye Movement Recordings for Quantification of Visual Interest,” in Proceedings of the 2004 Symposium on ETRA, New York, NY, USA, 2004.
  • P. Hejmady and N. H. Narayanan, “Visual Attention Patterns During Program Debugging with an IDE,” in Proceedings of the 2012 Symposium on ETRA, New York, NY, USA, 2012.
  • K.-J. Räihä, A. Aula, P. Majaranta, H. Rantala and K. Koivunen, “Static Visualization of Temporal Eye-Tracking Data,” in Human-Computer Interaction - INTERACT 2005: IFIP TC13 International Conference, Rome, Italy, September 12-16, 2005. Proceedings, M. F. Costabile and F. Paternò, Eds., Berlin, Heidelberg: Springer Berlin Heidelberg, 2005, pp. 946-949.
Year 2019, Volume: 7 Issue: 4, 373 - 383, 30.10.2019
https://doi.org/10.17694/bajece.490601

Abstract

References

  • Y. Yesilada, S. Harper and S. Eraslan, “Experiential Transcoding: An EyeTracking Approach,” in Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility, New York, NY, USA, 2013.
  • T. Blascheck, K. Kurzhals, M. Raschke, M. Burch, D. Weiskopf and T. Ertl, “Visualization of Eye Tracking Data: A Taxonomy and Survey,” Computer Graphics Forum, vol. 36, pp. 260-284, 2017.
  • M. E. Akpınar and Y. Yeşilada, “Vision Based Page Segmentation Algorithm: Extended and Perceived Success,” in Current Trends in Web Engineering: ICWE 2013 International Workshops ComposableWeb, QWE, MDWE, DMSSW, EMotions, CSE, SSN, and PhD Symposium, Aalborg, Denmark, July 8-12, 2013. Revised Selected Papers, Q. Z. Sheng and J. Kjeldskov, Eds., Cham, Springer International Publishing, 2013, pp. 238-252.
  • S. Eraslan, Y. Yesilada and S. Harper, “Eye tracking scanpath analysis techniques on web pages: A survey, evaluation and comparison,” Journal of Eye Movement Research, vol. 9, 2015.
  • S. Eraslan, Y. Yesilada and S. Harper, “Scanpath Trend Analysis on Web Pages: Clustering Eye Tracking Scanpaths,” ACM Trans. Web, vol. 10, pp. 20:1--20:35, 11 2016.
  • C. Tablatin and M. M. Rodrigo, “Identifying Common Code Reading Patterns using Scanpath Trend Analysis with a Tolerance,” in Proceedings of thee 26th International Conference for Computers in Education (ICCE 2018), Metro Manila, Philippines, 2018.
  • Ş. Eraslan, S. Karabulut, M. C. Atalay and Y. Yeşilada, “ViSTA: Visualisation of Scanpath Trend Analysis (STA) / Scanpath Trend Analysis (STA)'in Görselleştirilmesi,” in Proceedings of the 12th Turkish National Symposium on Software Engineering (12. Ulusal Yazılım Mühendisligi Sempozyumu, UYMS 2018), İstanbul, Turkey, 2018.
  • Tobii Technology AB, “Tobii Studioᵀᴹ 2.X User Manual (Sep. 2010),” 2010.
  • K. Holmqvist, J. Holsanova, M. Barthelson and D. Lundqvist, “Reading or scanning? A study of newspaper and net paper reading.,” J. R. In Hyönä and H. Deubel, Eds., Elsevier, 2003, pp. 657-670.
  • L. Herman, S. Popelka and V. Hejlova, “Eye-tracking Analysis of Interactive 3D Geovisualization,” Journal of Eye Movement Research, vol. 10, 2017.
  • J. Dolezalova and S. Popelka, “ScanGraph: A Novel Scanpath Comparison Method Using Visualisation of Graph Cliques,” Journal of Eye Movement Research, vol. 9, 2016.
  • G. Topić, A. Yamaya, A. Aizawa and P. Martínez-Gómez, “FixFix: Fixing the Fixations,” in Proceedings of the Ninth Biennial ACM Symposium on ETRA, New York, NY, USA, 2016.
  • S. Eraslan, Y. Yesilada and S. Harper, “Engineering web-based interactive systems: trend analysis in eye tracking scanpaths with a tolerance,” in Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS 2017, New York, NY, USA, 2017.
  • A. Santella and D. DeCarlo, “Robust Clustering of Eye Movement Recordings for Quantification of Visual Interest,” in Proceedings of the 2004 Symposium on ETRA, New York, NY, USA, 2004.
  • P. Hejmady and N. H. Narayanan, “Visual Attention Patterns During Program Debugging with an IDE,” in Proceedings of the 2012 Symposium on ETRA, New York, NY, USA, 2012.
  • K.-J. Räihä, A. Aula, P. Majaranta, H. Rantala and K. Koivunen, “Static Visualization of Temporal Eye-Tracking Data,” in Human-Computer Interaction - INTERACT 2005: IFIP TC13 International Conference, Rome, Italy, September 12-16, 2005. Proceedings, M. F. Costabile and F. Paternò, Eds., Berlin, Heidelberg: Springer Berlin Heidelberg, 2005, pp. 946-949.
There are 16 citations in total.

Details

Primary Language English
Subjects Computer Software
Journal Section Araştırma Articlessi
Authors

Şükrü Eraslan 0000-0002-9277-8375

Serkan Karabulut This is me 0000-0002-6694-7219

Mehmet Can Atalay This is me 0000-0002-9029-9880

Yeliz Yeşilada This is me 0000-0001-8501-0205

Publication Date October 30, 2019
Published in Issue Year 2019 Volume: 7 Issue: 4

Cite

APA Eraslan, Ş., Karabulut, S., Atalay, M. C., Yeşilada, Y. (2019). Evaluation of Visualisation of Scanpath Trend Analysis (ViSTA) Tool. Balkan Journal of Electrical and Computer Engineering, 7(4), 373-383. https://doi.org/10.17694/bajece.490601

All articles published by BAJECE are licensed under the Creative Commons Attribution 4.0 International License. This permits anyone to copy, redistribute, remix, transmit and adapt the work provided the original work and source is appropriately cited.Creative Commons Lisansı