Developing multiple evaluation frameworks in an older adults care information system project: A case study from Taiwan

Abstract

Many hospital managers agree that they can copy their successful experience in the medical center through implementing the information system (IS) successfully in the older adults care institution. However, these facilities are not the same care model as general hospitals. In addition, the scales of operation in older adults care institution are often rather small and they can not undertake IS project with a high failure risk. Thus, the same standards for evaluating a successful implementation cannot be guaranteed for both types of institutions. A suitable system evaluation framework before the whole system migrates is very important, especially in the older adults care institution with low informatization levels. The goal of this study is emphasized by developing an innovative system project and its’ multiple evaluation framework in our case which turned to be a research-action, study participant comprising whole staffs and its residents of the older adults care village of biggest health care group in Taiwan. The results describe our resulting functional design of the system, multiple evaluation framework phases, and several challenges, difficulties or attentions. The contribution of this study is our project design and practical feasibility and execution of its evaluation methodology to an older adults care institution.

Key Practitioners Message

• Introducing an information system for older adults care institution in a holistic care concept helps practitioners to improve the work effectiveness of health care teams.
• Perceptions regarding the comprehensible and practical evaluation method of the information system for the older adults’ institution might be important topics for health care professionals.
• Both personal satisfaction and organization benefit of the caregivers and residents might affect the successful implementation
  

Keywords

• Older Adults,Care Information System,System Evaluation Framework,Information System Implementation

References

1. Aggelidis, V. P., & Chatzoglou, P. D. (2009). Using a modified technology acceptance model in hospitals. International Journal of Medical Informatics, 78(2), 115-126.
2. Ammenwerth, E., & de Keizer, N. (2005). An inventory of evaluation studies of information technology in health care trends in evaluation research 1982-2002. Methods of Information in Medicine, 44(1), 44-56.
3. Ammenwerth, E., Iller, Delone, W. H., & McLean, E. R. (2003). The DeLone and McLean model of information systems success: a ten-year update. Journal of Management Information Systems, 19(4), 9-30.
4. Garcia-Smith, D., & Effken, J. A. (2013). Development and initial evaluation of the clinical information systems success model (CISSM). International Journal of Medical Informatics, 82(6), 539-552.
5. Greenhalgh, T., Potts, H. W., Wong, G., Bark, P., & Swinglehurst, D. (2009). Tensions and paradoxes in electronic patient record research: A systematic literature review using the meta-narrative method. Milbank Quarterly, 87(4), 729-788.
6. C., & Mahler, C.(2006). IT-adoption and the interaction of task, technology and individuals: A fit framework and a case study. BMC Medical Informatics and Decision Making, 6(3), 1-13.
7. Bates, D. W., Cohen, M., Leape, L. L., Overhage, J. M., Shabot, M. M., & Sheridan, T. (2001). Reducing the frequency of errors in medicine using information technology. Journal of the American Medical Informatics Association, 8(4), 299-308.
8. Berg, M. (2001). Implementing information systems in health care organizations: myths and challenges. International Journal Medical Informatics, 64(2-3), 143-156.

9. Brender, J., Ammenwerth, E., Nykänen, P., & Talmon, J. (2006). Factors Influencing Success and Failure of Health Informatics Systems: A Pilot Delphi Study. Methods of Information in Medicine, 45(1), 125-136.
10. Chang, I.-C., Chang, C.-H., Wu, J.-W., & Huang, T. C.-K. (2015). Assessing the performance of long-term care information systems and the continued use intention of users. Telematics and Informatics, 32(2), 273-281.
11. Gremy, F., Fessler, J. M, & Bonnin, M., (1999). Information systems evaluation and subjectivity. International Journal of Medical Informatics, 56(1), 13-23.
12. Hsu, H. M., Hou, Y. H., Chang, I. C., & Yen, D. C. (2009). Factors influencing computer literacy of Taiwan and South Korea nurses. Journal of Medical Systems, 33(2), 133139.
13. Hurlock-Chorostecki, C. (1999). Holistic care in the critical care setting: application of a concept through Watson’s and Orem’s theories of nursing. Canadian Association of Critical Care Nurse, 10(4), 20–25.
14. Jen, W. Y., & Chao, C. C. (2008). Measuring mobile patient safety information system success: An empirical study.. International Journal of Medical Informatics, 77(10), 689-697.
15. Kaplan, B. (2001). Evaluating informatics applications—clinical decision support systems literature review. International Journal of Medical Informatics, 64(1), 15-37.
16. Lee, T. T., Mills, M. E., Bausell, B., & Lu, M. H. (2008). Two-stage evaluation of the impact of a nursing information system in Taiwan. International Journal of Medical Informatics, 77(10), 698-707.
17. Moehr, J. R. (2002). Evaluation of health information systems: Beyond efficiency and effectiveness. Computers in Biology and Medicine, 32(3), 111-112.
18. Sinchenko, V, Westbrook, J., Tipper, S., Mathie, M., & Coiera, E. (2003). Electronic decision support activities in different healthcare settings in Australia. Electronic Decision Support for Australia’s Health Sector, National Electronic Decision Support Taskforce, Commonwealth of Australia.
19. Sittig, D. F., & Singh, H. (2010). A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Quality and Safety in Health Care, 19 Suppl 3, i68-74.
20. Tsiknakis, M., & Kouroubali, A. (2009). Organizational factors affecting successful adoption of innovative eHealth services: A case study employing the FITT framework. International Journal of Medical Informatics, 78(1), 39-52.
21. Tung, F. C., Chang, S. C., & Chou, C. M. (2008). An extension of trust and TAM model with IDT in the adoption of the electronic logistics information system in HIS in the medical industry. International Journal of Medical Informatics, 77(5), 324-335.
22. Yu, P., Li, H., & Gagnon, M. P. (2009). Health IT acceptance factors in long-term care facilities: a cross-sectional survey. International Journal of Medical Informatics, 78(4), 219-229.
23. Yusof, M. M., Papazafeiropoulou, A., Paul, R. J., & Stergioulas, L. K. (2008). Investigating evaluation frameworks for health information systems. International Journal of Medical Informatics, 77(6), 377-385.