Evaluating Non-Technical Skills of Airline Pilot Candidates Using an Analytic Hierarchy Process (AHP) Approach

Abstract

This study evaluates the non-technical skills (NOTECHS) of airline pilot candidates using the Analytical Hierarchy Process (AHP) approach. It aims to determine the importance and weighting of these skills in pilot selection processes. Nine non-technical competencies used in pilot selection within a Turkish aviation company were identified and weighted based on their importance across various flight stages (preflight, take-off, cruise, approach/landing, taxi) using the AHP technique. Scenarios based on real flight operations were evaluated by experienced flight examiners. The analysis revealed that situation awareness, problem-solving, and decision-making were the most critical non-technical skills across all phases of flight. Leadership and communication also played significant roles, while planning and professional development were less critical. As a result of the analysis, theoretical and practical suggestions in the field of aviation were presented.

Keywords

• Aviation
• Pilot selection
• Crew resource management
• Non-technical skills
• Human factors

Supporting Institution

Turkish Airlines Human Resources Assessment Center Department

Ethical Statement

The studies involving human participants were reviewed and approved by the Istanbul University Research Ethics Committee (IUREC 356/2022). The participants provided their written informed consent to participate in this study.

Thanks

This paper was derived from Seda Ceken's doctoral research titled "Analytic Hierarchy Process-Based Selection Method for Airline Pilot Candidates: A Focus on Non-Technical Skills (NOTECHS)" conducted at Istanbul University, Business School, Department of Organizational Behavior. The authors gratefully acknowledge the invaluable contributions of Turkish Airlines Company Assessment Center throughout the doctoral research process.

References

1. Airbus (2023). Airbus Global Services Forecast 2023 – 2042. Airbus.https://aircraft.airbus.com/sites/g/files/jlcbta126/files/202311/airbus_global_services_forecast_2023 _-_2042_i_press_briefing_gsf_nov_29th_0.pdf
2. Boeing (2023). Pilot and Technician Outlook 2023-2042. Boeing.https://www.boeing.com/content/dam/boeing/boeingdotcom/market/assets/downloads/2023- pto.pdf
3. Bor, R., Eriksen, C., Hubbard, T., and King, R. (2020). Pilot selection: Psychological principles and practice (1st ed.). CRC Press.
4. CAE (2023). CAE Aviation Talent Forecast 2023. CAE. https://www.cae.com/aviation-talent-forecast- 2023/en/pilot.html
5. Civil Aviation Authority (2016). Flight-crew human factors handbook. Civil Aviation Authority. https://skybrary.aero/sites/default/files/bookshelf/3199.pdf
6. Eaglestone, J., Hörmann, H.-J., Stadler, K., and Wium, J. (2022). Selection in aviation: A European Association for Aviation Psychology report. European Association for Aviation Psychology. https://www.eaap.net/get/files/10022.pdf
7. Federal Aviation Administration (FAA). (2004). Crew resource management training. U.S. Department of Transportation Advisory Circular. Retrieved from https://www.faa.gov/documentlibrary/media/advisory_circular/ac120-51e.pdf
8. Flin, R. (2010). CRM (Non-Technical) skills — Applications for and beyond the flight deck. In B. G. Kanki, R. L. Helmreich, & J. Anca (Eds.), Crew resource management (pp. 181-202). Academic Press.

9. Flin, R., O’Connor, P., and Crichton, M. (2008). Safety at the sharp end: A guide to non-technical skills. CRC Press.
10. General Directorate of Civil Aviation (2024). Flight Examiner (FE). DGCA. https://web.shgm.gov.tr/en/preview/2107-flight-examiner-fe
11. Goeters, K. M., Maschke, P., and Eißfeldt, H. (2004). Ability requirements in core aviation professions: Job analysis of airline pilots and air traffic controllers. Aviation psychology: Practice and research, 99-119.
12. Gontar, P., Hoermann, H., and Haslbeck, A. (2014). How pilots assess their non-technical performance - A flight simulator study. In Proceedings of the 5th International Conference on Applied Human Factors and Ergonomics (AHFE), Krakow, Poland.
13. Hedge, P., and Kriwoken, L. K. (2000). Evidence for effects of Spartina anglica invasion on benthic macrofauna in Little Swanport estuary, Tasmania. Austral Ecology, 25(2), 150-159.
14. Helmreich, R. L., Merritt, A. C., and Wilhelm, J. A. (1999). The evolution of crew resource management training in commercial aviation. International Journal of Aviation Psychology, 9(1), 19-32.
15. Helmreich, R., and Foushee, C. (2019). Why CRM? Empirical and theoretical bases of human factors training. In B. G. Kanki, J. Anca, & T. R. Chidester (Eds.), Crew resource management (pp. 3-52). Academic Press.
16. Hoermann, H. J., and Goerke, P. (2014). Assessment of social competence for pilot selection. The International Journal of Aviation Psychology, 24(1), 6-28.
17. Hörmann, H. J., Stadler, K., and Wium, J. (2022). Common practices of psychological selection of aviation personnel in Europe. Transportation research procedia, 66, 8-15.
18. Hunter, D. R. (1995). Airman research questionnaire: Methodology and overall results (Final Report). Retrieved from https://www.researchgate.net/ publication/235173778_Airman_Research_Questionnaire_Methodology_and_Overall_Results
19. ICAO (2013). Manual of Evidence-based Training. ICAO Doc 9995. https://store.icao.int/en/manual-of- evidence-based-training-doc-9995
20. International Air Transport Association (IATA) (2021). Loss of Control In-flight (LOC-I). IATA. https://www.iata.org/en/programs/safety/operational-safety/loss-of-control-inflight/
21. International Air Transport Association (IATA) (2023). Competency Assessment and Evaluation for Pilots, Instructors and Evaluators. IATA Guidance Material. https://www.iata.org/contentassets/c0f61fc821dc4f62bb6441d7abedb076/competency-assessment-and- evaluation-for-pilots-instructors-and-evaluators-gm.pdf
22. International Air Transport Association (IATA) (2020). Cabin operations safety best practices guide (6th ed.). International Air Transport Association. ISBN 978-92-9264-035-4.
23. International Air Transport Association (IATA) (2019, December 20). Pilot aptitude testing guidance material and best practices. International Air Transport Association. https://www.iata.org/contentassets/ 19f9168ecf584fc7b4af8d6d1e35c769/pilot-aptitude-testing-guide.pdf
24. Kaya, M., and Ateş, S. S. (2023). The Share of Communication Errors in Aircraft Accidents and Artificial Intelligences That Can Be Developed Based on Communication in Aviation. International Journal of Entrepreneurship and Management Inquiries, 7(12), 82-95.
25. Lenné, M. G., Ashby, K., and Fitzharris, M. (2008). Analysis of general aviation crashes in Australia using the human factors analysis and classification system. The International Journal of Aviation Psychology, 18(4), 340-352.
26. Li, G., Baker, S. P., Grabowski, J. G., and Rebok, G. W. (2001). Factors associated with pilot error in aviation crashes. Aviation, space, and environmental medicine, 72(1), 52-58.
27. Mansikka, H., Harris, D., and Virtanen, K. (2017). An input process-output model of pilot core competencies. Aviation Psychology and Applied Human Factors, 11(2), 78-85.
28. Mızrak, F. (2023). Evaluation of non-type rated pilot selection criteria in the civil aviation industry with AHP and TOPSIS methods. Research Journal of Business and Management, 10(1), 1-11.
29. National Transportation Safety Board (NTSB). (1989). General aviation accidents involving visual flight rules flight into instrument meteorological conditions (NTSB/SR-89/01). Retrieved from http://libraryonline.erau.edu/online-full-text/ntsb/safety-reports/SR89-01.pdf
30. National Transportation Safety Board (NTSB). (2010). Loss of thrust in both engines after encountering a flock of birds and subsequent ditching on the Hudson River, US Airways Flight 1549, Airbus A320-214, N106US, Weehawken, New Jersey (Aircraft Accident Report). Retrieved from https://www.ntsb.gov/investigations/ Accident Reports/Reports/AAR1003.pdf
31. Oktal, H., and Onrat, A. (2020). Analytic hierarchy process–based selection method for airline pilot candidates. The International Journal of Aerospace Psychology, 30(3-4), 268-281.
32. Oster, C. V., Strong, J. S., and Zorn, K. (2010, March 11-13). Why airplanes crash: causes of accidents worldwide. [Conference presentation]. 51st Annual Transportation Research Forum, Arlington, Virginia.
33. Prince, C., and Salas, E. (1993). Training and research for teamwork in the military aircrew. In E. L. Wiener, B. G. Kanki, & R. L. Helmreich (Eds.), Cockpit resource management (pp. 337-366).
34. Ruff-Stahl, H. J. K., Vogel, D., Dmoch, N., Krause, A., Strobl, A., Farsch, D., and Stehr, R. (2016). Measuring CRM aptitude: is NOTECHS a suitable tool for pilot selection? International Journal of Aviation, Aeronautics, and Aerospace, 3(3), 4.
35. Salas, E., DiazGranados, D., Weaver, S. J., and King, H. (2008). Does team training work? Principles for health care. Academic Emergency Medicine, 15(11), 1002-1009.
36. Sexton, J. B., Thomas, E. J., and Helmreich, R. L. (2000). Error, stress, and teamwork in medicine and aviation: cross sectional surveys. Bmj, 320(7237), 745-749.
37. Shook, R., Bandiero, M., Coello, J. P., Garland, D. J., and Endsley, M. R. (2000). Situation awareness problems in general aviation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 44(1), 185-188.
38. Şimşek, H., Özaslan, İ. H., and Eryılmaz, İ. (2022). Pilot selection in airline organizations with the analytical hierarchy process. Journal of Aviation, 6(2), 218-227.
39. Tuncal, A., & Çinar, E. (2024). A Scale Development Study For Evaluating The Competency Perception of Air Traffic Controllers. International Journal of Aviation, Aeronautics, and Aerospace, 11(3).
40. Wiegmann, D., Faaborg, T., Boquet, A., Detwiler, C., Holcomb, K., and Shappell, S. (2005). Human error and general aviation accidents: A comprehensive, fine-grained analysis using HFACS.
41. Yazgan, E., and Erol, D. (2016). Sivil Pilot Adayları İçin Seçim Kriterlerinin Belirlenmesi. Niğde Ömer Halisdemir Üniversitesi Mühendislik Bilimleri Dergisi, 5(2), 97-104.
42. Yazgan, E., and Üstün, A. K. (2011). Application of analytic network process: weighting of selection criteria for civil pilots. Journal of Aeronautics and Space Technologies, 5(2), 1-12.
43. Zinn, F., Goerke, P., and Marggraf-Micheel, C. (2019). Selecting for cockpit crew. In R. Bor, C. Eriksen, T. P. Hubbard, & R. King (Eds.), Pilot selection: Psychological principles and practice (pp. 21-34). CRC Press.