Evaluating Non-Technical Skills of Airline Pilot Candidates Using an Analytic Hierarchy Process (AHP) Approach
Year 2025,
Volume: 9 Issue: 1, 207 - 215, 26.02.2025
Seda Çeken
,
Aslı Beyhan Acar
Abstract
This study evaluates the non-technical skills (NOTECHS) of airline pilot candidates using the Analytical Hierarchy Process (AHP) approach. It aims to determine the importance and weighting of these skills in pilot selection processes. Nine non-technical competencies used in pilot selection within a Turkish aviation company were identified and weighted based on their importance across various flight stages (preflight, take-off, cruise, approach/landing, taxi) using the AHP technique. Scenarios based on real flight operations were evaluated by experienced flight examiners. The analysis revealed that situation awareness, problem-solving, and decision-making were the most critical non-technical skills across all phases of flight. Leadership and communication also played significant roles, while planning and professional development were less critical. As a result of the analysis, theoretical and practical suggestions in the field of aviation were presented.
Ethical Statement
The studies involving human participants were reviewed and approved by the Istanbul University Research Ethics Committee (IUREC 356/2022). The participants provided their written informed consent to participate in this study.
Supporting Institution
Turkish Airlines Human Resources Assessment Center Department
Thanks
This paper was derived from Seda Ceken's doctoral research titled "Analytic Hierarchy Process-Based Selection Method for Airline Pilot Candidates: A Focus on Non-Technical Skills (NOTECHS)" conducted at Istanbul University, Business School, Department of Organizational Behavior. The authors gratefully acknowledge the invaluable contributions of Turkish Airlines Company Assessment Center throughout the doctoral research process.
References
- Airbus (2023). Airbus Global Services Forecast 2023 – 2042.
Airbus.https://aircraft.airbus.com/sites/g/files/jlcbta126/files/202311/airbus_global_services_forecast_2023
_-_2042_i_press_briefing_gsf_nov_29th_0.pdf
- Boeing (2023). Pilot and Technician Outlook 2023-2042.
Boeing.https://www.boeing.com/content/dam/boeing/boeingdotcom/market/assets/downloads/2023-
pto.pdf
- Bor, R., Eriksen, C., Hubbard, T., and King, R. (2020). Pilot selection: Psychological principles and practice (1st
ed.). CRC Press.
- CAE (2023). CAE Aviation Talent Forecast 2023. CAE. https://www.cae.com/aviation-talent-forecast-
2023/en/pilot.html
- Civil Aviation Authority (2016). Flight-crew human factors handbook. Civil Aviation Authority.
https://skybrary.aero/sites/default/files/bookshelf/3199.pdf
- Eaglestone, J., Hörmann, H.-J., Stadler, K., and Wium, J. (2022). Selection in aviation: A European Association
for Aviation Psychology report. European Association for Aviation Psychology.
https://www.eaap.net/get/files/10022.pdf
- Federal Aviation Administration (FAA). (2004). Crew resource management training. U.S. Department of
Transportation Advisory Circular. Retrieved from
https://www.faa.gov/documentlibrary/media/advisory_circular/ac120-51e.pdf
- Flin, R. (2010). CRM (Non-Technical) skills — Applications for and beyond the flight deck. In B. G. Kanki, R. L.
Helmreich, & J. Anca (Eds.), Crew resource management (pp. 181-202). Academic Press.
- Flin, R., O’Connor, P., and Crichton, M. (2008). Safety at the sharp end: A guide to non-technical skills. CRC
Press.
- General Directorate of Civil Aviation (2024). Flight Examiner (FE). DGCA.
https://web.shgm.gov.tr/en/preview/2107-flight-examiner-fe
- Goeters, K. M., Maschke, P., and Eißfeldt, H. (2004). Ability requirements in core aviation professions: Job
analysis of airline pilots and air traffic controllers. Aviation psychology: Practice and research, 99-119.
- Gontar, P., Hoermann, H., and Haslbeck, A. (2014). How pilots assess their non-technical performance - A flight
simulator study. In Proceedings of the 5th International Conference on Applied Human Factors and
Ergonomics (AHFE), Krakow, Poland.
- Hedge, P., and Kriwoken, L. K. (2000). Evidence for effects of Spartina anglica invasion on benthic macrofauna
in Little Swanport estuary, Tasmania. Austral Ecology, 25(2), 150-159.
- Helmreich, R. L., Merritt, A. C., and Wilhelm, J. A. (1999). The evolution of crew resource management training in
commercial aviation. International Journal of Aviation Psychology, 9(1), 19-32.
- Helmreich, R., and Foushee, C. (2019). Why CRM? Empirical and theoretical bases of human factors training. In
B. G. Kanki, J. Anca, & T. R. Chidester (Eds.), Crew resource management (pp. 3-52). Academic Press.
- Hoermann, H. J., and Goerke, P. (2014). Assessment of social competence for pilot selection. The International
Journal of Aviation Psychology, 24(1), 6-28.
- Hörmann, H. J., Stadler, K., and Wium, J. (2022). Common practices of psychological selection of aviation
personnel in Europe. Transportation research procedia, 66, 8-15.
- Hunter, D. R. (1995). Airman research questionnaire: Methodology and overall results (Final Report). Retrieved
from https://www.researchgate.net/
publication/235173778_Airman_Research_Questionnaire_Methodology_and_Overall_Results
- ICAO (2013). Manual of Evidence-based Training. ICAO Doc 9995. https://store.icao.int/en/manual-of-
evidence-based-training-doc-9995
- International Air Transport Association (IATA) (2021). Loss of Control In-flight (LOC-I). IATA.
https://www.iata.org/en/programs/safety/operational-safety/loss-of-control-inflight/
- International Air Transport Association (IATA) (2023). Competency Assessment and Evaluation for Pilots,
Instructors and Evaluators. IATA Guidance Material.
https://www.iata.org/contentassets/c0f61fc821dc4f62bb6441d7abedb076/competency-assessment-and-
evaluation-for-pilots-instructors-and-evaluators-gm.pdf
- International Air Transport Association (IATA) (2020). Cabin operations safety best practices guide (6th ed.).
International Air Transport Association. ISBN 978-92-9264-035-4.
- International Air Transport Association (IATA) (2019, December 20). Pilot aptitude testing guidance material
and best practices. International Air Transport Association. https://www.iata.org/contentassets/
19f9168ecf584fc7b4af8d6d1e35c769/pilot-aptitude-testing-guide.pdf
- Kaya, M., and Ateş, S. S. (2023). The Share of Communication Errors in Aircraft Accidents and Artificial
Intelligences That Can Be Developed Based on Communication in Aviation. International Journal of
Entrepreneurship and Management Inquiries, 7(12), 82-95.
- Lenné, M. G., Ashby, K., and Fitzharris, M. (2008). Analysis of general aviation crashes in Australia using the
human factors analysis and classification system. The International Journal of Aviation Psychology, 18(4),
340-352.
- Li, G., Baker, S. P., Grabowski, J. G., and Rebok, G. W. (2001). Factors associated with pilot error in aviation
crashes. Aviation, space, and environmental medicine, 72(1), 52-58.
- Mansikka, H., Harris, D., and Virtanen, K. (2017). An input process-output model of pilot core competencies.
Aviation Psychology and Applied Human Factors, 11(2), 78-85.
- Mızrak, F. (2023). Evaluation of non-type rated pilot selection criteria in the civil aviation industry with AHP and
TOPSIS methods. Research Journal of Business and Management, 10(1), 1-11.
- National Transportation Safety Board (NTSB). (1989). General aviation accidents involving visual flight rules
flight into instrument meteorological conditions (NTSB/SR-89/01). Retrieved from
http://libraryonline.erau.edu/online-full-text/ntsb/safety-reports/SR89-01.pdf
- National Transportation Safety Board (NTSB). (2010). Loss of thrust in both engines after encountering a flock
of birds and subsequent ditching on the Hudson River, US Airways Flight 1549, Airbus A320-214, N106US,
Weehawken, New Jersey (Aircraft Accident Report). Retrieved from https://www.ntsb.gov/investigations/
Accident Reports/Reports/AAR1003.pdf
- Oktal, H., and Onrat, A. (2020). Analytic hierarchy process–based selection method for airline pilot
candidates. The International Journal of Aerospace Psychology, 30(3-4), 268-281.
- Oster, C. V., Strong, J. S., and Zorn, K. (2010, March 11-13). Why airplanes crash: causes of accidents worldwide.
[Conference presentation]. 51st Annual Transportation Research Forum, Arlington, Virginia.
- Prince, C., and Salas, E. (1993). Training and research for teamwork in the military aircrew. In E. L. Wiener, B. G.
Kanki, & R. L. Helmreich (Eds.), Cockpit resource management (pp. 337-366).
- Ruff-Stahl, H. J. K., Vogel, D., Dmoch, N., Krause, A., Strobl, A., Farsch, D., and Stehr, R. (2016). Measuring CRM
aptitude: is NOTECHS a suitable tool for pilot selection? International Journal of Aviation, Aeronautics, and
Aerospace, 3(3), 4.
- Salas, E., DiazGranados, D., Weaver, S. J., and King, H. (2008). Does team training work? Principles for health
care. Academic Emergency Medicine, 15(11), 1002-1009.
- Sexton, J. B., Thomas, E. J., and Helmreich, R. L. (2000). Error, stress, and teamwork in medicine and aviation:
cross sectional surveys. Bmj, 320(7237), 745-749.
- Shook, R., Bandiero, M., Coello, J. P., Garland, D. J., and Endsley, M. R. (2000). Situation awareness problems in
general aviation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 44(1), 185-188.
- Şimşek, H., Özaslan, İ. H., and Eryılmaz, İ. (2022). Pilot selection in airline organizations with the analytical
hierarchy process. Journal of Aviation, 6(2), 218-227.
- Tuncal, A., & Çinar, E. (2024). A Scale Development Study For Evaluating The Competency Perception of Air
Traffic Controllers. International Journal of Aviation, Aeronautics, and Aerospace, 11(3).
- Wiegmann, D., Faaborg, T., Boquet, A., Detwiler, C., Holcomb, K., and Shappell, S. (2005). Human error and
general aviation accidents: A comprehensive, fine-grained analysis using HFACS.
- Yazgan, E., and Erol, D. (2016). Sivil Pilot Adayları İçin Seçim Kriterlerinin Belirlenmesi. Niğde Ömer Halisdemir
Üniversitesi Mühendislik Bilimleri Dergisi, 5(2), 97-104.
- Yazgan, E., and Üstün, A. K. (2011). Application of analytic network process: weighting of selection criteria for
civil pilots. Journal of Aeronautics and Space Technologies, 5(2), 1-12.
- Zinn, F., Goerke, P., and Marggraf-Micheel, C. (2019). Selecting for cockpit crew. In R. Bor, C. Eriksen, T. P.
Hubbard, & R. King (Eds.), Pilot selection: Psychological principles and practice (pp. 21-34). CRC Press.
Year 2025,
Volume: 9 Issue: 1, 207 - 215, 26.02.2025
Seda Çeken
,
Aslı Beyhan Acar
References
- Airbus (2023). Airbus Global Services Forecast 2023 – 2042.
Airbus.https://aircraft.airbus.com/sites/g/files/jlcbta126/files/202311/airbus_global_services_forecast_2023
_-_2042_i_press_briefing_gsf_nov_29th_0.pdf
- Boeing (2023). Pilot and Technician Outlook 2023-2042.
Boeing.https://www.boeing.com/content/dam/boeing/boeingdotcom/market/assets/downloads/2023-
pto.pdf
- Bor, R., Eriksen, C., Hubbard, T., and King, R. (2020). Pilot selection: Psychological principles and practice (1st
ed.). CRC Press.
- CAE (2023). CAE Aviation Talent Forecast 2023. CAE. https://www.cae.com/aviation-talent-forecast-
2023/en/pilot.html
- Civil Aviation Authority (2016). Flight-crew human factors handbook. Civil Aviation Authority.
https://skybrary.aero/sites/default/files/bookshelf/3199.pdf
- Eaglestone, J., Hörmann, H.-J., Stadler, K., and Wium, J. (2022). Selection in aviation: A European Association
for Aviation Psychology report. European Association for Aviation Psychology.
https://www.eaap.net/get/files/10022.pdf
- Federal Aviation Administration (FAA). (2004). Crew resource management training. U.S. Department of
Transportation Advisory Circular. Retrieved from
https://www.faa.gov/documentlibrary/media/advisory_circular/ac120-51e.pdf
- Flin, R. (2010). CRM (Non-Technical) skills — Applications for and beyond the flight deck. In B. G. Kanki, R. L.
Helmreich, & J. Anca (Eds.), Crew resource management (pp. 181-202). Academic Press.
- Flin, R., O’Connor, P., and Crichton, M. (2008). Safety at the sharp end: A guide to non-technical skills. CRC
Press.
- General Directorate of Civil Aviation (2024). Flight Examiner (FE). DGCA.
https://web.shgm.gov.tr/en/preview/2107-flight-examiner-fe
- Goeters, K. M., Maschke, P., and Eißfeldt, H. (2004). Ability requirements in core aviation professions: Job
analysis of airline pilots and air traffic controllers. Aviation psychology: Practice and research, 99-119.
- Gontar, P., Hoermann, H., and Haslbeck, A. (2014). How pilots assess their non-technical performance - A flight
simulator study. In Proceedings of the 5th International Conference on Applied Human Factors and
Ergonomics (AHFE), Krakow, Poland.
- Hedge, P., and Kriwoken, L. K. (2000). Evidence for effects of Spartina anglica invasion on benthic macrofauna
in Little Swanport estuary, Tasmania. Austral Ecology, 25(2), 150-159.
- Helmreich, R. L., Merritt, A. C., and Wilhelm, J. A. (1999). The evolution of crew resource management training in
commercial aviation. International Journal of Aviation Psychology, 9(1), 19-32.
- Helmreich, R., and Foushee, C. (2019). Why CRM? Empirical and theoretical bases of human factors training. In
B. G. Kanki, J. Anca, & T. R. Chidester (Eds.), Crew resource management (pp. 3-52). Academic Press.
- Hoermann, H. J., and Goerke, P. (2014). Assessment of social competence for pilot selection. The International
Journal of Aviation Psychology, 24(1), 6-28.
- Hörmann, H. J., Stadler, K., and Wium, J. (2022). Common practices of psychological selection of aviation
personnel in Europe. Transportation research procedia, 66, 8-15.
- Hunter, D. R. (1995). Airman research questionnaire: Methodology and overall results (Final Report). Retrieved
from https://www.researchgate.net/
publication/235173778_Airman_Research_Questionnaire_Methodology_and_Overall_Results
- ICAO (2013). Manual of Evidence-based Training. ICAO Doc 9995. https://store.icao.int/en/manual-of-
evidence-based-training-doc-9995
- International Air Transport Association (IATA) (2021). Loss of Control In-flight (LOC-I). IATA.
https://www.iata.org/en/programs/safety/operational-safety/loss-of-control-inflight/
- International Air Transport Association (IATA) (2023). Competency Assessment and Evaluation for Pilots,
Instructors and Evaluators. IATA Guidance Material.
https://www.iata.org/contentassets/c0f61fc821dc4f62bb6441d7abedb076/competency-assessment-and-
evaluation-for-pilots-instructors-and-evaluators-gm.pdf
- International Air Transport Association (IATA) (2020). Cabin operations safety best practices guide (6th ed.).
International Air Transport Association. ISBN 978-92-9264-035-4.
- International Air Transport Association (IATA) (2019, December 20). Pilot aptitude testing guidance material
and best practices. International Air Transport Association. https://www.iata.org/contentassets/
19f9168ecf584fc7b4af8d6d1e35c769/pilot-aptitude-testing-guide.pdf
- Kaya, M., and Ateş, S. S. (2023). The Share of Communication Errors in Aircraft Accidents and Artificial
Intelligences That Can Be Developed Based on Communication in Aviation. International Journal of
Entrepreneurship and Management Inquiries, 7(12), 82-95.
- Lenné, M. G., Ashby, K., and Fitzharris, M. (2008). Analysis of general aviation crashes in Australia using the
human factors analysis and classification system. The International Journal of Aviation Psychology, 18(4),
340-352.
- Li, G., Baker, S. P., Grabowski, J. G., and Rebok, G. W. (2001). Factors associated with pilot error in aviation
crashes. Aviation, space, and environmental medicine, 72(1), 52-58.
- Mansikka, H., Harris, D., and Virtanen, K. (2017). An input process-output model of pilot core competencies.
Aviation Psychology and Applied Human Factors, 11(2), 78-85.
- Mızrak, F. (2023). Evaluation of non-type rated pilot selection criteria in the civil aviation industry with AHP and
TOPSIS methods. Research Journal of Business and Management, 10(1), 1-11.
- National Transportation Safety Board (NTSB). (1989). General aviation accidents involving visual flight rules
flight into instrument meteorological conditions (NTSB/SR-89/01). Retrieved from
http://libraryonline.erau.edu/online-full-text/ntsb/safety-reports/SR89-01.pdf
- National Transportation Safety Board (NTSB). (2010). Loss of thrust in both engines after encountering a flock
of birds and subsequent ditching on the Hudson River, US Airways Flight 1549, Airbus A320-214, N106US,
Weehawken, New Jersey (Aircraft Accident Report). Retrieved from https://www.ntsb.gov/investigations/
Accident Reports/Reports/AAR1003.pdf
- Oktal, H., and Onrat, A. (2020). Analytic hierarchy process–based selection method for airline pilot
candidates. The International Journal of Aerospace Psychology, 30(3-4), 268-281.
- Oster, C. V., Strong, J. S., and Zorn, K. (2010, March 11-13). Why airplanes crash: causes of accidents worldwide.
[Conference presentation]. 51st Annual Transportation Research Forum, Arlington, Virginia.
- Prince, C., and Salas, E. (1993). Training and research for teamwork in the military aircrew. In E. L. Wiener, B. G.
Kanki, & R. L. Helmreich (Eds.), Cockpit resource management (pp. 337-366).
- Ruff-Stahl, H. J. K., Vogel, D., Dmoch, N., Krause, A., Strobl, A., Farsch, D., and Stehr, R. (2016). Measuring CRM
aptitude: is NOTECHS a suitable tool for pilot selection? International Journal of Aviation, Aeronautics, and
Aerospace, 3(3), 4.
- Salas, E., DiazGranados, D., Weaver, S. J., and King, H. (2008). Does team training work? Principles for health
care. Academic Emergency Medicine, 15(11), 1002-1009.
- Sexton, J. B., Thomas, E. J., and Helmreich, R. L. (2000). Error, stress, and teamwork in medicine and aviation:
cross sectional surveys. Bmj, 320(7237), 745-749.
- Shook, R., Bandiero, M., Coello, J. P., Garland, D. J., and Endsley, M. R. (2000). Situation awareness problems in
general aviation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 44(1), 185-188.
- Şimşek, H., Özaslan, İ. H., and Eryılmaz, İ. (2022). Pilot selection in airline organizations with the analytical
hierarchy process. Journal of Aviation, 6(2), 218-227.
- Tuncal, A., & Çinar, E. (2024). A Scale Development Study For Evaluating The Competency Perception of Air
Traffic Controllers. International Journal of Aviation, Aeronautics, and Aerospace, 11(3).
- Wiegmann, D., Faaborg, T., Boquet, A., Detwiler, C., Holcomb, K., and Shappell, S. (2005). Human error and
general aviation accidents: A comprehensive, fine-grained analysis using HFACS.
- Yazgan, E., and Erol, D. (2016). Sivil Pilot Adayları İçin Seçim Kriterlerinin Belirlenmesi. Niğde Ömer Halisdemir
Üniversitesi Mühendislik Bilimleri Dergisi, 5(2), 97-104.
- Yazgan, E., and Üstün, A. K. (2011). Application of analytic network process: weighting of selection criteria for
civil pilots. Journal of Aeronautics and Space Technologies, 5(2), 1-12.
- Zinn, F., Goerke, P., and Marggraf-Micheel, C. (2019). Selecting for cockpit crew. In R. Bor, C. Eriksen, T. P.
Hubbard, & R. King (Eds.), Pilot selection: Psychological principles and practice (pp. 21-34). CRC Press.