An Examination of the Internal Validity of the Sino-Nasal Outcome Test-22 in Patients with Septal Deviation

Year 2023, Volume: 6 Issue: 2, 49 - 54, 28.08.2023

Stephen P Williams David M Hughes Samuel C Leong

Abstract

Objective: The objective of this study was to examine the construct validity of the sino-nasal outcome test-22 in the setting of patients with nasal septal deviation undergoing septoplasty.

Methods: Retrospective case note audit recording preoperative sino-nasal outcome test-22 scores in consecutive patients undergoing septoplasty. Statistical analysis considered 4 existing factor structures for the sino-nasal outcome test-22 survey, all of which emerged from its use in the context of chronic rhinosinusitis. Structural equation modeling and factor analysis were used to compare these existing models to data from this different context of septal deviation.

Results: Between January 2017 and January 2021, 115 patients completed sino-nasal outcome test-22 scores prior to undergoing septoplasty. Using confirmatory factor analysis, none of the existing conceptual frameworks could be shown to fit data from patients with septal deviation. Subsequent exploratory factor analysis showed that multiple items failed to significantly load within a 5-factor model: Nasal obstruction, Dizziness, and Frust rated /rest less/ irrit able.

Conclusion: Results suggest that sino-nasal outcome test-22 does not demonstrate internal validity when considering symptom burden in patients undergoing septoplasty and suggest caution should be exercised when considering such results as either an indication for surgery or a method of reporting postoperative outcomes. We believe that the utility of sino-nasal outcome test-22, in the setting of nasal septal deviation, would be significantly enhanced with modifications made specific to this context.

Keywords

Factor analysis , nasal airway obstruction , nasal septum , quality of life , sino-nasal outcome test

References

• Hopkins C, Gillett S, Slack R, Lund VJ, Browne JP. Psychometric validity of the 22-item sinonasal Outcome Test. Clin Otolaryngol. 2009;34(5):447-454.
• Dizdar D, Bozan A, Dizdar SK, Göde S, Alpay HC. Evaluation of nasal symptoms in septoplasty patients using SNOT-22. Acta Otorhinolaryngol Ital. 2019;39(2):98-102.
• Rennie KJ, O'Hara J, Rousseau N, et al. Nasal Airway Obstruction Study (NAI-ROS): a phase III, open-label, mixed-methods, multicentre randomised controlled trial of septoplasty versus medical management of a septal deviation with nasal obstruction. Trials. 2020;21(1):179.
• von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational studies. Br Med J. 2007;335:806-808.
• Anderson JC, Gerbing DW. The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika. 1984;49(2):155-173.
• DeConde AS, Bodner TE, Mace JC, Smith TL. Response shift in quality of life after endoscopic sinus surgery for chronic rhinosinusitis. JAMA Otolaryngol Head Neck Surg. 2014;140(8):712-719.
• Crump RT, Liu G, Janjua A, Sutherland JM. Analyzing the 22-item sino-nasal outcome test using item response theory. Int Forum Allergy Rhinol. 2016;6(9):914-920.
• Feng AL, Wesely NC, Hoehle LP, et al. A validated model for the 22-item sinonasal outcome test subdomain structure in chronic rhinosinusitis. Int Forum Allergy Rhinol. 2017;7(12):1140-1148.
• Dejaco D, Riedl D, Huber A, et al. The SNOT-22 factorial structure in European patients with chronic rhinosinusitis: new clinical insights. Eur Arch Otorhinolaryngol. 2019;276(5):1355-1365.
• Yuan KH, Bentler PM. Three likelihood‐based methods for mean and covariance structure analysis with nonnormal missing data. Sociol Methodol. 2000;30(1):165-200.
• Schreiber JB, Nora A, Stage FK, Barlow EA, King J. Reporting structural equation modeling and confirmatory factor analysis results: a review. J Educ Res. 2006;99(6):323-338.
• Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107(2):238-246
• Satorra A, Bentler PM. Corrections to test statistics and standard errors in covariance structure analysis. In: von Eye A., Clogg C.C., eds. Latent Variables Analysis: Applications for Developmental Research. Thousand Oaks, CA: Sage; 1994:399-419.
• Buckland JR, Thomas S, Harries PG. Can the sino-nasal Outcome Test (SNOT-22) be used as a reliable outcome measure for successful septal surgery? Clin Otolaryngol Allied Sci. 2003;28(1):43-47.
• Srinivasan DG, Hegde J, Ramasamy K, et al. Comparison of the efficacy of septoplasty with nonsurgical management in improving nasal obstruction in patients with deviated nasal septum–A randomized clinical trial. Int Arch Otorhinolaryngol. 2022;26(2):e226-e232.
• Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1-55.