Research Article

Developing and validating the Second Language Buoyancy Scale (L2BS): Evidence from psychometric and machine learning analyses

Volume: 13 Number: 1 January 2, 2026
  • Kenan Gao *
  • Juan Zhang
  • Yihui Wang
  • Wei He
  • Jianhong Mo
TR EN

Developing and validating the Second Language Buoyancy Scale (L2BS): Evidence from psychometric and machine learning analyses

Abstract

Given that existing academic buoyancy measures do not capture learners’ everyday capacity to cope with setbacks in the L2 learning, an L2-specific scale is needed to assess second language (L2) buoyancy. This study aimed to develop and validate the Second Language Buoyancy Scale (L2BS). Using convenience sampling, data were collected from 554 university students at two mainland Chinese institutions and randomly split into two equal subsets (n = 277 per subset). Content validity was established via qualitative item generation (17 interviews) and expert review (ICC = .83). For structural validity, EFA on Subset 1 (KMO = .826; Bartlett’s χ²(6) = 616.99, p < .001) supported a single-factor, four-item solution with loadings > .65; CFA on Subset 2 showed good fit (RMSEA = .096, CFI = .992, TLI = .977). Internal consistency was strong (Cronbach’s α = .898; McDonald’s ω = .898). Construct validity was supported by AVE = .689 and small-to-moderate correlations with academic buoyancy, growth mindset, grit, and conscientiousness. Criterion-related validity was evidenced by hierarchical regressions (incremental variance: ΔR² = .173 for L2 engagement; ΔR² = .160 for L2 enjoyment) and machine-learning models (Random Forest/XGBoost/LightGBM), in which L2BS consistently outperformed academic buoyancy (best accuracies: 73.21% for engagement; 64.29% for enjoyment). Overall, L2BS provides a brief, reliable, and valid measure of L2 buoyancy with clear utility for predicting key L2 outcomes such as L2 engagement and L2 enjoyment.

Keywords

Ethical Statement

University of Macau, SSHRE24-APP024-FED.

References

  1. Aiken, L.S., West, S.G., & Reno, R.R. (1991). Multiple regression: Testing and Interpreting Interactions. Sage.
  2. Bartlett, M.S. (1954). A note on the multiplying factors for various χ2 approximations. Journal of the Royal Statistical Society. Series B (Methodological), 16(2) 296-298.
  3. Bayrami, M., Heshmati, R., Mohammadpour, V., Gholamzadeh, M., Hasanloo, H.O., & Moslemifar, M. (2012). Happiness and willingness to communicate in three attachment styles: a study on college students. Procedia – Social and Behavioral Sciences, 46, 294 298. https://doi.org/10.1016/j.sbspro.2012.05.109
  4. Breiman, L. (2001). Random Forests. Machine Learning, 45(1), 5 32. https://doi.org/10.1023/A:1010933404324
  5. Byrne, B.M., Shavelson, R.J., & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: the issue of partial measurement invariance. Psychological Bulletin, 105(3), 456–466. https://doi.org/10.1037/0033-2909.105.3.456
  6. Chen, T., & Guestrin, C. (2016). XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 785-794). Association for Computing Machinery. https://doi.org/10.1145/2939672.2939785
  7. Clark, L.A., & Watson, D. (2016). Constructing validity: Basic issues in objective scale development. In A.E. Kazdin (Ed.), Methodological issues and strategies in clinical research (4th ed., pp. 187–203). American Psychological Association. https://doi.org/10.1037/14805-012
  8. Cohen, J., Cohen, P., West, S.G., & Aiken, L.S. (2013). Applied multiple regression/correlation analysis for the behavioral sciences. Routledge.

Details

Primary Language

English

Subjects

Measurement Theories and Applications in Education and Psychology , Psychological Methodology, Design and Analysis

Journal Section

Research Article

Publication Date

January 2, 2026

Submission Date

June 27, 2025

Acceptance Date

December 2, 2025

Published in Issue

Year 2026 Volume: 13 Number: 1

APA
Gao, K., Zhang, J., Wang, Y., He, W., & Mo, J. (2026). Developing and validating the Second Language Buoyancy Scale (L2BS): Evidence from psychometric and machine learning analyses. International Journal of Assessment Tools in Education, 13(1), 330-358. https://doi.org/10.21449/ijate.1726804

23823             23825             23824