COMPARATIVE PREDICTIVE MODELLING OF TECHNOLOGY-INDUCED LABOUR MARKET DYNAMICS USING XGBOOST AND LIGHTGBM MODELS
Abstract
Purpose- Rapid advances in industrial automation, artificial intelligence, and digital production technologies are transforming labour market structures worldwide, intensifying concerns related to job displacement, occupational vulnerability, and regional inequality. This study aims to forecast technology-induced labour market dynamics using an interpretable and policy-relevant machine-learning framework. Methodology- The study develops an interpretable predictive modelling framework based on a large-scale, harmonized panel dataset comprising 68,882 occupation–region–year observations spanning the period 2010–2023. The dataset integrates labour-force microdata, task-based automation risk indicators, occupational characteristics, and macroeconomic control variables across multiple economies. Two state-of-the-art gradient-boosting algorithms—XGBoost and LightGBM—are trained and evaluated using temporally consistent cross- validation. Model performance is assessed using Root Mean Squared Error (RMSE) and the coefficient of determination (R²), while model interpretability is achieved through SHapley Additive exPlanations (SHAP). Findings- Empirical results indicate that XGBoost substantially outperforms LightGBM, achieving a lower RMSE (2,304.76) and a higher R² (0.9325), compared to LightGBM’s RMSE of 6,017.03 and R² of 0.5398. These results demonstrate XGBoost’s superior ability to capture nonlinear relationships and heterogeneous automation effects across occupations and regions. Conclusion- SHAP-based interpretability analysis identifies task repetitiveness, physical proximity, and cognitive complexity as the most influential drivers of automation-related labour market vulnerability. Scenario-based simulations further reveal that targeted policy interventions—such as reskilling programmes and workforce transition support—can significantly reduce projected job displacement, particularly among mid-risk occupations. Overall, the findings confirm that interpretable gradient-boosting models provide a robust and policy-relevant tool for forecasting automation-driven labour market dynamics and supporting evidence-based workforce planning in economies undergoing rapid technological transformation.
Keywords
References
- Acemoglu, D., & Restrepo, P. (2020). Robots and jobs: Evidence from U.S. labor markets. Journal of Political Economy, 128(6), 2188–2244. https://doi.org/10.1086/705716
- Acemoglu, D., & Restrepo, P. (2022). Tasks, automation, and the rise in U.S. wage inequality. Econometrica, 90(5), 1973–2016. https://doi.org/10.3982/ECTA19815
- Arik, S. Ö., & Pfister, T. (2021). TabNet: Attentive interpretable tabular learning. Proceedings of the AAAI Conference on Artificial Intelligence, 35(8), 6679–6687. https://doi.org/10.1609/aaai.v35i8.16826
- Athey, S., & Imbens, G. W. (2019). Machine learning methods that economists should know about. Annual Review of Economics, 11, 685– 725. https://doi.org/10.1146/annurev-economics-080217-053433
- Autor, D. H. (2015). Why are there still so many jobs? The history and future of workplace automation. Journal of Economic Perspectives, 29(3), 3–30. https://doi.org/10.1257/jep.29.3.3
- Autor, D. H., Levy, F., & Murnane, R. J. (2003). The skill content of recent technological change: An empirical exploration. The Quarterly Journal of Economics, 118(4), 1279–1333. https://doi.org/10.1162/003355303322552801
- Autor, D. H., Mindell, D. A., & Reynolds, E. (2023). The work of the future: Building better jobs in an age of intelligent machines. MIT Press.
- Autor, D. H., & Salomons, A. (2018). Is automation labor-displacing? Productivity growth, employment, and the labor share. In D. H. Autor (Ed.), Brookings Papers on Economic Activity, Spring 2018 (pp. 1–87). Brookings Institution. https://www.brookings.edu/wp- content/uploads/2018/03/1_autorsalomons.pdf
Details
Primary Language
English
Subjects
Industrial Marketing
Journal Section
Research Article
Authors
Lawrence Farinola
0009-0004-5480-2137
Kuzey Kıbrıs Türk Cumhuriyeti
Publication Date
June 30, 2026
Submission Date
June 11, 2026
Acceptance Date
June 30, 2026
Published in Issue
Year 2026 Volume: 15 Number: 1