Residual-based efficient and powerful independence testing in multivariate isotonic semiparametric nonlinear regression

Abstract

We study residual-based independence testing in multivariate isotonic semiparametric nonlinear regression models, where the regression function combines a finite-dimensional nonlinear parametric component with an infinite-dimensional shape-constrained isotonic component. A key assumption is the independence between regression errors and joint covariates, whose violation may indicate model misspecification or hidden dependence. To assess this assumption, we propose two residual-based nonparametric diagnostic procedures based on distance covariance and the Bergsma-Dassios $\tau^*$ statistic. The former detects general nonlinear dependence, while the latter provides a rank-based robust alternative. Estimation is performed using an alternating least squares algorithm that combines nonlinear least squares and multivariate isotonic regression. We establish convergence of the algorithm, derive joint asymptotic representations for the estimators, and show that the plug-in effect of estimated residuals is asymptotically negligible. The asymptotic behavior of the tests is investigated under the null hypothesis and contiguous local alternatives, and large-sample power functions, along with Pitman and Bahadur efficiencies, are obtained. Simulation studies demonstrate accurate size control and strong power under a variety of dependence structures, including heavy-tailed, heteroscedastic, and contaminated settings. Distance covariance generally exhibits higher sensitivity under smooth nonlinear alternatives, whereas $\tau^*$ shows greater robustness to outliers and heavy-tailed errors. A real-data analysis using the Boston Housing dataset illustrates the practical applicability of the proposed methodology. The resulting framework provides a theoretically grounded and computationally efficient approach for model adequacy assessment in shape-constrained semiparametric nonlinear regression.

Keywords

• asymptotic power
• Bahadur efficiency
• isotonic regression
• semiparametric nonlinear regression
• Pitman efficiency.

Ethical Statement

This study does not involve any human participants or animals. Hence, ethical approval was not required.

Thanks

The author thanks Brainware University, India, for providing the necessary academic support for this research.

References

1. [1] M. Banerjee and J. A. Wellner, Likelihood ratio tests for monotone functions, The Annals of Statistics 29, 1699–1731, 2001.
2. [2] R. E. Barlow, D. J. Bartholomew, J. M. Bremner and H. D. Brunk, Statistical Inference under Order Restrictions, Wiley, New York, 1972.
3. [3] W. Bergsma and A. Dassios, A consistent test of independence based on a sign covariance related to Kendall’s tau, Bernoulli 20 (2), 1006–1028, 2014.
4. [4] P. J. Bickel, C. A. J. Klaassen, Y. Ritov and J. A. Wellner, Efficient and Adaptive Estimation for Semiparametric Models, Johns Hopkins University Press, Baltimore, 1993.
5. [5] S. S. Dhar, A. Dassios and W. Bergsma, A study of the power and robustness of a new test for independence against contiguous alternatives, Electronic Journal of Statistics 10 (1), 330–351, 2016.
6. [6] Ł. Delong and M. V. Wüthrich, Isotonic regression for variance estimation and its role in mean estimation and model validation, North American Actuarial Journal, 2024. doi:10.1080/10920277.2024.2421221.
7. [7] H. Dette, N. Neumeyer and I. Van Keilegom, A new test for the parametric form of the variance function in nonparametric regression, Journal of the Royal Statistical Society, Series B 69, 903–917, 2007.
8. [8] D. Edelmann, T. Welchowski and A. Benner, A consistent version of distance covariance for right-censored survival data and its application in hypothesis testing, Biometrics 78 (3), 867–879, 2022.

9. [9] F. Ferraccioli, L. M. Sangalli and L. Finos, Nonparametric tests for semiparametric regression models, TEST 32 (3), 1106–1130, 2023.
10. [10] A. Gretton, O. Bousquet, A. Smola and B. Schölkopf, Measuring statistical dependence with Hilbert–Schmidt norms, in: Proceedings of the International Conference on Algorithmic Learning Theory, 63–77, Springer, Berlin, 2005.
11. [11] P. Groeneboom and G. Jongbloed, Nonparametric Estimation under Shape Constraints, Cambridge University Press, Cambridge, 2014.
12. [12] W. Härdle, M. Müller, S. Sperlich and A. Werwatz, Nonparametric and Semiparametric Models, Springer, Berlin, 2004.
13. [13] A. Henzi and M. Law, A rank-based sequential test of independence, Biometrika 111 (4), 1169–1186, 2024.
14. [14] C. Huang and X. Huo, A statistically and numerically efficient independence test based on random projections and distance covariance, Frontiers in Applied Mathematics and Statistics 7, 779841, 2022.
15. [15] E. V. Khmaladze and H. L. Koul, Martingale transforms goodness-of-fit tests in regression models, The Annals of Statistics 32, 995–1034, 2004.
16. [16] H. Kosugi, K. Naito and S. Penev, Semiparametric regression with localized Bregman divergence, Scandinavian Journal of Statistics 52 (3), 1330–1375, 2025.
17. [17] E. Lapenta, A bootstrap specification test for semiparametric models with generated regressors, arXiv:2212.11112 [stat.ME], 2022.
18. [18] Z. Li, T. Ding, T. Zhou and Y. Zhang, Enhanced HSIC for independence test via projection integration, Journal of Multivariate Analysis 210, 105485, 2025.
19. [19] M. M. Müller, H. W. J. Reeve, T. I. Cannings and R. J. Samworth, Isotonic subgroup selection, Journal of the Royal Statistical Society: Series B (Statistical Methodology) 87 (1), 132–156, 2025. doi:10.1093/jrsssb/qkae083.
20. [20] P. Nandy, L. Weihs and M. Drton, Large-sample theory for the Bergsma–Dassios sign covariance, Electronic Journal of Statistics 10 (2), 2287–2311, 2016.
21. [21] S. Panda, C. Shen, R. Perry, J. Zorn, A. Lutz, C.E. Priebe and J.T. Vogelstein, Universally consistent K-sample tests via dependence measures, Statistics & Probability Letters 216, 110278, 2025.
22. [22] T. Robertson, F. T. Wright and R. L. Dykstra, Order Restricted Statistical Inference, John Wiley & Sons, New York, 1988.
23. [23] D. Ruppert, M. P. Wand and R. J. Carroll, Semiparametric Regression, Cambridge University Press, New York, 2003.
24. [24] W. Stute, W. González Manteiga and M. Presedo Quindimil, Bootstrap approximations in model checks for regression, Journal of the American Statistical Association 93, 141–149, 1998.
25. [25] G. J. Székely, M. L. Rizzo and N. K. Bakirov, Measuring and testing dependence by correlation of distances, The Annals of Statistics 35 (6), 2769–2794, 2007.
26. [26] G. J. Székely and M. L. Rizzo, Brownian distance covariance, The Annals of Applied Statistics 3 (4), 1236–1265, 2009.
27. [27] G. J. Székely and M. L. Rizzo, Partial distance correlation with methods for dissimilarities, The Annals of Statistics 42 (6), 2382–2412, 2014.
28. [28] L. Weihs, M. Drton and D. Leung, Efficient computation of the Bergsma–Dassios sign covariance, Computational Statistics 31 (1), 315–328, 2016.
29. [29] L. Weihs, M. Drton and N. Meinshausen, Symmetric rank covariances: A generalized framework for nonparametric measures of dependence, Biometrika 105 (3), 547–562, 2018.
30. [30] J.-T. Zhang and T. Zhu, A fast and accurate kernel-based independence test with applications to high-dimensional and functional data, Journal of Multivariate Analysis 202, 105320, 2024.
31. [31] Y. Zhou, K. Xu, L. Zhu and R. Li, Rank-based indices for testing independence between two high-dimensional vectors, The Annals of Statistics 52 (1), 184–206, 2024.