Heterogeneous Mixture Distributions for Modeling Skewed Data in Engineering Applications: A Theoretical Approach

Öz

Mixture distribution models have become indispensable tools for characterizing complex, non-Gaussian data structures that frequently arise in engineering and reliability contexts. However, existing mixture frameworks predominantly assume homogeneous component families, typically Gaussian, which limits their capacity to represent data generated by fundamentally different physical mechanisms. This paper presents a formal theoretical framework for heterogeneous mixture distributions, in which component densities are drawn from distinct parametric families — specifically the Normal, Gamma, Weibull, and Lognormal distributions — with identifiability conditions formally established across the full family set. A unified parameter estimation strategy based on maximum likelihood and the Expectation-Maximization (EM) algorithm is developed, accommodating cross-family heterogeneity within a single iterative procedure. The framework is evaluated through a Monte Carlo simulation study comprising B = 500 independent replications with n = 2000 observations per replication, under two engineering-motivated scenarios: a two-component heterogeneous mixture (Weibull–Normal) designed to reflect early-failure and steady-state behavior, and a three-component mixture (Weibull–Normal–Lognormal) representing a full bathtub-curve reliability profile. Model performance is assessed using the Akaike Information Criterion (AIC) and Bayesian Information Criterion (BIC). The proposed heterogeneous models yield mean AIC improvements of 717.7 and 606.6 units over conventional Gaussian mixture benchmarks for the two- and three-component scenarios respectively, with the heterogeneous model achieving superior fit in all 500 replications in both scenarios. These results provide strong empirical evidence that cross-family heterogeneity in mixture components offers substantial and consistent gains in model fit for engineering data with structurally complex generating processes. Future research should extend the framework to censored lifetime data, formalize component family selection procedures, and investigate Bayesian estimation alternatives.

Anahtar Kelimeler

• Heterogeneous mixture distribution
• EM algorithm
• Skewed data
• Engineering reliability
• Weibull distribution
• Lognormal distribution

Etik Beyan

Ethics committee approval was not required for this study because there was no study on animals or humans.

Kaynakça

1. Abernethy, R. B. (2006). The new Weibull handbook: Reliability and statistical analysis for predicting life, safety, supportability, risk, cost and warranty claims (5th ed.).
2. Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6), 716–723. https://doi.org/10.1109/TAC.1974.1100705
3. Berk, R. H. (1966). Limiting behavior of posterior distributions when the model is incorrect. The Annals of Mathematical Statistics, 37(1), 51–58. https://doi.org/10.1214/aoms/1177699597
4. Bishop, C. M. (2006). Pattern recognition and machine learning. Springer.
5. Burnham, K. P., & Anderson, D. R. (2002). Model selection and multimodel inference: A practical information-theoretic approach (2nd ed.). Springer. https://doi.org/10.1007/b97636
6. Celeux, G., & Govaert, G. (1995). Gaussian parsimonious clustering models. Pattern Recognition, 28(5), 781–793. https://doi.org/10.1016/0031-3203(94)00125-6
7. Crow, L. H., & Shimizu, K. (Eds.). (1988). Lognormal distributions: Theory and applications. Marcel Dekker.
8. Crowder, M. J., Kimber, A. C., Smith, R. L., & Sweeting, T. J. (1991). Statistical analysis of reliability data. Chapman & Hall.

9. DeCarlo, L. T. (1997). On the meaning and use of kurtosis. Psychological Methods, 2(3), 292–307. https://doi.org/10.1037/1082-989X.2.3.292
10. Delignette-Muller, M. L., & Dutang, C. (2015). fitdistrplus: An R package for fitting distributions. Journal of Statistical Software, 64(4), 1–34. https://doi.org/10.18637/jss.v064.i04
11. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society: Series B (Methodological), 39(1), 1–38. https://doi.org/10.1111/j.2517-6161.1977.tb01600.x
12. Ebeling, C. E. (2010). An introduction to reliability and maintainability engineering (2nd ed.). Waveland Press.
13. Everitt, B. S., & Hand, D. J. (1981). Finite mixture distributions. Chapman & Hall.
14. Fraley, C., & Raftery, A. E. (2002). Model-based clustering, discriminant analysis, and density estimation. Journal of the American Statistical Association, 97(458), 611–631. https://doi.org/10.1198/016214502760047131
15. Frühwirth-Schnatter, S. (2006). Finite mixture and Markov switching models. Springer. https://doi.org/10.1007/978-0-387-35768-3
16. Furman, E., & Landsman, Z. (2005). Risk capital decomposition for a multivariate dependent Gamma portfolio. Insurance: Mathematics and Economics, 37(3), 635–649. https://doi.org/10.1016/j.insmatheco.2005.06.006
17. Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis (8th ed.). Cengage Learning.
18. Jiang, R., & Murthy, D. N. P. (1995). Modeling failure-data by mixture of 2 Weibull distributions: A graphical approach. IEEE Transactions on Reliability, 44(3), 477–488. https://doi.org/10.1109/24.406588
19. Jiang, R., & Murthy, D. N. P. (1998). Mixture of Weibull distributions — parametric characterization of failure rate function. Applied Stochastic Models and Data Analysis, 14(1), 47–65. https://doi.org/10.1002/(SICI)1099-0747(199803)14:1<47::AID-ASM306>3.0.CO;2-E
20. Johnson, N. L., Kotz, S., & Balakrishnan, N. (1994). Continuous univariate distributions (2nd ed., Vol. 1). Wiley.
21. Lawless, J. F. (2003). Statistical models and methods for lifetime data (2nd ed.). Wiley. https://doi.org/10.1002/9781118033005
22. MathWorks. (2023). MATLAB (Version R2023b) [Computer software]. The MathWorks, Inc. https://www.mathworks.com
23. McLachlan, G. J., & Krishnan, T. (2008). The EM algorithm and extensions (2nd ed.). Wiley. https://doi.org/10.1002/9780470191613
24. McLachlan, G. J., & Peel, D. (2000). Finite mixture models. Wiley. https://doi.org/10.1002/0471721182
25. Meeker, W. Q., Escobar, L. A., & Pascual, F. G. (2022). Statistical methods for reliability data (2nd ed.). Wiley.
26. Murphy, K. P. (2012). Machine learning: A probabilistic perspective. MIT Press.
27. Murthy, D. N. P., Xie, M., & Jiang, R. (2004). Weibull models. Wiley. https://doi.org/10.1002/047147326X
28. Pearson, K. (1894). Contributions to the mathematical theory of evolution. Philosophical Transactions of the Royal Society of London A, 185, 71–110. https://doi.org/10.1098/rsta.1894.0003
29. R Core Team. (2024). R: A language and environment for statistical computing [Computer software]. R Foundation for Statistical Computing. https://www.R-project.org/
30. Reynolds, D. A. (2009). Gaussian mixture models. In S. Z. Li & A. K. Jain (Eds.), Encyclopedia of biometrics (pp. 659–663). Springer. https://doi.org/10.1007/978-0-387-73003-5_196
31. Rinne, H. (2009). The Weibull distribution: A handbook. CRC Press.
32. Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6(2), 461–464. https://doi.org/10.1214/aos/1176344136
33. Teicher, H. (1963). Identifiability of finite mixtures. The Annals of Mathematical Statistics, 34(4), 1265–1269. https://doi.org/10.1214/aoms/1177703862
34. Titterington, D. M., Smith, A. F. M., & Makov, U. E. (1985). Statistical analysis of finite mixture distributions. Wiley.
35. Virtanen, P., Gommers, R., Oliphant, T. E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J., van der Walt, S. J., Brett, M., Wilson, J., Millman, K. J., Mayorov, N., Nelson, A. R. J., Jones, E., Kern, R., Larson, E., … SciPy 1.0 Contributors. (2020). SciPy 1.0: Fundamental algorithms for scientific computing in Python. Nature Methods, 17(3), 261–272. https://doi.org/10.1038/s41592-020-0772-5
36. Weibull, W. (1951). A statistical distribution function of wide applicability. Journal of Applied Mechanics, 18(3), 293–297. https://doi.org/10.1115/1.4010337
37. White, H. (1982). Maximum likelihood estimation of misspecified models. Econometrica, 50(1), 1–25. https://doi.org/10.2307/1912526
38. Wickham, H. (2016). ggplot2: Elegant graphics for data analysis. Springer. https://doi.org/10.1007/978-3-319-24277-4
39. Yakowitz, S. J., & Spragins, J. D. (1968). On the identifiability of finite mixtures. The Annals of Mathematical Statistics, 39(1), 209–214. https://doi.org/10.1214/aoms/1177698520