Home Statistical separation of mixtures in the problem of reconstructing the coefficients of an Itô stochastic process-type model of the interplanetary magnetic flux density: ℓ2-distance minimization vs likelihood maximization
Article
Licensed
Unlicensed Requires Authentication

Statistical separation of mixtures in the problem of reconstructing the coefficients of an Itô stochastic process-type model of the interplanetary magnetic flux density: 2-distance minimization vs likelihood maximization

  • Kirill Karpov , Victor Korolev EMAIL logo and Natalia Sukhareva
Published/Copyright: February 14, 2025

Abstract

Two approaches to the problem of statistical separation of finite mixtures of probability distributions are discussed. The first of them consists in finding maximum likelihood estimates of the parameters of the mixture by the EM-algorithm, whereas the second approach consists in finding the values of the parameters that deliver minimum to the distance between the theoretical and empirical distribution functions. It is demonstrated that the second approach is preferable at least in the problem of statistical reconstruction of the coefficients of an Itô stochastic process that requires dynamic separation of finite normal mixtures in the moving window mode. For this problem, the performance of the numerical procedures is critical. A combination of numerical procedures is described that provides (almost) the same value of the likelihood function for the second approach that is attained by the EM-algorithm, but ensures multiple decrease of the 2-distance between the theoretical mixture and the empirical distribution function while demonstrating better performance. A kind of ‘metric’ regularization of the problem of likelihood maximization is proposed. The proposed techniques are illustrated by adjusting the Itô process model to the time series of the interplanetary magnetic field (magnetic flux density) registered by the Global Geospace Science (GGS) Wind apparatus (the spacecraft placed in the Lagrange point between the Earth and the Sun).

MSC 2010: 62M10; 62-08; 65K10; 65C99

Funding statement: This work was done with the support of the MSU Program of Development, Project No. 23-SCH03-03.

References

[1] G. Barles and H. M. Soner, Option pricing with transaction costs and a nonlinear Black–Scholes equation. Finance and Stochastics 2 (1998), 369–397.10.1007/s007800050046Search in Google Scholar

[2] K. Belyaev, A. Kuleshov, N. Tuchkova, and C. A. S. Tanajura, An optimal data assimilation method and its application to the numerical simulation of the ocean dynamics. Mathematical and Computer Modelling of Dynamical Systems (2017), 1–14.10.1080/13873954.2017.1338300Search in Google Scholar

[3] C. M. Bishop, Pattern Recognition and Machine Learning. New York, Springer, 2006. Chapter 9: Mixture Models and EM, pp. 423–459.Search in Google Scholar

[4] J. Chen, X. Tan, and R. Zhang, Inference for normal mixtures in mean and variance. Statistica Sinica 18 (2008), No. 2, 443–465.Search in Google Scholar

[5] G. Ciuperca, A. Ridolfi, and J. Idier, Penalized maximum likelihood estimator for normal mixtures. Scandinavian Journal of Statistics 30 (2003), No. 1, 45–59.10.1111/1467-9469.00317Search in Google Scholar

[6] J. C. Cox, J. E. Ingersoll, and S. A. Ross, A theory of the term structure of interest rates. Econometrica 53 (1985), 385–407.10.2307/1911242Search in Google Scholar

[7] A. Dempster, N. Laird, and D. Rubin, Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B 39 (1977), No. 1, 1–38.10.1111/j.2517-6161.1977.tb01600.xSearch in Google Scholar

[8] E. Derman and J. Kani, Riding on a smile. Risk 7 (1994), 32–39.Search in Google Scholar

[9] B. Dupire, Pricing with a smile. Risk 7 (1994), 18–20.Search in Google Scholar

[10] B. S. Everitt and D. J. Hand, Finite Mixture Distributions. Chapman and Hall, London–New York, 1981.10.1007/978-94-009-5897-5Search in Google Scholar

[11] D. Florens-Zmirou, On estimating the diffusion coefficient from discrete observations. Journal of Applied Probability 30 (1993), No. 4, 790–804.10.2307/3214513Search in Google Scholar

[12] C. Fraley and A. E. Raftery, Bayesian regularization for normal mixture estimation and model-based clustering. Journal of Classification 24 (2007), 155–181.10.1007/s00357-007-0004-5Search in Google Scholar

[13] V. Genon-Catalot and J. Jacod, On the estimation of the diffusion coefficient for multi-dimensional diffusion processes. Annales de l’Institute Henri Poincaré, Ser. B 29 (1993), No. 1, 119–151.Search in Google Scholar

[14] V. Genon-Catalot and J. Jacod, Estimation of the diffusion coefficient for diffusion processes: random sampling. Scandinavian Journal of Statistics 21 (199.), No. 3, 193–221.Search in Google Scholar

[15] S. L. Heston, A closed-form solution for options with stochastic volatility, with application to bond and currency options. Review of Financial Studies 6 (1993), 327–343.10.1093/rfs/6.2.327Search in Google Scholar

[16] J. Hull and A. White, The pricing of options on assets with stochastic volatilities. Journal of Finance 42 (1987), 281–308.10.2307/2328253Search in Google Scholar

[17] M. A. Ivanov, Ya. A. Roshchina, and V. Yu. Korolev, Overtraining if finite mixtures of normal distributions. In: Multivariate statistical analysis, econometrics and simulation of real processes. Proceedings of XI-th International Conference. Part 1. Plenary reports. Section 1. Multidimensional Statistical Analysis and Econometrics (Ed. V. L. Makarov). Moscow, CEMI RAS, 2024.Search in Google Scholar

[18] S. Kolouri, G. K. Rohde, and H. Hoffmann, Sliced Wasserstein distance for learning Gaussian mixture models. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City, IEEE, 2018, pp. 3427–3436.10.1109/CVPR.2018.00361Search in Google Scholar

[19] V. Yu. Korolev, Probability and Statistical Methods for the Decomposition of the Volatility of Chaotic Processes. Moscow University Publishing House, Moscow, 2011.Search in Google Scholar

[20] V. Yu. Korolev, A. V. Chertok, A. Yu. Korchagin, and A. K. Gorshenin, Some properties of variance-mean mixtures of normal laws. In: Statistical Methods of Estimation and Testing Hypotheses, Vol. 26. Perm State University Publishing House, Perm, 2015.Search in Google Scholar

[21] D. Lamouroux and K. Lehnertz, Kernel-based regression of drift and diffusion coefficients of stochastic processes. Physics Letters A 373 (2009), 3507–3512.10.1016/j.physleta.2009.07.073Search in Google Scholar

[22] H. E. Leland, Option pricing and replication with transactions costs. Journal of Finance 40 (1985), 1283–1301.10.1111/j.1540-6261.1985.tb02383.xSearch in Google Scholar

[23] G. J. McLachlan and T. Krishnan, The EM Algorithm and Extensions. Wiley, New York, 1997.Search in Google Scholar

[24] D. Ormoneit and V. Tresp, Averaging, maximum penalized likelihood and Bayesian estimation for improving Gaussian mixture probability density estimates. IEEE Transactions on Neural Networks 9 (1998), No. 4, 639–650.10.1109/72.701177Search in Google Scholar PubMed

[25] R. A. Redner and H. F. Walker, Mixture densities, maximum likelihood and the EM algorithm. SIAM Review 26 (1984), No. 2, 195–239.10.1137/1026034Search in Google Scholar

[26] A. N. Shiryaev, Foundations of Financial Mathematics. Volume 1. Facts, Models. World Scientific, Singapore, 1998.Search in Google Scholar

[27] H. Teicher, Identifiability of mixtures. Annals of Mathematical Statistics 32 (1961), 244–248.10.1214/aoms/1177705155Search in Google Scholar

[28] C. Wei anf H. Shu, Maximum likelihood estimation for the drift parameter in diffusion processes. Stochastics 88 (2016), No. 5, 699–710.10.1080/17442508.2015.1124879Search in Google Scholar

[29] C. F. J. Wu, On the convergence properties of the EM algorithm. The Annals of Statistics 11 (1983), No. 1, 95–103.10.1214/aos/1176346060Search in Google Scholar

[30] N. Yoshida, Estimation for diffusion processes from discrete observation. Journal of Multivariate Analysis 41 (1992), 220–242.10.1016/0047-259X(92)90068-QSearch in Google Scholar

[31] Q. Zhang and J. Chen, Minimum Wasserstein distance estimator under finite location-scale mixtures. In: Advances and Innovations in Statistics and Data Science (Eds. W. He, L. Wang, J. Chen, and C. D. Lin). Springer International Publishing, Cham, 2022.Search in Google Scholar

Received: 2024-07-07
Accepted: 2024-11-25
Published Online: 2025-02-14
Published in Print: 2025-02-25

© 2025 Walter de Gruyter GmbH, Berlin/Boston

Downloaded on 2.10.2025 from https://www.degruyterbrill.com/document/doi/10.1515/rnam-2025-0002/html
Scroll to top button