Abstract
The long-standing Gaussian product inequality (GPI) conjecture states that
1 Introduction
Gaussian distributions play a fundamental role in both probability and statistics (see [30] and references therein). Over the past decade, there has been a surge of interest in the study of inequalities related to Gaussian distributions. This was sparked by Royen’s famous proof of the long-conjectured Gaussian correlation inequality (GCI) [16,23]. GCIs are valuable tools for the study of small ball probabilities (i.e. Li [17] and Shao [28]) and the zeros of random polynomials (i.e. Li and Shao [18]), among others. In this work, we will investigate the Gaussian product inequality (GPI), another long-standing conjecture and one of the late Wenbo Li’s open problems (Shao [29]).
In its most general form, the GPI conjecture (Li and Wei [19]) states that for any non-negative real numbers
Verification of this inequality has immediate and far-reaching consequences. For example (Malicet et al. [21]), if (1.1) holds when the
The GPI conjecture has proven to be very challenging to solve, but not for lack of trying. Some progress has been made in the form of partial results. By Karlin and Rinott [11, Corollary 1.1, Theorem 3.1 and Remark 1.4], (1.1) holds for
Theorem 1.1
Let
and the equality sign holds if and only if
Liu et al. [20] also used integral representations to provide an alternate proof of (1.2) when
Frenkel [4] used algebraic methods to prove (1.1) for the case that
Lan et al.’s proof of the three-dimensional (3D) GPI brought renewed hope to solving this difficult problem.
In [26], we investigated the 3D inequality
for any
Several months after the preprint of our publication [25] was initially posted online, Herry et al. [9] proved the 3D GPI (1.1) for any even-integer exponents. Motivated by this work, we continued to investigate the GPI in dimension greater than three and the case where the exponents are real-valued.
Throughout this work, any Gaussian random variable is assumed to be real-valued and non-degenerate, i.e., has positive variance.
Conjecture 1.2
Let
The equality holds if and only if
In [26], we proved Conjecture 1.2 (for any
Proposition 1.3
[26, Lemma 2.3] Let
Remark 1.4
(i) Genest and Ouimet [5] proved (1.3) when the covariance matrix is completely positive. Edelmann et al. [3] extended Proposition 1.3 to the multivariate gamma distribution in the sense of Krishnamoorthy and Parthasarathy [14]. It is interesting to point out that Edelmann et al. [3] also demonstrated that the GCI implies the strong form of the GPI with negative exponents.
(ii) Note that product inequality (1.3) may not hold for non-Gaussian random vectors. Let
We have
and
Hence,
For some more recent GPI-related results, we refer the reader to Genest and Ouimet [6] and Genest et al. [7].
In this work, we develop an efficient computational algorithm that produces exact sums-of-squares (SOS) polynomials to tackle the GPI. We describe this method in Section 2 and use it to rigorously prove some special cases of the GPI conjecture with fixed exponents in Section 3. Then, in Section 4, we reveal the true power of the SOS method by extending these special cases to the stronger result where one exponent is unbounded. Finally, in Section 5 and Additional Material Section 2, we prove a five-dimensional (5D) GPI as a template for a new and improved SOS method that handles the case where the unbounded exponent can be real rather than simply an even integer. Fully solving the GPI conjecture is most difficult when correlations can be negative and when exponents are not integers. In theory, our algorithm is applicable to any GPI of the form (1.1) with fixed
2 The SOS method of solving the GPI
An SOS representation of a polynomial is of the form
Lemma 2.1
Let
Then,
Proof
In view of the classical Isserlis-Wick formula (cf. [13]), (2.1) is an equality involving polynomials in the entries of
and
Then,
For
Hence,
Therefore, the proof is complete.□
Let
where each
Define
By (2.1) and (2.2), it is easy to see that
By (2.1) and using the Mathematica functions Expand[] and Coefficient[], we obtain
Combining (2.2) and (2.3), we have an algorithm to obtain the expression of
This package is very user-friendly and, along with the semi-definite programming package it uses, comes pre-installed in the newest versions of Macaulay2. By using a “mixed symbolic-numerical approach” [22], “SumsOfSquares” takes advantage of the speed of approximate numerical calculations, yet still produces a final SOS decomposition that is exact (not an approximation). This SOS polynomial can then be expanded and checked to match the original
To further increase the efficiency of our method, we will use a trick to reduce the number of variables of the polynomial
Lemma 2.2
[26, Lemma 2.1] Let
then for any centered Gaussian random vector
Additionally, if Inequality (2.4) is strict when
The main advantage of Lemma 2.2 is to prove the GPI (2.5), we may assume without loss of generality that
3 Applications of the SOS method
First, we will verify (1.3) for the case
Theorem 3.1
For any centered Gaussian random vector
The equality holds if and only if
Proof
Let
By Lemma 2.2, we need only to show that
where the second expression (i.e., the SOS decomposition) is obtained by an application of “SumsOfSquares” to the first expression.□
Building on this result, we will verify (1.3) for the case
Theorem 3.2
For any centered Gaussian random vector
The equality holds if and only if
Proof
Let
By Lemma 2.2, we need only to show that
where the second expression (i.e., the SOS decomposition) is obtained by an application of “SumsOfSquares” to the first expression.□
Next we will verify (1.3) for the case
Theorem 3.3
For any centered Gaussian random vector
The equality holds if and only if
Proof
Let
Case 1:
Case 2:
Case 3:
Note that Case 1 corresponds to the case that the rank of the covariance matrix equals 3 and
Case 1 (see Additional Material Section 1 for the full SOS decomposition):
Case 2 (see Additional Material Section 1 for the full SOS decomposition):
Case 3 (see Additional Material Section 1 for the full SOS decomposition):
where in each case, the first expression is obtained by (2.3) and the second expression (i.e., the SOS decomposition) is obtained by an application of “SumsOfSquares” to the first expression.□
Remark 3.4
To establish Inequality (3.1), we need only to consider Case 1. However, to show that the equality sign holds if and only if
4 SOS method with one exponent unbounded
In this section, we demonstrate an even more powerful application of the SOS method to be used when one exponent is unknown. In particular, we extend Theorems 3.2 and 3.3 to the case where
Theorem 4.1
Let
The equality holds if and only if
Proof
Let
By Lemma 2.2, we need only to show that
where the second expression (i.e., the SOS decomposition) is obtained by an application of “SumsOfSquares” to the first expression.□
Theorem 4.2
Let
The equality holds if and only if
Proof
Let
Case 1:
Case 2:
Case 3:
By Lemma 2.2, we need only to show that, in each of these three cases,
Case 1 (see Additional Material Section 1 for the full SOS decomposition):
Case 2 (see Additional Material Section 1 for the full SOS decomposition):
Case 3 (see Additional Material Section 1 for the full SOS decomposition):
where in each case, the second expression (i.e., the SOS decomposition) is obtained by an application of “SumsOfSquares” to the first expression.□
Remark 4.3
To establish Inequality (4.1), we need only consider Case 1. However, to show that the equality sign holds if and only if
5 Alternative SOS method in Mathematica
Since Mathematica is much more user-friendly than Macaulay2, we were pleased to see that, in the latest versions of Mathematica, a new function PolynomialSumOfSquaresList[] has been added. Although this function does not give SOS decompositions with strictly rational components, it still produces an exact and verifiable SOS decomposition when it works.
This motivated us to develop a more efficient SOS method that only necessitates the use of Mathematica. Please see Additional Material Section 2 for a self-contained proof in a Mathematica notebook in which we prove the following new 5D GPI using this SOS method:
Theorem 5.1
Let
6 Discussion
The GPI conjecture is an extremely difficult problem to solve, particularly when some of the correlations are negative. The SOS method described in this study can be used to rigorously verify any specific case of the GPI (1.3), constrained only by computing power. Furthermore, as demonstrated in Section 4, this method is even powerful enough to prove GPIs with one exponent unbounded, a feat that is extremely difficult by purely theoretical methods. Moreover, in Section 5 and Additional Material Section 2, we proved a new 5D GPI, showing that we can even use the SOS method to verify more general GPIs with at least one unbounded real exponent. On the other hand, should the GPI conjecture not hold in its full generality, our method may prove quite useful in the search for a counterexample. Our algorithm is efficient, straightforward, and produces exact results. Furthermore, while calculations of multivariate Gaussian moments are often burdened by the constraints imposed by the covariance matrix, our method has the advantage of using free variables (with domain over the reals).
Despite the fact that the GPI is widely believed to be true, as of yet there has not been much to strongly support this presumption. At the time the original preprint was posted online, all theorems in this work constituted never-before obtained results. Till today, to the best of our knowledge, Theorems 4.2 and 5.1 have not been proved by any other methods. In fact, using the method outlined above, we were able to verify many more GPIs with one exponent unbounded and higher fixed exponents, the proofs of which we omit seeing as the SOS decompositions, although exact, can be quite long. Thus, with the help of software, our work provides some of the first legitimate support to the correctness of the GPI in dimensions higher than 3. Therefore, we propose a stronger version of the GPI:
Conjecture 6.1
Let
Then, H has an SOS representation.
By approximation, we find that if Conjecture 6.1 is true, then the GPI (1.3) holds. By virtue of this conjecture, we have connected the probability inequality to analysis, algebra, geometry, combinatorics, mathematical programming and computer science. In particular, research on SOS is abundant and ongoing (e.g., [8]), but so far, no theoretical results in that field have been used to prove a GPI. Although software is used, our rigorous proofs establish the first meaningful link between the GPI and SOS, and should stimulate those working on SOS.
It is well-known that a non-negative multivariate polynomial may not have an SOS representation. Denote by
Then, we have
where
where
Acknowledgements
We thank Dr. Thomas Royen for fruitful discussion and encouragement with regards to the SOS method. We thank Dr. Victor Magron for pointing out Scheiderer’s result [27, Theorem 2.1] among other helpful suggestions.
-
Funding information: This work was supported by the Natural Sciences and Engineering Research Council of Canada (Nos. 559668-2021 and 4394-2018).
-
Author contributions: Both authors have accepted responsibility for the entire content of this manuscript and consented to its submission to the journal, reviewed all the results and approved the final version of the manuscript. OR and WS conceived of the presented idea and developed the theory. OR performed the computations.
-
Conflict of interest: The authors state no conflict of interest.
-
Supplementary Material: This article contains supplementary material available at https://www.degruyter.com/document/doi/10.1515/demo-2024-0003.
References
[1] Benítez, C., Sarantopolous, Y., & Tonge, A. M. (1998). Lower bounds for norms of products of polynomials. Mathematical Proceedings of the Cambridge Philosophical Society, 124(3), 395–408. 10.1017/S030500419800259XSearch in Google Scholar
[2] Cifuentes, D., Kahle, T., & Parrilo, P. (2020). Sums of squares in Macaulay2. Journal of Software for Algebra and Geometry, 10(1), 17–24. 10.2140/jsag.2020.10.17Search in Google Scholar
[3] Edelmann, D., Richards, D., & Royen, T. (2023). Product inequalities for multivariate Gaussian, gamma, and positively upper orthant dependent distributions. Statistics and Probability Letters, 197, 109820. 10.1016/j.spl.2023.109820Search in Google Scholar
[4] Frenkel, P. E. (2008). Pfaffians, Hafnians and products of real linear functionals. Mathematical Research Letters, 15(2), 351–358. 10.4310/MRL.2008.v15.n2.a12Search in Google Scholar
[5] Genest, C., & Ouimet, F. (2022). A combinatorial proof of the Gaussian product inequality beyond the MTP2 case. Dependence Modeling, 10(1), 236–244. 10.1515/demo-2022-0116Search in Google Scholar
[6] Genest, C., & Ouimet, F. (2023). Miscellaneous results related to the Gaussian product inequality conjecture for the joint distribution of traces of Wishart matrices. Journal of Mathematical Analysis and Applications, 523(1), 126951. 10.1016/j.jmaa.2022.126951Search in Google Scholar
[7] Genest, C., Ouimet, F., & Richards, D. (2024). On the Gaussian product inequality conjecture for disjoint principal minors of Wishart random matrices. arXiv:2311.00202v2. Search in Google Scholar
[8] Henrion, D., Korda, M., & Lasserre, J. B. (2020). The Moment-SOS Hierarchy. London, UK: World Scientific. 10.1142/q0252Search in Google Scholar
[9] Herry, R., Malicet, D., & Poly, G. (2024). A short proof of a strong form of the three dimensional Gaussian product inequality. Proceedings of the American Mathematical Society, 152, 403–409. 10.1090/proc/16448Search in Google Scholar
[10] Hilbert, D. (1888). Ueber die Darstellung definiter Formen als Summe von Formenquadraten. Mathematische Annalen, 32(3), 342–350. 10.1007/BF01443605Search in Google Scholar
[11] Karlin, S., & Rinott, Y. (1981). Total positivity properties of absolute value multinormal variables with applications to confidence interval estimates and related probabilistic inequalities. The Annals of Statistics, 9(5), 1035–1049. 10.1214/aos/1176345583Search in Google Scholar
[12] Kagan, A. M., Linnik, Y. V., & Rao, C. R. (1973). Characterization Problems in Mathematical Statistics. New York and London: Wiley. Search in Google Scholar
[13] Kan, R. (2008). From moments of sum to moments of product. Journal of Multivariate Analysis, 99(3), 542–554. 10.1016/j.jmva.2007.01.013Search in Google Scholar
[14] Krishnamoorthy, A. S., & Parthasarathy, M. (1951). A multivariate gamma-type distribution. The Annals of Mathematical Statistics, 22(4), 549–557. 10.1214/aoms/1177729544Search in Google Scholar
[15] Lan, G. L., Hu, Z. C., & Sun, W. (2020). The three-dimensional Gaussian product inequality. Journal of Mathematical Analysis and Applications, 485(2), 123858. 10.1016/j.jmaa.2020.123858Search in Google Scholar
[16] Latała, R., & Matlak, D. (2017). Royenas proof of the Gaussian correlation inequality. In: Geometric Aspects of Functional Analysis (Vol. 2169, pp. 265–275). Cham, Switzerland: Springer. 10.1007/978-3-319-45282-1_17Search in Google Scholar
[17] Li, W. V. (1999). A Gaussian correlation inequality and its applications to small ball probabilities. Electronic Communications in Probability, 4, 111–118. 10.1214/ECP.v4-1012Search in Google Scholar
[18] Li, W. V., & Shao, Q. M. (2002). A normal comparison inequality and its applications. Probability Theory and Related Fields, 122(4), 494–508. 10.1007/s004400100176Search in Google Scholar
[19] Li, W. V., & Wei, A. (2012). A Gaussian inequality for expected absolute products. Journal of Theoretical Probability, 25(1), 92–99. 10.1007/s10959-010-0329-0Search in Google Scholar
[20] Liu, Z., Wang, Z., & Yang, X. (2017). A Gaussian expectation product inequality. Statistics and Probability Letters, 124, 1–4. 10.1016/j.spl.2016.12.018Search in Google Scholar
[21] Malicet, D., Nourdin, I., Peccati, G., & Poly, G. (2016). Squared chaotic random variables: new moment inequalities with applications. Journal of Functional Analysis, 270(2), 649–670. 10.1016/j.jfa.2015.10.013Search in Google Scholar
[22] Peyrl, H., & Parrilo, P. A. (2008). Computing sum of squares decompositions with rational coefficients. Theoretical Computer Science, 409(2), 269–281. 10.1016/j.tcs.2008.09.025Search in Google Scholar
[23] Royen, T. (2014). A simple proof of the Gaussian correlation conjecture extended to multivariate gamma distributions. Far East Journal of Theoretical Statistics, 48(2), 139–145. Search in Google Scholar
[24] Russell, O., & Sun, W. (2022). An opposite Gaussian product inequality. Statistics and Probability Letters, 191, 109656. 10.1016/j.spl.2022.109656Search in Google Scholar
[25] Russell, O., & Sun, W. (2023). Moment ratio inequality of bivariate Gaussian distribution and three-dimensional Gaussian product inequality. Journal of Mathematical Analysis and Applications, 527(1), 127410. 10.1016/j.jmaa.2023.127410Search in Google Scholar
[26] Russell, O., & Sun, W. (2022). Some new Gaussian product inequalities. Journal of Mathematical Analysis and Applications, 515(2), 126439. 10.1016/j.jmaa.2022.126439Search in Google Scholar
[27] Scheiderer, C. (2016). Sums of squares of polynomials with rational coefficients. Journal of the European Mathematical Society, 18(7), 1495–1513. 10.4171/jems/620Search in Google Scholar
[28] Shao, Q. M. (2003). A Gaussian correlation inequality and its applications to the existence of small ball constant. Stochastic Processes and their Applications, 107(2), 269–287. 10.1016/S0304-4149(03)00084-XSearch in Google Scholar
[29] Shao, Q. M. (2016). In memory of Wenbo V. Lias contributions. In: High Dimensional Probability VII (Vol. 71, pp. 281–291). Switzerland: Birkhäuser. 10.1007/978-3-319-40519-3_12Search in Google Scholar
[30] Tong, Y. L. (1990). The Multivariate Normal Distribution. New York, NY: Springer. 10.1007/978-1-4613-9655-0Search in Google Scholar
© 2024 the author(s), published by De Gruyter
This work is licensed under the Creative Commons Attribution 4.0 International License.
Articles in the same Issue
- Research Articles
- Sharp bounds on the survival function of exchangeable min-stable multivariate exponential sequences
- Invariance properties of limiting point processes and applications to clusters of extremes
- Assessing copula models for mixed continuous-ordinal variables
- Using sums-of-squares to prove Gaussian product inequalities
- On the construction of stationary processes and random fields
- Decomposition and graphical correspondence analysis of checkerboard copulas
- Special Issue on 40th Linz Seminar
- Special Issue: 40th Linz Seminar on Fuzzy Set Theory. Copulas – Theory and Applications
- Geometry of generators of triangular norms and copulas
- Dependence properties of bivariate copula families
- Median and quantile conditional copulas
- On comprehensive families of copulas involving the three basic copulas and transformations thereof
Articles in the same Issue
- Research Articles
- Sharp bounds on the survival function of exchangeable min-stable multivariate exponential sequences
- Invariance properties of limiting point processes and applications to clusters of extremes
- Assessing copula models for mixed continuous-ordinal variables
- Using sums-of-squares to prove Gaussian product inequalities
- On the construction of stationary processes and random fields
- Decomposition and graphical correspondence analysis of checkerboard copulas
- Special Issue on 40th Linz Seminar
- Special Issue: 40th Linz Seminar on Fuzzy Set Theory. Copulas – Theory and Applications
- Geometry of generators of triangular norms and copulas
- Dependence properties of bivariate copula families
- Median and quantile conditional copulas
- On comprehensive families of copulas involving the three basic copulas and transformations thereof