Startseite Mathematik The Inflation Technique for Causal Inference with Latent Variables
Artikel Open Access

The Inflation Technique for Causal Inference with Latent Variables

  • Elie Wolfe ORCID logo EMAIL logo , Robert W. Spekkens und Tobias Fritz
Veröffentlicht/Copyright: 16. Juli 2019

Abstract

The problem of causal inference is to determine if a given probability distribution on observed variables is compatible with some causal structure. The difficult case is when the causal structure includes latent variables. We here introduce the inflation technique for tackling this problem. An inflation of a causal structure is a new causal structure that can contain multiple copies of each of the original variables, but where the ancestry of each copy mirrors that of the original. To every distribution of the observed variables that is compatible with the original causal structure, we assign a family of marginal distributions on certain subsets of the copies that are compatible with the inflated causal structure. It follows that compatibility constraints for the inflation can be translated into compatibility constraints for the original causal structure. Even if the constraints at the level of inflation are weak, such as observable statistical independences implied by disjoint causal ancestry, the translated constraints can be strong. We apply this method to derive new inequalities whose violation by a distribution witnesses that distribution’s incompatibility with the causal structure (of which Bell inequalities and Pearl’s instrumental inequality are prominent examples). We describe an algorithm for deriving all such inequalities for the original causal structure that follow from ancestral independences in the inflation. For three observed binary variables with pairwise common causes, it yields inequalities that are stronger in at least some aspects than those obtainable by existing methods. We also describe an algorithm that derives a weaker set of inequalities but is more efficient. Finally, we discuss which inflations are such that the inequalities one obtains from them remain valid even for quantum (and post-quantum) generalizations of the notion of a causal model.

1 Introduction

Given a joint probability distribution of some observed variables, the problem of causal inference is to determine which hypotheses about the causal mechanism can explain the given distribution. Here, a causal mechanism may comprise both causal relations among the observed variables, as well as causal relations among these and a number of unobserved variables, and among unobserved variables only. Causal inference has applications in all areas of science that use statistical data and for which causal relations are important. Examples include determining the effectiveness of medical treatments, sussing out biological pathways, making data-based social policy decisions, and possibly even in developing strong machine learning algorithms [1], [2], [3], [4], [5]. A closely related type of problem is to determine, for a given set of causal relations, the set of all distributions on observed variables that can be generated from them. A special case of both problems is the following decision problem: given a probability distribution and a hypothesis about the causal relations, determine whether the two are compatible: could the given distribution have been generated by the hypothesized causal relations? This is the problem that we focus on. We develop necessary conditions for a given distribution to be compatible with a given hypothesis about the causal relations.

In the simplest setting, the causal hypothesis consists of a directed acyclic graph (DAG) all of whose nodes correspond to observed variables. In this case, obtaining a verdict on the compatibility of a given distribution with the causal hypothesis is simple: the compatibility holds if and only if the distribution is Markov with respect to the DAG, which is to say that the distribution features all of the conditional independence relations that are implied by d-separation relations among variables in the DAG. The DAGs that are compatible with the given distribution can be determined algorithmically [1].[1]

A significantly more difficult case is when one considers a causal hypothesis which consists of a DAG some of whose nodes correspond to latent (i. e., unobserved) variables, so that the set of observed variables corresponds to a strict subset of the nodes of the DAG. This case occurs, e. g., in situations where one needs to deal with the possible presence of unobserved confounders, and thus is particularly relevant for experimental design in applications. With latent variables, the condition that all of the conditional independence relations among the observed variables that are implied by d-separation relations in the DAG is still a necessary condition for compatibility of a given such distribution with the DAG, but in general it is no longer sufficient, and this is what makes the problem difficult.

Whenever the observed variables in a DAG have finite cardinality,[2] one may also restrict the latent variables in the causal hypothesis to be of finite cardinality as well, without loss of generality [6]. As such, the mathematical problem which one must solve to infer the distributions that are compatible with the hypothesis is a quantifier elimination problem for some finite number of variables, as follows: The probability distributions of the observed variables can all be expressed as functions of the parameters specifying the conditional probabilities of each node given its parents, many of which involve latent variables. If one can eliminate these parameters, then one obtains constraints that refer exclusively to the probability distribution of the observed variables. This is a nonlinear quantifier elimination problem. The Tarski-Seidenberg theorem provides an in principle algorithm for an exact solution, but unfortunately the computational complexity of such quantifier elimination techniques is far too large to be practical, except in particularly simple scenarios [7], [8].[3] Most uses of such techniques have been in the service of deriving compatibility conditions that are necessary but not sufficient, for both observational [10], [11], [12], [13] and interventionist data [14], [15], [16].

Historically, the insufficiency of the conditional independence relations for causal inference in the presence of latent variables was first noted by Bell in the context of the hidden variable problem in quantum physics [17]. Bell considered an experiment for which considerations from relativity theory implied a very particular causal structure, and he derived an inequality that any distribution compatible with this structure, and compatible with certain constraints imposed by quantum theory, must satisfy. Bell also showed that this inequality was violated by distributions generated from entangled quantum states with particular choices of incompatible measurements. Later work, by Clauser, Horne, Shimony and Holt (CHSH) derived inequalities without assuming any facts about quantum correlations [18]; this derivation can retrospectively be understood as the first derivation of a constraint arising from the causal structure of the Bell scenario alone [19]. The CHSH inequality was the first example of a compatibility condition that appealed to the strength of the correlations rather than simply the conditional independence relations inherent therein. Since then, many generalizations of the CHSH inequality have been derived for the same sort of causal structure [20]. The idea that such work is best understood as a contribution to the field of causal inference has only recently been put forward [19], [21], [22], [23], as has the idea that techniques developed by researchers in the foundations of quantum theory may be usefully adapted to causal inference.[4]

Independently of Bell’s work, Pearl later derived the instrumental inequality [31], which provides a necessary condition for the compatibility of a distribution with a causal structure known as the instrumental scenario. This causal structure comes up when considering, for instance, certain kinds of noncompliance in drug trials. More recently, Steudel and Ay [32] derived an inequality which must hold whenever a distribution on n variables is compatible with a causal structure where no set of more than c variables has a common ancestor, for arbitrary n,cN. More recent work has focused specifically on the simplest nontrivial case, with n=3 and c=2, a causal structure that has been called the Triangle scenario [21], [33] (Fig. 1).

Recently, Henson, Lal and Pusey [22] have investigated those causal structures for which merely confirming that a given distribution on observed variables satisfies all of the conditional independence relations implied by d-separation relations does not guarantee that this distribution is compatible with the causal structure. They coined the term interesting for causal structures that have this property. They presented a catalogue of all potentially interesting causal structures having six or fewer nodes in [22, App. E], of which all but three were shown to be indeed interesting. Evans has also sought to generate such a catalogue [34]. The Bell scenario, the Instrumental scenario, and the Triangle scenario all appear in the catalogue, together with many others. Furthermore,they provided numerical evidence and an intuitive argument in favour of the hypothesis that the fraction of causal structures that are interesting increases as the total number of nodes increases. This highlights the need for moving beyond a case-by-case consideration of individual causal structures and for developing techniques for deriving constraints beyond conditional independence relations that can be applied to any interesting causal structure. Shannon-type entropic inequalities are an example of such constraints [21], [25], [32], [33], [35]. They can be derived for a given causal structure with relative ease, via exclusively linear quantifier elimination, since conditional independence relations are linear equations at the level of entropies. They also have the advantage that they apply for any finite cardinality of the observed variables. Recent work has also looked at non-Shannon type inequalities, potentially further strengthening the entropic constraints [26], [36]. However, entropic techniques are still wanting, since the resulting inequalities are often rather weak. For example, they are not sensitive enough to witness some known incompatibilities, in particular for distributions that only arise in quantum but not classical models with a given causal structure [21] , [26].[5]

In order to improve this state of affairs, we here introduce a new technique for deriving necessary conditions for the compatibility of a distribution of observed variables with a given causal structure, which we term the inflation technique. This technique is frequently capable of witnessing incompatibility when many other causal inference techniques fail. For example, in Example 2 of Sec. 3.2 we prove that the tripartite “W-type” distribution is incompatible with the Triangle scenario, despite the incompatibility being invisible to other causal inference tools such as conditional independence relations, Shannon-type [25], [33], [35] or non-Shanon-type entropic inequalities [26], or covariance matrices [27].

The inflation technique works roughly as follows. For a given causal structure under consideration, one can construct many new causal structures, termed inflations of this causal structure. An inflation duplicates one or more of the nodes of the original causal structure, while mirroring the form of the subgraph describing each node’s ancestry. Furthermore, the causal parameters that one adds to the inflated causal structure mirror those of the original causal structure. We show that if marginal distributions on certain subsets of the observed variables in the original causal structure are compatible with the original causal structure, then the same marginal distributions on certain copies of those subsets in the inflated causal structure are compatible with the inflated causal structure (Lemma 4). Similarly, we show that any necessary condition for compatibility of such distributions with the inflated causal structure translates into a necessary condition for compatibility with the original causal structure (Corollary 6). Thus, applying standard techniques for deriving causal compatibility inequalities to the inflated causal structure typically results in new causal compatibility inequalities for the original causal structure. The reader interested in seeing an example of how our technique works may want to take a sneak peak at Sec. 3.2.

Concretely, we consider causal compatibility inequalities for the inflated causal structure that are obtained as follows. One begins by identifying inequalities for the marginal problem, which is the problem of determining when a given family of marginal distributions on some subsets of variables can arise as marginals of a global joint distribution. One then looks for sets of variables within the inflated causal structure which admit of nontrivial d-separation relations. (We mainly consider sets of variables with disjoint ancestries.) For each such set, one writes down the appropriate factorization of their joint distribution. These factorization conditions are finally substituted into the marginal problem inequalities to obtain causal compatibility inequalities for the inflated causal structure. Although these constraints are extremely weak, the inflation technique turns them into powerful necessary conditions for compatibility with the original causal structure.

We show how to identify all relevant factorization conditions from the structure of the inflated causal structure, and also how to obtain all marginal problem inequalities by enumerating all facets of the associated marginal polytope (Sec. 4.2). Translating the resulting causal compatibility inequalities on the inflated causal structure back to the original causal structure, we obtain causal compatibility conditions in the form of nonlinear (polynomial) inequalities. As a concrete example of our technique, we present all the causal compatibility inequalities that can be derived in this manner from a particular inflation of the Triangle scenario (Sec. 4.3). In general, we also show how to efficiently obtain a partial set of marginal problem inequalities by enumerating transversals of a certain hypergraph (Sec. 4.4).

Besides the entropic techniques discussed above, our method is the first systematic tool for causal inference with latent variables that goes beyond observed conditional independence relations while not assuming any bounds on the cardinality of each latent variable. While our method can be used to systematically generate necessary conditions for compatibility with a given causal structure, we do not know whether the set of inequalities thus generated are also sufficient.

We present our technique primarily as a tool for standard causal inference, but we also briefly discuss applications to quantum causal models [22], [23], [39], [40], [41], [42], [43] and causal models within generalized probabilistic theories [22] (Sec. 5.4). In particular, we discuss when our inequalities are necessary conditions for a distribution of observed variables to be compatible with a given causal structure within any generalized probabilistic theory [44], [45] rather than simply within classical probability theory.

2 Basic definitions of causal models and compatibility

A causal model consists of a pair of objects: a causal structure and a family of causal parameters. We define each in turn. First, recall that a directed acyclic graph (DAG) G consists of a finite set of nodes Nodes(G) and a set of directed edges Edges(G)Nodes(G)×Nodes(G), meaning that an edge is an ordered pair of nodes, such that this directed graph is acylic, which means that there is no way to start and end at the same node by traversing edges forward. In the context of a causal model, each node XNodes(G) will be equipped with a random variable that we denote by the same letter X. A directed edge XY corresponds to the possibility of a direct causal influence from the variable X to the variable Y. In this way, the edges represent causal relations.

Our terminology for the causal relations between the nodes in a DAG is the standard one. The parents of a node X in G are defined as those nodes from which an outgoing edge terminates at X, i. e. PaG(X)={Y|YX}. When the graph G is clear from the context, we omit the subscript. Similarly, the children of a node X are defined as those nodes at which edges originating at X terminate, i. e. ChG(X)={Y|XY}. If X is a set of nodes, then we put PaG(X):=XXPaG(X) and ChG(X):=XXChG(X). The ancestors of a set of nodes X, denoted AnG(X), are defined as those nodes which have a directed path to some node in X, including the nodes in X themselves.[6] Equivalently, An(X):=nNPan(X), where Pan(X) is defined inductively via Pa0(X):=X and Pan+1(X):=Pa(Pan(X)).

A causal structure is a DAG that incorporates a distinction between two types of nodes: the set of observed nodes, and the set of latent nodes.[7] Following [22], we will depict the observed nodes by triangles and the latent nodes by circles, as in Fig. 1.[8] Henceforth, we will use G to refer to the causal structure rather than just the DAG, so that G includes a specification of which variables are observed, denoted ObservedNodes(G), and which are latent, denoted LatentNodes(G). Frequently, we will also imagine the causal structure to include a specification of the cardinalities of the observed variables. While these are finite in all of our examples, the inflation technique may apply in the case of continuous variables as well. Although we will not do so in this work, the inflation technique can also be applied in the presence of other types of constraints, e. g., when all variables are assumed to be Gaussian.

The second component of a causal model is a family of causal parameters. The causal parameters specify, for each node X, the conditional probability distribution over the values of the random variable X, given the values of the variables in Pa(X). In the case of root nodes, we have Pa(X)=, and the conditional distribution is an unconditioned distribution. We write PY|X for the conditional distribution of a variable Y given a variable X, while the particular conditional probability of the variable Y taking the value y given that the variable X takes the values x is denoted[9]PY|X(y|x). Therefore, a family of causal parameters has the form

(1){PX|PaG(X):XNodes(G)}.

Finally, a causal modelM consists of a causal structure together with a family of causal parameters,

M=(G,{PX|PaG(X):XNodes(G)}).

A causal model specifies a joint distribution of all variables in the causal structure via

(2)PNodes(G)=XNodes(G)PX|PaG(X),

where ∏ denotes the usual product of functions, so that e. g. (PY|X×PY)(x,y)=PY|X(y|x)PX(x). A distribution PNodes(G) arises in this way if and only if it satisfies the Markov conditions associated to G [1, Sec. 1.2].

The joint distribution of the observed variables is obtained from the joint distribution of all variables by marginalization over the latent variables,

(3)PObservedNodes(G)={U:ULatentNodes(G)}PNodes(G),

where U denotes marginalization over the (latent) variable U, so that (UPUV)(v):=uPUV(uv).

Definition 1.

A given distribution PObservedNodes(G) is compatible with a given causal structure G if there is some choice of the causal parameters that yields PObservedNodes(G) via Eqs. (2, 3). A given family of distributions on a family of subsets of observed variables is compatible with a given causal structure if and only if there exists some PObservedNodes(G) such that both

  1. PObservedNodes(G) is compatible with the causal structure, and

  2. PObservedNodes(G) yields the given family as marginals.

3 The inflation technique for causal inference

3.1 Inflations of a causal model

We now introduce the notion of an inflation of a causal model. If a causal model specifies a causal structure G, then an inflation of this model specifies a new causal structure, G, which we refer to as an inflation of G. For a given causal structure G, there are many causal structures G constituting an inflation of G. We denote the set of such causal structures Inflations(G). The particular choice of GInflations(G) then determines how to map a causal model M on G into a causal model M on G, since the family of causal parameters of M will be determined by a function M=InflationGG(M) that we define below. We begin by defining when a causal structure G is an inflation of G, building on some preliminary definitions.

For any subset of nodes XNodes(G), we denote the induced subgraph on X by SubDAGG(X). It consists of the nodes X and those edges of G which have both endpoints in X. Of special importance to us is the ancestral subgraphAnSubDAGG(X), which is the subgraph induced by the ancestry of X, AnSubDAGG(X):=SubDAGG(AnG(X)).

In an inflated causal structure G, every node is also labelled by a node of G. That is, every node of the inflated causal structure G is a copy of some node of the original causal structure G, and the copies of a node X of G in G are denoted X1,,Xk. The subscript that indexes the copies is termed the copy-index. A copy is classified as observed or latent according to the classification of the original. Similarly, any constraints on cardinality or other types of constraints such as Gaussianity are also inherited from the original. When two objects (e. g. nodes, sets of nodes, causal structures, etc…) are the same up to copy-indices, then we use ∼ to indicate this, as in XiXjX. In particular, XX for sets of nodes XNodes(G) and XNodes(G) if and only if X contains exactly one copy of every node in X. Similarly, SubDAGG(X)SubDAGG(X) means that in addition to XX, an edge is present between two nodes in X if and only if it is present between the two associated nodes in X.

In order to be an inflation, G must locally mirror the causal structure of G:

Definition 2.

The causal structure G is said to be an inflation of G, that is, GInflations(G), if and only if for every ViObservedNodes(G), the ancestral subgraph of Vi in G is equivalent, under removal of the copy-index, to the ancestral subgraph of V in G,

(4)GInflations(G)iffViObservedNodes(G):AnSubDAGG(Vi)AnSubDAGG(V).

Equivalently, the condition can be restated wholly in terms of local causal relationships, i. e.

(5)GInflations(G)iffXiNodes(G):PaG(Xi)PaG(X).

In particular, this means that an inflation is a fibration of graphs [46], although there are fibrations that are not inflations.

To illustrate the notion of inflation, we consider the causal structure of Fig. 1, which is called the Triangle scenario (for obvious reasons) and which has been studied recently by a number of authors [22 (Fig. E#8), 19 (Fig. 18b), 21 (Fig. 3), 33 (Fig. 6a), 40 (Fig. 1a), 47 (Fig. 8), 32 (Fig. 1b), 25 (Fig. 4b)]. Different inflations of the Triangle scenario are depicted in Figs. 2 to 6, which will be referred to as the Web, Spiral, Capped, and Cut inflation, respectively.

Figure 1 The Triangle scenario.
Figure 1

The Triangle scenario.

Figure 2 The Web inflation of the Triangle scenario where each latent node has been duplicated and each observed node has been quadrupled. The four copies of each observed node correspond to the four possible choices of parentage given the pair of copies of each latent parent of the observed node.
Figure 2

The Web inflation of the Triangle scenario where each latent node has been duplicated and each observed node has been quadrupled. The four copies of each observed node correspond to the four possible choices of parentage given the pair of copies of each latent parent of the observed node.

Figure 3 The Spiral inflation of the Triangle scenario. Notably, this causal structure is the ancestral subgraph of the set {A1A2B1B2C1C2}\{{A_{1}}{A_{2}}{B_{1}}{B_{2}}{C_{1}}{C_{2}}\} in the Web inflation (Fig. 2).
Figure 3

The Spiral inflation of the Triangle scenario. Notably, this causal structure is the ancestral subgraph of the set {A1A2B1B2C1C2} in the Web inflation (Fig. 2).

Figure 4 The Capped inflation of the Triangle scenario; notably also the ancestral subgraph of the set {A1A2B1C1}\{{A_{1}}{A_{2}}{B_{1}}{C_{1}}\} in the Spiral inflation (Fig. 3).
Figure 4

The Capped inflation of the Triangle scenario; notably also the ancestral subgraph of the set {A1A2B1C1} in the Spiral inflation (Fig. 3).

Figure 5 The Cut inflation of the Triangle scenario; notably also the ancestral subgraph of the set {A2B1C1}\{{A_{2}}{B_{1}}{C_{1}}\} in the Capped inflation (Fig. 4). Unlike the other examples, this inflation does not contain the Triangle scenario as a subgraph.
Figure 5

The Cut inflation of the Triangle scenario; notably also the ancestral subgraph of the set {A2B1C1} in the Capped inflation (Fig. 4). Unlike the other examples, this inflation does not contain the Triangle scenario as a subgraph.

Figure 6 A different depiction of the Cut inflation of Fig. 5.
Figure 6

A different depiction of the Cut inflation of Fig. 5.

We now define the function InflationGG, that is, we specify how causal parameters are defined for a given inflated causal structure in terms of causal parameters on the original causal structure.

Definition 3.

Consider causal models M and M where DAG(M)=G and DAG(M)=G, where G is an inflation of G. Then M is said to be the GGinflation ofM, that is, M=InflationGG(M), if and only if for every node Xi in G, the manner in which Xi depends causally on its parents within G is the same as the manner in which X depends causally on its parents within G. Noting that XiX and that PaG(Xi)PaG(X) by Eq. (5), one can formalize this condition as:

(6)XiNodes(G):PXi|PaG(Xi)=PX|PaG(X).

For a given triple G, G, and M, this definition specifies a unique inflation model M, resulting in a well-defined function InflationGG.

To sum up, the inflation of a causal model is a new causal model where (i) each variable in the original causal structure may have counterparts in the inflated causal structure with ancestral subgraphs mirroring those of the originals, and (ii) the manner in which a variable depends causally on its parents in the inflated causal structure is given by the manner in which its counterpart in the original causal structure depends causally on its parents. The operation of modifying a DAG and equipping the modified version with conditional probability distributions that mirror those of the original also appears in the do calculus and twin networks of Pearl [1], and moreover bears some resemblance to the adhesivity technique used in deriving non-Shannon-type entropic inequalities (see also Appendix E).

We are now in a position to describe the key property of the inflation of a causal model, the one that makes it useful for causal inference. With notation as in Definition 3, let PX and PX denote marginal distributions on some XNodes(G) and XNodes(G), respectively. Then

(7)ifXXandAnSubDAGG(X)AnSubDAGG(X),thenPX=PX.

This follows from the fact that the distributions on X and X depend only on their ancestral subgraphs and the parameters defined thereon, which by the definition of inflation are the same for X and for X. It is useful to have a name for those sets of observed nodes in G which satisfy the antecedent of Eq. (7), that is, for which one can find a copy-index-equivalent set in the original causal structure G with a copy-index-equivalent ancestral subgraph. We call such subsets of the observed nodes of Ginjectable sets,

(8)VInjectableSets(G)iffVObservedNodes(G):VVandAnSubDAGG(V)AnSubDAGG(V).

Similarly, those sets of observed nodes in the original causal structure G which satisfy the antecedent of Eq. (7), that is, for which one can find a corresponding set in the inflated causal structure G with a copy-index-equivalent ancestral subgraph, we describe as images of the injectable sets under the dropping of copy-indices,

(9)VImagesInjectableSets(G)iffVObservedNodes(G):VVandAnSubDAGG(V)AnSubDAGG(V).

Clearly, VImagesInjectableSets(G) iff VInjectableSets(G) such that VV.

For example in the Spiral inflation of the Triangle scenario depicted in Fig. 3, the set {A1B1C1} is injectable because its ancestral subgraph is equivalent up to copy-indices to the ancestral subgraph of {ABC} in the original causal structure, and the set {A2C1} is injectable because its ancestral subgraph is equivalent to that of {AC} in the original causal structure.

A set of nodes in the inflated causal structure can only be injectable if it contains at most one copy of any node from the original causal structure. More strongly, it can only be injectable if its ancestral subgraph contains at most one copy of any observed or latent node from the original causal structure. Thus, in Fig. 3, {A1A2C1} is not injectable because it contains two copies of A, and {A2B1C1} is not injectable because its ancestral subgraph contains two copies of Y.

We can now express Eq. (7) in the language of injectable sets,

(10)PV=PVifVVandVInjectableSets(G).

In the example of Fig. 3, injectability of the sets {A1B1C1} and {A2C1} thus implies that the marginals on each of these are equal to the marginals on their counterparts, {ABC} and {AC}, in the original causal model, so that PA1B1C1=PABC and PA2C1=PAC.

3.2 Witnessing incompatibility

Finally, we can explain why inflation is relevant for deciding whether a distribution is compatible with a causal structure. For a distribution PObservedNodes(G) to be compatible with G, there must be a causal model M that yields it. Per Definition 1, given a PObservedNodes(G) compatible with G, the family of marginals of PObservedNodes(G) on the images of the injectable sets of observed variables in G, {PV:VImagesInjectableSets(G)}, are also said to be compatible with G. Looking at the inflation model M=InflationGG(M), Eq. (10) implies that the family of distributions on the injectable sets given by {PV:VInjectableSets(G)} — where PV=PV for VV — is compatible with G.

The same considerations apply for any family of distributions such that each set of variables in the family corresponds to an injectable set (i. e., when the family of distributions is associated with an incomplete collection of injectable sets.) Formally,

Lemma 4.

Let the causal structureGbe an inflation of G. LetSInjectableSets(G)be a collection of injectable sets, and letSImagesInjectableSets(G)be the images of this collection under the dropping of copy-indices. If a distributionPObservedNodes(G)is compatible with G, then the family of distributions{PV:VS}is compatible with G per Definition1. Furthermore the corresponding family of distributions{PV:VS}, defined viaPV=PVforVV, must be compatible withG.

We have thereby related a question about compatibility with the original causal structure to one about compatibility with the inflated causal structure. If one can show that the new compatibility question on G is answered in the negative, then it follows that the original compatibility question on G is answered in the negative as well. Some simple examples serve to illustrate the idea.

Example 1 (Incompatibility of perfect three-way correlation with the Triangle scenario).

Consider the following causal inference problem. We are given a joint distribution of three binary variables, PABC, where the marginal on each variable is uniform and the three are perfectly correlated,

(11)PABC=[000]+[111]2,i.e.,PABC(abc)=12ifa=b=c,0otherwise,

and we would like to determine whether it is compatible with the Triangle scenario (Fig. 1). The notation [abc] in Eq. (11) is shorthand for the deterministic distribution where A, B, and C take the values a, b, and c respectively; in terms of the Kronecker delta, [abc]:=δA,aδB,bδC,c.

Since there are no conditional independence relations among the observed variables in the Triangle scenario, there is no opportunity for ruling out the distribution on the grounds that it fails to satisfy the required conditional independences.

To solve the causal inference problem, we consider the Cut inflation (Fig. 5). The injectable sets include {A2C1} and {B1C1}. Their images in the original causal structure are {AC} and {BC}, respectively.

We will show that the distribution of Eq. (11) is not compatible with the Triangle scenario by demonstrating that the contrary assumption of compatibility implies a contradiction. If the distribution of Eq. (11) were compatible with the Triangle scenario, then so too would its pair of marginals on {AC} and {BC}, which are given by:

PAC=PBC=[00]+[11]2.

By Lemma 4, this compatibility assumption would entail that the marginals

(12)PA2C1=PB1C1=[00]+[11]2

are compatible with the Cut inflation of the Triangle scenario. We now show that the latter compatibility cannot hold, thereby obtaining our contradiction. It suffices to note that (i) the only joint distribution that exhibits perfect correlation between A2 and C1 and between B1 and C1 also exhibits perfect correlation between A2 and B1, and (ii) A2 and B1 have no common ancestor in the Cut inflation and hence must be marginally independent in any distribution that is compatible with it.

We have therefore certified that the distribution PABC of Eq. (11) is not compatible with the Triangle scenario, recovering a result originally proven by Steudel and Ay [32].

Example 2 (Incompatibility of the W-type distribution with the Triangle scenario).

Consider another causal inference problem on the Triangle scenario, namely, that of determining whether the distribution

(13)PABC=[100]+[010]+[001]3,i.e.,PABC(abc)=13ifa+b+c=1,0otherwise.

is compatible with it. We call this the W-type distribution.[10] To settle this compatibility question, we consider the Spiral inflation of the Triangle scenario (Fig. 3). The injectable sets in this case include {A1B1C1}, {A2C1}, {B2A1}, {C2B1}, {A2}, {B2} and {C2}.

Therefore, we turn our attention to determining whether the marginals of the W-type distribution on the images of these injectable sets are compatible with the Triangle scenario. These marginals are:

(14)PABC=[100]+[010]+[001]3,
(15)PAC=PBA=PCB=[10]+[01]+[00]3,
(16)PA=PB=PC=23[0]+13[1].
By Lemma 4, this compatibility holds only if the associated marginals for the injectable sets, namely,
(17)PA1B1C1=[100]+[010]+[001]3,
(18)PA2C1=PB2A1=PC2B1=[10]+[01]+[00]3,
(19)PA2=PB2=PC2=23[0]+13[1],
are compatible with the Spiral inflation (Fig. 3). Eq. (18) implies that C1=0 whenever A2=1. It similarly implies that A1=0 whenever B2=1, and that B1=0 whenever C2=1,

(20)A2=1C1=0,B2=1A1=0,C2=1B1=0.

The Spiral inflation is such that A2, B2 and C2 have no common ancestor and consequently are marginally independent in any distribution compatible with it. Together with the fact that each value of these variables has a nonzero probability of occurrence (by Eq. (19)), this implies that

(21)SometimesA2=1andB2=1andC2=1.

Finally, Eq. (20) together with Eq. (21) entails

(22)SometimesA1=0andB1=0andC1=0.

This, however, contradicts Eq. (17). Consequently, the family of marginals described in Eqs. (1719) is not compatible with the causal structure of Fig. 3. By Lemma 4, this implies that the family of marginals described in Eqs. (1416)—and therefore the W-type distribution of which they are marginals—is not compatible with the Triangle scenario.

To our knowledge, this is a new result. In fact, the incompatibility of the W-type distribution with the Triangle scenario cannot be derived via any of the existing causal inference techniques. In particular:

  1. Checking conditional independence relations is not relevant here, as there are no conditional independence relations between any observed variables in the Triangle scenario.

  2. The relevant Shannon-type entropic inequalities for the Triangle scenario have been classified, and they do not witness the incompatibility [25], [33], [35].

  3. Moreover, no entropic inequality can witness the W-type distribution as unrealizable. Weilenmann and Colbeck [26] have constructed an inner approximation to the entropic cone of the Triangle causal structure, and the entropies of the W-distribution form a point in this cone. In other words, a distribution with the same entropic profile as the W-type distribution can arise from the Triangle scenario.

  4. The newly-developed method of covariance matrix causal inference due to Kela et al. [27], which gives tighter constraints than entropic inequalities for the Triangle scenario, also cannot detect the incompatibility.

Therefore, in this case at least, the inflation technique appears to be more powerful.

We have arrived at our incompatibility verdict by combining inflation with reasoning reminiscent of Hardy’s version of Bell’s theorem [49], [50]. Sec. 4.4 will present a generalization of this kind of argument and its applications to causal inference.

Example 3 (Incompatibility of PR-box correlations with the Bell scenario).

Bell’s theorem [17], [18], [20], [51] concerns the question of whether the distribution obtained in an experiment involving a pair of systems that are measured at space-like separation is compatible with a causal structure of the form of Fig. 7. Here, the observed variables are {A,B,X,Y}, and Λ is a latent variable acting as a common cause of A and B. We shall term this causal structure the Bell scenario. While the causal inference formulation of Bell’s theorem is not the traditional one, several recent articles have introduced and advocated this perspective [19 (Fig. 19), 22 (Fig. E#2), 23 (Fig. 1), 33 (Fig. 1), 52 (Fig. 2b), 53 (Fig. 2)].

Figure 7 The Bell scenario causal structure. The local outcomes, A and B, of a pair of measurements are assumed to each be a function of some latent common cause and their independent local experimental settings, X and Y.
Figure 7

The Bell scenario causal structure. The local outcomes, A and B, of a pair of measurements are assumed to each be a function of some latent common cause and their independent local experimental settings, X and Y.

We consider the distribution PABXY=PAB|XYPXPY, where PX and PY are arbitrary full-support distributions on {0,1},[11] and

(23)PAB|XY=12([00]+[11])ifx=0,y=012([00]+[11])ifx=1,y=012([00]+[11])ifx=0,y=112([01]+[10])ifx=1,y=1,i.e.,PAB|XY(ab|xy)=12ifab=x·y,0otherwise.

This conditional distribution was discovered by Tsirelson [54] and later independently by Popescu and Rohrlich [55], [56]. It has become known in the field of quantum foundations as the PR-box after the latter authors.[12]

Figure 8 An inflation of the Bell scenario causal structure, where both local settings and outcome variables have been duplicated.
Figure 8

An inflation of the Bell scenario causal structure, where both local settings and outcome variables have been duplicated.

The Bell scenario implies nontrivial conditional independences[13] among the observed variables, namely, XY, AY|X, and BX|Y, as well as those that can be generated from these by the semi-graphoid axioms [19]. It is straightforward to check that these conditional independence relations are respected by the PABXY resulting from Eq. (23). It is well-known that this distribution is nonetheless incompatible with the Bell scenario, since it violates the CHSH inequality. Here we present a proof of incompatibility in the style of Hardy’s proof of Bell’s theorem [49] in terms of the inflation technique, using the inflation of the Bell scenario depicted in Fig. 8.

We begin by noting that {A1B1X1Y1}, {A2B1X2Y1}, {A1B2X1Y2}, {A2B2X2Y2}, {X1}, {X2}, {Y1}, and {Y2} are all injectable sets. By Lemma 4, it follows that any causal model that recovers PABXY inflates to a model that results in marginals

(24)PA1B1X1Y1=PA2B1X2Y1=PA1B2X1Y2=PA2B2X2Y2=PABXY,
(25)PX1=PX2=PX,PY1=PY2=PY.
Using the definition of conditional probability, we infer that

(26)PA1B1|X1Y1=PA2B1|X2Y1=PA1B2|X1Y2=PA2B2|X2Y2=PAB|XY.

Because {X1}, {X2}, {Y1}, and {Y2} have no common ancestor in the inflated causal structure, these variables must be marginally independent in any distribution compatible with it, so that PX1X2Y1Y2=PX1PX2PY1PY2. Given the assumption that the distributions PX and PY have full support, it follows from Eq. (25) that

(27)SometimesX1=0andX2=1andY1=0andY2=1.

On the other hand, from Eq. (26) together with the definition of PR-box, Eq. (23), we conclude that

(28)X1=0,Y1=0A1=B1,X1=0,Y2=1A1=B2,X2=1,Y1=0A2=B1,X2=1,Y2=1A2B2.

Combining this with Eq. (27), we obtain

(29)SometimesA1=B1andA1=B2andA2=B1andA2B2.

No values of A1, A2, B1, and B2 can jointly satisfy these conditions. So we have reached a contradiction, showing that our original assumption of compatibility of PABXY with the Bell scenario must have been false.

The structure of this argument parallels that of standard proofs of the incompatibility of the PR-box with the Bell scenario. Standard proofs focus on a set of variables {A0A1B0B1} where Ax is the value of A when X=x and By is the value of B when Y=y. Note that the distribution ΛPA0|ΛPA1|ΛPB0|ΛPB1|ΛPΛ is a joint distribution of these four variables for which the marginals on pairs {A0B0}, {A0B1}, {A1B0} and {A1B1} are those that can arise in the Bell scenario. The existence of such a joint distribution rules out the possibility of having A1=B1, A1=B2, A2=B1 but A2B2, and therefore shows that the PR-box distribution is incompatible with the Bell scenario [57], [58]. In light of our use of Eq. (27), the reasoning based on the inflation of Fig. 8 is really the same argument in disguise.

Appendix G shows that the inflation of the Bell scenario depicted in Fig. 8 is sufficient to witness the incompatibility of any distribution that is incompatible with the Bell scenario.

3.3 Deriving causal compatibility inequalities

The inflation technique can be used not only to witness the incompatibility of a given distribution with a given causal structure, but also to derive necessary conditions that a distribution must satisfy to be compatible with the given causal structure. These conditions can always be expressed as inequalities, and we will refer to them as causal compatibility inequalities.[14] Formally, we have:

Definition 5.

Let G be a causal structure and let S be a family of subsets of the observed variables of G, S2ObservedNodes(G). Let IS denote an inequality that operates on the corresponding family of distributions, {PV:VS}. Then IS is a causal compatibility inequality for the causal structure G whenever it is satisfied by every family of distributions {PV:VS} that is compatible with G.

While violation of a causal compatibility inequality witnesses the incompatibility with the causal structure, satisfaction of the inequality does not guarantee compatibility. This is the sense in which it merely provides a necessary condition for compatibility.

The inflation technique is useful for deriving causal compatibility inequalities because of the following consequence of Lemma 4:

Corollary 6.

Suppose thatGis an inflation of G. LetSInjectableSets(G)be a family of injectable sets andSImagesInjectableSets(G)the images of members ofSunder the dropping of copy-indices. LetISbe a causal compatibility inequality forGoperating on families{PV:VS}. Define an inequalityISas follows: in the functional form ofIS, replace every occurrence of a termPVbyPVfor the uniqueVSwithVV. ThenISis a causal compatibility inequality for G operating on families{PV:VS}.

Proof.

Suppose that the family {PV:VS} is compatible with G. By Lemma 4, it follows that the family {PV:VS} where PV:=PV for VV is compatible with G. Since IS is a causal compatibility inequality for G, it follows that {PV:VS} satisfies IS. But by the definition of IS, its evaluation on {PV:VS} is equal to IS evaluated on {PV:VS}. It therefore follows that {PV:VS} satisfies IS. Since {PV:VS} was an arbitrary family compatible with G, we conclude that IS is a causal compatibility inequality for G.  □

We now present some simple examples of causal compatibility inequalities for the Triangle scenario that one can derive from the inflation technique via Corollary 6. Some terminology and notation will facilitate their description. We refer to a pair of nodes which do not share any common ancestor as being ancestrally independent. This is equivalent to being d-separated by the empty set [1], [2], [3], [4]. Given that the conventional notation for X and Y being d-separated by Z in a DAG is XdY|Z, we denote X and Y being ancestrally independent within G as XdY. Generalizing to sets, XdY indicates that no node in X shares a common ancestor with any node in Y within the causal structure G,

(30)XdYiffAnG(X)AnG(Y)=.

Ancestral independence is closed under union; that is, XdY and XdZ implies Xd(YZ). Consequently, pairwise ancestral independence implies joint factorizability; i. e., ijXidXj implies that PiXi=iPXi.

Example 4 (A causal compatibility inequality in terms of correlators).

As in Example 1 of the previous subsection, consider the Cut inflation of the Triangle scenario (Fig. 5), where all observed variables are binary. For technical convenience, we assume that they take values in the set {−1,+1}, rather than taking values in {0,1} as was presumed in the last subsection.

The injectable sets that we make use of are {A2C1}, {B1C1}, {A2}, and {B1}. From Corollary 6, any causal compatibility inequality for the inflated causal structure that operates on the marginal distributions of {A2C1}, {B1C1}, {A2}, and {B1} will yield a causal compatibility inequality for the original causal structure that operates on the marginal distributions on {AC}, {BC}, {A}, and {B}. We begin by noting that for any distribution on three binary variables {A2B1C1}, that is, regardless of the causal structure in which they are embedded, the marginals on {A2C1}, {B1C1} and {A2B1} satisfy the following inequality for expectation values [59], [60], [61], [62], [63],

(31)E[A2C1]+E[B1C1]1+E[A2B1].

This is an example of a constraint on pairwise correlators that arises from the presumption that they are consistent with a joint distribution. (The problem of deriving such constraints is the marginal constraint problem, discussed in detail in Sec. 4.)

But in the Cut inflation of the Triangle scenario (Fig. 5), A2 and B1 have no common ancestor and consequently any distribution compatible with this inflated causal structure must make A2 and B1 marginally independent. In terms of correlators, this can be expressed as

(32)A2dB1A2B1E[A2B1]=E[A2]E[B1].

Substituting this into Eq. (31), we have

(33)E[A2C1]+E[B1C1]1+E[A2]E[B1].

This is an example of a simple but nontrivial causal compatibility inequality for the causal structure of Fig. 5. Finally, by Corollary 6, we infer that

(34)E[AC]+E[BC]1+E[A]E[B]

is a causal compatibility inequality for the Triangle scenario. This inequality expresses the fact that as long as A and B are not completely biased, there is a tradeoff between the strength of AC correlations and the strength of BC correlations.

Given the symmetry of the Triangle scenario under permutations and sign flips of A, B and C, it is clear that the image of inequality (34) under any such symmetry is also a valid causal compatibility inequality. Together, these inequalities constitute a type of monogamy[15] of correlations in the Triangle scenario with binary variables: if any two observed variables with unbiased marginals are perfectly correlated, then they are both independent of the third.

Moreover, since inequality (31) is valid even for continuous variables with values in the interval [−1,+1], it follows that the polynomial inequality (34) is valid in this case as well.

Note that inequality (31) serves as a robust witness certifying the incompatibility of 3-way perfect correlation (described in Eq. (11)) with the Triangle scenario. Inequality (31) is robust in the sense that it demonstrates the incompatibility of distributions close to 3-way perfect correlation.

One might be curious as to how close to perfect correlation one can get while still being compatible with the Triangle scenario. To partially answer this question, we used Eq. (31) to rule out many distributions close to perfect correlation and we also pursued explicit model-construction to rule in various distributions sufficiently far from perfect correlation. Explicitly, we found that distributions of the form

(35)PABC=α[000]+[111]2+(1α)[else]6,i.e.,PABC(abc)=α2ifa=b=c,1α6otherwise,

where [else] denotes any point distribution [abc] other than [000] or [111], are incompatible for the range 58=0.625<α1 as a consequence of Eq. (31). On the other hand, we found a family of explicit models allowing us to certify the compatibility of distributions for 0α12.

The presence of this gap between our inner and outer constructions could reflect either the inadequacy of our limited model constructions or the inadequacy of relatively small inflations of the Triangle causal structure to generate suitably sensitive inequalities. We defer closing the gap to future work.[16]

Example 5 (A causal compatibility inequality in terms of entropic quantities).

One way to derive constraints that are independent of the cardinality of the observed variables is to express these in terms of the mutual information between observed variables rather than in terms of correlators. The inflation technique can also be applied to achieve this. To see how this works in the case of the Triangle scenario, consider again the Cut inflation (Fig. 5).

One can follow the same logic as in the preceding example, but starting from a different constraint on marginals. For any distribution on three variables {A2B1C1} of arbitrary cardinality (again, regardless of the causal structure in which they are embedded), the marginals on {A2C1}, {B1C1} and {A2B1} satisfy the inequality [35, Eq. (29)]

(36)I(A2:C1)+I(C1:B1)H(C1)+I(A2:B1),

where H(X) denotes the Shannon entropy of the distribution of X, and I(X:Y) denotes the mutual information between X and Y with respect to the marginal joint distribution on the pair of variables X and Y. The fact that A2 and B1 have no common ancestor in the inflated causal structure implies that in any distribution that is compatible with it, A2 and B1 are marginally independent. This is expressed entropically as the vanishing of their mutual information,

(37)A2dB1A2B1I(A2:B1)=0.

Substituting the latter equality into Eq. (36), we have

(38)I(A2:C1)+I(C1:B1)H(C1).

This is another example of a nontrivial causal compatibility inequality for the causal structure of Fig. 5. By Corollary 6, it follows that

(39)I(A:C)+I(C:B)H(C)

is also a causal compatibility inequality for the Triangle scenario. This inequality was originally derived in [21]. Our rederivation in terms of inflation coincides with the proof found by Henson et al. [22].

Standard algorithms already exist for deriving entropic casual compatibility inequalities given a causal structure [25], [33], [35]. We do not expect the methodology of causal inflation to offer any computation advantage in the task of deriving entropic inequalities. The advantage of the inflation approach is that it provides a narrative for explaining an entropic inequality without reference to unobserved variables. As elaborated in Sec. 5.4, this consequently has applications to quantum information theory. A further advantage is the potential of the inflation approach to give rise to non-Shannon type inequalities, starting from Shannon type inequalities; see Appendix E for further discussion.

Example 6 (A causal compatibility inequality in terms of joint distributions).

Consider the Spiral inflation of the Triangle scenario (Fig. 3) with the injectable sets {A1B1C1}, {A1B2}, {B1C2}, {A1,C2}, {A2}, {B2}, and {C2}. We derive a causal compatibility inequality under the assumption that the observed variables are binary, adopting the convention that they take values in {0,1}.

We begin by noting that the following is a constraint that holds for any joint distribution of {A1B1C1A2B2C2}, regardless of the causal structure,

(40)PA2B2C2(111)PA1B2C2(111)+PB1C2A2(111)+PA2C1B2(111)+PA1B1C1(000).

To prove this claim, it suffices to check that the inequality holds for each of the 26 deterministic assignments of outcomes to {A1B1C1A2B2C2}, from which the general case follows by convex linearity. A more intuitive proof will be provided in Sec. 4.4.

Next, we note that certain sets of variables have no common ancestors with other sets of variables in the inflated causal structure, which implies the marginal independence of these sets. Such independences are expressed in the language of joint distributions as factorizations,

(41)A1B2dC2PA1B2C2=PA1B2PC2,B1C2dA2PB1C2A2=PB1C2PA2,A2C1dB2PA2C1B2=PA2C1PB2,A2dB2dC2PA2B2C2=PA2PB2PC2.

Substituting these factorizations into Eq. (40), we obtain the polynomial inequality

(42)PA2(1)PB2(1)PC2(1)PA1B2(11)PC2(1)+PB1C2(11)PA2(1)+PA2C1(11)PB2(1)+PA1B1C1(000).

This, therefore, is a causal compatibility inequality for the inflated causal structure. Finally, by Corollary 6, we infer that

(43)PA(1)PB(1)PC(1)PAB(11)PC(1)+PBC(11)PA(1)+PAC(11)PB(1)+PABC(000)

is a causal compatibility inequality for the Triangle scenario.

What is distinctive about this inequality is that—through the presence of the term PABC(000)—it takes into account genuine three-way correlations, while the inequalities we derived earlier only depend on the two-variable marginals. This inequality is strong enough to demonstrate the incompatibility of the W-type distribution of Eq. (13) with the Triangle scenario: for this distribution, the right-hand side of the inequality vanishes while the left-hand side does not.

Of the known techniques for witnessing the incompatibility of a distribution with a causal structure or deriving necessary conditions for compatibility, the most straightforward one is to consider the constraints implied by ancestral independences among the observed variables of the causal structure. The constraints derived in the last two sections have all made use of this basic technique, but at the level of the inflated causal structure rather than the original causal structure. The constraints that one thereby infers for the original causal structure reflect facts about it that cannot be expressed in terms of ancestral independences among its observed variables. The inflation technique exposes these facts in the ancestral independences among observed variables of the inflated causal structure.

In the rest of this article, we shall continue to rely only on the ancestral independences among observed variables within the inflated causal structure to derive examples of compatibility constraints on the original causal structure. Nonetheless, it seems plausible that the inflation technique can also amplify the power of other techniques that do not merely consider ancestral independences among the observed variables. We consider some prospects in Sec. 5.

4 Systematically witnessing incompatibility and deriving inequalities

This section considers the problem of how to generalize the above examples of causal inference via the inflation technique to a systematic procedure. We start by introducing the crucial concept of an expressible set, which figures implicitly in our earlier examples. By reformulating Example 1, we sketch our general method and explain why solving a marginal problem is an essential subroutine of our method. Subsequently, Sec. 4.1 explains how to systematically identify, for a given inflated causal structure, all of the sets that are expressible by virtue of ancestral independences. Sec. 4.2 describes how to solve any sort of marginal problem. This may involve determining all the facets of the marginal polytope, which is computationally costly (Appendix A). It is therefore useful to also consider relaxations of the marginal problem that are more tractable by deriving valid linear inequalities which may or may not bound the marginal polytope tightly. We describe one such approach based on possibilistic Hardy-type paradoxes and the hypergraph transversal problem in Sec. 4.4.

As far as causal compatibility inequalities are concerned, we limit ourselves to those expressed in terms of probabilities,[17] as these are generally the most powerful. However, essentially the same techniques can be used to derive inequalities expressed in terms of entropies [35], as demonstrated in Example 5.

In the examples from the previous section, the initial inequality—a constraint upon marginals that is independent of the causal structure—involves sets of observed variables that are not all injectable sets. However, the Markov conditions on the inflated causal structures nevertheless allowed us to express the distribution on these sets in terms of the known distributions on the injectable sets. For instance, in Example 4, the set {A2B1} is not injectable, but it can be partitioned into the singleton sets {A2} and {B1} which are ancestrally independent, so that one has PA2B1=PA2PB1=PAPB in every inflated causal model. This motivates us to define the notion of an expressible set of variables in an inflated causal structure as one for which the joint distribution can be expressed as a function of distributions over injectable sets by making repeated use of the conditional independences implied by d-separation relations as well as marginalization. More formally,

Definition 7.

Consider an inflation G of a causal structure G. Sufficient conditions for a set of variables VObservedNodes(G) to be expressible include VInjectableSets(G), or if V can be obtained from a collection of injectable sets by recursively applying the following rules:

  1. For X,Y,ZObservedNodes(G), if XdY|Z and XZ and YZ are expressible, then XYZ is also expressible. This follows by constructing

    PXYZ(xyz)=PXZ(xz)PYZ(yz)PZ(z)ifPZ(z)>0,0ifPZ(z)=0.
  2. If VObservedNodes(G) is expressible, then so is every subset of V. This follows by marginalization.

An expressible set is maximal if it is not a proper subset of another expressible set.

Expressible sets are important since in an inflated model, the distribution of the variables making up an expressible set can be computed explicitly from the known distributions on the injectable sets, by repeatedly using the conditional independences implied by d-separation and taking marginals. Appendix D.1 provides a good example.

With the exception of Appendix D, in the remainder of this article we will limit ourselves to working with expressible sets of a particularly simple kind and leave the investigation of more general expressible sets to future work.

Definition 8.

A set of nodes VObservedNodes(G) is ai-expressible if it can be written as a union of injectable sets that are ancestrally independent,

(44)VAIExpressibleSets(G)iff{XiInjectableSets(G)}s.t.V=iXiandij:XidXjinG.

An ai-expressible set is maximal if it is not a proper subset of another ai-expressible set.

Because ancestral independence in G implies statistical independence for any compatible distribution, it follows that if V is an ai-expressible set with ancestrally independent and injectable components V1,,Vn, then we have the factorization

(45)PV=PV1PVn

for any distribution compatible with G. The situation, therefore, is this: for any constraint that one can derive for the marginals on the ai-expressible sets based on the existence of a joint distribution—and hence without reference to the causal structure—one can infer a constraint that does refer to the causal structure by substituting within the derived constraint a factorization of the form of Eq. (45). This results in a causal compatibility inequality on G of a very weak form that only takes into account the independences between observed variables.

As a build-up to our exposition of a systematic application of the inflation technique, we now revisit Example 1. As before, to demonstrate the incompatibility of the distribution of Eq. (11) with the Triangle scenario, we assume compatibility and derive a contradiction. Given the distribution of Eq. (11), Lemma 4 implies that the marginal distributions on the injectable sets of the Cut inflation of the Triangle scenario are

(46)PA2C1=PB1C1=12[00]+12[11],

and

(47)PA2=PB1=12[0]+12[1].

From the fact that A2 and B1 are ancestrally independent in the Cut inflation, we also infer that the distribution on the ai-expressible set {A2B1} must be

(48)PA2B1=PA2PB1=12[0]+12[1]×12[0]+12[1]=14[00]+14[01]+14[10]+14[11].

But there is no three-variable distribution PA2B1C1 that would have as its two-variable marginals the distributions of Eqs. (46, 48). For as we noted in our prior discussion of this example, the perfect correlation between A2 and C1 exhibited by PA2C1 and the perfect correlation between B1 and C1 exhibited by PB1C1 would entail perfect correlation between A2 and B1 as well, which is at odds with (48). We have therefore derived a contradiction and consequently can infer the incompatibility of the distribution of Eq. (11) with the Triangle scenario.

Generalizing to an arbitrary causal structure, therefore, the procedure is as follows:

  1. Based on the inflation under consideration, identify the ai-expressible sets and how they each partition into ancestrally independent injectable sets.

  2. From the given distribution on the original causal structure, infer the family of distributions on the ai-expressible sets of the inflated causal structure as follows: the distribution on any injectable set is equal to the corresponding distribution on its image in the original causal structure; the distribution on any ai-expressible set is the product of the distributions on the injectable sets into which it is partitioned.

  3. Determine whether the family of distributions obtained in step 2 are the marginals of a single joint distribution. If not, then the original distribution is incompatible with the original causal structure.

We have just described how to test a specified joint distribution for compatibility with a given causal structure by means of considering an inflation of that causal structure. Passing the inflation-based test is a necessary but not sufficient requirement for the specified joint distribution to be compatible with a given causal structure. The procedure is to focus on a particular family of marginals (on the images of injectable sets) of the given joint distribution, then from products of these, obtain the distribution on each of the ai-expressible sets. Finally, one asks simply whether the family of distributions on the ai-expressible sets are consistent in the sense of all being marginals of a single joint distribution. By analogous logic, the following technique allows one to systematically derive causal compatibility inequalities: find the constraints that any family of distributions on the ai-expressible sets must satisfy if these are to be consistent in the sense of all being marginals of a single joint distribution. Next, express each distribution of this family as a product of distributions on the injectable sets, according to Eq. (45), and rewrite the constraints in terms of the family of distributions on the injectable sets. These constraints constitute causal compatibility inequalities for the inflated causal structure. Finally, one can rewrite the constraints in terms of the family of distributions on the images of the injectable sets, using Corollary 6, to obtain causal compatibility inequalities for the original causal structure.

In summary, we have used the contrapositive of Lemma 4 in order to show:

Theorem 9.

LetGbe an inflation of G. Let a distributionPObservedNodes(G)be given. Consider the family of distributions{PV:VAIExpressibleSets(G)}. Following Eq. (45), each distribution in that set factorizes according toPV=i=1nPVi, where the variable subsetsV1Vnassociated with the factorization are precisely the injectable components of the ai-expressible setV. Additionally, for every injectable setVi, letPVi=PViwherePViis the marginal onViofPObservedNodes(G), and whereViVi. If the family of distributions{PV:VAIExpressibleSets(G)}does not arise as the family of marginals of some joint distribution, then the original distributionPObservedNodes(G)is not compatible with G.

The ai-expressible sets play a crucial role in linking the original causal structure with the inflated causal structure. They are precisely those sets of variables whose joint distributions in the inflation model are fully specified by the causal model on the original causal structure, as they can be computed using Eq. (45) and Lemma 4. So we begin with the problem of identifying the ai-expressible sets systematically.

4.1 Identifying the AI-expressible sets

To identify the ai-expressible sets of an inflated causal structure G, we must first identify the injectable sets. This problem can be reduced to identifying the injectable pairs of nodes, because if all of the pairs in a set of nodes are injectable, then so too is the set itself. This can be proven as follows. Let φ:GG be the projection map from G to the original causal structure G, corresponding to removing copy-indices. Then φ has the characteristic feature that it preserves and reflects edges: if AB in G, then also φ(A)φ(B) in G, and vice versa; this follows from the assumption that G is an inflation of G. A set VObservedNodes(G) is injectable if and only if the restriction of φ to An(V) is an injective map. But now injectivity of a map means precisely that no two different elements of the domain get mapped to the same element of the codomain. So if V is injectable, then so is each of its two-element subsets; conversely, if V is not injectable, then φ maps two nodes among the ancestors of V to the same node, which means that there are two nodes in the ancestry that differ only by copy-index. Each of these two nodes must be an ancestor of at least some node in V; if one chooses two such descendants, then one gets a two-element subset of V such that φ is not injective on the ancestry of that subset, and therefore this two-element set of observed nodes is not injectable.

To enumerate the injectable sets, it is therefore useful to encode certain features of the inflated causal structure in an undirected graph which we call the injection graph. The nodes of the injection graph are the observed nodes of the inflated causal structure, and a pair of nodes Ai and Bj share an edge if the pair {AiBj} is injectable. For example, Fig. 9 shows the injection graph of the Spiral inflation of the Triangle scenario (Fig. 3). The property noted above states that the injectable sets are precisely the cliques[18] of the injection graph. While for many other applications only the maximal cliques are of interest, our application of the inflation technique requires knowledge of all nonempty cliques.

Given a list of the injectable sets, the ai-expressible sets can be read off from the ai-expressability graph. The nodes of the ai-expressibility graph are taken to be the injectable sets in G, and two nodes share an edge if the associated injectable sets are ancestrally independent. Fig. 10 depicts an example. The ai-expressible sets correspond to the cliques of the ai-expressibility graph: the union of all the injectable sets that make up the nodes of a clique is an ai-expressible set, while the individual nodes already give us the partition into injectable sets relevant for the factorization relation of Eq. (45). For our purposes, it is sufficient to enumerate the maximal ai-expressible sets, so that one only needs to consider the maximal cliques of the ai-expressibility graph.

Figure 9 The injection graph corresponding to the Spiral inflation of the Triangle scenario (Fig. 3), wherein the cliques are the injectable sets.
Figure 9

The injection graph corresponding to the Spiral inflation of the Triangle scenario (Fig. 3), wherein the cliques are the injectable sets.

Figure 10 The ai-expressibility graph corresponding to the Spiral inflation of the Triangle scenario (Fig. 3), wherein two injectable sets are adjacent iff they are ancestrally independent. A set of nodes is ai-expressible iff it arises as a union of sets that form a clique in this graph.
Figure 10

The ai-expressibility graph corresponding to the Spiral inflation of the Triangle scenario (Fig. 3), wherein two injectable sets are adjacent iff they are ancestrally independent. A set of nodes is ai-expressible iff it arises as a union of sets that form a clique in this graph.

From Figs. 9 and 10, we easily infer the injectable sets and the maximal ai-expressible sets, as well as the partition of the maximal ai-expressible sets into ancestrally independent subsets. For the Spiral example, this results in:

(49){A1},{B1},{C1},{A2},{B2},{C2},{A1B1},{A1C1},{B1C1},{A1B2}.{A2C1},{B1C2},{A1B1C1}The injectable sets{A1B1C1}{A1B2C2}{B1C2A2}{C1A2B2}{A2B2C2}The maximalai-expressible sets{A1B2}d{C2}{B1C2}d{A2}{C1A2}d{B2}{A2}d{B2}d{C2}The relevantancestral independences

Having identified the ai-expressible sets and how they partition into injectable sets, we now infer the factorization relations implied by ancestral independences, which is Eq. (41) in the Spiral example. Next, we discuss the other ingredient of our systematic procedure: the marginal problem.

4.2 The marginal problem and its solution

The third step in our procedure is determining whether the given distributions on ai-expressible sets can arise as marginals of one joint distribution on all observed nodes of the inflated causal structure. In general, the problem of determining whether a given family of distributions can arise as marginals of some joint distribution is known as the marginal problem.[19] In order to derive causal compatibility inequalities, one must solve the closely related problem of determining necessary and sufficient constraints that a family of marginal distributions must satisfy in order for the marginal problem to have a solution. For better clarity, we distinguish these two variants of the marginal problem as the marginal satisfiability problem and the marginal constraint problem. The generic marginal problem will be used as an umbrella term referring to both types.

Figure 11 The simplicial complex of ai-expressible sets for the Spiral inflation of the Triangle scenario (Fig. 3). The 5 facets correspond to the maximal ai-expressible sets, namely {A1B1C1}\{{A_{1}}{B_{1}}{C_{1}}\}, {A1B2C2}\{{A_{1}}{B_{2}}{C_{2}}\}, {A2B1C2}\{{A_{2}}{B_{1}}{C_{2}}\}, {A2B2C1}\{{A_{2}}{B_{2}}{C_{1}}\} and {A2B2C2}\{{A_{2}}{B_{2}}{C_{2}}\}.
Figure 11

The simplicial complex of ai-expressible sets for the Spiral inflation of the Triangle scenario (Fig. 3). The 5 facets correspond to the maximal ai-expressible sets, namely {A1B1C1}, {A1B2C2}, {A2B1C2}, {A2B2C1} and {A2B2C2}.

To specify either sort of marginal problem, one must specify the full set of variables to be considered, denoted V, together with a family of subsets of S, denoted (V1,,Vn) and called contexts. The family of contexts can be visualized through the simplicial complex that it generates, as illustrated in Fig. 11. A marginal scenario consists of a specification of contexts together with a specification of the cardinality of each variable. Every joint distribution PV defines a family of marginal distributions (PV1,,PVn) through marginalization, PVi:=VViPV. The marginal problem concerns the converse inference. In the marginal satisfiability problem, a concrete family of distributions (PV1,,PVn) is given, and one wants to decide whether there exists a joint distribution PˆV such that PVi=VViPˆV for all i. In the marginal constraint problem, one seeks to find conditions on the family of distributions (PV1,,PVn), considered as parameters, for when a joint distribution PˆV exists which reproduces these as marginals, PVi=VViPˆV for all i.

In order for PˆV to exist, distributions on different contexts must be consistent on the intersection of contexts, that is, marginalizing PVi to those variables in the intersection ViVj must result in the same distribution as marginalizing PVj to that intersection. In many cases, this is not sufficient;[20] indeed, we have already seen examples of additional constraints, namely, the inequalities (31), (36) and (40) from Sec. 3.3. So what are the necessary and sufficient conditions? To answer this question, it helps to realize two things:

  1. The set of all valid (positive, normalized) distributions PV is precisely the convex hull of the deterministic assignments of values to V (the deterministic distributions), and

  2. The map PV(PV1,,PVn), describing marginalization to each of the contexts in (V1,,Vn), is linear.

Hence the image of the set of possibilities for the distribution PV under the map PV(PV1,,PVn) is exactly the convex hull of the deterministic assignments of values to (V1,,Vn) which are consistent where these contexts overlap. Since there are only finitely many such deterministic assignments, this convex hull is a polytope; it is called the marginal polytope [68]. Together with the above equations on coinciding submarginals, the facet inequalities of this polytope solve the marginal constraint problem. The marginal satisfiability problem asks about membership in the polytope; by the above, this becomes a linear program with the joint probabilities PV as the unknowns.

To express this more concretely, we write the marginal satisfiability problem in the form of a generic linear program.

Let the joint distribution vectorv be the vector associated with the joint probability distribution PV, that is, the vector whose components are the probabilities PV(v). Let the marginal distribution vectorb be the vector that is the concatenation over i of the vectors associated with the distributions PVi. Finally, let the marginal description matrixM be the matrix representation of the linear map corresponding to marginalization on each of the contexts, that is, PV(PV1,,PVn) where PVi=VViPV. The components of M all take the value zero or one.

In this notation, the marginal satisfiability problem consists of determining whether, for a given vector b, the following constraints are feasible:

(50)v:v0,Mv=b,

where the component-wise inequality v0 enforces the constraint that PV is a nonnegative probability distribution. This is clearly a linear program.

In the example of Fig. 11 with binary variables, M is a 48×64 matrix, so that Mv=b represents 48 equations and v0 represents 64 inequalities; explicit representations of M, v, and b for the simpler example of the Cut inflation can be found in Appendix B. A single linear program can then assess whether there is a solution in v for a given marginal distribution vector b. If this is not the case, then the marginal satisfiability problem has a negative answer.

Since linear programming is quite easy, probing specific distributions for compatibility for a given inflated causal structure is computationally inexpensive. For instance, using the Web inflation of the Triangle scenario (Fig. 2), which contains a large number of observed variables, our numerical computations have reproduced the result of [21, Theorem 2.16], that a certain distribution considered therein is incompatible with the Triangle scenario.[21]

In the case of the marginal constraint problem, the vector b is not given, but one rather wants to find conditions on b that hold if and only if Eq. (50) has a solution. As per the above, this is a problem of facet enumeration[22] for the marginal polytope. Equivalently, it is the problem of linear quantifier elimination[23] for the system of Eq. (50): one tries to find a system of linear equations and inequalities in b such that some b satisfies the system if and only if Eq. (50) has a solution. There is a unique minimal system achieving this, and it consists of the constraints of consistency on the intersections of contexts (mentioned above), together with the facet inequalities of the marginal polytope. Taken together, these form a system of linear equations and inequalities that is equivalent to Eq. (50), but does not contain any quantifiers. In our application, the equations expressing consistency on the intersections of contexts are guaranteed to hold automatically, so that only the facet inequalities are of interest to us.

In terms of Eq. (50), a valid inequality for the marginal distribution vector b—such as a facet inequality of the marginal polytope—can always be expressed as yTb0 for some vector y. Validity of an inequality yTb0 means precisely that yTM0, since the columns of M are the vertices of the marginal polytope. The marginal satisfiability problem for a given vector b0 has no solution if and only if there is a vector y that yields a valid inequality but for which yTb0<0. Necessity follows by noting that if Eq. (50) does have a solution v for a given vector b0, then the fact that yTM0 and the fact that v0 implies that yTb0=yTMv0. Sufficiency follows from Farkas’ lemma. Most linear programming tools are capable of returning a Farkas infeasibility certificate [69] whenever a linear program has no solution. In our case, if the marginal problem is infeasible for a vector b0, then the certificate is a vector y that yields a valid inequality but for which yTb0<0.[24]

Upon substituting the factorization relations of Eq. (45) and deleting copy indices, any valid inequality for the marginal problem turns into a causal compatibility inequality. This applies both to facet inequalities of the marginal polytope, and to Farkas infeasibility certificates. In the latter case, one obtains an explicit causal compatibility inequality which witnesses the given distribution as incompatible with the given causal structure. In other words, if a given distribution is witnessed as incompatible with a causal structure using the technique we have described, then with little additional numerical effort, one can also obtain a causal compatibility inequality that exhibits the incompatibility. This may have applications to problems where the facet enumeration is computationally intractable.

Summarizing, we have shown how to leverage the marginal satisfiability problem to witness causal incompatibility of particular distributions, and how to leverage the marginal constraint problem to derive causal compatibility inequalities.

4.3 A list of causal compatibility inequalities for the triangle scenario

As an example of the above method, we have considered the Triangle scenario with binary observed variables and derived all causal compatibility inequalities which follow by means of using ancestral independences in the Spiral inflation (Fig. 3). We found that there are 4884 inequalities corresponding to the facets of the relevant marginal polytope, which results in 4884 polynomial causal compatibility inequalities for the Triangle scenario.

However, most inequalities in this set have turned out to be redundant, where an inequality is considered redundant if there is no distribution that violates this inequality but none of the others. We thus have looked for a subset of inequalities that is irredundant (does not contain any redundant inequality) but nevertheless complete (defines the same set of distributions as the full set). While a finite system of linear inequalities always has a unique irredundant complete subset, this need not be the case for finite systems of polynomial inequalities; we therefore speak of “a” complete irredundant set instead of “the” complete irredundant set.

We exploited linear programming techniques to quickly identify a 1433-inequalities complete subset of our original 4884 inequalities; concretely, the copy isomorphisms of Appendix C yield an additional list of linear equations satisfied by all inflation models, and from every set of inequalities that differ by merely a linear combination of these equations we choose one representative. To further prune away redundant inequalities, we successively employed nonlinear constrained maximization on each inequality’s left-hand-side, to determine numerically if it could be violated pursuant to all the other inequalities as constraints. An inequality is found to be redundant if the solution to the constrained maximization does not exceed the inequality’s right-hand side. Such an inequality was immediately dropped from the set before testing the next candidate for redundancy.[25] This post-processing led us to identify 60 irredundant inequalities which defines the same set of satisfying distributions as the original 4884. Of the remaining 60, we recognized 8 as uninteresting positivity inequalities, PABC(abc)0, so that our irredundant complete system consists of 52 polynomial inequalities.

To present those inequalities in an efficient manner, we further grouped them into four symmetry classes. In Eqs. (5154) we present one representative from each class; the multiplicity of inequalities contained in each symmetry class is marked in parentheses. The symmetry group for any causal structure with finite-cardinality observed variables is generated by those permutations of the observed variables which can be extended to automorphisms of the (original) DAG, as well as any permutation among the discrete values assigned to an individual observed variable (i. e., bijections on the sample space of that variable). In the case of the Triangle scenario with binary observed variables, the symmetry group therefore has 48 elements, comprised of the 6 permutations of the three observed variables, the three local binary-value relabellings, and all their compositions (48=6×2×2×2).

We choose to express our inequalities in terms of correlators (where the two possible values of each variables to be {−1,+1}), rather than in terms of joint probabilities, because such a presentation is more compact:

(51)01E[AC]E[BC]+E[A]E[B](×12)
(52)03E[A]E[B]E[C]+2E[AB]+2E[AC]+2E[BC]+E[ABC]+E[A]E[B]+E[A]E[C]+E[B]E[C]E[A]E[BC]E[B]E[AC]E[C]E[AB]+E[A]E[B]E[C](×8)
(53)04+2E[C]2E[AB]3E[AC]2E[BC]E[ABC]+E[A]E[B]E[C]+2E[A]E[B]+E[A]E[C]E[A]E[BC]E[C]E[AB](×24)
(54)042E[AB]2E[AC]2E[BC]E[ABC]+2E[A]E[B]+2E[A]E[C]+2E[B]E[C]E[A]E[BC]E[B]E[AC]E[C]E[AB](×8)
All the inequalities (5154) have no slack in the sense that they can be saturated by distributions compatible with the Triangle scenario. Indeed, all the inequalities are saturated by the deterministic distribution E[A]=E[B]=E[C]=1, except for Eq. (52) which is saturated by the deterministic distribution E[A]=E[B]=E[C]=1. Generally speaking, any polynomial inequality generated by a facet of the marginal polytope (i. e. corresponding to some linear inequality in the variables of the inflated causal structure) will be saturated by some deterministic distribution.

A machine-readable and closed-under-symmetries version of this list of inequalities may be found in Appendix F.

4.4 Causal compatibility inequalities via hardy-type inferences from logical tautologies

Enumerating all the facets of the marginal polytope is computationally feasible only for small examples. But our method transforms every inequality that bounds the marginal polytope into a causal compatibility inequality. We now present a general approach for deriving a special type of such inequalities very quickly.

In the literature on Bell inequalities, it has been noticed that incompatibility with the Bell causal structure can sometimes be witnessed by merely looking at which joint outcomes have zero probability and which ones have nonzero probability. In other words, instead of considering the probability of an outcome, the inconsistency of some marginal distributions can be evident from considering only the possibility or impossibility of each outcome. This insight is originally due to Hardy [49], and versions of Bell’s theorem that are based on the violation of such possibilistic constraints are known as Hardy-type paradoxes [57], [70], [71], [72], [73]; a partial classification of these can be found in [50]. The method that we describe in the second half of this section can be used to compute a complete classification of possibilistic constraints for any marginal problem.

Possibilistic constraints follow from a consideration of logical relations that can hold among deterministic assignments to the observed variables. Such logical constraints can also be leveraged to derive probabilistic constraints instead of possibilistic ones, as shown in [60], [74]. This results in a partial solution to any given (probabilistic) marginal problem. Essentially, we solve a possibilistic marginal problem [50], then upgrade the possibilistic constraints into probabilistic inequalities, resulting in a set of probabilistic inequalities whose satisfaction is a necessary but insufficient condition for satisfying the corresponding probabilistic marginal problem. We now demonstrate how to systematically derive all inequalities of this type.

We have already provided a simple example of a Hardy-type argument in Example 2, in the logic used to demonstrate that the family of distributions of Eqs. (1719) cannot arise as the marginals of a single joint distribution. For our present purposes, it is useful to recast that argument into a new but manifestly equivalent form. First, for the family of distributions in question, we have

(55)A2=1C1=0,B2=1A1=0,C2=1B1=0,NeverA1=0andB1=0andC1=0.

From the last constraint one infers that at least one of A1, B1 and C1 must be 1, which from the three other constraints implies that at least one of A2, B2 and C2 must be 0, so that it is not the case that all of A2, B2 and C2 are 1. Thus Eq. (55) implies

(56)NeverA2=1andB2=1andC2=1.

However, the Spiral inflation (Fig. 3) is such that A2, B2, and C2 have no common ancestor and consequently the distribution on the ai-expressible set {A2B2C2} is the product of the distributions on A2, B2 and C2. Since each of the latter has full support (Eq. (19)), it follows that the distribution on {A2B2C2} also has full support, which contradicts Eq. (56).

We are here interested in recasting the argument in a manner amenable to systematic generalization. This is done as follows. We work in a marginal scenario where the contexts are {A2B2C2}, {A2C1}, {B2A1}, {C2B1}, and {A1B1C1}, and all variables are binary. The first step of the argument is to note that[26]

(57)¬[A2=1,C1=1]¬[B2=1,A1=1]¬[C2=1,B1=1]¬[A1=0,B1=0,C1=0]¬[A2=1,B2=1,C2=1].

is a logical tautology for binary variables. It can be understood as a constraint on marginal deterministic assignments, which can be thought of as a logical counterpart of a linear inequality bounding the marginal polytope. The second and final step of the argument notes that the given marginal distributions are such that the antecedent is always true, while the consequent is sometimes false.

To see how to translate this into a constraint on marginal distributions, we rewrite Eq. (57) in its contrapositive form,

Next, we note that if a logical tautology can be expressed as

(59)E0E1En,

then by applying the union bound—which asserts that the probability of at least one of a set of events occurring is no greater than the sum of the probabilities of each event occurring—one obtains

(60)P(E0)j=1nP(Ej).

Applying this to Eq. (58) in particular yields

which is a constraint on the marginal distributions.

This inequality allows one to demonstrate the incompatibility of the family of distributions of Eqs. (1719) with the Spiral inflation just as easily as one can with the tautology of Eq. (57). The fact that A2, B2 and C2 are ancestrally independent in the Spiral inflation implies that PA2B2C2=PA2PB2PC2. It then suffices to note that for the given family of distributions, the probability on the left-hand side of Eq. (61) is nonzero (which corresponds to the consequent of Eq. (57) being sometimes false) while every probability on the right-hand side is zero (which corresponds to the antecedent of Eq. (57) being always true). But, of course, the inequality can witness many other incompatibilities in addition to this one.

As another example, consider the marginal problem where the variables are A, B and C, with each being binary, and the contexts are the pairs {AB}, {AC}, and {BC}. The following tautology provides a constraint on marginal deterministic assignments[27]:

Applying the union bound, one obtains a constraint on marginal distributions,[28]

In this section, we seek to determine, for any marginal scenario, the set of all inequalities that can be derived in this manner. We do so by enumerating the full set of tautologies of the form of Eqs. (57, 62). This boils down to solving the possibilistic version of the marginal constraint problem.

We now describe the general procedure. As before, we express a constraint on marginal deterministic assignments as a logical implication, having a valuation (assignment of outcomes) on one context as the antecedent and a disjunction over valuations on contexts as the consequent. In the following, we explain how to generate all such implications which are tight in the sense that the consequent is minimal, i. e., involves as few terms as possible in the disjunction.

First, we fix the antecedent by choosing some context and a joint valuation of its variables. In order to generate all constraints on marginal deterministic assignments, one will have to perform this procedure for every context as the antecedent and every choice of valuation thereon. For the sake of concreteness, we take the above Spiral inflation example with as the antecedent. Each logical implication we consider is required to have the property that any variable that appears in both the antecedent and the consequent must be given the same value in both.

To formally determine all valid consequents, it is useful to introduce two hypergraphs associated to the problem. Recall the definition of the incidence matrix of a hypergraph: if vertex i is contained in edge j of the hypergraph, the component in the ith row and jth column of the matrix is 1; otherwise it is 0.

The first hypergraph we consider is the one whose incidence matrix is the marginal description matrix M for the marginal problem being considered, as introduced near Eq. (50). Each vertex in this hypergraph corresponds to a valuation on some particular context. Each hyperedge corresponds to a possible joint valuation of all the variables. A hyperedge contains a vertex if the valuation represented by the hyperedge is an extension of the valuation represented by the vertex. For example, the hyperedge contains the vertex . In our example following Fig. 11, this initial hypergraph has 5·23=40 vertices and 26=64 hyperedges.

The second hypergraph is a subhypergraph of the first one. We delete from the first hypergraph all vertices and hyperedges which contradict the outcomes supposed by the antecedent. In our example, because the vertex contradicts the antecedent , we delete it. We also delete the vertex corresponding to the antecedent itself. In our example, this second hypergraph has 23+3·21=14 vertices and 23=8 hyperedges.

All valid (minimal) consequents are (minimal) transversals of this latter hypergraph. A transversal is a set of vertices which has the property that it intersects every hyperedge in at least one vertex. In order to get implications which are as tight as possible, it is sufficient to enumerate only the minimal transversals. Doing so is a well-studied problem in computer science with various natural reformulations and for which manifold algorithms have been developed [75].

In our example, it is not hard to check that the consequent of

is such a minimal transversal: every assignment of values to all variables which extends the assignment on the left-hand side satisfies at least one of the terms on the right, but this ceases to hold as soon as one removes any one term on the right.

We convert these implications into inequalities in the usual way via the union bound (i. e., replacing “⇒” by “≤” at the level of probabilities and the disjunction by summation). Thus Eq. (63) translates into the constraint on marginal distributions

This inequality constitutes a strengthening of Eq. (61) that we had used as Eq. (40) as the starting point for deriving a causal compatibility inequality for the Triangle scenario, Eq. (43).

Inequalities that one derives from hypergraph transversals are generally weaker than those that result from a complete solution of the marginal problem. Nevertheless, many Bell inequalities are of this form, the CHSH inequality among them [74]. So it seems that this method is still sufficiently powerful to generate plenty of interesting inequalities. At the same time, the method is significantly less computationally costly than the full-fledged facet enumeration, even if one does it for every possible antecedent. Interestingly, all of the irredundant polynomial inequalities represented in Eqs. (5154) are found to be derivable by means of hypergraph transversals.

In conclusion, facet enumeration is the preferred method for deriving inequalities for the marginal problem when it is computationally tractable. When it is not, enumerating hypergraph transversals presents a good alternative.

5 Further prospects for the inflation technique

Lemma 4 and Corollary 6 state that any causal inference technique on an inflated causal structure G can be transferred to the original causal structure G. In the previous section, we have found that even extremely weak techniques on G—namely the constraints implied by the existence of a joint distribution together with ancestral independences—can lead to significant and new results for causal inference on G. In the following three subsections, we consider some additional possibilities for constraints that might be exploited in this way to enhance the power of inflation further.

5.1 Appealing to d-separation relations in the inflated causal structure beyond ancestral independance

In Sec. 4, we considered the inflation technique using sets of observed variables on the inflated causal structure that were ai-expressible, that is, that can be written as a union of injectable sets that are ancestrally independent. However, it is standard practice when deriving causal compatibility conditions for a causal structure to make use not just of ancestral independences, but of arbitrary d-separation relations among variables, and for this reason we had also introduced the notion of expressible set in Sec. 4. We now comment on the utility of general expressible sets for the inflation technique.

In a given causal structure, if sets of variables X and Y are d-separated[29] by Z, denoted XdY|Z, then a distribution is compatible with that causal structure only if it satisfies the conditional independence relation XY|Z, that is, xyz:PXY|Z(xy|z)=PX|Z(x|z)PY|Z(y|z). In terms of unconditioned probabilities, this reads

(65)xyz:PXYZ(xyz)PZ(z)=PXZ(xz)PYZ(yz).

For Z=, d-separation of X and Y relative to Z is simply ancestral independence of X and Y, and we infer factorization of the distribution on X and Y. So it is natural to ask: can the inflation technique make use of arbitrary d-separation relations among sets of observed variables?

The answer is that it can. Consider an inflation G wherein X and Y are d-separated by Z and moreover where the sets XZ, YZ and Z are injectable. In such an instance, the distribution on XYZ can be inferred exclusively from distributions on injectable sets,

(66)PXYZ(xyz)=PXZ(xz)PYZ(yz)PZ(z)ifPZ(z)>0,0ifPZ(z)=0.

It follows that if one includes expressible sets such as XYZ in the set of contexts defining the marginal problem, then this simply increases the number of given marginal distributions, and one can solve the marginal problem as before by linear programming techniques. In the case where one derives inequalities on the marginal distributions, these remain linear inequalities, but ones that now include the joint probabilities PXYZ(xyz). Upon substituting conditional independence relations such as Eq. (66) in order to derive causal compatibility inequalities, one still ends up with polynomial inequalities, as in the case of using ai-expressible sets only, after multiplying by the denominators. As before, these causal compatibility inequalities for the inflation are translated into polynomial causal compatibility inequalities for the original causal structure per Corollary 6.

In Appendix D, we provide a concrete example of how a d-separation relation distinct from ancestral independence can be useful both for the problem of witnessing the incompatibility of a specific distribution with a causal structure and for the problem of deriving causal compatibility inequalities.

Per Definition 7, the notion of expressibility is recursive: The set XYZ is expressible if XdY|Z and XZ, YZ and Z are all expressible. In general, one can obtain stronger causal compatibility inequalities, and stronger witnessing power when testing the compatibility of a specific distribution, by determining the maximal expressible sets instead of restricting attention to the maximal ai-expressible sets.

5.2 Imposing symmetries from copy-index-equivalent subgraphs of the inflated causal structure

By the definition of an inflation model (Definition 3), if two variables in the inflated causal structure G are copy-index-equivalent, AiAj, then each depends on its parents in the same fashion as A depends on its parents in the original causal structure G, meaning that PAi|PaG(Ai)=PA|PaG(A) and PAj|PaG(Aj)=PA|PaG(A). Thus by transitivity, also Ai and Aj have the same dependence on their parents,

(67)PAi|PaG(Ai)=PAj|PaG(Aj).

The ancestral subgraphs of Ai and Aj are also equivalent, and consequently equations like Eq. (67) also hold for all of the ancestors of Ai and Aj. We conclude that the marginal distributions of Ai and Aj must also be equal, PAi=PAj. More generally, it may be possible to find pairs of contexts in G of any size such that constraints of the form of Eq. (67) imply that the marginal distributions on these two contexts must be equal.

For example, consider the pair of contexts {A1A2B1} and {A1A2B2} for the marginal scenario defined by the Spiral inflation (Fig. 3). Neither of these two contexts is an injectable set. Nonetheless, because of Eq. (67), we can conclude that their marginal distributions coincide in any inflation model,

(68)aab:PA1A2B1(aab)=PA1A2B2(aab).

We can similarly conclude that in the inflation model these marginal distributions satisfy PA1A2B1=PA2A1B2—where now the order of A1 and A2 is opposite on the two sides of the equation—or equivalently,

(69)aab:PA1A2B1(aab)=PA1A2B2(aab).

These constraints entail that PA1A2B2 must be symmetric under exchange of A1 and A2, which in itself is another equation of the type above.

Parameters such as PA1A2B1(a1a2b), PA1A2B2(a1a2b) and PA1A2(a1a2) can each be expressed as sums of the unknowns PA1A2B1B2C1C2(a1a2b1b2c1c2), so that each equation like Eqs. (68, 69) can be added to the system of equations and inequalities that constitute the starting point of the satisfiability problem (if one is seeking to test the compatibility of a given distribution with the inflated causal structure) or the quantifier elimination problem (if one is seeking to derive causal compatibility inequalities for the inflated causal structure). If any such additional relation yields stronger constraints at the level of the inflated causal structure, then one may obtain stronger constraints at the level of the original causal structure.

The general problem of finding pairs of contexts in the inflated causal structure for which relations of copy-index-equivalence imply equality of the marginal distributions, and the conditions under which such equalities may yield tighter inequalities, are discussed in more detail in Appendix C.

5.3 Incorporating nonlinear constraints

In deriving causal compatibility inequalities and in witnessing causal incompatibility of a specific distribution, we restricted ourselves to starting from the marginal problem where the contexts are the (ai-)expressible sets, and wherein one imposes only linear constraints derived from the marginal problem. In this approach, facts about the causal structure only get incorporated in the construction of the marginal distribution on each expressible set, and the quantifier elimination step of the computational algorithm is linear. However, one can also incorporate facts about the causal structure as constraints on the quantifier elimination problem at the cost making the quantifier elimination problem nonlinear.

Take the Spiral inflation of the Triangle scenario as an example. There is an ancestral independence therein that we did not use in our previous application of the inflation technique, namely, A1A2dC2. It was not used because {A1A2C2} is not an expressible set. Nonetheless, we can incorporate this ancestral independence as an additional constraint in the quantifier elimination problem, namely,

(70)a1a2c2:PA1A2C2(a1a2c2)=PA1A2(a1a2)PC2(c2).

Recall that in the marginal problem, one seeks to eliminate the unknowns PA1A2B1B2C1C2(a1a2b1b2c1c2) from a set of linear equalities that define the marginal distributions, such as for instance

(71)PA2B2(a2b2)=a1b1c1c2PA1A2B1B2C1C2(a1a2b1b2c1c2),

together with linear inequalities expressing the nonnegativity of the PA1A2B1B2C1C2(a1a2b1b2c1c2). We can incorporate the ancestral independence A1A2dC2 as an additional constraint by defining a variant of the marginal problem wherein the set of linear equations such as Eq. (71) is supplemented by the nonlinear Eq. (70) when one replaces every term therein with the corresponding sum over the PA1A2B1B2C1C2(a1a2b1b2c1c2). We can then proceed with quantifier elimination as we did before, eliminating the unknowns PA1A2B1B2C1C2(a1a2b1b2c1c2) from the system of equations in order to obtain constraints that involve only joint probabilities on expressible sets.

One can incorporate any d-separation relation in the inflated causal structure in this manner. For instance, if XdY|Z, then this implies the conditional independence relation of Eq. (65), which can be incorporated as an additional nonlinear equality constraint when eliminating the unknowns PA1A2B1B2C1C2(a1a2b1b2c1c2). For instance, in the Spiral inflation of the Triangle scenario (Fig. 3), the d-separation relation A1dC2|A2B2 implies the conditional independence relation

(72)a1a2b2c2:PA1A2B2C2(a1a2b2c2)PA2B2(a2b2)=PA1A2B2(a1a2b2)PA2B2C2(a2b2c2).

However, because {A1A2B2C2} is not an expressible set, the method of Sec. 4 does not take this d-separation relation into account. However, it can be incorporated if Eq. (72) is included as an additional nonlinear constraint in the quantifier elimination problem.

On the one hand, many modern computer algebra systems do have functions capable of tackling nonlinear quantifier elimination symbolically.[30] Currently, however, it is generally not practical to perform nonlinear quantifier elimination on large polynomial systems with many unknowns to be eliminated. It may help to exploit results on the concrete algebraic-geometric structure of these particular systems [11].

If one is seeking merely to assess the compatibility of a given distribution with the causal structure, then one can avoid the quantifier elimination problem and simply try and solve an existence problem: after substituting the values that the given distribution prescribes for the outcomes on ai-expressible sets into the polynomial system in terms of the unknown global joint probabilities, one must only determine whether that system has a solution. Most computer algebra systems can resolve such satisfiability questions quite easily.[31]

It is also possible to use a mixed strategy of linear and nonlinear quantifier elimination, such as Chaves [9] advocates. The explicit results of [9] are directly causal implications of the original causal structure, achieved by applying a mixed quantifier elimination strategy. Perhaps further causal compatibility inequalities will be derivable by applying such a mixed quantifier elimination strategy to the inflated causal structure.

5.4 Implications of the inflation technique for quantum physics and generalized probabilistic theories

This specialized subsection is intended specifically for those readers already somewhat proficient with fundamental concepts in quantum theory. Non-physicists may wish to skip ahead to the conclusions (Sec. 6).

Recent work has sought to explore quantum generalizations of the notion of a causal model, termed quantum causal models [22], [23], [39], [40], [41], [42], [43]. We here use the quantum generalization that is implied by the approach of [22] and closely related to the one of [23].

The causal structures are still represented by DAGs, supplemented with a distinction between observed and latent nodes. However, the latent nodes are now associated with families of quantum channels and the observed nodes are now associated with families of quantum measurements. Observed nodes are still labelled by random variables, which represent the outcome of the associated measurement. One also makes a distinction between edges in the DAG that carry classical information and edges that carry quantum information.[32] An observed node can have incoming edges of either type: those that come from other observed nodes carry classical information, while those that come from latent nodes carry quantum information. Each quantum measurement in the set that is associated to an observed node acts on the collection of quantum systems received by this node (i. e., on the tensor product of the Hilbert spaces associated to the incoming edges). The classical variables that are received by the node act collectively as a control variable, determining which measurement in the set is implemented. Finally, the random variable that is associated to the node encodes the outcome of the measurement. All of the outgoing edges of an observed node are classical and simply broadcast the outcome of the measurement to the children nodes. A latent node can also have incoming edges that carry classical variables as well as incoming edges that carry quantum systems. Each quantum channel in the set that is associated to a latent node takes the collection of quantum systems associated to the incoming edges as its quantum input and the collection of quantum systems associated to the outgoing edges as its quantum output (the input and output spaces need not have the same dimension). The classical variables that are received by the node act collectively as a control variable, determining which channel in the set is implemented.

A quantum causal model is still ultimately in the service of explaining joint distributions of observed classical variables. The joint distribution of these variables is the only experimental data with which one can confront a given quantum causal model. The basic problem of causal inference for quantum causal models, therefore, concerns the compatibility of a joint distribution of observed classical variables with a given causal structure, where the model supplementing the causal structure is allowed to be quantum, in the sense defined above. If this happens, we say that the distribution is quantumly compatible with the causal structure.

One motivation for studying quantum causal models is that they offer a new perspective on an old problem in the field of quantum foundations: that of establishing precisely which of the principles of classical physics must be abandoned in quantum physics. It was noticed by Fritz [21] and Wood and Spekkens [19] that Bell’s theorem [51] states that there are distributions on observed nodes of the Bell causal structure that are quantumly compatible but not classically compatible with it. Moreover, it was shown in [19] that these distributions cannot be explained by any causal structure while complying with the additional principle that conditional independences should not be fine-tuned, i. e., while demanding that any observed conditional independence should be accounted for by a d-separation relation in the DAG. These results suggest that quantum theory is perhaps best understood as revising our notions of the nature of unobserved entities, and of how one represents causal dependences thereon and incomplete knowledge thereof, while nonetheless preserving the spirit of causality and the principle of no fine-tuning [39], [84], [85].

Another motivation for studying quantum causal models is a practical one. Violations of Bell inequalities have been shown to constitute resources for information processing [86], [87], [88]. Hence it seems plausible that if one can find more causal structures for which there exist distributions that are quantumly compatible but not classically so, then this quantum-classical separation may also find applications to information processing. For example, it has been shown that in addition to the Bell scenario, such a quantum-classical separation also exists in the bilocality scenario [47] and the Triangle scenario [21], and it is likely that many more causal structures with this property will be found, some with potential applicability to information processing.

So for both foundational and practical reasons, there is good reason to find examples of causal structures that exhibit a quantum-classical separation. However, this is by no means an easy task. The set of distributions that are quantumly compatible with a given causal structure is quite hard to separate from the set of distributions that are classically compatible [21], [22]. For example, both the classical and quantum sets respect the conditional independence relations among observed nodes that are implied by the d-separation relations of the DAG [22], and entropic inequalities are only of very limited use [21], [89]. We hope that the inflation technique will provide better tools for finding such separations.

In addition to quantum generalizations of causal models, one can define generalizations for other operational theories that are neither classical nor quantum [22], [23]. Such generalizations are formalized using the framework of generalized probabilistic theories (GPTs) [90], [91], which is sufficiently general to describe any operational theory that makes statistical predictions about the outcomes of experiments and passes some basic sanity checks. Some constraints on compatibility can be proven to be theory-independent in that they apply not only to classical and quantum causal models, but to any kind of generalized probabilistic causal model [22]. For example, the classically-valid conditional independence relations that hold among observed variables in a causal structure are all also valid in the GPT framework. Another example is the entropic monogamy inequality Eq. (39), which was proven in [22] to be GPT valid as well. These kinds of constraints are of interest because they clarify what any conceivable theory of physics must satisfy on a given causal structure.

The essential element in deriving such constraints is to only make reference to the observed nodes, as done in [22]. In fact, we now understand the argument of [22] to be an instance of the inflation technique. Nonetheless, we have seen that the inflation technique often yields inequalities that hold for the classical notion of compatibility, while having quantum and GPT violations, such as the Bell inequalities of Example 3 of Sec. 3.2 and Appendix G. In fact, inflation can be used to derive inequalities with quantum violations for the Triangle scenario as well [92].

So what distinguishes applications of the inflation technique that yield inequalities for GPT compatibility from those that yield inequalities for classical compatibility? The distinction rests on a structural feature of the inflation:

Definition 10.

In GInflations(G), an inflationary fan-out is a latent node that has two or more children that are copy-index equivalent.

The Web and Spiral inflations of the Triangle scenario, depicted in Fig. 2 and Fig. 3 respectively, contain one or more inflationary fan-outs, as does the inflation of the Bell causal structure that is depicted in Fig. 8. On the other hand, the simplest inflation of the Triangle scenario that we consider in this article, the Cut inflation depicted in Fig. 5, does not contain any inflationary fan-outs.

Our main observation is that if one uses an inflation without an inflationary fan-out, then the resulting inequalities derived by the inflation technique will all be GPT valid. In other words, one can only hope to detect a GPT-classical separation if one uses an inflation that has at least one inflationary fan-out. We now explain the intuition for why this is the case. In the classical causal model obtained by inflation, the copy-index-equivalent children of an inflationary fan-out causally depend on their parent node in precisely the same way as their counterparts in the original causal structure do. For example, this dependence may be such that these two children are exact copies of the inflationary fan-out node. So when one tries to write down a GPT version of our notion of inflation, one quickly runs into trouble: in quantum theory, the no-broadcasting theorem shows that such duplication is impossible in a strong sense [93], and an analogous theorem holds for GPTs [94]. This is why in the presence of an inflationary fan-out, one cannot expect our inequalities to hold in the quantum or GPT case, which is consistent with the fact that they often do have quantum and GPT violations.

On the other hand, for any inflation that does not contain an inflationary fan-out, the notion of an inflation model generalizes to all GPTs; we sketch how this works for the case of quantum theory. By the definition of inflation, any node in G has a set of incoming edges equivalent to its counterpart in G, while by the assumption that the inflated causal structure does not contain any inflationary fan-outs, any node in G has either the equivalent set of outgoing edges as its counterpart in G, or some pruning of this set. In the former case, one associates to this node the same set of quantum channels (if it is a latent node) or measurements (if it is an observed node) that are associated to its counterpart. In the latter case, one simply applies the partial trace operation on the pruned edges (if it is a latent node) or a marginalization on the pruned edges (if it is an observed node). That these prescriptions make sense depends crucially on the assumption that G is an inflation of G, so that the ancestries of any node in G mirrors the ancestry of the corresponding node in G perfectly. Hence for inflations G without inflationary fan-outs, we have quantum analogues of Lemma 4 and Corollary 6. The problem of quantum causal inference on G therefore translates into the corresponding problem on G, and any constraint that we can derive on G translates back to G. In particular, our Examples 1, 4 and 5 also hold for quantum causal inference: perfect correlation is not only classically incompatible with the Triangle scenario, it is quantumly incompatible as well, and the inequalities Eqs. (34, 39) have no quantum violations.

All of these assertions about inflations that do not contain any inflationary fan-outs apply not only to quantum causal models, but to GPT causal models as well, using the definition of the latter provided in [22].

In the remainder of this section, we discuss the relation between the quantum and the GPT case. Since quantum theory is a particular generalized probabilistic theory, quantum compatibility trivially implies GPT compatibility. Through the work of Tsirelson [54] and Popescu and Rohrlich [55], it is known that the converse is not true: the Bell scenario manifests a GPT-quantum separation. The identification of distributions witnessing this difference, and the derivation of quantum causal compatibility inequalities with GPT violations, has been a focus of much foundational research in recent years. Traditionally, the foundational question has always been: why does quantum theory predict correlations that are stronger than one would expect classically? But now there is a new question being asked: why does quantum theory only allow correlations that are weaker than those predicted by other GPTs? There has been some interesting progress in identifying physical principles that can pick out the precise correlations that are exhibited by quantum theory [95], [96], [97], [98], [99], [100], [101], [102], [103]. Further opportunities for identifying such principles would be useful. This motivates the problem of classifying causal structures into those which have a quantum-classical separation, those which have a GPT-quantum separation and those which have both. Similarly, one can try to classify causal compatibility inequalities into those which are GPT-valid, those which are GPT-violable but quantumly valid, and those which are quantum-violable but classically valid.

The problem of deriving inequalities that are GPT-violable but quantumly valid is particularly interesting. Chaves et al. [40] have derived some entropic inequalities that can do so. At present, however, we do not see a way of applying the inflation technique to this problem.

6 Conclusions

We have described the inflation technique for causal inference in the presence of latent variables.

We have shown how many existing techniques for witnessing incompatibility and for deriving causal compatibility inequalities can be enhanced by the inflation technique, independently of whether these pertain to entropic quantities, correlators or probabilities. The computational difficulty of achieving this enhancement depends on the seed technique. We summarize the computational difficulty of the approaches that we have considered in Table 1. A similar table could be drawn for the satisfiability problem, with relative difficulties preserved, but where none of the variants of the problem are computationally hard.

Table 1

A comparison of different approaches for deriving constraints on compatibility at the level of the inflated causal structure, which then translate into constraints on compatibility at the level of the original causal structure.

Type of constraints imposed on the joint distribution over all observed variables in the inflated graphGeneral problemStandard algorithm(s)Difficulty
Marginal compatibility, i. e., the joint distribution should recover all expressible (or ai-expressible) distributions as marginals (Sec. 5.1)Facet enumeration of marginal polytope (Sec. 4.2)see Appendix AHard
Finding possibilistic constraints by identifying hypergraph transversals (Sec. 4.4)see Eiter et al. [75]Very easy
Whenever two equivalent-up-to-copy-indices sets of observed variables have ancestral subgraphs which are also equivalent-up-to-copy-indices, then the marginals over said variables must coincide (Sec. 5.2)Marginal problem with additional equality constraints, therefore linear quantifier elimination (Appendix C)Fourier-Motzkin elimination [77], [78], [79], [80], [81], Equality set projection [82], [83]Hard
The joint distribution should satisfy all conditional independence relations implied by d-separation conditions on the observed variables (Sec. 5.3)Real (nonlinear) quantifier eliminationCylindrical algebraic decomposition [9]Very hard

Especially in Sec. 4, we have focused on one particular seed technique: the existence of a joint distribution on all observed nodes together with ancestral independences. We have shown how a complete or partial solution of the marginal problem for the ai-expressible sets of the inflated causal structure can be leveraged to obtain criteria for causal compatibility, both at the level of witnessing particular distributions as incompatible and deriving causal compatibility inequalities. These inequalities are polynomial in the joint probabilities of the observed variables. They are capable of exhibiting the incompatibility of the W-type distribution with the Triangle scenario, while entropic techniques cannot, so that our polynomial inequalities are stronger than entropic inequalities in at least some cases (see Example 2 of Sec. 3.2). As far as we can tell, our inequalities are not related to the nonlinear causal compatibility inequalities which have been derived specifically to constrain classical networks [28], [29], [30], nor to the nonlinear inequalities which account for interventions to a given causal structure [53], [104].

We have shown that some of the causal compatibility inequalities we derive by the inflation technique are necessary conditions not only for compatibility with a classical causal model, but also for compatibility with a causal model in any generalized probabilistic theory, which includes quantum causal models as a special case. It would be enlightening to understand the general extent to which our polynomial inequalities for a given causal structure can be violated by a distribution arising in a quantum causal model. A variety of techniques exist for estimating the amount by which a Bell inequality [105], [106] is violated in quantum theory, but even finding a quantum violation of one of our polynomial inequalities for causal structures other than the Bell scenario presents a new task for which we currently lack a systematic approach. Nevertheless, we know that there exists a difference between classical and quantum also beyond Bell scenarios [21, Theorem 2.16], and we hope that our polynomial inequalities will perform better in probing this separation than entropic inequalities do [22], [40].

We have shown that the inflation technique can also be used to derive causal compatibility inequalities that hold for arbitrary generalized probabilistic theories, a significant generalization of the results of [22]. Such inequalities are also very significant insofar as they constitute a restriction on the sorts of statistical correlations that could arise in a given causal scenario even if quantum theory is superseded by some alternative physical theory. As long as the successor theory falls within the framework of generalized probabilistic theories, the restriction will hold.

Finally, an interesting question is whether it might be possible to modify our methods somehow to derive causal compatibility inequalities that hold for quantum theory and are violated by some GPT. Since the initial drafting of this manuscript, such a modification has been identified [107].

A single causal structure has an unlimited number of potential inflations. Selecting a good inflation from which strong polynomial inequalities can be derived is an interesting challenge. To this end, it would be desirable to understand how particular features of the original causal structure are exposed when different nodes in the causal structure are duplicated. By isolating which features are exposed in each inflation, we could conceivably quantify the utility for causal inference of each inflation. In so doing, we might find that inflations beyond a certain level of variable duplication need not be considered. The multiplicity beyond which further inflation is irrelevant may be related to the maximum degree of those polynomials which tightly characterize a causal scenario. Presently, however, it is not clear how to upper bound either number, though a finite upper bound on the maximum degree of the polynomials follows from the semialgebraicity of the compatible distributions, per Ref. [6].

Causal compatibility inequalities are, by definition, merely necessary conditions for compatibility. Depending on what kind of causal inference methods one uses at the level of an inflated causal structure G, one may or may not obtain sufficient conditions. An interesting question is: if one only uses the existence of a joint distribution and ancestral independences at the level of G, then does one obtain sufficient conditions as G varies? In other words: if a given distribution is such that for every inflation G, the marginal problem of Sec. 4 is solvable, then is the distribution compatible with the original causal structure? This occurs for the Bell scenario, where it is enough to consider only one particular inflation (Appendix G).

Significantly, since the initial drafting of this manuscript, Ref. [108] has proven that the inflation technique indeed gives necessary and sufficient conditions for causal compatibility: any incompatible distribution is witnessed as incompatible by a suitably large inflation. Ref. [108] also provides other interesting results, such as a prescription for how to generate all relevant inflations, as well as an explicit demonstration of the inflation technique as applied to Pearl’s instrumental scenario.

Award Identifier / Grant number: 69609

Funding statement: This project/publication was made possible in part through the support of a grant #69609 from the John Templeton Foundation. The opinions expressed in this publication are those of the authors and do not necessarily reflect the views of the John Templeton Foundation. This research was supported in part by Perimeter Institute for Theoretical Physics. Research at Perimeter Institute is supported in part by the Government of Canada through the Department of Innovation, Science and Economic Development Canada and by the Province of Ontario through the Ministry of Economic Development, Job Creation and Trade.

Acknowledgment

E. W. would like to thank Rafael Chaves, Miguel Navascues, and T. C. Fraser for suggestions which have improved this manuscript. T. F. would like to thank Nihat Ay and Guido Montúfar for discussion and references. Part of this research was conducted while T. F. was with the Max Planck Institute for Mathematics in the Sciences.

Appendix A Algorithms for solving the marginal constraint problem

By solving the marginal constraint problem, what we mean is to determine all the facets of the marginal polytope for a given marginal scenario. Since the vertices of this polytope are precisely the deterministic assignments of values to all variables, which are easy to enumerate, solving the marginal constraint problem is an instance of a facet enumeration problem: given the vertices of a convex polytope, determine its facets. This is a well-studied problem in combinatorial optimization for which a variety of algorithms are available [109].

A generic facet enumeration problem takes a matrix VRd×n, which lists the vertices as its columns, and asks for an inequality description of the set of vectors bRd that can be written as a convex combination of the vertices using weights xRn that are nonnegative and normalized,

(A.1)bRd|xRn:b=Vx,x0,ixi=1.

To solve the marginal problem one uses the marginal description matrix introduced in Sec. 4.2 as the input to the facet enumeration algorithm, i. e. V=M, see Eq. (50).

The oldest-known method for facet enumeration relies on linear quantifier elimination in the form of Fourier-Motzkin (FM) elimination [77], [78]. This refers to the fact that one starts with the system b=Vx, x0 and ixi=1, which is the half-space representation of a convex polytope (a simplex), and then one needs to project onto b-space by eliminating the variables x to which the existential quantifierx refers. The Fourier-Motzkin algorithm is a particular method for performing this quantifier elimination one variable at a time; when applied to Eq. (A.1), it is equivalent to the double description method [78], [110]. Linear quantifier elimination routines are available in many software tools.[33] The authors found it convenient to custom-code a linear quantifier elimination routine in Mathematica™.

Other algorithms for facet enumeration that are not based on linear quantifier elimination include the following. Lexicographic reverse search (LRS) [112] explores the entire polytope by repeatedly pivoting from one facet to an adjacent one, and is implemented in lrs. Equality Set Projection (ESP) [82], [83] is also based on pivoting from facet to facet, though its implementation is less stable.[34] These algorithms could be interesting to use in practice, since each pivoting step churns out a new facet; by contrast, Fourier-Motzkin type algorithms only generate the entire list of facets at once, after all the quantifiers have been eliminated one by one, see Ref. [113] for a recent comparative review.

It may also be possible to exploit special features of marginal polytopes in order to facilitate their facet enumeration, such as their high degree of symmetry: permuting the outcomes of each variable maps the polytope to itself, which already generates a sizeable symmetry group, and oftentimes there are additional symmetries given by permuting some of the variables. This simplifies the problem of facet enumeration [114], [115], and it may be interesting to apply dedicated software[35] to the facet enumeration problem of marginal polytopes [116], [117], [118].

Appendix B Explicit marginal description matrix of the cut inflation with binary observed variables

The three maximal ai-expressible sets of the Cut inflation (Fig. 5) are {A2B1}, {B1C1}, and {A2C1}. Taking the variables to be binary, each ai-expressible set corresponds to 22=4 equations pertinent to the marginal problem. The three sets of equations which relate the marginal probabilities to a posited joint distribution are given by

(B.1)a2b1:PA2B1(a2b1)=c1PA2B1C1(a2b1c1),b1c1:PB1C1(b1c1)=a2PA2B1C1(a2b1c1),a2c1:PA2C1(a2c1)=b1PA2B1C1(a2b1c1).

As we noted in the main text, such conditions can be expressed in terms of a single matrix equality, Mv=b where v is the joint distribution vector, b is the marginal distribution vector and M is the marginal description matrix. In the Cut inflation example, the joint distribution vector v has 8 elements, whereas the marginal distribution vector b has 12, i. e.

(B.2)v=PA2B1C1(000)PA2B1C1(001)PA2B1C1(010)PA2B1C1(011)PA2B1C1(100)PA2B1C1(101)PA2B1C1(110)PA2B1C1(111),b=pA2B1(00)pA2B1(01)pA2B1(10)pA2B1(11)pA2C1(00)pA2C1(01)pA2C1(10)pA2C1(11)pB1C1(00)pB1C1(01)pB1C1(10)pB1C1(11)=PA2B1C1(00ˍ)PA2B1C1(01ˍ)PA2B1C1(10ˍ)PA2B1C1(11ˍ)PA2B1C1(0ˍ0)PA2B1C1(0ˍ1)PA2B1C1(1ˍ0)PA2B1C1(1ˍ1)PA2B1C1(ˍ00)PA2B1C1(ˍ01)PA2B1C1(ˍ10)PA2B1C1(ˍ11),

and hence the marginal description matrix M is a 12×8 matrix of zeroes and ones, i. e.

such that Mv=b per Eq. (50).

Appendix C Constraints on marginal distributions from copy-index equivalence relations

In Sec. 5.2, we noted that every copy of a variable in an inflation model has the same probabilistic dependence on its parents as every other copy. It followed that for certain pairs of marginal contexts, the marginal distributions in any inflation model are necessarily equal. We now describe not only how to identify all such pairs of contexts, but also how to identify weak pairs, who’s corresponding symmetry imposition cannot help strengthen the final constraints.

Given X,YNodes(G) in an inflated causal structure G, let us say that a map φ:XY is a copy isomorphism if it is a graph isomorphism[36] between SubDAG(X) and SubDAG(Y) such that φ(X)X for all XX, meaning that φ maps every node XX to a node Y=φ(X)Y such that Y is equivalent to X under dropping the copy-index.

Furthermore, we say that a copy isomorphism φ:XY is an inflationary isomorphism whenever it can be extended to a copy isomorphism on the ancestral subgraphs, Φ:An(X)An(Y). A copy isomorphism Φ:An(X)An(Y) defines an inflationary isomorphism φ:XY if and only if Φ(X)=Y. So in practice, one can either start with φ:XY and try to extend it to Φ:An(X)An(Y), or start with such a Φ and see whether it maps X to Y and thereby restricts to a φ.

For given observed V1 and V2, a sufficient condition for equality of their marginal distributions in an inflation model is that there exists an inflationary isomorphism between them. Because V1 and V2 might themselves contain several variables that are copy-index equivalent (recall the examples of Sec. 5.2), equating the distribution PV1 with the distribution PV2 in an unambiguous fashion requires one to specify a correspondence between the variables that make up V1 and those that make up V2. This is exactly the data provided by the inflationary isomorphism φ. This result is summarized in the following lemma.

Lemma 11.

LetGbe an inflation of G, and letV1,V2ObservedNodes(G). Then every inflationary isomorphismφ:V1V2induces an equalityPV1=PV2for inflation models, where the variables inV1are identified with those inV2according to φ.

This applies in particular when V1=V2, in which case the statement is that the distribution PV1 is invariant under permuting the variables according to φ.

Lemma 11 is best illustrated by returning to our example from Sec. 5.2 which considered the Spiral inflation of Fig. 3 and the pair of contexts V1={A1A2B1} and V2={A1A2B2}. The map

(C.1)φ:A1A1,A2A2,B1B2

is a copy isomorphism between V1 and V2 because it trivially implements a graph isomorphism (both subgraphs are edgeless), and it maps each variable in V1 to a variable in V2 that is copy-index equivalent. There is a unique choice to extend φ to a copy isomorphism Φ:An(V1)An(V2), namely, by extending Eq. (C.1) to the ancestors via

(C.2)Φ:X1X1,Y1Y1,Y2Y2,Z1Z2,

which is again a copy isomorphism. Therefore φ is indeed an inflationary isomorphism. From Lemma 11, we then conclude that any inflation model satisfies PA1A2B1=PA1A2B2.

Similarly, the map

(C.3)φ:A1A2,A2A1,B1B2

is also easily verified to be a copy isomorphism between SubDAG(V1) and SubDAG(V2), and there is again a unique choice to extend φ to a copy isomorphism Φ:AnSubDAG(V1)AnSubDAG(V2), by extending Eq. (C.3) with

(C.4)Φ:X1X1,Y1Y2,Y2Y1,Z1Z2,

so that φ too is verified to be an inflationary isomorphism. From Lemma 11, we then conclude that every inflation model also satisfies PA1A2B1=PA2A1B2. (And this in turn implies that for the context {A1A2}, the marginal distribution satisfies the permutation invariance PA1A2=PA2A1.)

Figure 12 The instrumental scenario of Pearl [31].
Figure 12

The instrumental scenario of Pearl [31].

Figure 13 An inflation of the instrumental scenario which illustrates why coinciding ancestral subgraphs doesn’t necessarily imply coinciding marginal distributions.
Figure 13

An inflation of the instrumental scenario which illustrates why coinciding ancestral subgraphs doesn’t necessarily imply coinciding marginal distributions.

Figure 14 The ancestral subgraph of Fig. 13 for either {X1Y2Z1}\{{X_{1}}{Y_{2}}{Z_{1}}\} or {X1Y2Z2}\{{X_{1}}{Y_{2}}{Z_{2}}\}.
Figure 14

The ancestral subgraph of Fig. 13 for either {X1Y2Z1} or {X1Y2Z2}.

In order to avoid any possibility of confusion, we emphasize that it is not a plain copy isomorphism between the subgraphs of V1 and V2 themselves which results in coinciding marginal distributions, nor a copy isomorphism between the ancestral subgraphs of V1 and V2. Rather, it is an inflationary isomorphism between the subgraphs, i. e., a copy isomorphism between the ancestral subgraphs that restricts to a copy isomorphism between the subgraphs. To see why a copy isomorphism between ancestral subgraphs by itself may not be sufficient for deriving equality of marginal distributions, we offer the following example. Take as the original causal structure the instrumental scenario of Pearl [31], and consider the inflation depicted in Fig. 13. Consider the pair of contexts V1={X1Y2Z1} and V2={X1Y2Z2} on the inflated causal structure. Since SubDAG(V1) and SubDAG(V2) are not isomorphic, there is no copy isomorphism between the two. On the other hand, the ancestral subgraphs are both given by the causal structure of Fig. 14, so that the identity map is a copy isomorphism between AnSubDAG(X1Y2Z1) and AnSubDAG(X1Y2Z2).

One can try to make use of Lemma 11 when deriving polynomial inequalities with inflation via solving the marginal problem, by imposing the resulting equations of the form PV1=PV2 as additional constraints, one constraint for each inflationary isomorphism φ:V1V2 between sets of observed nodes. This is advantageous to speed up to the linear quantifier elimination, since one can solve each of the resulting equations for one of the unknown joint probabilities and thereby eliminate that probability directly without Fourier-Motzkin elimination. Moreover, one could hope that these additional equations also result in tighter constraints on the marginal problem, which would in turn yield tighter causal compatibility inequalities. Our computations have so far not revealed any example of such a tightening.

In some cases, this lack of impact can be explained as follows. Suppose that φ:V1V2 is an inflationary isomorphism such that φ can be extended to a copy automorphism Φ:GG, which maps the entirety of the inflated causal structure onto itself. An inflationary isomorphism can always be extended to some copy isomorphism between the ancestral subgraphs Φ:AnSubDAG(V1)AnSubDAG(V2) by definition, but not every inflationary isomorphism can also be extended to a full copy automorphism of G. In those cases where φ can be extended to a copy automorphism, the irrelevance of the additional constraint PV1=PV2 to the marginal problem for inflation models can be explained by the following argument.

Suppose that some joint distribution PObservedNodes(G) solves the unconstrained marginal problem, i. e., without requiring PV1=PV2. Now apply the automorphism Φ to the variables in PObservedNodes(G), switching the variables around, to generate a new distribution PObservedNodes(G):=PΦ(ObservedNodes(G)). Because the set of marginal distributions that arise from inflation models is invariant under this switching of variables, we conclude that P is also a solution to the unconstrained marginal problem. Taking the uniform mixture of P and P is therefore still a solution of the unconstrained marginal problem. But this uniform mixture also satisfies the supplementary constraint PV1=PV2. Hence the supplementary constraint is satisfiable whenever the unconstrained marginal problem is solvable, which makes adding the constraint irrelevant.

This argument does not apply when the inflationary isomorphism φ:V1V2 cannot be extended to a copy automorphism of the entire inflated causal structure. It also does not apply if one uses d-separation conditions beyond ancestral independence on the inflated causal structure as additional constraints (Sec. 5.1), because in this case the set of compatible distributions is not necessarily convex. In either of these cases, it is unclear whether or not constraints arising from copy-index equivalence could yield tighter inequalities.

Appendix D Using the inflation technique to certify a causal structure as “interesting”

By considering all possible d-separation relations on the observed nodes of a causal structure, one can infer the set of all conditional independence (CI) relations that must hold in any distribution compatible with it. Due to the presence of latent variables, satisfying these CI relations is generally not sufficient for compatibility. Henson, Lal and Pusey (HLP) [22] introduced the term interesting for those causal structures for which this happens, and derived a partial classification of causal structures into interesting and non-interesting ones by finding necessary criteria for a causal structure to be interesting, and they also conjectured their criteria to be sufficient. As evidence in favour of this conjecture, they enumerated all possible isomorphism classes of causal structure with up to six nodes satisfying their criteria, which resulted in only 21 equivalence classes of potentially interesting causal structures. Of those 21, they further proved that 18 were indeed interesting by writing down explicit distributions which are incompatible despite satisfying the observed CI relations. Incompatibility was certified by means of entropic inequalities.

That left three classes of causal structures as potentially interesting (Figs. 1517). For each of these, HLP derived both: (i) the set of Shannon-type entropic inequalities that take into account the CI relations among the observed variables, and (ii) the set of Shannon-type entropic inequalities that also take into account CI relations among latent variables. Finding the second set to be larger than the first constitutes evidence that the causal structure is interesting. The evidence is not conclusive, however, because the Shannon-type inequalities that are included in the second set but not the first might be non-Shannon-type inequalities that merely follow from the CI relations among the observed variables [22].

One way to close this loophole would be to show that the novel Shannon-type inequalities imply constraints beyond some inner approximation to the genuine entropic cone corresponding to the CI relations among observed variables, perhaps along the lines of [26]. Another is to use causal compatibility inequalities beyond entropic inequalities to identify some CI-respecting but incompatible distributions. Pienaar [36] accomplished precisely this by considering the different values that an observed root variable may take. In the following, we demonstrate how the inflation technique can be used for the same purpose.

Figure 15 Causal structure #15 in [22]. The d-separation relations are C⊥dYC{\perp _{d}}Y and A⊥dB|YA{\perp _{d}}B\hspace{0.1667em}|\hspace{0.1667em}Y.
Figure 15

Causal structure #15 in [22]. The d-separation relations are CdY and AdB|Y.

Figure 16 Causal structure #16 in [22]. The only d-separation relation is C⊥dYC{\perp _{d}}Y.
Figure 16

Causal structure #16 in [22]. The only d-separation relation is CdY.

Figure 17 Causal structure #20 in [22]. The d-separation relations are C⊥dYC{\perp _{d}}Y and A⊥dY|BA{\perp _{d}}Y\hspace{0.1667em}|\hspace{0.1667em}B.
Figure 17

Causal structure #20 in [22]. The d-separation relations are CdY and AdY|B.

D.1 Certifying that Henson-Lal-Pusey’s causal structure #16 is “interesting”

Figure 18 The Russian dolls inflation of Fig. 16.
Figure 18

The Russian dolls inflation of Fig. 16.

Pienaar [ 36] identified a distribution which satisfies the only CI relation that must hold among the observed variables in HLP’s causal structure #16 (Fig. 16), namely, CY, but which is nonetheless incompatible with it:

(D.1)PABCYPienaar:=[0000]+[0110]+[0001]+[1011]4,i.e.,PABCYPienaar(abcy)=14ify·c=aand(y1)·c=b,0otherwise.

It is useful to compute the conditional on Y,

(D.2)PABC|YPienaar(···|y)=12([000]+[011])ify=0,12([000]+[101])ify=1.

This makes it evident that the distribution can be described as follows: if Y=0, then A=0 while B and C are uniformly random and perfectly correlated, while if Y=1, then B=0 and A and C are uniformly random and perfectly correlated.

Here, we will establish the incompatibility of Pienaar’s distribution with HLP’s causal structure #16 (reproduced in Fig. 16 here) using the inflation technique. To do so, we use the inflation depicted in Fig. 18, which we term the Russian dolls inflation. We will make use of the fact that {A1C1Y1}, {B2C2Y2} and {B2C1Y2} are injectable sets, together with the fact that {A1C2Y1} is an expressible set.

We begin by demonstrating how the d-separation relations in the Russian dolls inflation imply that {A1C2Y1} is expressible. First, we note that the set {A1B1C2Y1} is expressible because the d-separation relation A1dC2|B1Y1 implies that

(D.3)PA1B1C2Y1=PA1B1Y1PC2B1Y1PB1Y1,

and the sets {A1B1Y1}, {C2B1Y1}, and {B1Y1} are injectable. The expressibility of {A1C2Y1} then follows from the expressibility of {A1B1C2Y1} and the fact that the distribution on the former can be obtained from the distribution on the latter by marginalization,

(D.4)PA1C2Y1(acy)=bPA1B1C2Y1(abcy).

It follows that the distribution PA1C2Y1 in the inflation model associated to the Pienaar distribution can be computed by first writing down the distributions on the relevant injectable sets,

(D.5)PB2C2Y2(bcy)=PBCYPienaar(bcy),PA1C1Y1(acy)=PACYPienaar(acy),PB2C1Y2(bcy)=PBCYPienaar(bcy),

and from Eq. (D.4) and (D.3), as well as the injectability of {A1B1Y1}, {C2B1Y1}, and {B1Y1}, we infer that

(D.6)PA1C2Y1(acy)=bPABYPienaar(aby)PCBYPienaar(cby)PBYPienaar(by).

We are now in a position to derive a contradiction. Our derivation will begin by setting Y2=0 and Y1=1. It is therefore convenient to condition on Y1 and Y2 in the distributions of interest and set them equal to these values, and to express these in terms of the conditioned Pienaar distribution via Eq. (D.5),

(D.7)PB2C2|Y2(bc|0)=PBC|YPienaar(bc|0)PA1C1|Y1(ac|1)=PAC|YPienaar(ac|1)PB2C1|Y2(bc|0)=PBC|YPienaar(bc|0)

and similarly from Eq. (D.6),

(D.8)PA1C2|Y1(ac|1)=bPAB|YPienaar(ab|1)PCB|YPienaar(cb|1)PB|YPienaar(b|1).

From these and Eq. (D.2), we infer

(D.9)PB2C2|Y2(··|0)=12([00]+[11]),
(D.10)PA1C1|Y1(··|1)=12([00]+[11]),
(D.11)PB2C1|Y2(··|0)=12([00]+[11]),
(D.12)PA1C2|Y1(··|1)=14([00]+[01]+[10]+[11]).
Henceforth, we leave the condition that Y2=0 and Y1=1 implicit. From Eq. (D.11), we have

(D.13)With probability 1/2,B2=0andC1=0.

From Eq. (D.9), we have

(D.14)IfB2=0thenC2=0.

From Eq. (D.10), we have

(D.15)IfC1=0thenA1=0.

These three statements imply that

(D.16)The probability thatC2=0andA1=0is1/2.

However, Eq. (D.12) implies that the probability of C2=0andA1=0 is only p=1/4. We have therefore arrived at a contradiction. This establishes the incompatibility of the Pienaar distribution with HLP’s causal structure #16. Our reasoning is again a form of the Hardy-type arguments from Sec. 4.4.

D.2 Deriving a causal compatibility inequality for HLP’s causal structure #16

We can also turn the above argument into an inequality. Using the methods of Sec. 4.4, it is straightforward to show that the assumption of a joint distribution on {A1B2C1Y1Y2} implies the inequality on marginals,

(D.17)PB2C1Y1Y2(0010)PB2C2Y1Y2(0110)+PA1C1Y1Y2(1010)+PA1C2Y1Y2(0010).

From the following four ancestral independences in the inflated causal structure, B2C1Y2dY1, B2C2Y2dY1, A1C1Y1dY2, and A1C2Y1dY2, we infer, respectively, the following factorization conditions:

(D.18)PB2C1Y2Y1=PB2C1Y2PY1,PB2C2Y2Y1=PB2C2Y2PY1,PA1C1Y1Y2=PA1C1Y1PY2,PA1C2Y1Y2=PA1C2Y1PY2.

Substituting these into Eq. (D.17), we obtain:

(D.19)PB2C1Y2(000)PY1(1)PB2C2Y2(010)PY1(1)+PA1C1Y1(101)PY2(0)+PA1C2Y1(001)PY2(0).

This is a nontrivial causal compatibility inequality for the inflated causal structure. However, in this form, it cannot be translated into one for the observed variables in the original causal structure: the sets {B2C1Y2}, {B2C2Y2} and {A1C1Y1} are injectable, and the singleton sets {Y1} and {Y2} are injectable (by the definition of inflation), the set {A1C2Y1} is merely expressible. Therefore, we must substitute the expression for PA1C2Y1 given by Eqs. (D.3, D.4) into Eq. (D.19), to obtain

(D.20)PB2C1Y2(000)PY1(1)PB2C2Y2(010)PY1(1)+PA1C1Y1(101)PY2(0)+bPA1B1Y1(0b1)PB1C2Y1(0b1)PB1Y1(b1)PY2(0).

This is also a nontrivial causal compatibility inequality for the inflated causal structure, but now it refers exclusively to distributions on injectable sets. As such, we can directly translate it into a nontrivial causal compatibility inequality for the original causal structure, namely,

(D.21)PBCY(000)PY(1)PBCY(010)PY(1)+PACY(101)PY(0)+bPABY(0b1)PBCY(0b1)PBY(b1)PY(0).

Dividing by PY(0)PY(1), and using the definition of conditional probabilities, this inequality can be expressed in the form

(D.22)PBC|Y(00|0)PBC|Y(01|0)+PAC|Y(10|1)+bPAB|Y(0b|1)PBC|Y(0b|1)PB|Y(b|1).

This inequality is strong enough to witness the incompatibility of Pienaar’s distribution Eq. (D.1) with HLP’s causal structure #16.

D.3 Certifying that Henson-Lal-Pusey’s causal structures #15 and #20 are “interesting”

Any distribution PABCY that is incompatible with HLP’s causal structure #16 (Fig. 16 here) is also incompatible with HLP’s causal structures #15 (Fig. 15 here) and #20 (Fig. 17 here) because the causal models defined by HLP’s causal structures #15 and #20 are included among the causal models defined by HLP’s causal structure #16. Consequently, Eq. (D.22) is also a valid causal compatibility inequality for HLP’s causal structure #15 and for HLP’s causal structure #20.

It follows that if one can find a distribution that exhibits all of the observable CI relations implied by either of HLP’s causal structures #15 and #20, namely, CY (per #15 and #16), AB|Y (per #15), and AY|B (per #20), and which moreover is not compatible with HLP’s causal structure #16, then this proves—in one go—that HLP’s causal structures #15, #16 and #20 are interesting. Any distribution PABCY with the conditional[37]

(D.23)PABC|Y(abc|y):=14([000]+[111]+[011]+[100])ify=0,14([000]+[111]+[010]+[101])ify=1,

achieves this because it satisfies the required CI relations while also violating Eq. (D.22).

Appendix E The copy lemma and non-Shannon type entropic inequalities

The inflation technique may also be useful outside beyond causal inference. As we argue in the following, inflation is secretly what underlies the Copy Lemma in the derivation of non-Shannon type entropic inequalities [119, Chapter 15]. The following formulation of the Copy Lemma is the one of Kaced [120].

Lemma 12.

Let A, B and C be random variables with joint distributionPABC. Then there exists a fourth random variableAand joint distributionPAABCsuch that:

  1. PAB=PAB,

  2. AAC|B.

The proof via inflation is as follows.

Proof.

Fig. 20. Every joint distribution PABC is compatible with the causal structure of Fig. 19. This follows from the fact that one may take X to be any sufficient statistic for the joint variable (A,C) given B, such as X:=(A,B,C). Next, we consider the inflation of Fig. 19 depicted in Fig. 20. The maximal injectable sets are {A1B1C1} and {A2B1}. By Lemma 4, because PABC is assumed to be compatible with Fig. 19, it follows that the family of marginals {PA1B1C1,PA2B1}, where PA1B1C1:=PABC and PA2B1:=PAB, is compatible with the inflation of Fig. 20. The resulting joint distribution PA1A2B1C1 has marginals PA1B1=PA2B1=PAB and satisfies the conditional independence relation A2A1C1|B1, since A2 is d-separated from A1C1 by B1 in  □

Figure 19 A causal structure that is compatible with any distribution PABC{P_{ABC}}.
Figure 19

A causal structure that is compatible with any distribution PABC.

Figure 20 An inflation of Fig. 19.
Figure 20

An inflation of Fig. 19.

While it is also not hard to write down the distribution constructed in the proof explicitly as PA1A2B1C1:=PA1B1C1PA2B1PB11 [119, Lemma 15.8], the fact that one can reinterpret it using the inflation technique is significant. For one, all the non-Shannon type inequalities derived by Dougherty et al. [121] are obtained by applying some Shannon-type inequality to the distribution derived from the Copy Lemma. Our result shows, therefore, that one can understand these non-Shannon type inequalities for a causal structure as arising from Shannon-type inequalities applied to an inflated causal structure. We thus speculate that the inflation technique may be a more general-purpose tool for deriving non-Shannon-type entropic inequalities. A natural direction for future research is to explore whether more sophisticated applications of the inflation technique might result in new examples of such inequalities.

Appendix F Causal compatibility inequalities for the triangle scenario in machine-readable format

Table 2 lists the fifty two numerically irredundant polynomial inequalities resulting from consistent marginals of the Spiral inflation of Fig. 3. Stronger inequalities can be derived be considering larger inflations, such as the Web inflation of Fig. 2. Each row in the table specifies the coefficient of the corresponding correlator monomial. As noted previously, these inequalities also follow from the hypergraph transversals technique per Sec. 4.4.

Table 2

A machine-readable and closed-under-symmetries version of the table in Sec. 4.3.

constant E[A]E[B]E[C]E[AB]E[AC]E[BC]E[ABC]E[A]E[B]E[A]E[C]E[B]E[C]E[A]E[BC]E[AC]E[B]E[AB]E[C]E[A]E[B]E[C]
1 000 -1-10 0 001 000 0
1 000 -110 0 00-1 000 0
1 000 1-10 0 00-1 000 0
1 000 110 0 001 000 0
1 000 -10-1 0 010 000 0
1 000 -101 0 0-10 000 0
1 000 10-1 0 0-10 000 0
1 000 101 0 010 000 0
1 000 0-1-1 0 100 000 0
1 000 0-11 0 -100 000 0
1 000 01-1 0 -100 000 0
1 000 011 0 100 000 0
3 -1-1-1 222 1 111 -1-1-1 1
3 -1-11 2-2-2 -1 1-1-1 111 -1
3 -11-1 -22-2 -1 -11-1 111 -1
3 -111 -2-22 1 -1-11 -1-1-1 1
3 1-1-1 -2-22 -1 -1-11 111 -1
3 1-11 -22-2 1 -11-1 -1-1-1 1
3 11-1 2-2-2 1 1-1-1 -1-1-1 1
3 111 222 -1 111 111 -1
4 -200 -3-2-2 1 102 110 -1
4 -200 -322 -1 10-2 -1-10 1
4 -200 3-22 -1 -10-2 -1-10 1
4 -200 32-2 1 -102 110 -1
4 200 -3-2-2 -1 102 -1-10 1
4 200 -322 1 10-2 110 -1
4 200 3-22 1 -10-2 110 -1
4 200 32-2 -1 -102 -1-10 1
4 0-20 -2-2-3 1 021 011 -1
4 0-20 -223 -1 0-2-1 0-1-1 1
4 0-20 2-23 1 02-1 011 -1
4 0-20 22-3 -1 0-21 0-1-1 1
4 020 -2-2-3 -1 021 0-1-1 1
4 020 -223 1 0-2-1 011 -1
4 020 2-23 -1 02-1 0-1-1 1
4 020 22-3 1 0-21 011 -1
4 00-2 -2-3-2 1 210 101 -1
4 00-2 -232 1 2-10 101 -1
4 00-2 2-32 -1 -210 -10-1 1
4 00-2 23-2 -1 -2-10 -10-1 1
4 002 -2-3-2 -1 210 -10-1 1
4 002 -232 -1 2-10 -10-1 1
4 002 2-32 1 -210 101 -1
4 002 23-2 1 -2-10 101 -1
4 000 -2-2-2 -1 222 -1-1-1 0
4 000 -2-2-2 1 222 111 0
4 000 -222 -1 2-2-2 -1-1-1 0
4 000 -222 1 2-2-2 111 0
4 000 2-22 -1 -22-2 -1-1-1 0
4 000 2-22 1 -22-2 111 0
4 000 22-2 -1 -2-22 -1-1-1 0
4 000 22-2 1 -2-22 111 0

Appendix G Recovering the Bell inequalities from the inflation technique

To further illustrate the power of the inflation technique, we now demonstrate how to recover all Bell inequalities [18], [20], [51] via our method. To keep things simple we only discuss the case of a bipartite Bell scenario with two values for both “settings” and “outcome” variables, but the case of more parties and/or more values per settings or outcome variable is totally analogous.

The causal structure associated to the Bell [17], [18], [20], [51] scenario [22 (Fig. E#2), 19 (Fig. 19), 33 (Fig. 1), 23 (Fig. 1), 52 (Fig. 2b), 53 (Fig. 2)] is depicted in Fig. 7. The observed variables are A, B, X, Y, and Λ is the latent common cause of A and B. One traditionally works with the conditional distribution PAB|XY, to be understood as an array of distributions indexed by the possible values of X and Y, instead of with the original distribution PABXY, which is what we do.

In the inflation of Fig. 8, the maximal ai-expressible sets are

(G.1){A1B1X1X2Y1Y2},{A1B2X1X2Y2Y2},{A2B1X1X2Y2Y2},{A2B2X1X2Y2Y2},

where notably every maximal ai-expressible set contains all “settings” variables X1 to Y2. The marginal distributions on these ai-expressible sets are then specified by the original observed distribution via

(G.2)abx1x2y1y2:PA1B1X1X2Y1Y2(abx1x2y1y2)=PABXY(abx1y1)PX(x2)PY(y2),PA1B2X1X2Y1Y2(abx1x2y1y2)=PABXY(abx1y2)PX(x2)PY(y1),PA2B1X1X2Y1Y2(abx1x2y1y2)=PABXY(abx2y1)PX(x1)PY(y2),PA2B2X1X2Y1Y2(abx1x2y1y2)=PABXY(abx2y2)PX(x1)PY(y1),PX1X2Y1Y2(x1x2y1y2)=PX(x1)PX(x2)PY(y1)PY(y2).

By dividing each of the first four equations by the fifth, we obtain

(G.3)abx1x2y1y2:PA1B1|X1X2Y1Y2(ab|x1x2y1y2)=PAB|XY(ab|x1y1),PA1B2|X1X2Y1Y2(ab|x1x2y1y2)=PAB|XY(ab|x1y2),PA2B1|X1X2Y1Y2(ab|x1x2y1y2)=PAB|XY(ab|x2y1),PA2B2|X1X2Y1Y2(ab|x1x2y1y2)=PAB|XY(ab|x2y2).

The existence of a joint distribution of all six variables—i. e. the existence of a solution to the marginal problem—implies in particular

(G.4)abx1x2y1y2:PA1B1|X1X2Y1Y2(ab|x1x2y1y2)=a,bPA1A2B1B2|X1X2Y1Y2(aabb|x1x2y1y2),

and similarly for the other three conditional distributions under consideration. For compatibility with the Bell scenario, Eq. (G.3) therefore implies that the original distribution must satisfy in particular

(G.5)ab:PAB|XY(ab|00)=a,bPA1A2B1B2|X1X2Y1Y2(aabb|0101)PAB|XY(ab|10)=a,bPA1A2B1B2|X1X2Y1Y2(aabb|0101)PAB|XY(ab|01)=a,bPA1A2B1B2|X1X2Y1Y2(aabb|0101)PAB|XY(ab|11)=a,bPA1A2B1B2|X1X2Y1Y2(aabb|0101)

The possibility to write the conditional probabilities in the Bell scenario in this form is equivalent to the existence of a latent variable model, as noted in Fine’s theorem [122]. Thus, the existence of a solution to our marginal problem implies the existence of a latent variable model for the original distribution; the converse follows from our Lemma 4. Hence the inflation of Fig. 8 provides necessary and sufficient conditions for the compatibility of the original distribution with the Bell scenario.

Moreover, it is possible to describe the marginal polytope over the ai-expressible sets of Eq. (G.1), resulting in a concrete correspondence between tight Bell inequalities and the facets of our marginal polytope. This is based on the observation that the “settings” variables X1 to Y2 occur in all four contexts. The marginal polytope lives in i=14R26=i=14(R2)6, where each tensor factor has basis vectors corresponding to the two possible outcomes of each variable, and the direct summands enumerate the four contexts. The polytope is given as the convex hull of the points

(eA1eB1eX1eX2eY1eY2)(eA1eB2eX1eX2eY1eY2)(eA2eB1eX1eX2eY1eY2)(eA2eB2eX1eX2eY1eY2),

where all six variables range over their possible values. Since the last four tensor factors occur in every direct summand in exactly the same way, we can also write such a polytope vertex as

(eA1eB1)(eA1eB2)(eA2eB1)(eA2eB2)eX1eX2eY1eY2

in (i=14R22)R24. Now since the first four variables in the first tensor factor vary completely independently of the latter four variables in the second tensor factor, the resulting polytope will be precisely the tensor product [123], [124] of two polytopes: first, the convex hull of all points of the form

(eA1eB1)(eA1eB2)(eA2eB1)(eA2eB2),

and second the convex hull of all eX1eX2eY1eY2. While the latter polytope is just the standard probability simplex in R8, the former polytope is precisely the “local polytope” or “Bell polytope” that is traditionally used in the context of Bell scenarios [20, Sec. II.B]. This implies that the facets of our marginal polytope are precisely the pairs consisting of a facet of the Bell polytope and a facet of the simplex, the latter of which are only the nonnegativity of probability inequalities like PX1X2Y1Y2(0101)0. For example, in this way we obtain one version of the CHSH inequality [18] as a facet of our marginal polytope,

a,b,x,y(1)a+b+xyPAxByX1X2Y1Y2(ab0101)2PX1X2Y1Y2(0101).

This translates into the standard form of the CHSH inequality as follows. Upon using Eq. (G.3), the inequality becomes

a,b(1)a+b(PABXY(ab00)PX(1)PY(1)+PABXY(ab01)PX(1)PY(0)+PABXY(ab10)PX(0)PY(1)PABXY(ab11)PX(0)PY(0))PX(0)PX(1)PY(0)PY(1),

so that dividing by the right-hand side results in one of the conventional forms of the CHSH inequality,

a,b(1)a+bPAB|XY(ab|00)+PAB|XY(ab|01)+PAB|XY(ab|10)PAB|XY(ab|11)2.

In conclusion, the inflation technique is powerful enough to get a precise characterization of all distributions compatible with the Bell causal structure, and our technique for generating polynomial inequalities through solving the marginal constraint problem recovers all Bell inequalities.

Some Bell inequalities may also be derived using the hypergraph transversals technique discussed in Sec. 4.4. For example, the inequality

(G.6)PA1B1X1Y1(0000)PX2(1)PY2(1)PA1B2X1Y2(0001)PX2(1)PY1(0)+PA2B1X2Y1(0010)PX1(0)PY2(1)+PA2B2X2Y2(1111)PX1(0)PY1(0)

is the inflationary precursor of the Bell inequality

(G.7)PAB|XY(00|00)PAB|XY(00|01)+PAB|XY(00|10)+PAB|XY(11|11),

as Eq. (G.7) is obtained from Eq. (G.6) by dividing both sides by PX1Y1X2Y2(0011)=PX1(0)PY2(0)PX2(1)PY2(1) and then dropping copy indices. On the other hand, Eq. (G.6) follows directly from factorization relations on ai-expressible sets and the tautology

which corresponds to the original “Hardy paradox” [49] in our notation.

References

1. Pearl J. Causality: Models, reasoning, and inference. Cambridge University Press; 2009.10.1017/CBO9780511803161Suche in Google Scholar

2. Spirtes P, Glymour C, Scheines R. Causation, prediction, and search. Lecture Notes in Statistics. New York: Springer; 2011.Suche in Google Scholar

3. Studený M. Probabilistic conditional independence structures. Information Science and Statistics. London: Springer; 2005.Suche in Google Scholar

4. Koller D. Probabilistic graphical models: Principles and techniques. MIT Press; 2009.Suche in Google Scholar

5. Pearl J. Theoretical impediments to machine learning with seven sparks from the causal revolution. arXiv:1801.04016 (2018).10.1145/3159652.3176182Suche in Google Scholar

6. Rosset D, Gisin N, Wolfe E. Universal bound on the cardinality of local hidden variables in networks. Quantum Inf Comput 2018;18.10.26421/QIC18.11-12-2Suche in Google Scholar

7. Geiger D, Meek C. Graphical models and exponential families. In: Proc 14th conf uncert artif intell. AUAI; 1998. p. 156–65.Suche in Google Scholar

8. Lee CM, Spekkens RW. Causal inference via algebraic geometry: Feasibility tests for functional causal structures with two binary observed variables. J Causal Inference. 2017;5:20160013.10.1515/jci-2016-0013Suche in Google Scholar

9. Chaves R. Polynomial Bell inequalities. Phys Rev Lett. 2016;116:010402.10.1103/PhysRevLett.116.010402Suche in Google Scholar PubMed

10. Geiger D, Meek C. Quantifier elimination for statistical problems. In: Proc 15th conf uncert artif intell. AUAI; 1999. p. 226–35.Suche in Google Scholar

11. Garcia LD, Stillman M, Sturmfels B. Algebraic geometry of bayesian networks. J Symb Comput. 2005;39:331.10.1016/j.jsc.2004.11.007Suche in Google Scholar

12. Garcia LD. Algebraic statistics in model selection. In: Proc 20th conf uncert artif intell. AUAI; 2004. p. 177–84.Suche in Google Scholar

13. Garcia-Puente LD, Spielvogel S, Sullivant S. Identifying causal effects with computer algebra. In: Proc 26th conf uncert artif intell. AUAI; 2010. p. 193–200.Suche in Google Scholar

14. Tian J, Pearl J. On the testable implications of causal models with hidden variables. In: Proc 18th conf uncert artif intell. AUAI; 2002. p. 519–27.Suche in Google Scholar

15. Kang C, Tian J. Inequality constraints in causal models with hidden variables. In: Proc 22nd conf uncert artif intell. AUAI; 2006. p. 233–40.Suche in Google Scholar

16. Kang C, Tian J. Polynomial constraints in causal bayesian networks. In: Proc 23rd conf uncert artif intell. AUAI; 2007. p. 200–8.Suche in Google Scholar

17. Bell JS. On the Einstein-Podolsky-Rosen paradox. Physics. 1964;1:195.10.1103/PhysicsPhysiqueFizika.1.195Suche in Google Scholar

18. Clauser JF, Horne MA, Shimony A, Holt RA. Proposed experiment to test local hidden-variable theories. Phys Rev Lett. 1969;23:880.10.1103/PhysRevLett.23.880Suche in Google Scholar

19. Wood CJ, Spekkens RW. The lesson of causal discovery algorithms for quantum correlations: causal explanations of Bell-inequality violations require fine-tuning. New J Phys. 2015;17:033002.10.1088/1367-2630/17/3/033002Suche in Google Scholar

20. Brunner N, Cavalcanti D, Pironio S, Scarani V, Wehner S. Bell nonlocality. Rev Mod Phys. 2014;86:419.10.1103/RevModPhys.86.419Suche in Google Scholar

21. Fritz T. Beyond Bell’s theorem: correlation scenarios. New J Phys. 2012;14:103001.10.1088/1367-2630/14/10/103001Suche in Google Scholar

22. Henson J, Lal R, Pusey MF. Theory-independent limits on correlations from generalized Bayesian networks. New J Phys. 2014;16:113043.10.1088/1367-2630/16/11/113043Suche in Google Scholar

23. Fritz T. Beyond Bell’s theorem II: Scenarios with arbitrary causal structure. Commun Math Phys. 2015;341:391.10.1007/s00220-015-2495-5Suche in Google Scholar

24. Chaves R, Budroni C. Entropic nonsignaling correlations. Phys Rev Lett. 2016;116:240501.10.1103/PhysRevLett.116.240501Suche in Google Scholar PubMed

25. Chaves R, Luft L, Maciel TO, Gross D, Janzing D, Schölkopf B. Inferring latent structures via information inequalities. In: Proc 30th conf uncert artif intell. AUAI; 2014. p. 112–21.Suche in Google Scholar

26. Weilenmann M, Colbeck R. Non-Shannon inequalities in the entropy vector approach to causal structures. Quantum. 2018;2:57.10.22331/q-2018-03-14-57Suche in Google Scholar

27. Kela A, von Prillwitz K, Åberg J, Chaves R, Gross D. Semidefinite tests for latent causal structures. arXiv:1701.00652 (2017).Suche in Google Scholar

28. Tavakoli A, Skrzypczyk P, Cavalcanti D, Acín A. Nonlocal correlations in the star-network configuration. Phys Rev A. 2014;90:062109.10.1103/PhysRevA.90.062109Suche in Google Scholar

29. Rosset D, Branciard C, Barnea TJ, Pütz G, Brunner N, Gisin N. Nonlinear Bell inequalities tailored for quantum networks. Phys Rev Lett. 2016;116:010403.10.1103/PhysRevLett.116.010403Suche in Google Scholar PubMed

30. Tavakoli A. Bell-type inequalities for arbitrary noncyclic networks. Phys Rev A. 2016;93:030101.10.1103/PhysRevA.93.030101Suche in Google Scholar

31. Pearl J. On the Testability of Causal Models with Latent and Instrumental Variables. In: Proc 11th conf uncert artif intell. AUAI; 1995. p. 435–43.Suche in Google Scholar

32. Steudel B, Ay N. Information-theoretic inference of common ancestors. Entropy. 2015;17:2304.10.3390/e17042304Suche in Google Scholar

33. Chaves R, Luft L, Gross D. Causal structures from entropic information: geometry and novel scenarios. New J Phys. 2014;16:043001.10.1088/1367-2630/16/4/043001Suche in Google Scholar

34. Evans RJ. Graphical methods for inequality constraints in marginalized DAGs. In: Proc 2012 IEEE intern work MLSP. IEEE; 2012. p. 1–6.10.1109/MLSP.2012.6349796Suche in Google Scholar

35. Fritz T, Chaves R. Entropic inequalities and marginal problems. IEEE Trans Inf Theory. 2013;59:803.10.1109/TIT.2012.2222863Suche in Google Scholar

36. Pienaar J. Which causal structures might support a quantum–classical gap? New J Phys. 2017;19:043021.10.1088/1367-2630/aa673eSuche in Google Scholar

37. Braunstein SL, Caves CM. Information-theoretic Bell inequalities. Phys Rev Lett. 1988;61:662.10.1103/PhysRevLett.61.662Suche in Google Scholar PubMed

38. Schumacher BW. Information and quantum nonseparability. Phys Rev A. 1991;44:7047.10.1103/PhysRevA.44.7047Suche in Google Scholar

39. Leifer MS, Spekkens RW. Towards a formulation of quantum theory as a causally neutral theory of Bayesian inference. Phys Rev A. 2013;88:052130.10.1103/PhysRevA.88.052130Suche in Google Scholar

40. Chaves R, Majenz C, Gross D. Information–theoretic implications of quantum causal structures. Nat Commun. 2015;6:5766.10.1038/ncomms6766Suche in Google Scholar PubMed

41. Ried K, Agnew M, Vermeyden L, Janzing D, Spekkens RW, Resch KJ. A quantum advantage for inferring causal structure. Nat Phys. 2015;11:414.10.1038/nphys3266Suche in Google Scholar

42. Costa F, Shrapnel S. Quantum causal modelling. New J Phys. 2016;18:063032.10.1088/1367-2630/18/6/063032Suche in Google Scholar

43. Allen J-MA, Barrett J, Horsman DC, Lee CM, Spekkens RW. Quantum common causes and quantum causal models. Phys Rev X. 2017;7:031021.10.1103/PhysRevX.7.031021Suche in Google Scholar

44. Hardy L. Quantum theory from five reasonable axioms, quant-ph/0101012 (2001).Suche in Google Scholar

45. Barrett J. Information processing in generalized probabilistic theories. Phys Rev A. 2007;75:032304.10.1103/PhysRevA.75.032304Suche in Google Scholar

46. Boldi P, Vigna S. Fibrations of graphs. Discrete Math. 2002;243:21.10.1016/S0012-365X(00)00455-6Suche in Google Scholar

47. Branciard C, Rosset D, Gisin N, Pironio S. Bilocal versus nonbilocal correlations in entanglement-swapping experiments. Phys Rev A. 2012;85:032119.10.1103/PhysRevA.85.032119Suche in Google Scholar

48. Dür W, Vidal G, Cirac JI. Three qubits can be entangled in two inequivalent ways. Phys Rev A. 2000;62:062314.10.1103/PhysRevA.62.062314Suche in Google Scholar

49. Hardy L. Nonlocality for two particles without inequalities for almost all entangled states. Phys Rev Lett. 1993;71:1665.10.1103/PhysRevLett.71.1665Suche in Google Scholar PubMed

50. Mansfield S, Fritz T. Hardy’s non-locality paradox and possibilistic conditions for non-locality. Found Phys. 2012;42:709.10.1007/s10701-012-9640-1Suche in Google Scholar

51. Bell JS. On the problem of hidden variables in quantum mechanics. Rev Mod Phys. 1966;38:447.10.1103/RevModPhys.38.447Suche in Google Scholar

52. Donohue JM, Wolfe E. Identifying nonconvexity in the sets of limited-dimension quantum correlations. Phys Rev A. 2015;92:062120.10.1103/PhysRevA.92.062120Suche in Google Scholar

53. Steeg GV, Galstyan A. A sequence of relaxations constraining hidden variable models. In: Proc 27th conf uncert artif intell. AUAI; 2011. p. 717–26.Suche in Google Scholar

54. Cirel’son BS. Quantum generalizations of Bell’s inequality. Lett Math Phys. 1980;4:93. Available at http://www.tau.ac.il/~tsirel/download/qbell80.html.10.1007/BF00417500Suche in Google Scholar

55. Popescu S, Rohrlich D. Quantum nonlocality as an axiom. Found Phys. 1994;24:379.10.1007/BF02058098Suche in Google Scholar

56. Barrett J, Pironio S. Popescu-Rohrlich correlations as a unit of nonlocality. Phys Rev Lett. 2005;95:140401.10.1103/PhysRevLett.95.140401Suche in Google Scholar PubMed

57. Liang Y-C, Spekkens RW, Wiseman HM. Specker’s parable of the overprotective seer: A road to contextuality, nonlocality and complementarity. Phys Rep. 2011;506:1.10.1016/j.physrep.2011.05.001Suche in Google Scholar

58. Roberts D. Aspects of quantum non-locality. PhD thesis. University of Bristol; 2004.Suche in Google Scholar

59. Pitowsky I. George Boole’s ‘Conditions of possible experience’ and the quantum puzzle. Br J Philos Sci. 1994;45:95.10.1093/bjps/45.1.95Suche in Google Scholar

60. Pitowsky I. Quantum probability – Quantum logic. Lecture Notes in Physics. vol. 321. Springer-Verlag; 1989.Suche in Google Scholar

61. Kellerer HG. Verteilungsfunktionen mit gegebenen Marginalverteilungen. Z Wahrscheinlichkeitstheorie. 1964;3:247.10.1007/BF00534912Suche in Google Scholar

62. Leggett AJ, Garg A. Quantum mechanics versus macroscopic realism: is the flux there when nobody looks? Phys Rev Lett. 1985;54:857.10.1103/PhysRevLett.54.857Suche in Google Scholar PubMed

63. Araújo M, Túlio Quintino M, Budroni C, Terra Cunha M, Cabello A. All noncontextuality inequalities for the n-cycle scenario. Phys Rev A. 2013;88:022118.10.1103/PhysRevA.88.022118Suche in Google Scholar

64. Horodecki R, Horodecki P, Horodecki M, Horodecki K. Quantum entanglement. Rev Mod Phys. 2009;81:865.10.1103/RevModPhys.81.865Suche in Google Scholar

65. Abramsky S, Brandenburger A. The sheaf-theoretic structure of non-locality and contextuality. New J Phys. 2011;13:113036.10.1088/1367-2630/13/11/113036Suche in Google Scholar

66. Vorob’ev NN. Consistent families of measures and their extensions. Theory Probab Appl. 1960;7:147.10.1137/1107014Suche in Google Scholar

67. Budroni C, Miklin N, Chaves R. Indistinguishability of causal relations from limited marginals. Phys Rev A. 2016;94:042127.10.1103/PhysRevA.94.042127Suche in Google Scholar

68. Kahle T. Neighborliness of marginal polytopes. Beitr Algebra Geom. 2010;51:45.Suche in Google Scholar

69. Andersen ED. Certificates of primal or dual infeasibility in linear programming. Comput Optim Appl. 2001;20:171.10.1023/A:1011259103627Suche in Google Scholar

70. Garuccio A. Hardy’s approach, Eberhard’s inequality, and supplementary assumptions. Phys Rev A. 1995;52:2535.10.1103/PhysRevA.52.2535Suche in Google Scholar

71. Cabello A. Bell’s theorem with and without inequalities for the three-qubit Greenberger-Horne-Zeilinger and W states. Phys Rev A. 2002;65:032108.10.1103/PhysRevA.65.032108Suche in Google Scholar

72. Braun D, Choi M-S. Hardy’s test versus the Clauser-Horne-Shimony-Holt test of quantum nonlocality: Fundamental and practical aspects. Phys Rev A. 2008;78:032114.10.1103/PhysRevA.78.032114Suche in Google Scholar

73. Mančinska L, Wehner S. A unified view on Hardy’s paradox and the Clauser–Horne–Shimony–Holt inequality. J Phys A. 2014;47:424027.10.1088/1751-8113/47/42/424027Suche in Google Scholar

74. Ghirardi G, Marinatto L. Proofs of nonlocality without inequalities revisited. Phys Lett A. 2008;372:1982.10.1016/j.physleta.2007.11.012Suche in Google Scholar

75. Eiter T, Makino K, Gottlob G. Computational aspects of monotone dualization: A brief survey. Discrete Appl Math. 2008;156:2035.10.1016/j.dam.2007.04.017Suche in Google Scholar

76. Barrett C, Fontaine P, Tinelli C. The satisfiability modulo theories library. 2016. www.SMT-LIB.org.Suche in Google Scholar

77. Fordan A. Projection in constraint logic programming. Ios Press; 1999.Suche in Google Scholar

78. Dantzig GB, Eaves BC. Fourier-Motzkin elimination and its dual. J Comb Theory, Ser A. 1973;14:288.10.1016/0097-3165(73)90004-6Suche in Google Scholar

79. Bastrakov SI, Zolotykh NY. Fast method for verifying Chernikov rules in Fourier-Motzkin elimination. Comput Math Math Phys. 2015;55:160.10.1134/S0965542515010042Suche in Google Scholar

80. Balas E. Projection with a minimal system of inequalities. Comput Optim Appl. 1998;10:189.10.21236/ADA257237Suche in Google Scholar

81. Jones CN, Kerrigan EC, Maciejowski JM. On polyhedral projection and parametric programming. J Optim Theory Appl. 2008;138:207.10.1007/s10957-008-9384-4Suche in Google Scholar

82. Jones C. Polyhedral tools for control. PhD thesis. University of Cambridge; 2005.Suche in Google Scholar

83. Jones C, Kerrigan EC, Maciejowski J. Equality set projection: A new algorithm for the projection of polytopes in halfspace representation. Tech Rep. Cambridge University Engineering Dept; 2004.Suche in Google Scholar

84. Spekkens RW. The paradigm of kinematics and dynamics must yield to causal structure. In: Questioning the foundations of physics: which of our fundamental assumptions are wrong? Springer International; 2015. p. 5–16.10.1007/978-3-319-13045-3_2Suche in Google Scholar

85. Henson J. Causality, Bell’s theorem, and ontic definiteness. arXiv:1102.2855 (2011).Suche in Google Scholar

86. Barrett J, Linden N, Massar S, Pironio S, Popescu S, Roberts D. Nonlocal correlations as an information-theoretic resource. Phys Rev A. 2005;71:022101.10.1103/PhysRevA.71.022101Suche in Google Scholar

87. Scarani V. The device-independent outlook on quantum physics. Acta Phys Slovaca. 2012;62:347.Suche in Google Scholar

88. Bancal J-D. On the device-independent approach to quantum physics. Springer International; 2014.10.1007/978-3-319-01183-7Suche in Google Scholar

89. Chaves R, Fritz T. Entropic approach to local realism and noncontextuality. Phys Rev A. 2012;85:032113.10.1103/PhysRevA.85.032113Suche in Google Scholar

90. Barnum H, Wilce A. Post-classical probability theory. arXiv:1205.3833 (2012).Suche in Google Scholar

91. Janotta P, Hinrichsen H. Generalized probability theories: what determines the structure of quantum theory? J Phys A. 2014;47:323001.10.1088/1751-8113/47/32/323001Suche in Google Scholar

92. Fraser TC, Wolfe E. Causal compatibility inequalities admitting quantum violations in the triangle structure. Phys Rev A. 2018;98:022113.10.1103/PhysRevA.98.022113Suche in Google Scholar

93. Barnum H, Caves CM, Fuchs CA, Jozsa R, Schumacher B. Noncommuting mixed states cannot be broadcast. Phys Rev Lett. 1996;76:2818.10.1103/PhysRevLett.76.2818Suche in Google Scholar PubMed

94. Barnum H, Barrett J, Leifer M, Wilce A. Cloning and broadcasting in generic probabilistic theories. quant-ph/0611295 (2006).Suche in Google Scholar

95. Popescu S. Nonlocality beyond quantum mechanics. Nat Phys. 2014;10:264.10.1038/nphys2916Suche in Google Scholar

96. Yang TH, Navascués M, Sheridan L, Scarani V. Quantum Bell inequalities from macroscopic locality. Phys Rev A. 2011;83:022105.10.1103/PhysRevA.83.022105Suche in Google Scholar

97. Rohrlich D. PR-box correlations have no classical limit. In: Quantum theory: A two-time success story. Milan: Springer; 2014. p. 205–11.10.1007/978-88-470-5217-8_13Suche in Google Scholar

98. Pawlowski M, Scarani V. Information causality. arXiv:1112.1142 (2011).Suche in Google Scholar

99. Fritz T, Sainz AB, Augusiak R, Brask JB, Chaves R, Leverrier A, Acin A. Local orthogonality as a multipartite principle for quantum correlations. Nat Commun. 2013;4:2263.10.1038/ncomms3263Suche in Google Scholar PubMed

100. Sainz AB, Fritz T, Augusiak R, Brask JB, Chaves R, Leverrier A, Acín A. Exploring the local orthogonality principle. Phys Rev A. 2014;89:032117.10.1103/PhysRevA.89.032117Suche in Google Scholar

101. Cabello A. Simple explanation of the quantum limits of genuine n-body nonlocality. Phys Rev Lett. 2015;114:220402.10.1103/PhysRevLett.114.220402Suche in Google Scholar PubMed

102. Barnum H, Müller MP, Ududec C. Higher-order interference and single-system postulates characterizing quantum theory. New J Phys. 2014;16:123029.10.1088/1367-2630/16/12/123029Suche in Google Scholar

103. Navascués M, Guryanova Y, Hoban MJ, Acín A. Almost quantum correlations. Nat Commun. 2015;6:6288.10.1038/ncomms7288Suche in Google Scholar PubMed

104. Kang C, Tian J. Polynomial constraints in causal bayesian networks. In: Proc 23rd conf uncert artif intell. AUAI; 2007. p. 200–8.Suche in Google Scholar

105. Navascués M, Pironio S, Acín A. A convergent hierarchy of semidefinite programs characterizing the set of quantum correlations. New J Phys. 2008;10:073013.10.1088/1367-2630/10/7/073013Suche in Google Scholar

106. Pál KF, Vértesi T. Quantum bounds on Bell inequalities. Phys Rev A. 2009;79:022120.10.1103/PhysRevA.79.022120Suche in Google Scholar

107. Wolfe E, et al. Quantum inflation: A general approach to quantum causal compatibility (in preparation).Suche in Google Scholar

108. Navascués M, Wolfe E. The inflation technique completely solves the causal compatibility problem. arXiv:1707.06476 (2017).Suche in Google Scholar

109. Avis D, Bremner D, Seidel R. How good are convex hull algorithms? Comput Geom. 1997;7:265.10.1145/220279.220282Suche in Google Scholar

110. Fukuda K, Prodon A. Double description method revisited. In: Combin & Comp Sci. Springer-Verlag; 1996. p. 91–111.10.1007/3-540-61576-8_77Suche in Google Scholar

111. Shapot DV, Lukatskii AM. Solution building for arbitrary system of linear inequalities in an explicit form. Am J Comput Math. 2012;02:1.10.4236/ajcm.2012.21001Suche in Google Scholar

112. Avis D. A revised implementation of the reverse search vertex enumeration algorithm. In: Polytopes — Combinatorics and computation. DMV Seminar. vol. 29. Basel: Birkhäuser; 2000. p. 177–98.10.1007/978-3-0348-8438-9_9Suche in Google Scholar

113. Gläßle T, Gross D, Chaves R. Computational tools for solving a marginal problem with applications in Bell non-locality and causal modeling. J Phys A. 2018;51:484002.10.1088/1751-8121/aae754Suche in Google Scholar

114. Bremner D, Sikiric MD, Schürmann A. Polyhedral representation conversion up to symmetries. In: Polyhedral computation. CRM proc lecture notes, vol. 48. Amer Math Soc; 2009. p. 45–71.10.1090/crmp/048/03Suche in Google Scholar

115. Schürmann A. Exploiting symmetries in polyhedral computations. Disc Geom Optim. 2013;265.10.1007/978-3-319-00200-2_15Suche in Google Scholar

116. Kaibel V, Liberti L, Schürmann A, Sotirov R. Mini-workshop: Exploiting symmetry in optimization. Oberwolfach Rep. 2010;7:2245.10.4171/OWR/2010/38Suche in Google Scholar

117. Rehn T, Schürmann A. C++ tools for exploiting polyhedral symmetries. In: Proc 3rd int congr conf math soft, ICMS’10. Springer-Verlag; 2010. p. 295–8.10.1007/978-3-642-15582-6_48Suche in Google Scholar

118. Lörwald S, Reinelt G. PANDA: a software for polyhedral transformations. EURO J Comp Optim. 2015;3:297.10.1007/s13675-015-0040-0Suche in Google Scholar

119. Yeung RW. Beyond Shannon-type inequalities. In: Information theory and network coding. Springer US; 2008. p. 361–86.10.1007/978-0-387-79234-7_15Suche in Google Scholar

120. Kaced T. Equivalence of two proof techniques for non-Shannon-type inequalities. In: Information theory proceedings (ISIT). IEEE; 2013. p. 236–40.10.1109/ISIT.2013.6620223Suche in Google Scholar

121. Dougherty R, Freiling CF, Zeger K. Non-Shannon information inequalities in four random variables. arXiv:1104.3602 (2011).Suche in Google Scholar

122. Fine A. Hidden variables, joint probability, and the Bell inequalities. Phys Rev Lett. 1982;48:291.10.1103/PhysRevLett.48.291Suche in Google Scholar

123. Namioka I, Phelps R. Tensor products of compact convex sets. Pac J Math. 1969;31:469.10.2140/pjm.1969.31.469Suche in Google Scholar

124. Bogart T, Contois M, Gubeladze J. Hom-polytopes. Math Z. 2013;273:1267.10.1007/s00209-012-1053-5Suche in Google Scholar

Received: 2017-08-16
Revised: 2018-08-31
Accepted: 2019-06-10
Published Online: 2019-07-16
Published in Print: 2019-09-25

© 2019 Walter de Gruyter GmbH, Berlin/Boston

This article is distributed under the terms of the Creative Commons Attribution Non-Commercial License, which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Heruntergeladen am 7.1.2026 von https://www.degruyterbrill.com/document/doi/10.1515/jci-2017-0020/html
Button zum nach oben scrollen