Chapter 10 Observational Studies, Selection Bias, and Nonparametric Identification of Causal Effects

Cochran, (1965) summarized two common characteristics of observational studies:

  1. 1.

    the objective is to elucidate cause-and-effect relationships;

  2. 2.

    it is not feasible to use controlled experimentation.

The first characteristic is identical to that of randomized experiments discussed in Part II of this book, but the second differs fundamentally from randomized experiments.

Dorn, (1953) suggested that the planner of an observational study should always ask the following question:

How would the study be conducted if it were possible to do it by controlled experimentation?

It is always helpful to follow Dorn, (1953)’s suggestion because the potential outcomes framework has an intrinsic link to an experiment, either a real experiment or a thought experiment. Part III of this book will discuss causal inference with observational studies. It will clarify the fundamental differences between observational studies and randomized experiments. Nevertheless, many ideas of causal inference with observational studies are deeply connected to those with randomized experiments.

53 Motivating Examples

Example 10.1 (job training program)

LaLonde, (1986) was interested in the causal effect of a job training program on earnings. He compared the results based on a randomized experiment to the results based on observational studies. We have used the experimental data before, which is the lalonde dataset in the Matching package. We have also used an observational counterpart cps1re74.csv in Chapter 2.1 and Problem 1.4. LaLonde, (1986) found that many traditional statistical or econometric methods for observational studies gave quite different estimates compared with the estimates based on the experimental data. Dehejia and Wahba, (1999) re-analyzed the data using methods motivated by causal inference, and found that those methods can recover the experimental gold standard well. Since then, this has become a canonical example in causal inference with observational studies.

Example 10.2 (smoking and homocysteine)

Bazzano et al., (2003) compared the homocysteine27 levels in daily smokers and non-smokers based on the data from the National Health and Nutrition Examination Survey (NHANES) 2005–2006. Rosenbaum, (2018) documented the data as homocyst in the package senstrat. The dataset has the following important covariates:

female 1=female, 0=male
age3 three age categories: 20–39, 40–50, \geq60
ed3 three education categories: < high school, high school, some college
bmi3 three BMI categories: <30, [30,35), \geq 35
pov2 TRUE=income at least twice the poverty level, FALSE otherwise
Example 10.3 (school meal program and body mass index)

Chan et al., (2016) used a subsample of the data from NHANES 2007–2008 to study whether participation in school meal programs led to an increase in BMI for school children. They documented the data as nhanes_bmi in the package ATE. The dataset has the following important covariates:

age Age
ChildSex Sex (1: male, 0: female)
black Race (1: black, 0: otherwise)
mexam Race (1: Hispanic: 0 otherwise)
pir200_plus Family above 200% of the federal poverty level
WIC Participation in the special supplemental nutrition program
Food_Stamp Participation in food stamp program
fsdchbi Childhood food security
AnyIns Any insurance
RefSex Sex of the adult respondent (1: male, 0: female)
RefAge Age of the adult respondent

A common feature of Examples 10.1–10.3 is that we are interested in estimating the causal effect of a nonrandomized treatment on an outcome. They are all from observational studies.

54 Causal effects and selection bias under the potential outcomes framework

For unit i (i=1,\ldots,n), we have pretreatment covariates X_{i}, a binary treatment indicator Z_{i}, and an observed outcome Y_{i} with two potential outcomes Y_{i}(1) and Y_{i}(0) under the treatment and control, respectively. For simplicity, we assume

\{X_{i},Z_{i},Y_{i}(1),Y_{i}(0)\}_{i=1}^{n}\stackrel{{\scriptstyle\textup{IID}}}{{\sim}}\{X,Z,Y(1),Y(0)\}.

So we can drop the subscript i for quantities of this population. The causal effects of interest are the average causal effect

\tau=E\{Y(1)-Y(0)\},

the average causal effect on the treated units

\tau_{\textsc{T}}=E\{Y(1)-Y(0)\mid Z=1\},

and the average causal effect on the control units:

\tau_{\textsc{C}}=E\{Y(1)-Y(0)\mid Z=0\}.

By the linearity of the expectation, we have

\displaystyle\tau_{\textsc{T}} \displaystyle= \displaystyle E\{Y(1)\mid Z=1\}-E\{Y(0)\mid Z=1\}
\displaystyle= \displaystyle E(Y\mid Z=1)-E\{Y(0)\mid Z=1\}

and

\displaystyle\tau_{\textsc{C}} \displaystyle= \displaystyle E\{Y(1)\mid Z=0\}-E\{Y(0)\mid Z=0\}
\displaystyle= \displaystyle E\{Y(1)\mid Z=0\}-E(Y\mid Z=0).

In the above two formulas of \tau_{\textsc{T}} and \tau_{\textsc{C}}, the quantities E(Y\mid Z=1) and E(Y\mid Z=0) are directly estimable from the data, but the quantities E\{Y(0)\mid Z=1\} and E\{Y(1)\mid Z=0\} are not. The latter two are counterfactuals because they are the means of the potential outcomes corresponding to the treatment level that is the opposite of the actual received treatment.

The simple difference in means, also known as the prima facie28 causal effect,

\displaystyle\tau_{\textsc{PF}} \displaystyle= \displaystyle E(Y\mid Z=1)-E(Y\mid Z=0)
\displaystyle= \displaystyle E\{Y(1)\mid Z=1\}-E\{Y(0)\mid Z=0\}

is generally biased for the causal effects defined above. For example,

\tau_{\textsc{PF}}-\tau_{\textsc{T}}=E\{Y(0)\mid Z=1\}-E\{Y(0)\mid Z=0\}

and

\tau_{\textsc{PF}}-\tau_{\textsc{C}}=E\{Y(1)\mid Z=1\}-E\{Y(1)\mid Z=0\}

are not zero in general, and they quantify the selection bias. They measure the differences in the means of the potential outcomes across the treatment and control groups.

Why is randomization so important? Rubin, (1978) first used potential outcomes to quantify the benefit of randomization. We have used the fact in Chapter 9 that

Z\ind \{Y(1),Y(0)\} (46)

in the CRE, which implies that the selection bias terms are both zero:

\tau_{\textsc{PF}}-\tau_{\textsc{T}}=E\{Y(0)\mid Z=1\}-E\{Y(0)\mid Z=0\}=0

and

\tau_{\textsc{PF}}-\tau_{\textsc{C}}=E\{Y(1)\mid Z=1\}-E\{Y(1)\mid Z=0\}=0.

So under the CRE in (46), we have

\tau=\tau_{\textsc{T}}=\tau_{\textsc{C}}=\tau_{\textsc{PF}}. (47)

From the above discussion, the fundamental benefit of randomization is to balance the distributions of the potential outcomes across the treatment and control groups. This is a much stronger guarantee than balancing the distributions of the observed covariates.

Without randomization, the selection bias terms can be arbitrarily large, especially for unbounded outcomes. This highlights the fundamental difficulty of causal inference with observational studies.

55 Sufficient conditions for nonparametric identification of causal effects

55.1 Identification

Causal inference with observational studies is challenging. It relies on strong assumptions. A strategy is to use the information from the pretreatment covariates and assume that conditioning on the observed covariates X, the selection bias terms are zero, that is,

\displaystyle E\{Y(0)\mid Z=1,X\} \displaystyle= \displaystyle E\{Y(0)\mid Z=0,X\}, (48)
\displaystyle E\{Y(1)\mid Z=1,X\} \displaystyle= \displaystyle E\{Y(1)\mid Z=0,X\}. (49)

The assumptions in (48) and (49) state that the differences in the means of the potential outcomes across the treatment and control groups are entirely due to the difference in the observed covariates. So given the same value of the covariates, the potential outcomes have the same means across the treatment and control groups. Mathematically, (48) and (49) ensure that the conditional versions of the effects in (47) are identical:

\tau(X)=\tau_{\textsc{T}}(X)=\tau_{\textsc{C}}(X)=\tau_{\textsc{PF}}(X),

where

\displaystyle\tau(X) \displaystyle= \displaystyle E\{Y(1)-Y(0)\mid X\},
\displaystyle\tau_{\textsc{T}}(X) \displaystyle= \displaystyle E\{Y(1)-Y(0)\mid Z=1,X\},
\displaystyle\tau_{\textsc{C}}(X) \displaystyle= \displaystyle E\{Y(1)-Y(0)\mid Z=0,X\},
\displaystyle\tau_{\textsc{PF}}(X) \displaystyle= \displaystyle E(Y\mid Z=1,X)-E(Y\mid Z=0,X).

In particular, \tau(X) is often called the conditional average causal effect (CATE).

A key result in this chapter is that the average causal effect \tau is nonparametrically identifiable under (48) and (49). The notion of nonparametrically identifiability does not appear frequently in classic statistics, but it is key to causal inference with observational studies. I first give an abstract definition below.

Definition 10.1 (identification)

A parameter \theta is identifiable if it can be written as a function of the distribution of the observed data under certain model assumptions. A parameter \theta is nonparametrically identifiable if it can be written as a function of the distribution of the observed data without any parametric model assumptions.

Definition 10.1 is too abstract at the moment. I will use more concrete examples in later chapters to illustrate its meaning. It is often neglected in classic statistics problems. For instance, the mean \theta=E(Y) is nonparametrically identifiable if we have IID draws of Y_{i}’s; the Pearson correlation coefficient \theta=\rho_{YX} is nonparametrically identifiable if we have IID draws of the pairs (X_{i},Y_{i})’s. In those examples, the parameters are nonparametrically identifiable automatically. However, Definition 10.1 is fundamental in causal inference with observational studies. In particular, the parameter of interest \tau=E\{Y(1)-Y(0)\} depends on some unobserved random variables, so it is unclear whether it is nonparametrically identifiable based on observed data. Under the assumptions in (48) and (49), it is nonparametrically identifiable, with details below.

Because \tau_{\textsc{PF}}(X) depends only on the observables, it is nonparametrically identified by definition. Moreover, (48) and (49) ensure that the three causal effects are the same as \tau_{\textsc{PF}}(X), so \tau(X), \tau_{\textsc{T}}(X) and \tau_{\textsc{C}}(X) are all nonparametrically identified. Consequently, the unconditional versions are also nonparametrically identified under (48) and (49) due to the law of total expectation:

\tau=E\{\tau(X)\},\quad\tau_{\textsc{T}}=E\{\tau_{\textsc{T}}(X)\mid Z=1\},\quad\tau_{\textsc{C}}=E\{\tau_{\textsc{C}}(X)\mid Z=0\}.

From now on, I will focus on \tau unless stated otherwise (Chapter 13 will be an exception). The following theorem summarizes the identification formulas of \tau.

Theorem 10.1

Under (48) and (49), the average causal effect \tau is identified by

\displaystyle\tau \displaystyle= \displaystyle E\{\tau(X)\} (50)
\displaystyle= \displaystyle E\{E(Y\mid Z=1,X)-E(Y\mid Z=0,X)\} (51)
\displaystyle= \displaystyle\int\{E(Y\mid Z=1,X=x)-E(Y\mid Z=0,X=x)\}f(x)\textup{d}x. (52)

The formula (51) was formally established by Rosenbaum and Rubin, 1983b (), which is also called the g-formula by Robins (Hernán and Robins,, 2020, see).

With a discrete covariate, we can write the identification formula in Theorem 10.1 as

\displaystyle\tau \displaystyle= \displaystyle\sum_{x}E(Y\mid Z=1,X=x)\textup{pr}(X=x) (53)
\displaystyle-\sum_{x}E(Y\mid Z=0,X=x)\textup{pr}(X=x),

and also the simple difference in means as

\displaystyle\tau_{\textsc{PF}} \displaystyle= \displaystyle\sum_{x}E(Y\mid Z=1,X=x)\textup{pr}(X=x\mid Z=1) (54)
\displaystyle-\sum_{x}E(Y\mid Z=0,X=x)\textup{pr}(X=x\mid Z=0)

by the law of total probability. Comparing (53) and (54), we can see that although both formulas compare the conditional expectations E(Y\mid Z=1,X=x) and E(Y\mid Z=0,X=x), they average over different distributions of the covariates. The causal parameter \tau averages the conditional expectations over the common distribution of the covariates, but the difference in means \tau_{\textsc{PF}} averages the conditional expectations over two different distributions of the covariates in the treated and control groups.

Usually, we impose a stronger assumption.

Assumption 10.1 (ignorability)

We have

\displaystyle Y(z)\ind Z\mid X\quad(z=0,1). (55)

Assumption 10.1 has many names:

  1. 1.

    ignorability due to Rubin, (1978)29;

  2. 2.

    unconfoundedness which is popular among epidemiologists;

  3. 3.

    selection on observables which is popular among social scientists;

  4. 4.

    conditional independence which is merely a description of the notation in the assumption.

Sometimes, we impose an even stronger assumption.

Assumption 10.2 (strong ignorability)

We have

\displaystyle\{Y(1),Y(0)\}\ind Z\mid X. (56)

Assumption 10.2 is called strong ignorability (Rubin,, 1978; Rosenbaum and Rubin, 1983b, ). If the parameter of interest is \tau, then the stronger Assumptions 10.1 and 10.2 are just imposed for notational simplicity thanks to the conditional independence notation . They are not necessary for identifying \tau. However, they can not be relaxed if the parameter of interest is the causal effects on other scales (for example, distribution, quantile, or some transformation of the outcome). The strong ignorability assumption requires that the potential outcomes vector be independent of the treatment given the covariates, but the ignorability assumption only requires each potential outcome be independent of the treatment given covariates. The former is stronger than the latter. However, their difference is rather technical and of pure theoretical interests; see Problem 10.5. In most reasonable statistical models, they both hold; see Section 55.2 below. We will not distinguish them in this book and will simply use ignorability to refer to both.

55.2 Plausibility of the ignorability assumption

A fundamental problem of causal inference with observational studies is the plausibility of the ignorability assumption. The discussion in Chapter 55.1 may seem too mathematical in the sense that the ignorability assumption serves as a sufficient condition to ensure the nonparametric identification of the average causal effect. What is its scientific meaning? Intuitively, it rules out all unmeasured covariates that affect the treatment and outcome simultaneously. Those “common causes” of the treatment and outcome are called confounders. That is why the ignorability assumption is also called the unconfoundedness assumption. More transparently, we can interpret the ignorability assumption based on the outcome data-generating process. If

\displaystyle Y(1) \displaystyle= \displaystyle g_{1}(X,V_{1}),
\displaystyle Y(0) \displaystyle= \displaystyle g_{0}(X,V_{0}),
\displaystyle Z \displaystyle= \displaystyle 1\{g(X,V)\geq 0\}

with (V_{1},V_{0})\ind V, then both Assumptions 10.1 and 10.2 hold. In the above data-generating process, the “common causes” X of the treatment and the outcome are all observed, and the remaining random components are independent. If the data-generating process changes to

\displaystyle Y(1) \displaystyle= \displaystyle g_{1}(X,U,V_{1}),
\displaystyle Y(0) \displaystyle= \displaystyle g_{0}(X,U,V_{0}),
\displaystyle Z \displaystyle= \displaystyle 1\{g(X,U,V)\geq 0\}

with (V_{1},V_{0})\ind V, then Assumptions 10.1 and 10.2 do not hold in general. The unmeasured “common cause” U induces dependence between the treatment and the potential outcomes even conditional on the observed covariates X. If we do not have access to U and analyze the data based only on (Z,X,Y), the final estimator will be biased for the causal parameter in general. This type of bias is called the omitted variable bias in econometrics; see Problem 16.2 in a later chapter.

The ignorability assumption can be reasonable if we observe a rich set of covariates X that affect the treatment and the outcome simultaneously. I start with this assumption to discuss identification and estimation strategies in Part III of this book. However, it is fundamentally untestable. We may justify it based on the scientific background knowledge, but we are often not sure whether it holds or not. Parts IV and V of this book will discuss other strategies when the ignorability assumption is not plausible.

56 Two simple estimation strategies and their limitations

56.1 Stratification or standardization based on discrete covariates

If the covariate X_{i}\in\{1,\ldots,K\} is discrete, then ignorability (55) reads as

Y(z)\ind Z\mid X=k\quad(z=0,1;k=1,\ldots,K),

which essentially assumes that the observational study is an SRE under the superpopulation framework in Chapter 9. Therefore, we can use the estimator

\hat{\tau}=\sum_{k=1}^{K}\pi_{[k]}\left\{\hat{\bar{Y}}_{[k]}(1)-\hat{\bar{Y}}_{[k]}(0)\right\},

which is identical to the stratified or post-stratified estimator discussed in Chapter 5.

This method is still widely used in practice. Example 10.2 contains discrete covariates, and I relegate the analysis to Problem 10.4. However, there are several obvious difficulties in implementing this method. First, it works well for the case with small K. For large K, it is very likely that many strata have n_{[k]1}=0 or n_{[k]0}=0, leading to the poorly defined \hat{\tau}_{[k]}’s for those strata. This is related to the issue of overlap which will be discussed in Chapter 20 later. Second, it is not obvious how to apply this stratification method to multidimensional continuous or mixed covariates X. A standard method is to create strata based on the initial covariates and then apply the stratification method. This may result in arbitrariness in the analysis.

56.2 Outcome regression

The most commonly used method based on outcome regression is to run the OLS with an additive model of the observed outcome on the treatment indicator and covariates, which assumes

E(Y\mid Z,X)=\beta_{0}+\beta_{z}Z+\beta_{x}^{\mkern-1.5mu\mathsf{T}}X.

If the above linear model is correct, then we have

\displaystyle\tau(X) \displaystyle= \displaystyle E(Y\mid Z=1,X)-E(Y\mid Z=0,X)
\displaystyle= \displaystyle(\beta_{0}+\beta_{z}+\beta_{x}^{\mkern-1.5mu\mathsf{T}}X)-(\beta_{0}+\beta_{x}^{\mkern-1.5mu\mathsf{T}}X)
\displaystyle= \displaystyle\beta_{z},

which implies that the causal effect is homogeneous with respect to the covariates. This, coupled with ignorability, implies that

\tau=E\{\tau(X)\}=\beta_{z}.

Therefore, if ignorability holds and the outcome model is linear, then the average causal effect equals the coefficient of Z. This is one of the most important applications of the linear model. However, the causal interpretation of the coefficient of Z is valid only under two strong assumptions: ignorability and the linear model.

We have discussed in Chapter 6, the above procedure is suboptimal even in CREs because it ignores the treatment effect heterogeneity induced by the covariates. If we assume

E(Y\mid Z,X)=\beta_{0}+\beta_{z}Z+\beta_{x}^{\mkern-1.5mu\mathsf{T}}X+\beta_{zx}^{\mkern-1.5mu\mathsf{T}}XZ,

we have

\displaystyle\tau(X) \displaystyle= \displaystyle E(Y\mid Z=1,X)-E(Y\mid Z=0,X)
\displaystyle= \displaystyle(\beta_{0}+\beta_{z}+\beta_{x}^{\mkern-1.5mu\mathsf{T}}X+\beta_{zx}^{\mkern-1.5mu\mathsf{T}}X)-(\beta_{0}+\beta_{x}^{\mkern-1.5mu\mathsf{T}}X)
\displaystyle= \displaystyle\beta_{z}+\beta_{zx}^{\mkern-1.5mu\mathsf{T}}X,

which, coupled with ignorability, implies that

\tau=E\{\tau(X)\}=E(\beta_{z}+\beta_{zx}^{\mkern-1.5mu\mathsf{T}}X)=\beta_{z}+\beta_{zx}^{\mkern-1.5mu\mathsf{T}}E(X).

The estimator for \tau is then \hat{\beta}_{z}+\hat{\beta}_{zx}^{\mkern-1.5mu\mathsf{T}}\bar{X}, where \hat{\beta}_{z} is the regression coefficient of Z and \bar{X} is the sample mean of X. If we center the covariates to ensure \bar{X}=0, then the estimator is simply the regression coefficient of Z. To simplify the procedure, we usually center the covariates at the beginning; also recall Lin, (2013)’s estimator introduced in Chapter 6. Rosenbaum and Rubin, 1983b () and Hirano and Imbens, (2001) discussed this estimator.

In general, we can use other more complex models to estimate the causal effects. For example, if we build two predictors \hat{\mu}_{1}(X) and \hat{\mu}_{0}(X) based on the treated and control data, respectively, then we have an estimator for the conditional average causal effect

\hat{\tau}(X)=\hat{\mu}_{1}(X)-\hat{\mu}_{0}(X)

and an estimator for the average causal effect:

\hat{\tau}^{\text{reg}}=n^{-1}\sum_{i=1}^{n}\{\hat{\mu}_{1}(X_{i})-\hat{\mu}_{0}(X_{i})\}.

The estimator \hat{\tau} above has the same form as the projective estimator discussed in Chapter 6. It is sometimes called the outcome regression estimator. The OLS-based estimators above are special cases. We can use the nonparametric bootstrap (see Chapter 30.F) to estimate the standard error of the outcome regression estimator.

I give another example for binary outcomes below.

Example 10.4 (outcome regression estimator for binary outcomes)

With a binary outcome, we may model Y using a logistic model

E(Y\mid Z,X)=\textup{pr}(Y=1\mid Z,X)=\frac{e^{\beta_{0}+\beta_{z}Z+\beta_{x}^{\mkern-1.5mu\mathsf{T}}X}}{1+e^{\beta_{0}+\beta_{z}Z+\beta_{x}^{\mkern-1.5mu\mathsf{T}}X}},

then based on the estimators of the coefficients \hat{\beta}_{0},\hat{\beta}_{z},\hat{\beta}_{x}, we have the following estimator for the average causal effect:

\hat{\tau}=n^{-1}\sum_{i=1}^{n}\left\{\frac{e^{\hat{\beta}_{0}+\hat{\beta}_{z}+\hat{\beta}_{x}^{\mkern-1.5mu\mathsf{T}}X_{i}}}{1+e^{\hat{\beta}_{0}+\hat{\beta}_{z}+\hat{\beta}_{x}^{\mkern-1.5mu\mathsf{T}}X_{i}}}-\frac{e^{\hat{\beta}_{0}+\hat{\beta}_{x}^{\mkern-1.5mu\mathsf{T}}X_{i}}}{1+e^{\hat{\beta}_{0}+\hat{\beta}_{x}^{\mkern-1.5mu\mathsf{T}}X_{i}}}\right\}.

This estimator is not simply the coefficient of the treatment in the logistic model.30 It is a nonlinear function of all the coefficients as well as the empirical distribution of the covariates. In econometrics, this estimator is called the “average partial effect” or “average marginal effect” of the treatment in the logistic model. Many econometric software packages can report this estimator associated with the standard error. Similarly, we can also derive the corresponding estimator based on a fully interacted logistic model; see Problem 10.3.

The above predictors for the conditional means of the outcome can also be other machine learning tools. In particular, Hill, (2011) championed the use of tree methods for estimating \tau, and Wager and Athey, (2018) proposed to use them also for estimating \tau(X). Wager and Athey, (2018) also combined the tree methods with the idea of the propensity score in the next chapter. Since then, the intersection of machine learning and causal inference has been an active research area (Hahn et al.,, 2020; Künzel et al.,, 2019, e.g.,).

The biggest problem with the above approach based on outcome regressions is its sensitivity to the specification of the outcome model. Problem 1.4 gave such an example. Depending on the incentive of empirical research and publications, people might report their favorable causal effects estimates after searching over a wide set of candidate models, without confessing this model searching process. This is a major source of p-hacking in causal inference. Problem 1.4 hinted at this issue. Leamer, (1978) criticized this approach in empirical research.

57 Homework Problems

10.1 A simple identity

Show that \tau=\textup{pr}(Z=1)\tau_{\textsc{T}}+\textup{pr}(Z=0)\tau_{\textsc{C}}.

10.2 Nonparametric identification of other causal effects

Under ignorability, show that

  1. 1.

    the distributional causal effect

    \textsc{DCE}_{y}=\textup{pr}\{Y(1)>y\}-\textup{pr}\{Y(0)>y\}

    is nonparametrically identifiable for all y;

  2. 2.

    the quantile causal effect

    \textsc{QCE}_{q}=\text{quantile}_{q}\{Y(1)\}-\text{quantile}_{q}\{Y(0)\},

    is nonparametrically identifiable for all q, where \text{quantile}_{q}\{\cdot\} is the qth quantile of a random variable.

Remark: In probability theory, \textup{pr}\{Y(z)\leq y\} is the cumulative distribution function and \textup{pr}\{Y(z)>y\} is the survival function of the potential outcome Y(z). The distributional causal effect compares the survival functions of the potential outcomes under treatment and control.

The quantile causal effect compares the marginal quantiles of the potential outcomes, which is different from the quantile of the individual causal effect

\tau_{q}=\text{quantile}_{q}\{Y(1)-Y(0)\}.

In fact, \tau_{q} is not identifiable in the sense that the marginal distributions \textup{pr}\{Y(1)\leq y\} and \textup{pr}\{Y(0)\leq y\} can not uniquely determine \tau_{q}.

10.3 Outcome imputation estimator in the fully interacted logistic model

This problem extends Example 10.4.

Assume that a binary outcome follows a logistic model

E(Y\mid Z,X)=\textup{pr}(Y=1\mid Z,X)=\frac{e^{\beta_{0}+\beta_{z}Z+\beta_{x}^{\mkern-1.5mu\mathsf{T}}X+\beta_{xz}^{\mkern-1.5mu\mathsf{T}}XZ}}{1+e^{\beta_{0}+\beta_{z}Z+\beta_{x}^{\mkern-1.5mu\mathsf{T}}X+\beta_{xz}^{\mkern-1.5mu\mathsf{T}}XZ}}.

What is the corresponding outcome regression estimator for the average causal effect?

10.4 Data analysis: stratification and regression

Use the dataset homocyst in the package senstrat. The outcome is homocysteine, the homocysteine level, and the treatment is z, where z=1 for a daily smoker and z=0 for a never smoker. Covariates are female, age3, ed3, bmi3, pov2 with detailed explanations in the package, and st is a stratum indicator, defined by all the combinations of the discrete covariates.

  1. [(1)]

  2. 1.

    How many strata have only treated or control units? What is the proportion of the units in these strata? Drop these strata and perform a stratified analysis of the observational study. Report the point estimator, variance estimator, and 95% confidence interval for the average causal effect.

  3. 2.

    Run the OLS of the outcome on the treatment indicator and covariates without interactions. Report the coefficient of the treatment and the robust standard error.

    Drop the strata with only treated or control units. Re-run the OLS and report the result.

  4. 3.

    Apply Lin, (2013)’s estimator of the average causal effect. Report the coefficient of the treatment and the robust standard error.

    If you do not drop the strata with only treated or control units, what will happen?

  5. 4.

    Compare the results in the above three analyses. Which one is more credible?

10.5 Ignorability versus strong ignorability

Give an example such that the ignorability holds but the strong ignorability does not hold.

Remark: This is related to a classic probability problem of finding three random variables A,B,C such that

A\ind C\text{ and }B\ind C\text{ but }(A,B)\nind C.
10.6 Recommended reading

Cochran, (1965) is a classic reference on observational studies. It contains many useful insights but does not use the formal potential outcomes framework. Dylan Small founded a new journal called Observational Studies in 2015 (Small,, 2015) and reprinted an old article “Observational Studies” by W. G. Cochran as Cochran, (2015). Many leading researchers also made insightful comments on Cochran, (2015).

脚注

27. Homocysteine is a type of amino acid. A high level of homocysteine in the blood is regarded as a marker of cardiovascular disease.

28. It is a Latin phrase, which means “based on the first impression” or “accepted as correct until proved otherwise.” Holland, (1986) used this phrase.

29. The reason for using this name is unclear based on the discussion in this book. In fact, it is from the Bayesian perspective of causal inference. It is beyond the scope of this book.

30. If the logistic outcome model is correct, then \hat{\beta}_{z} estimates the conditional odds ratio of the treatment on the outcome given covariates, which does not equal \tau. Freedman, 2008c () gave a warning of using the logistic regression coefficient to estimate \tau in CREs. See Chapter 31 for more details of the logistic regression.

本书:A First Course in Causal Inference,作者 Peng Ding。原文:arXiv:2305.18793v2,按 CC BY 4.0 许可发布。本站(yuanens.com)把 arXiv 网页版改成分章的纯 HTML,把公式渲染成图片,方便在 Kindle 等电子书阅读器上看,内容没有改动。转换难免有错,以原文为准。本站与作者和出版社无关。