Chapter 21 An Experimental Perspective of the Instrumental Variable

The instrumental variable method has been a powerful tool in econometrics. It identifies causal effects in studies without unconfoundedness between the treatment and the outcome. It relies on an additional variable, called the instrumental variable (IV), that satisfies certain conditions. These conditions may not be easy to digest when you learn them for the first time. In some sense, the IV method is like magic. This chapter presents a not-so-magic perspective based on the encouragement design. This again echos Dorn, (1953)’s suggestion that the planner of an observational study should always ask himself the following question:44

How would the study be conducted if it were possible to do it by controlled experimentation?

The experimental analog of the IV method is noncompliance in the encouragement design (Zelen,, 1979; Powers and Swinton,, 1984; Holland,, 1986).

103 Encouragement Design and Noncompliance

Consider an experiment with units indexed by i=1,\ldots,n. Let Z_{i} be the treatment assigned, with 1 for the treatment and 0 for the control. Let D_{i} be the treatment received, with 1 for the treatment and 0 for the control. When Z_{i}\neq D_{i} for some unit i, the noncompliance problem arises. Noncompliance is a very common problem, especially in encouragement designs involving human beings as experimental units. In those cases, the experimenters cannot force the units to take the treatment but rather only encourage them to do so. Let Y_{i} be the outcome of interest.

Consider complete randomization of Z and ignore covariates X for now. We have the potential values for the treatment received \{D_{i}(1),D_{i}(0)\} and the potential values for the outcome \{Y_{i}(1),Y_{i}(0)\}, all with respect to the treatment assignment levels 1 and 0. Their observed values are D_{i}=Z_{i}D_{i}(1)+(1-Z_{i})D_{i}(0) and Y_{i}=Z_{i}Y_{i}(1)+(1-Z_{i})Y_{i}(0), respectively. For notational simplicity, we assume \{Z_{i},D_{i}(1),D_{i}(0),Y_{i}(1),Y_{i}(0)\}_{i=1}^{n}\stackrel{{\scriptstyle\textup{IID}}}{{\sim}}\{Z,D(1),D(0),Y(1),Y(0)\} and sometimes drop the subscript i when it should not cause confusions.

We start with the CRE.

Assumption 21.1 (randomization)

Z\ind \{D(1),D(0),Y(1),Y(0)\}.

Randomization allows for the identification of the average causal effects on D and Y:

\tau_{D}=E\{D(1)-D(0)\}=E(D\mid Z=1)-E(D\mid Z=0)

and

\tau_{Y}=E\{Y(1)-Y(0)\}=E(Y\mid Z=1)-E(Y\mid Z=0).

We can use simple difference-in-means estimators \hat{\tau}_{D} and \hat{\tau}_{Y} to estimate \tau_{D} and \tau_{Y}, respectively.

Reporting the estimate \hat{\tau}_{Y} with the associated standard error is called the intention-to-treat (ITT) analysis. It estimates the effect of the treatment assignment on the outcome, and the CRE in Assumption 21.1 justifies this analysis. However, it may not answer the scientific question, that is, the causal effect of the treatment received on the outcome.

104 Latent Compliance Status and Effects

104.1 Nonparametric identification

Following Imbens and Angrist, (1994) and Angrist et al., (1996), we stratify the population based on the joint potential values of U_{i}=\{D_{i}(1),D_{i}(0)\}. Because D is binary, we have four possible combinations:

\displaystyle U_{i}=\left\{\begin{array}[]{ll}\textup{a},&\text{if}\hskip 5.69054ptD_{i}(1)=1\hskip 5.69054pt\text{and}\hskip 5.69054ptD_{i}(0)=1;\\
\textup{c},&\text{if}\hskip 5.69054ptD_{i}(1)=1\hskip 5.69054pt\text{and}\hskip 5.69054ptD_{i}(0)=0;\\
\textup{d},&\text{if}\hskip 5.69054ptD_{i}(1)=0\hskip 5.69054pt\text{and}\hskip 5.69054ptD_{i}(0)=1;\\
\textup{n},&\text{if}\hskip 5.69054ptD_{i}(1)=0\hskip 5.69054pt\text{and}\hskip 5.69054ptD_{i}(0)=0,\end{array}\right.

where “a” is for “always taker,” “c” is for “complier,” “d” is for “defier,” and “n” is for “never taker.” Because we cannot observe D_{i}(1) and D_{i}(0) simultaneously, U_{i} is a latent variable for the compliance behavior of unit i.

Based on U, we can use the law of total probability to decompose the average causal effect on Y into four terms:

\displaystyle\tau_{Y} \displaystyle= \displaystyle E\{Y(1)-Y(0)\mid U=\textup{a}\}\textup{pr}(U=\textup{a}) (99)
\displaystyle+E\{Y(1)-Y(0)\mid U=\textup{c}\}\textup{pr}(U=\textup{c})
\displaystyle+E\{Y(1)-Y(0)\mid U=\textup{d}\}\textup{pr}(U=\textup{d})
\displaystyle+E\{Y(1)-Y(0)\mid U=\textup{n}\}\textup{pr}(U=\textup{n}).

Therefore, \tau_{Y} is a weighted average of four latent subgroup effects. We will look into more details of the latent groups below.

Assumption 21.2 below restricts the third term in (99) to be zero.

Assumption 21.2 (monotonicity)

\textup{pr}(U_{i}=\textup{d})=0 or D_{i}(1)\geq D_{i}(0) for all i, that is, there are no defiers.

Assumption 21.2 holds automatically with one-sided noncompliance when the units assigned to the control arm have no access to the treatment, i.e., D_{i}(0)=0 for all units. Under randomization, Assumption 21.2 has a testable implication that

\textup{pr}(D=1\mid Z=1)\geq\textup{pr}(D=1\mid Z=0). (100)

But Assumption 21.2 is much stronger than the inequality (100). The former restricts D_{i}(1) and D_{i}(0) at the individual level whereas the latter restricts them only on average. Nevertheless, when the testable implication (100) holds, we cannot use the observed data to refute Assumption 21.2.

Assumption 21.3 below restricts the first and last terms in (99) to be zero based on the mechanism of the treatment assignment on the outcome through only the treatment received.

Assumption 21.3 (exclusion restriction)

Y_{i}(1)=Y_{i}(0) for always takers with U_{i}=\textup{a} and never takers with U_{i}=\textup{n}.

As equivalent statement of Assumption 21.3 is that D_{i}(1)=D_{i}(0) must imply Y_{i}(1)=Y_{i}(0) for all i. It requires that the treatment assignment affects the outcome only if it affects the treatment received. In double-blind RCTs45, it is biologically plausible because the outcome only depends on the actual treatment received. That is, if the treatment assignment does not change the treatment received, it does not change the outcome either. It can be violated if the treatment assignment has direct effects46 on the outcome, not through the treatment received. For example, some RCTs are not double-blinded, and the treatment assignment can have some unknown pathways to the outcome.

Under Assumptions 21.2 and 21.3, the decomposition (99) only has the second term :

\displaystyle\tau_{Y}=E\{Y(1)-Y(0)\mid U=\textup{c}\}\textup{pr}(U=\textup{c}). (101)

Similarly, we can decompose the average causal effect on D into four terms:

\displaystyle\tau_{D} \displaystyle= \displaystyle E\{D(1)-D(0)\mid U=\textup{a}\}\textup{pr}(U=\textup{a})
\displaystyle+E\{D(1)-D(0)\mid U=\textup{c}\}\textup{pr}(U=\textup{c})
\displaystyle+E\{D(1)-D(0)\mid U=\textup{d}\}\textup{pr}(U=\textup{d})
\displaystyle+E\{D(1)-D(0)\mid U=\textup{n}\}\textup{pr}(U=\textup{n})
\displaystyle= \displaystyle 0\times\textup{pr}(U=\textup{a})+1\times\textup{pr}(U=\textup{c})+(-1)\times\textup{pr}(U=\textup{d})+0\times\textup{pr}(U=\textup{n}),

which, under Assumption 21.2, reduces to

\displaystyle\tau_{D}=\textup{pr}(U=\textup{c}). (102)

By (102), the proportion of the compliers \pi_{\textup{c}}=\textup{pr}(U=\textup{c}) equals the average causal effect of the treatment assigned on D, an identifiable quantity under the CRE. Although we do not know all the compliers based on the observed data, we can identify their proportion in the whole population based on (102). Combining (101) and (102), we have the following result.

Theorem 21.1

Under Assumptions 21.2–21.3, we have

E\{Y(1)-Y(0)\mid U=\textup{c}\}=\frac{\tau_{Y}}{\tau_{D}}

if \tau_{D}\neq 0.

Following Imbens and Angrist, (1994) and Angrist et al., (1996), we define a new causal effect below.

Definition 21.1 (CACE or LATE)

Define

\tau_{\textup{c}}=E\{Y(1)-Y(0)\mid U=\textup{c}\}

as the “complier average causal effect (CACE)” or the “local average treatment effect (LATE)”. It has alternative forms:

\displaystyle\tau_{\textup{c}} \displaystyle= \displaystyle E\{Y(1)-Y(0)\mid D(1)=1,D(0)=0\}
\displaystyle= \displaystyle E\{Y(1)-Y(0)\mid D(1)>D(0)\}.

The CACE is the average causal effect of Z on Y among compliers with D(1)=1,D(0)=0, or, equivalently, units with D(1)>D(0) under the monotonicity. Based on Definition 21.1, we can rewrite Theorem 21.1 as

\tau_{\textup{c}}=\frac{\tau_{Y}}{\tau_{D}},

that is, the CACE or LATE equals the ratio of the average causal effects on Y over that on D. Under Assumption 21.1, we further identify the CACE below.

Corollary 21.1

Under Assumptions 21.1–21.3, we have

\tau_{\textup{c}}=\frac{E(Y\mid Z=1)-E(Y\mid Z=0)}{E(D\mid Z=1)-E(D\mid Z=0)}.

Therefore, under CRE, monotonicity, and exclusion restriction, we can nonparametrically identify the CACE as the ratio of the difference in means of the outcome over the difference in means of the treatment received.

104.2 Estimation

Based on Corollary 21.1, we can estimate \tau_{\textup{c}} by a simple ratio

\hat{\tau}_{\textup{c}}=\frac{\hat{\tau}_{Y}}{\hat{\tau}_{D}},

which is called the Wald estimator (Wald,, 1940) or the IV estimator. In the above discussion, Z acts as the IV for D.

We can obtain the variance estimator based on the following heuristics (see Example 30.3):

\hat{\tau}_{\textup{c}}-\tau_{\textup{c}}=(\hat{\tau}_{Y}-\tau_{\textup{c}}\hat{\tau}_{D})/\hat{\tau}_{D}\approx(\hat{\tau}_{Y}-\tau_{\textup{c}}\hat{\tau}_{D})/\tau_{D}=\hat{\tau}_{A}/\tau_{D},

where \hat{\tau}_{A} is the difference-in-means of the adjusted outcome A_{i}=Y_{i}-\tau_{\textup{c}}D_{i}. So the asymptotic variance of \hat{\tau}_{\textup{c}} is close to the variance of \hat{\tau}_{A} divided by \tau_{D}^{2}. The variance estimation proceeds in the following steps:

  1. 1.

    obtain the adjusted outcomes \hat{A}_{i}=Y_{i}-\hat{\tau}_{\textup{c}}D_{i}\ (i=1,\ldots,n);

  2. 2.

    obtain the Neyman-type variance estimate based on the adjusted outcomes:

    \hat{V}_{\hat{A}}=\frac{\hat{S}_{\hat{A}}^{2}(1)}{n_{1}}+\frac{\hat{S}_{\hat{A}}^{2}(0)}{n_{0}},

    where \hat{S}_{\hat{A}}^{2}(1) and \hat{S}_{\hat{A}}^{2}(0) are the sample variances of the \hat{A}_{i}’s under the treatment and control, respectively;

  3. 3.

    obtain the final variance estimator \hat{V}_{\hat{A}}/\hat{\tau}_{D}^{2}.

See Problem 21.2 for the justification of the above variance estimator. Alternatively, we can also use the bootstrap to approximate the variance of \hat{\tau}_{\textup{c}}. The following functions can calculate the point estimator \hat{\tau}_{\textup{c}} and the standard error with the formula \hat{V}_{\hat{A}} and the bootstrap.

## IV point estimator
IV_Wald = function(Z, D, Y)
{
tau_D = mean(D[Z==1]) - mean(D[Z==0])
tau_Y = mean(Y[Z==1]) - mean(Y[Z==0])
CACE = tau_Y/tau_D
c(tau_D, tau_Y, CACE)
}
## IV se via the delta method
IV_Wald_delta = function(Z, D, Y)
{
est = IV_Wald(Z, D, Y)
AdjustedY = Y - D*est[3]
VarAdj = var(AdjustedY[Z==1])/sum(Z) +
var(AdjustedY[Z==0])/sum(1 - Z)
c(est[3], sqrt(VarAdj)/abs(est[1]))
}
##IV se via the bootstrap
IV_Wald_bootstrap = function(Z, D, Y, n.boot = 200)
{
est = IV_Wald(Z, D, Y)
CACEboot = replicate(n.boot, {
id.boot = sample(1:length(Z), replace = TRUE)
IV_Wald(Z[id.boot], D[id.boot], Y[id.boot])[3]
})
c(est[3], sd(CACEboot))
}

Under the null hypothesis that \tau_{\textup{c}}=0, we can approximate the variance by \hat{V}_{Y}/\hat{\tau}_{D}^{2}, where \hat{V}_{Y} is the Neyman-type variance estimate for the difference in means of Y. This variance estimator is inconsistent if the true \tau_{\textup{c}} is not zero. Therefore, it works for testing but not for estimation. Nevertheless, it gives insights for the ITT estimator and the Wald estimator. The ITT estimator \hat{\tau}_{Y} has estimated standard error \sqrt{\hat{V}_{Y}}. The Wald estimator \hat{\tau}_{Y}/\hat{\tau}_{D} essentially equals the ITT estimator multiplied by 1/\hat{\tau}_{D}>1, which is larger in magnitude but at the same time, its estimated standard error increases by the same factor. Based on the variance estimators \hat{V}_{Y} and \hat{V}_{Y}/\hat{\tau}_{D}^{2}, the confidence intervals for \tau_{Y} and \tau_{\textup{c}} are

\hat{\tau}_{Y}\pm z_{1-\alpha/2}\sqrt{\hat{V}_{Y}}

and

\hat{\tau}_{Y}/\hat{\tau}_{D}\pm z_{1-\alpha/2}\sqrt{\hat{V}_{Y}}/\hat{\tau}_{D}=\left(\hat{\tau}_{Y}\pm z_{1-\alpha/2}\sqrt{\hat{V}_{Y}}\right)/\hat{\tau}_{D}

respectively, where z_{1-\alpha/2} is the 1-\alpha/2 upper quantile of the standard Normal random variable. These confidence intervals give the same qualitative conclusions since they will both cover zero or not. In some sense, the IV analysis provides the same qualitative information as the ITT analysis of Y although it involves more complicated procedures.

105 Covariates

105.1 Covariate adjustment in the CRE

We now consider completely randomized experiments with covariates and assume

Z\ind \{D(1),D(0),Y(1),Y(0),X\}.

With covariates X, we can obtain Lin, (2013)’s estimators \hat{\tau}_{D,\textsc{L}} and \hat{\tau}_{Y,\textsc{L}} for both D and Y, resulting in \hat{\tau}_{\textup{c},\textsc{L}}=\hat{\tau}_{Y,\textsc{L}}/\hat{\tau}_{D,\textsc{L}}. We can approximate the asymptotic variance of \hat{\tau}_{\textup{c},\textsc{L}} using the bootstrap. The following functions can calculate the point estimator \hat{\tau}_{\textup{c},\textsc{L}}p and the standard error based on the bootstrap.

## covariate adjustment in IV analysis
IV_Lin = function(Z, D, Y, X)
{
X = scale(as.matrix(X))
tau_D = lm(D ~ Z + X + Z*X)$coef[2]
tau_Y = lm(Y ~ Z + X + Z*X)$coef[2]
CACE = tau_Y/tau_D
c(tau_D, tau_Y, CACE)
}
##IV_adj se via the bootstrap
IV_Lin_bootstrap = function(Z, D, Y, X, n.boot = 200)
{
X = scale(as.matrix(X))
est = IV_Lin(Z, D, Y, X)
CACEboot = replicate(n.boot, {
id.boot = sample(1:length(Z), replace = TRUE)
IV_Lin(Z[id.boot], D[id.boot], Y[id.boot], X[id.boot, ])[3]
})
c(est[3], sd(CACEboot))
}
105.2 Covariates in conditional randomization or unconfounded observational studies

If randomization holds conditionally, i.e.,

Z\ind \{D(1),D(0),Y(1),Y(0)\}\mid X,

then we must adjust for covariates to avoid bias. The analysis is also straightforward since we already have discussed many estimators in Part III for estimating the effects of Z on D and Y, respectively. We can just use them in the ratio formula \hat{\tau}_{\textup{c}}=\hat{\tau}_{Y}/\hat{\tau}_{D} and use the bootstrap to approximate the asymptotic variance. I do not implement the corresponding estimator and variance estimator but relegate it as Problem 21.8.

106 Weak IV

106.1 Some simulation

Even if \tau_{D}>0, there is a positive probability that \hat{\tau}_{D} is zero, so the variance of \hat{\tau}_{\textup{c}} is infinity (see Problem 21.1). The variance from the Normal approximation discussed before is not the variance of \hat{\tau}_{\textup{c}} but rather the variance of its asymptotic distribution. This is a subtle technical point. When \tau_{D} is close to 0, which is referred to as the weak IV case, the ratio estimator \hat{\tau}_{\textup{c}}=\hat{\tau}_{Y}/\hat{\tau}_{D} has poor finite-sample properties. In this scenario, \hat{\tau}_{\textup{c}} has finite-sample bias and non-Normal asymptotic distribution, and the corresponding Wald-type confidence intervals have poor coverage properties47. In the simple case with a binary outcome Y, we know that \tau_{Y} must be bounded between -1 and 1, but there is no guarantee that \hat{\tau}_{\textup{c}} is bounded between -1 and 1.

Figures 31(a) and 31(b) show the histograms of \hat{\tau}_{\textup{c}} and \hat{\tau}_{\textup{c},\textsc{L}} over simulation with different \pi_{\textup{c}}. I leave the detailed data-generating processes to the R code. From the figures, the distributions of the estimators \hat{\tau}_{\textup{c}} and \hat{\tau}_{\textup{c},\textsc{L}} are far from Normal when \pi_{\textup{c}} equals 0.2 and 0.1. Statistical inference based on asymptotic Normality is unlikely to be reliable.

插图
(a) Without covariate adjustment
插图
(b) With covariate adjustment
Figure 31: Simulation with strong and weak IVs
106.2 A procedure robust to weak IV

How do we deal with a weak IV? From a testing perspective, there is an easy solution. Because \tau_{\textup{c}}=\tau_{Y}/\tau_{D}, so the following two null hypotheses are equivalent:

H_{0}:\tau_{\textup{c}}=0\Longleftrightarrow H_{0}^{\prime}:\tau_{Y}=0

if \tau_{D}>0. Therefore, we simply test H_{0}^{\prime}, i.e., the average causal effect of Z on Y is zero. This echoes our discussion in Section 104.2 about the relationship between the ITT analysis and the IV analysis.

From an estimation perspective, we can focus on the confidence interval although the point estimator has poor finite-sample properties. Because \tau_{\textup{c}}=\tau_{Y}/\tau_{D}, this is similar to the classical Fieller–Creasy problem in statistics. Below we discuss a strategy for constructing confidence intervals for \tau_{\textup{c}} motivated by Fieller, (1954); see Chapter 30.D.2. By the duality between confidence intervals and hypothesis tests (See Chapter 30.B.5), we can construct a confidence set for \tau_{\textup{c}} by inverting a sequence of null hypotheses

H_{0}(b):\tau_{\textup{c}}=b.

Given the true value \tau_{\textup{c}}=b, we have

\tau_{Y}-b\tau_{D}=0.

The null hypothesis H_{0}(b) is equivalent to the null hypothesis of zero average causal effect on the outcome A_{i}(b)=Y_{i}-bD_{i}:

H_{0}(b):\tau_{A(b)}=0.

Let \hat{\tau}_{A}(b) be a generic point estimator for \tau_{A(b)} with the associated variance estimator \hat{V}_{A}(b). The point and variance estimators depend on the settings. In the CRE without covariates, \hat{\tau}_{A}(b) is the difference in means of the outcome A_{i}(b) and \hat{V}_{A}(b) is the Neyman-type variance estimator. In the CRE with covariates, \hat{\tau}_{A}(b) is Lin, (2013)’s estimator for the outcome A_{i}(b) and \hat{V}_{A}(b) is the EHW variance estimator in the associated OLS fit of Y_{i}-bD_{i} on (Z_{i},X_{i},Z_{i}X_{i}) with the correction term48 discussed in Chapter 49. In unconfounded observational studies, we can obtain the estimator for the average causal effect on A_{i}(b) and the associated variance estimator based on many existing strategies in Part III of the book.

Based on \hat{\tau}_{A}(b) and \hat{V}_{A}(b), we can construct a Wald-type test for H_{0}(b). Inverting tests, we can construct the following confidence set for \tau_{\textup{c}}:

\left\{b:\frac{\hat{\tau}_{A}^{2}(b)}{\hat{V}_{A}(b)}\leq z_{1-\alpha/2}^{2}\right\}

where z_{1-\alpha/2} is the 1-\alpha/2 upper quantile of the standard Normal random variable. This is close to the Anderson–Rubin-type confidence interval in econometrics (Anderson and Rubin,, 1950). Due to its connection to Fieller, (1954), I will call it the Fieller–Anderson–Rubin (FAR) confidence interval. These weak-IV confidence intervals reduce to the asymptotic confidence intervals when the IV is strong. But they have additional guarantees when the IV is weak. I recommend using them in practice.

Example 21.1

To gain intuition about the FAR confidence interval, we look into the simple case of the CRE without covariates. The quadratic inequality in the confidence interval reduces to

\displaystyle(\hat{\tau}_{Y}-b\hat{\tau}_{D})^{2}
\displaystyle\leq \displaystyle z_{1-\alpha/2}\left[n_{1}^{-1}\{\hat{S}_{Y}^{2}(1)+b^{2}\hat{S}_{D}^{2}(1)-2b\hat{S}_{YD}(1)\}\right.
\displaystyle\left.+n_{0}^{-1}\{\hat{S}_{Y}^{2}(0)+b^{2}\hat{S}_{D}^{2}(0)-2b\hat{S}_{YD}(0)\}\right],

where \{\hat{S}_{Y}^{2}(1),\hat{S}_{D}^{2}(1),\hat{S}_{YD}(1)\} and \{\hat{S}_{Y}^{2}(0),\hat{S}_{D}^{2}(0),\hat{S}_{YD}(0)\} are the sample variances and covariances of Y and D under the treatment and control, respectively. The confidence set can be a close interval, two disconnected intervals, an empty set, or the whole real line. I relegate the detailed discussion to Problem 21.4.

106.3 Implementation and simulation

The following functions can compute a sequence of p-values as a function of b. The function FARci does not use covariates, and the function FARciX uses covariates which relies on the function linestimator defined in Chapter 50.

FARci = function(Z, D, Y, Lower, Upper, grid)
{
CIrange = seq(Lower, Upper, grid)
Pvalue = sapply(CIrange, function(t){
Y_t = Y - t*D
Tauadj = mean(Y_t[Z==1]) - mean(Y_t[Z==0])
VarAdj = var(Y_t[Z==1])/sum(Z) +
var(Y_t[Z==0])/sum(1 - Z)
Tstat = Tauadj/sqrt(VarAdj)
(1 - pnorm(abs(Tstat)))*2
})
return(list(CIrange = CIrange, Pvalue = Pvalue))
}
FARciX = function(Z, D, Y, X, Lower, Upper, grid)
{
CIrange = seq(Lower, Upper, grid)
X = scale(X)
Pvalue = sapply(CIrange, function(t){
Y_t = Y - t*D
linest = linestimator(Z, Y_t, X)
Tstat = linest[1]/linest[3]
(1 - pnorm(abs(Tstat)))*2
})
return(list(CIrange = CIrange, Pvalue = Pvalue))
}

Figure 32 displays the p-value as a function of b in simulated data with different \pi_{\textup{c}}. Figures 32(a) and 32(b) are based on two realizations of the same data-generating process, with details relegated to the R code. In Figure 32(a), the FAR confidence sets are all closed intervals, whereas, in Figure 32(b), the confidence sets are not closed intervals with \pi_{\textup{c}}=0.2 and \pi_{\textup{c}}=0.1. The shapes of the confidence sets remain stable across two realizations with \pi_{\textup{c}}=0.5.

插图
(a) Realization 1
插图
(b) Realization 2
Figure 32: FAR confidence interval based on simulated data with different \pi_{\textup{c}}: two realizations

107 Application

The mediation package contains a dataset jobs from the Job Search Intervention Study (JOBS II), which was a randomized field experiment that investigated the efficacy of a job training intervention on unemployed workers. The variable treat is the indicator for whether a participant was randomly selected for the JOBS II training program, and the variable comply is the indicator for whether a participant actually participated in the JOBS II program. An outcome of interest is job_seek for measuring the level of job-search self-efficacy with values from 1 to 5. Covariates include sex, age, marital, nonwhite, educ, and income.

> jobsdata = read.csv("jobsdata.csv")
> Z = jobsdata$treat
> D = jobsdata$comply
> Y = jobsdata$job_seek
> getX = lm(treat ~ sex + age + marital
+ + nonwhite + educ + income,
+ data = jobsdata)
> X = model.matrix(getX)[, -1]

We can estimate \tau_{\textup{c}} by \hat{\tau}_{\textup{c}} and obtain the standard error based on \hat{V}_{\hat{A}} and the bootstrap. We can further conduct covariate adjustment to obtain \hat{\tau}_{\textup{c},\textsc{L}} and obtain the standard error based on the bootstrap. The results are below. The point estimator and the standard error are stable across methods.

> ## without covariates
> res = rbind(IV_Wald_delta(Z, D, Y),
+ IV_Wald_bootstrap(Z, D, Y, n.boot = 10^3))
> ## with covariates
> res = rbind(res,
+ IV_Lin_bootstrap(Z, D, Y, X, n.boot = 10^3))
> res = cbind(res, res[, 1] - 1.96*res[, 2],
+ res[, 1] + 1.96*res[, 2])
> row.names(res) = c("delta", "bootstrap", "with covariates")
> colnames(res) = c("est", "se", "lower CI", "upper CI")
> round(res, 3)
est se lower CI upper CI
delta 0.109 0.081 -0.050 0.268
bootstrap 0.109 0.083 -0.054 0.271
with covariates 0.118 0.082 -0.042 0.278

We can also construct the FAR confidence sets by inverting tests. They are similar to the confidence intervals above.

lower CI upper CI
without covariates -0.050 0.267
with covariates -0.047 0.282

Figure 33 plots the p-values for a sequence of tests.

插图
Figure 33: Confidence interval of \tau_{\textup{c}} by inverting tests: upper panel without covariate adjustment, and lower panel with covariate adjustment

108 Interpreting the CACE

The notation for potential outcomes \{D(1),D(0),Y(1),Y(0)\} is with respect to the hypothetical intervention of the treatment assigned Z. So \tau_{\textup{c}} is the average causal effect of the treatment assigned on the outcome for compliers. Fortunately, D=Z for compliers, so we can also interpret \tau_{\textup{c}} as the average causal effect of the treatment received on the outcome for compliers. This partially answers the scientific question.

Some papers use different notation. For instance, Angrist et al., (1996) use Y_{i}(z,d) for the potential outcome of unit i under a two-by-two factorial experiment49 with the treatment assigned z and treatment received d. Angrist, (2022, Section 3.1) comments on the intellectual history of this choice of notation. With the notation, the exclusion restriction assumption then has the following form.

Assumption 21.4 (exclusion restriction)

Y_{i}(z,d)=Y_{i}(d) for all i, that is, the potential outcome is only a function of d.

Based on the causal diagram below, Assumption 21.4 rules out the direct arrow from Z to Y. In such a case, Z is an IV for D.

\textstyle{U\ignorespaces\ignorespaces\ignorespaces\ignorespaces\ignorespaces\ignorespaces\ignorespaces\ignorespaces}\textstyle{Z\ignorespaces\ignorespaces\ignorespaces\ignorespaces}\textstyle{D\ignorespaces\ignorespaces\ignorespaces\ignorespaces}\textstyle{Y}

Under Assumption 21.4, the augmented notation Y_{i}(z,d) reduces to Y_{i}(d), which justifies the name of “exclusion restriction.” Therefore, Y_{i}(1,d)=Y_{i}(0,d) for d=0,1, which, coupled with Assumption 21.2, implies that

\displaystyle Y_{i}(z=1)-Y_{i}(z=0) \displaystyle= \displaystyle Y_{i}(1,D_{i}(1))-Y_{i}(0,D_{i}(0))
\displaystyle= \displaystyle\left\{\begin{array}[]{ll}0,&\text{if}\hskip 5.69054ptU_{i}=\textup{a},\\
0,&\text{if}\hskip 5.69054ptU_{i}=\textup{n},\\
Y_{i}(d=1)-Y_{i}(d=0),&\text{if}\hskip 5.69054ptU_{i}=\textup{c}.\end{array}\right.

In the above, I emphasize the potential outcomes are with respect to z, d, or both, to avoid confusion. The previous decomposition of \tau_{Y} holds and we have the following result from Imbens and Angrist, (1994) and Angrist et al., (1996).

Recall the average causal effect on D, \tau_{D}=E\{D(1)-D(0)\}, define the average causal effect on Y as \tau_{Y}=E\{Y(D(1))-Y(D(0))\}, and define the complier average causal effect as

\tau_{\textup{c}}=E\{Y(d=1)-Y(d=0)\mid U=\textup{c}\}.
Theorem 21.2

Under Assumptions 21.2–21.4, we have

Y(D(1))-Y(D(0))=\{D(1)-D(0)\}\times\{Y(d=1)-Y(d=0)\}

and \tau_{\textup{c}}=\tau_{Y}/\tau_{D}.

The proof is almost identical to the proof of Theorem 21.1 with modifications of the notation. I leave it as Problem 21.3. From the notation Y_{i}(d), it is more convenient to interpret \tau_{\textup{c}} as the average causal effect of the treatment received on the outcome for compliers.

109 Homework problems

21.1 Variance of the Wald estimator

Show that \textup{var}(\hat{\tau}_{\textup{c}})=\infty.

21.2 Asymptotic variance of the Wald estimator and its estimation

Consider the large-sample regime with n\rightarrow\infty. First show that \sqrt{n}(\hat{\tau}_{\textup{c}}-\tau_{\textup{c}})\rightarrow\textsc{N}(0,V) in distribution and find V. Then show that \hat{V}_{\hat{A}}/V\rightarrow 1 in probability.

21.3 Proof of the main theorem of Imbens and Angrist, (1994) and Angrist et al., (1996)

Prove Theorem 21.2.

21.4 More on the FAR confidence set

The confidence set in Example 21.1 can be a close interval, two disconnected intervals, an empty set, or the whole real line. Find the precise condition for each case.

21.5 More simulation for the FAR confidence set

Figure 32 shows the FAR confidence sets without using covariates. Conduct parallel simulation for the FAR confidence sets adjusting for covariates in CRE.

21.6 Binary IV and ordinal treatment received

Angrist and Imbens, (1995) discussed a more general setting with a binary IV Z, an ordinal treatment received D\in\{0,1,\ldots,J\}, and an outcome Y. The ordinal treatment received has potential outcomes D(1) and D(0) with respect to the binary IV, and the outcome has potential outcomes Y(z,d) with respect to both the binary IV and the ordinal treatment received. Extend the discussion in Section 108 and the corresponding IV assumptions as below.

Assumption 21.5

We have (1) randomization that Z\ind \{D(z),Y(z,d):z=0,1;d=0,1,\ldots,J\}; (2) monotonicity that D(1)\geq D(0); and (3) exclusion restriction that Y(z,d)=Y(d) for all z=0,1 and d=0,1,\ldots,J.

They proved Theorem 21.3 below.

Theorem 21.3

Under Assumption 21.5, we have

\frac{E(Y\mid Z=1)-E(Y\mid Z=0)}{E(D\mid Z=1)-E(D\mid Z=0)}=\sum_{j=1}^{J}w_{j}E\{Y(j)-Y(j-1)\mid D(1)\geq j>D(0)\}

where

w_{j}=\frac{\textup{pr}\{D(1)\geq j>D(0)\}}{\sum_{j^{\prime}=1}^{J}\textup{pr}\{D(1)\geq j^{\prime}>D(0)\}}.

Prove Theorem 21.3.

Remark: When J=1, Theorem 21.3 reduces to Theorem 21.2. With a general J, it states that the standard IV formula identifies a weighted average of some latent subgroup effects. The weights are proportional to the probability of the latent groups defined by D(1)\geq j>D(0), and the latent subgroup effect E\{Y(j)-Y(j-1)\mid D(1)\geq j>D(0)\} compares the adjacent levels of the treatment received. However, this weighted average may not be easy to interpret because the latent groups overlap.

The proof can be tedious. A trick is to write the treatment received and outcome under treatment assignment z as

D(z)=\sum_{j=0}^{J}j1\{D(z)=j\},\quad Y(D(z))=\sum_{j=0}^{J}Y(j)1\{D(z)=j\}

to obtain

D(1)-D(0)=\sum_{j=0}^{J}j[1\{D(1)=j\}-1\{D(0)=j\}]

and

Y(D(1))-Y(D(0))=\sum_{j=0}^{J}Y(j)[1\{D(1)=j\}-1\{D(0)=j\}].

Then use the following Abel’s lemma, also called summation by parts:

\sum_{j=0}^{J}f_{j}(g_{j+1}-g_{j})=f_{J}g_{J+1}-f_{0}g_{0}-\sum_{j=1}^{J}g_{j}(f_{j}-f_{j-1})

for appropriately specified sequences (f_{j}) and (g_{j}).

21.7 Data analysis: a flu shot encouragement design (McDonald et al.,, 1992)

The dataset in fludata.txt is from a randomized encouragement design of McDonald et al., (1992), which was also re-analyzed by Hirano et al., (2000). It contains the following variables:

assign binary encouragement to receive the flu shot
receive binary indicator for receiving the flu shot
outcome binary outcome for flu-related hospitalization
age age of the patient
sex sex of the patient
race race of the patient
copd chronic obstructive pulmonary disease
dm diabetes
heartd heart disease
renal renal disease
liverd liver disease

Analyze the data with and without adjusting for the covariates.

21.8 IV estimation conditional on covariates

Implement the estimators and corresponding variance estimators mentioned in Chapter 105.2 in R.

Remark: The problem is useful for Problem 21.9.

21.9 Data analysis: the Karolinska data

Revisit Problem 12.5. Rubin, (2008) used the Karolinska data as an example for the IV method. In karolinska.txt, whether a patient was diagnosed at a large volume hospital can be viewed as an IV for whether a patient was treated at a large volume hospital. This is plausible conditional on other observed covariates. See Rubin, (2008)’s analysis for more details.

Re-analyze the data assuming that the IV is randomly assigned conditional on observed covariates.

21.10 Data analysis: a job training program

The file jobtraining.rtf contains the description of the data files X.csv and Y.csv.

The dataset X.csv contains the pretreatment covariates. You can view the sampling weight variable wgt as a covariate too. Many previous analyses made this simplification although this is always a controversial issue in statistical analysis of survey data. Conduct analyses with and without covariates.

The dataset Y.csv contains the sampling weight, treatment assigned, treatment received, and many post-treatment variables. Therefore, this dataset contains many outcomes depending on your questions of interest. The data also have many complications. First, some outcomes are missing. Second, unemployed individuals do not have wages. Third, the outcomes are repeatedly observed over time. When you analyze the data, please give details about your choice of the questions of interest and estimators.

Remark: Schochet et al., (2008) analyzed the original data. Frumento et al., (2012) provided a more sophisticated analysis based on the framework in Chapter 26 later.

21.11 Recommended reading

Angrist et al., (1996) bridged the econometric IV perspective and statistical causal inference based on potential outcomes and demonstrated its usefulness with an application.

脚注

44. This quote also appeared in Chapter 10 before.

45. In general, it is better to blind the experiment to avoid various biases arising from placebo effects, patients’ expectations, etc. In double-blind RCTs, both doctors and patients do not know the treatment; in single-blind RCTs, the patients do not know the treatment but the doctors know. Sometimes, it is impossible to conduct double or even single-blind trials; those trials are called open trials.

46. I use “direct effects” informally here. See more detailed discussion of the concept in Chapters 27 and 28 later.

47. The theory often assumes that \tau_{D} has the order n^{-1/2}. Under this regime, the proportion of compliers goes to 0 as n goes to infinity. The IV method can only identify a subgroup average causal effect with the proportion shrinking to 0. This is a contrived regime for theoretical analysis. It is hard to justify this assumption in practice. The following discussion does not assume it.

48. If we adopt the finite-population perspective, then we do not need this correction.

49. The name “factorial experiment” is from the experimental design literature (Dasgupta et al.,, 2015). The experimenter randomizes multiple factors to each unit. The treatment in the factorial experiment has multiple levels.

本书:A First Course in Causal Inference,作者 Peng Ding。原文:arXiv:2305.18793v2,按 CC BY 4.0 许可发布。本站(yuanens.com)把 arXiv 网页版改成分章的纯 HTML,把公式渲染成图片,方便在 Kindle 等电子书阅读器上看,内容没有改动。转换难免有错,以原文为准。本站与作者和出版社无关。