2018 年的期刊文章 · 第 9 页

共 1294 篇,按发表时间排,新的在前,每页 40 篇。这一页是 2018-09-12 到 2018-08-24。

按期刊、按主题看 →

第 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 页

SiM Clinical Trials Causal Inference · 发表于 2018-09-12

Theory of general balance applied to step wedge designs

Simon Bond

摘要

A standard idealized step‐wedge design satisfies the requirements, in terms of the structure of the observation units, to be considered a balanced design and can be labeled as a criss‐cross design (time crossed with cluster) with replication. As such, Nelder's theory of general balance can be used to decompose the analysis of variance into independent strata (grand mean, cluster, time, cluster:time, residuals). If time is considered as a fixed effect, then the treatment effect of interest is estimated solely within the cluster and time:cluster strata; the time effects are estimated solely within the time stratum. This separation leads directly to scalar, rather than matrix, algebraic manipulations to provide closed‐form expressions for standard errors of the treatment effect estimate. We use the tools provided by the theory of general balance to obtain an expression for the standard error of the estimated treatment effect in a general case where the assumed covariance structure includes random‐effects at the time and time:cluster levels. This provides insights that are helpful for experimental design regarding the assumed correlation within clusters over time, sample size in terms of numbers of clusters and replication within cluster, and components of the standard error for estimated treatment effect.

SiM Clinical Trials Longitudinal Data · 发表于 2018-09-12

Relative efficiency of unequal cluster sizes in stepped wedge and other trial designs under longitudinal or cross‐sectional sampling

Alan J. Girling

摘要

Background: A cluster trial with unequal cluster sizes often has lower precision than one with equal clusters, with a corresponding inflation of the design effect. For parallel group trials, adjustments to the design effect are available under sampling models with a single intracluster correlation. Design effects for equal clusters under more complex scenarios have appeared recently (including stepped wedge trials under cross‐sectional or longitudinal sampling). We investigate the impact of unequal cluster size in these more general settings. Results: Assuming a linear mixed model with an exchangeable correlation structure that incorporates cluster and subject autocorrelation, we compute the relative efficiency (RE) of a trial with clusters of unequal size under a size‐stratified randomization scheme, as compared to an equal cluster trial with the same total number of observations. If there are no within‐cluster time effects, the RE exceeds that for a parallel trial. In general, the RE is a weighted average of the RE for a parallel trial and the RE for a crossover trial in the same clusters. Existing approximations for parallel designs are extended to the general setting. Increasing the cluster size by the factor (1 + CV2), where CV is the coefficient of variation of cluster size, leads to conservative sample sizes, as in a popular method for parallel trials. Conclusion: Methods to assess experimental precision for single‐period parallel trials with unequal cluster sizes can be extended to stepped wedge and other complete layouts under longitudinal or cross‐sectional sampling. In practice, the loss of precision due to unequal cluster sizes is unlikely to exceed 12%.

SiM Longitudinal Data Survival Analysis · 发表于 2018-09-12

Investigation of one‐stage meta‐analysis methods for joint longitudinal and time‐to‐event data through simulation and real data application

Maria Sudell, Ruwanthi Kolamunnage‐Dona, François Gueyffier, Catrin Tudur Smith

摘要

Background:Joint modeling of longitudinal and time‐to‐event data is often advantageous over separate longitudinal or time‐to‐event analyses as it can account for study dropout, error in longitudinally measured covariates, and correlation between longitudinal and time‐to‐event outcomes. The current literature on joint modeling focuses mainly on the analysis of single studies with a lack of methods available for the meta‐analysis of joint data from multiple studies. Methods:We investigate a variety of one‐stage methods for the meta‐analysis of joint longitudinal and time‐to‐event outcome data. These methods are applied to the INDANA dataset to investigate longitudinally measured systolic blood pressure, with each of time to death, time to myocardial infarction, and time to stroke. Results are compared to separate longitudinal or time‐to‐event meta‐analyses. A simulation study is conducted to contrast separate versus joint analyses over a range of scenarios. Results:The performance of the examined one‐stage joint meta‐analytic models varied. Models that accounted for between study heterogeneity performed better than models that ignored it. Of the examined methods to account for between study heterogeneity, under the examined association structure, fixed effect approaches appeared preferable, whereas methods involving a baseline hazard stratified by study were least time intensive. Conclusions:One‐stage joint meta‐analytic models that accounted for between study heterogeneity using a mix of fixed effects or a stratified baseline hazard were reliable; however, models examined that included study level random effects in the association structure were less reliable.

SiM Survival Analysis Clinical Trials Causal Inference · 发表于 2018-09-12

Interim monitoring using the adaptively weighted log‐rank test in clinical trials for survival outcomes

Song Yang

摘要

For testing treatment effect with survival data, the log‐rank test has been the method of choice and enjoys an optimality property under proportional hazards alternatives. However, there can be significant loss of power in a variety of nonproportional situations. Yang and Prentice proposed an adaptively weighted log‐rank test that improves the power of the log‐rank test over a wide range of hazard ratio scenarios. In clinical trials, the data and safety monitoring board typically monitors the trial results periodically. Here, we develop interim testing procedures for the adaptively weighted log‐rank test. We establish the asymptotic distribution of the test statistics at the interim looks and use a resampling method to obtain the stopping boundaries. Through examination of the test behavior under local alternatives, we show that the adaptively weighted log‐rank test is fully efficient when the limiting censoring distributions in the two groups are equal. Unlike the case for the usual application of the log‐rank test, critical values obtained from the resampling method are asymptotically valid without the assumption of equal censoring distributions in the two groups. Extensive simulation studies show that the new method improves the log‐rank test for a wide range of treatment effect patterns, and that the resampling approach yields better control of the type 1 error rate than the originally proposed approach in the work of Yang and Prentice. The new procedures are illustrated in several clinical trial examples.

SiM Diagnostics & Prediction · 发表于 2018-09-12

Evaluating classification performance of biomarkers in two‐phase case‐control studies

Lu Wang, Ying Huang

摘要

Biomarkers are playing an increasingly important role in disease screening, early detection, and risk prediction. The two‐phase case‐control sampling study design is widely used for the evaluation of candidate biomarkers. The sampling probabilities for cases and controls in the second phase can often depend on other covariates (sampling strata). This biased sampling can lead to invalid inference on a biomarker's classification accuracy if not properly accounted for. In this paper, we adopt the idea of inverse probability weighting and develop inverse probability weighting–based estimators for various measures of a biomarker's classification performance, including the points on the receiver operating characteristics (ROCs) curve, the area under the ROC curve (area under the curve), and the partial area under the curve. In particular, we consider classification accuracy estimators using sampling weights estimated conditionally on sampling strata and further improve their efficiency through the use of estimated weights that additionally take into account the auxiliary variables available from the phase‐one cohort. We develop asymptotic properties of the proposed estimators and provide analytical variance for making inference. Extensive simulation studies demonstrate excellent performance of the proposed weighted estimators, while the traditional empirical estimator can be severely biased. We also investigate the advantages in efficiency gain for estimating various classification accuracy estimators through the use of auxiliary variables in addition to sampling strata and apply the proposed method to examples from a renal artery stenosis study and a prostate cancer study.

SiM Testing & Uncertainty Missing Data & Measurement Error · 发表于 2018-09-12

Combining multiple imputation and bootstrap in the analysis of cost‐effectiveness trial data

Jaap Brand, Stef van Buuren, Saskia le Cessie, Wilbert van den Hout

摘要

In healthcare cost‐effectiveness analysis, probability distributions are typically skewed and missing data are frequent. Bootstrap and multiple imputation are well‐established resampling methods for handling skewed and missing data. However, it is not clear how these techniques should be combined. This paper addresses combining multiple imputation and bootstrap to obtain confidence intervals of the mean difference in outcome for two independent treatment groups. We assessed statistical validity and efficiency of 10 candidate methods and applied these methods to a clinical data set. Single imputation nested in the bootstrap percentile method (with added noise to reflect the uncertainty of the imputation) emerged as the method with the best statistical properties. However, this method can require extensive computation times and the lack of standard software makes this method not accessible for a larger group of researchers. Using a standard unpaired t‐test with standard multiple imputation without bootstrap appears to be a robust alternative with acceptable statistical performance for which standard multiple imputation software is available.

SiM Longitudinal Data Bayesian Methods Nonparametric & Semiparametric · 发表于 2018-09-12

Bayesian varying coefficient kernel machine regression to assess neurodevelopmental trajectories associated with exposure to complex mixtures

Shelley H. Liu, Jennifer F. Bobb, Birgit Claus Henn, Chris Gennings, Lourdes Schnaas, Martha Tellez‐Rojo, David Bellinger, Manish Arora, Robert O. Wright, Brent A. Coull

摘要

Exposure to environmental mixtures can exert wide‐ranging effects on child neurodevelopment. However, there is a lack of statistical methods that can accommodate the complex exposure‐response relationship between mixtures and neurodevelopment while simultaneously estimating neurodevelopmental trajectories. We introduce Bayesian varying coefficient kernel machine regression (BVCKMR), a hierarchical model that estimates how mixture exposures at a given time point are associated with health outcome trajectories. The BVCKMR flexibly captures the exposure‐response relationship, incorporates prior knowledge, and accounts for potentially nonlinear and nonadditive effects of individual exposures. This model assesses the directionality and relative importance of a mixture component on health outcome trajectories and predicts health effects for unobserved exposure profiles. Using contour plots and cross‐sectional plots, BVCKMR also provides information about interactions between complex mixture components. The BVCKMR is applied to a subset of data from PROGRESS, a prospective birth cohort study in Mexico city on exposure to metal mixtures and temporal changes in neurodevelopment. The mixture include metals such as manganese, arsenic, cobalt, chromium, cesium, copper, lead, cadmium, and antimony. Results from a subset of Programming Research in Obesity, Growth, Environment and Social Stressors data provide evidence of significant positive associations between second trimester exposure to copper and Bayley Scales of Infant and Toddler Development cognition score at 24 months, and cognitive trajectories across 6‐24 months. We also detect an interaction effect between second trimester copper and lead exposures for cognition at 24 months. In summary, BVCKMR provides a framework for estimating neurodevelopmental trajectories associated with exposure to complex mixtures.

SiM Other · 发表于 2018-09-11

Statistical inferences of extended concentration indices for directly standardized rates

Mandi Yu, Benmei Liu, Yan Li, Zhaohui Zou, Nancy Breen

摘要

The relative concentration index (RCI) and the absolute concentration index (ACI) have been widely used for monitoring health disparities with ranked health determinants. The RCI has been extended to allow value judgments about inequality aversion by Pereira in 1998 and by Wagstaff in 2002. Previous studies of the extended RCI have focused on survey sample data. This paper adapts the extended RCI for use with directly standardized rates (DSRs) calculated from population‐based surveillance data. A Taylor series linearization (TL)–based variance estimator is developed and evaluated using simulations. A simulation‐based Monte Carlo (MC) variance estimator is also evaluated as a comparison. Following Wagstaff's approach in 1991, we extend the ACI for use with DSRs. In all simulations, both the TL and MC methods produce valid variance estimates. The TL variance estimator has a simple, closed form that is attractive to users without sophisticated programming skills. The TL and MC estimators have been incorporated into a beta version of the National Cancer Institute's Health Disparities Calculator, a free statistical software tool that enables the estimation of 11 commonly used summary measures of health disparities for DSRs.

SMMR Diagnostics & Prediction · 发表于 2018-09-11

Robust likelihood inference for diagnostic accuracy measures for paired organs

Tsung-Shan Tsou

摘要

Paired data arise naturally in Ophthalmology where pairs of eyes undergo diagnostic tests to predict the presence of certain diseases. The common correlation model is popular for modeling the joint probabilities of responses from fellow eyes for inference about accuracy measures. One of the assumptions underlying the model is exchangeability of fellow eyes that stipulates the accuracy measures such as sensitivities/specificities of fellow eyes be equal. We propose a parametric robust likelihood approach to testing the equality of accuracy measures of fellow eyes without modeling correlation. The robust likelihood procedure is applicable for inference about diagnostic accuracy measures in general paired designs. We provide simulations and analyses of a data set in Ophthalmology to demonstrate the effectiveness of the parametric robust procedure.

Biometrics Clinical Trials Survival Analysis · 发表于 2018-09-11

Power and Sample Size for Dose-Finding Studies with Survival Endpoints Under Model Uncertainty

Qiqi Deng, Xiaofei Bai, Dacheng Liu, Dooti Roy, Zhiliang Ying, Dan-Yu Lin

摘要

Summary: Multiple comparison procedures combined with modeling techniques (MCP-Mod) (Bretz et al., 2005) is an efficient and robust statistical methodology for the model-based design and analysis of dose-finding studies with an unknown dose–response model. With this approach, multiple comparison methods are used to identify statistically significant contrasts corresponding to a set of candidate dose–response models, and the best model is then used to estimate the target dose. Power and sample size calculations for this methodology require knowledge of the covariance matrix for the estimators of the (placebo-adjusted) mean responses among the dose groups. In this article, we consider survival endpoints and derive an analytic form of the covariance matrix for the estimators of the log hazard ratios as a function of the total number of events in the study. We then use this closed-form expression of the covariance matrix to derive the power and sample size formulas. We discuss practical considerations in the application of these formulas. In addition, we provide an illustration with a motivating example on chronic obstructive pulmonary disease. Finally, we demonstrate through simulation studies that the proposed formulas are accurate enough for practical use.

SiM Survival Analysis Networks & Graphs · 发表于 2018-09-11

Graphing the Win Ratio and its components over time

Dianne M. Finkelstein, David A. Schoenfeld

摘要

Clinical trials are often designed to compare treatments on the basis of multiple outcomes. For the analysis of the treatment comparison from such a trial, in 1999, the Finkelstein‐Schoenfeld test was proposed, which was a generalization of the Gehan‐Wilcoxon test based on pairwise comparison of patients on a primary outcome when possible but otherwise on a secondary outcome. In 2012, Pocock and colleagues suggested an estimate based on this concept, the Win Ratio, which summarized the ratio of the number of patients who fared better versus worse on the experimental arm. However, in 2016, Oakes noted that the Win Ratio could be a function of the distribution of follow‐up times of the trial. The aim of this paper is to propose an approach to representing the Win Ratio graphically in such a way that the effect of time on the estimate would be apparent. In addition, the methods are used to display the contribution of each endpoint to the composite. We apply the methods to clinical trials in cancer, cardiology, and neurology. Software is available named winRatioAnalysis in CRAN.

SiM Clinical Trials · 发表于 2018-09-11

Adaptive enrichment designs for confirmatory trials

Tze Leung Lai, Philip W. Lavori, Ka Wai Tsang

摘要

After an overview of the Food and Drugs Administration's 2012 draft guidance on enrichment strategies for clinical trials to support drug/biologic approval, we describe subsequent advances in adaptive enrichment designs in this direction. We also provide a concrete application in the enrichment design of theDiffusion and Perfusion ImagingEvaluationforUnderstandingStrokeEvolution 3 trial comparing a new endovascular treatment with standard of care for ischemic stroke patients.

SMMR Causal Inference Latent Variables & Mixtures · 发表于 2018-09-11

A review and empirical comparison of causal inference methods for clustered observational data with application to the evaluation of the effectiveness of medical devices

Guy Cafri, Wei Wang, Priscilla H Chan, Peter C Austin

摘要

Observational studies are commonplace in medicine. A frequent concern is confounding bias due to differences in patient characteristics across treatment groups, but other important issues include dependency among observations nested within clusters (e.g. patients clustered within physicians or surgeons) and confounding due to cluster characteristics (e.g. physician or surgeon experience or training). Given the frequency with which these issues arise in medical research, as well as their relative complexity, methods for the analysis of clustered observational data are reviewed. We argue for estimating causal treatment effects using marginal models that either match or weight observations using a suitable distance metric (e.g. the propensity score). Simulation results demonstrated that methods incorporating clustering into calculation of the variance were generally more accurate than those that did not. Moreover, methods that account for cluster confounding when estimating the treatment effect were least biased and most accurate. Throughout the paper we illustrate the proposed methods in a medical device setting that compares the effectiveness of femoral heads used in total hip replacements. Whenever possible the clustered aspect of the data should be considered in the design of the study when constructing the distance measure or in the matching process, as well as in the analysis when estimating the variance of the treatment effect.

SMMR Testing & Uncertainty Longitudinal Data · 发表于 2018-09-11

A novel approach to selecting classification types for time-dependent covariates in the marginal analysis of longitudinal data

I-Chen Chen, Philip M Westgate

摘要

Generalized estimating equations are routinely utilized for the marginal analysis of longitudinal data. In order to obtain consistent regression parameter estimates, these estimating equations must be unbiased. However, when certain types of time-dependent covariates are presented, these equations can be biased unless the working independence structure is used. Unfortunately, regression parameter estimation can be very inefficient with this structure because not all valid moment conditions are incorporated within the corresponding equations. Therefore, approaches have been proposed to utilize all valid moment conditions. However, these approaches assume that the data analyst knows the type of time-dependent covariate, although this likely is not the case in practice. Whereas hypothesis testing has been used to determine covariate type, we propose a novel strategy to select a working covariate type in order to avoid potentially high type II error rates with these hypothesis testing procedures. Parameter estimates resulting from our proposed method are consistent and have overall improved mean squared error relative to hypothesis testing approaches. Existing and proposed methods are compared in a simulation study and application example.

Biometrics Testing & Uncertainty Bayesian Methods Latent Variables & Mixtures · 发表于 2018-09-11

A Novel Bayesian Multiple Testing Approach to Deregulated miRNA Discovery Harnessing Positional Clustering

Noirrit Kiran Chandra, Richa Singh, Sourabh Bhattacharya

摘要

Summary: MicroRNAs (miRNAs) are small non-coding RNAs that function as regulators of gene expression. In recent years, there has been a tremendous interest among researchers to investigate the role of miRNAs in normal as well as in disease processes. To investigate the role of miRNAs in oral cancer, we analyse expression levels of miRNAs to identify miRNAs with statistically significant differential expression in cancer tissues. In this article, we propose a novel Bayesian hierarchical model of miRNA expression data. Compelling evidence has demonstrated that the transcription process of miRNAs in the human genome is a latent process instrumental for the observed expression levels. We take into account positional clustering of the miRNAs in the analysis and model the latent transcription phenomenon nonparametrically by an appropriate Gaussian process. For the purpose of testing, we employ a novel Bayesian multiple testing method where we mainly focus on utilizing the dependence structure between the hypotheses for better results, while also ensuring optimality in many respects. Indeed, our non-marginal method yielded results in accordance with the underlying scientific knowledge which are found to be missed by the very popular Benjamini–Hochberg method.

SMMR Other · 发表于 2018-09-10

Testing modified zeros for Poisson regression models

Yi Tang, Wan Tang

摘要

Excessive zeros are common in practice and may cause overdispersion and invalidate inferences when fitting Poisson regression models. Zero-inflated Poisson regression models may be applied if there are inflated zeros; however, it is desirable to test if there are inflated zeros before such zero-inflated Poisson models are applied. Assuming a constant probability of being a structural zero in a zero-inflated Poisson regression model, the existence of the inflated zeros may be tested by testing whether the constant probability is zero. In such situations, the Wald, score, and likelihood ratio tests can be applied. Without specifying a zero-inflated Poisson model, He et al. recently developed a test by comparing the amount of observed zeros with that expected under the Poisson model. In this paper, we develop a closed form for the test and compare it with the Wald, score, and likelihood ratio tests through simulation studies. The simulation studies show that the test of He et al. is the best in controlling type I errors, while the score test generally has the least power among the tests. The tests are illustrated with two real data examples.

SiM Clinical Trials · 发表于 2018-09-10

Half blind superiority tests for clinical trials of anti‐infective drugs

Dean Follmann, Erica Brittain, Keith Lumbard

摘要

This paper introduces a test of superiority of new anti‐infective drug B over comparator drug A based on a randomized clinical trial. This test can be used to demonstrate assay (trial) sensitivity for noninferiority trials and rigorously tailor drug choice for individual patients. Our approach uses specialized baseline covariatesXA,XB, which should predict the benefits of drug A and drug B, respectively. Using a response surface model for the treatment effect, we test for superiority at the (XA,XB) point that is most likely to show superiority. We identify this point based on estimates from a novel half‐blind pseudo likelihood, where we augment a blinded likelihood (mixed over the treatment indicator) with likelihoods for the overall success rates for drug A and drug B (mixed overXA,XB). The augmentation results in much better estimates than those based on the mixed blinded likelihood alone but, interestingly, the estimates almost behave as if they were based on fully blinded data. We also develop an analogous univariate method usingXAfor settings whereXBhas little variation. Permutation methods are used for testing. If the “half‐blind” test rejects, pointwise confidence interval can be used to identify patients who would benefit from drug B. We compare the new tests to other methods with an example and via simulations.

SiM Clinical Trials · 发表于 2018-09-10

Designing cancer immunotherapy trials with random treatment time‐lag effect

Zhenzhen Xu, Yongsoek Park, Boguang Zhen, Bin Zhu

摘要

In some clinical settings such as the cancer immunotherapy trials, a treatment time‐lag effect may be present and the lag duration possibly vary from subject to subject. An efficient study design and analysis procedure should not only take into account the time‐lag effect but also consider the individual heterogeneity in the lag duration. In this paper, we present a Generalized Piecewise Weighted Logrank (GPW‐Logrank) test, designed to account for the random time‐lag effect while maximizing the study power with respect to the weights. Based on the proposed test, both analytic and numeric approaches are developed for the sample size and power calculation. Asymptotic properties are derived and finite sample efficiency is evaluated in simulations. Compared with the standard practice ignoring the delayed effect, the proposed design and analysis procedures are substantially more efficient when a random lag is expected; further, compared with the existing methods by Xu et al considering the fixed time‐lag effect, the proposed approaches are significantly more robust when the lag model is misspecified. An R package (DelayedEffect.Design) is developed for implementation.

SiM Diagnostics & Prediction Clinical Trials · 发表于 2018-09-09

An alternative method to analyse the biomarker‐strategy design

Cornelia Ursula Kunz, Thomas Jaki, Nigel Stallard

摘要

Recent developments in genomics and proteomics enable the discovery of biomarkers that allow identification of subgroups of patients responding well to a treatment. One currently used clinical trial design incorporating a predictive biomarker is the so‐called biomarker strategy design (or marker‐based strategy design). Conventionally, the results from this design are analysed by comparing the mean of the biomarker‐led arm with the mean of the randomised arm. Several problems regarding the analysis of the data obtained from this design have been identified in the literature. In this paper, we show how these problems can be resolved if the sample sizes in the subgroups fulfil the specified orthogonality condition. We also propose a different analysis strategy that allows definition of test statistics for the biomarker‐by‐treatment interaction effect as well as for the classical treatment effect and the biomarker effect. We derive equations for the sample size calculation for the case of perfect and imperfect biomarker assays. We also show that the often used 1:1 randomisation does not necessarily lead to the smallest sample size. In addition, we provide point estimators and confidence intervals for the treatment effects in the subgroups. Application of our method is illustrated using a real data example.

SMMR Clinical Trials Causal Inference · 发表于 2018-09-07

Inference for the treatment effect in multiple-period cluster randomised trials when random effect correlation structure is misspecified

Jessica Kasza, Andrew B Forbes

摘要

Multiple-period cluster randomised trials, such as stepped wedge or cluster cross-over trials, are being conducted with increasing frequency. In the design and analysis of these trials, it is necessary to specify the form of the within-cluster correlation structure, and a common assumption is that the correlation between the outcomes of any pair of subjects within a cluster is identical. More complex models that allow for correlations within a cluster to decay over time have recently been suggested. However, most software packages cannot fit these models. As a result, practitioners may choose a simpler model. We analytically examine the impact of incorrectly omitting a decay in correlation on the variance of the treatment effect estimator and show that misspecification of the within-cluster correlation structure can lead to incorrect conclusions regarding estimated treatment effects for stepped wedge and cluster crossover trials.

SMMR Diagnostics & Prediction · 发表于 2018-09-07

Eliminating systematic bias from case-crossover designs

Xiaoming Wang, Sukun Wang, Warren Kindzierski

摘要

Case-crossover designs have been widely applied to epidemiological and medical investigations of associations between short-term exposures and risk of acute adverse health events. Much effort has been made in literature on understanding source of confounding and reducing systematic bias by reference-select strategies. In this paper, we explored the nature of bias in the ambi-directional and time-stratified case-crossover designs via simulation using actual air pollution data from urban Edmonton, Alberta, Canada. We further proposed a calibration approach for eliminating systematic bias in estimates (coefficient estimate, 95% confident interval, and p-value). Bias check for coefficient estimation, size check and power check for significance test were done via simulation experiments to show advantages of the calibrated case-crossover studies over the ones without calibration. An application was done to investigate associations between air pollutants and acute myocardial infarction hospitalizations in urban Edmonton. In conclusion, systematic bias in a case-crossover design is often unavoidable, leading to an obvious bias in the estimated effect and an unreliable p value in the significance test. The proposed calibration technique provides an efficient approach to eliminating systematic bias in a case-crossover study.

SiM Bayesian Methods Clinical Trials · 发表于 2018-09-06

Use of a random effects meta‐analysis in the design and analysis of a new clinical trial

Hayley E. Jones, A. E. Ades, Alex J. Sutton, Nicky J. Welton

摘要

In designing a randomized controlled trial, it has been argued that trialists should consider existing evidence about the likely intervention effect. One approach is to form a prior distribution for the intervention effect based on a meta‐analysis of previous studies and then power the trial on its ability to affect the posterior distribution in a Bayesian analysis. Alternatively, methods have been proposed to calculate the power of the trial to influence the “pooled” estimate in an updated meta‐analysis. These two approaches can give very different results if the existing evidence is heterogeneous, summarised using a random effects meta‐analysis. We argue that the random effects mean will rarely represent the trialist's target parameter, and so, it will rarely be appropriate to power a trial based on its impact upon the random effects mean. Furthermore, the random effects mean will not generally provide an appropriate prior distribution. More appropriate alternatives include the predictive distribution and shrinkage estimate for the most similar study. Consideration of the impact of the trial on the entire random effects distribution might sometimes be appropriate. We describe how beliefs about likely sources of heterogeneity have implications for how the previous evidence should be used and can have a profound impact on the expected power of the new trial. We conclude that the likely causes of heterogeneity among existing studies need careful consideration. In the absence of explanations for heterogeneity, we suggest using the predictive distribution from the meta‐analysis as the basis for a prior distribution for the intervention effect.

SiM Survival Analysis Nonparametric & Semiparametric · 发表于 2018-09-06

Nonparametric adaptive enrichment designs using categorical surrogate data

Matthias Brückner, Hans U. Burger, Werner Brannath

摘要

Adaptive survival trials are particularly important for enrichment designs in oncology and other life‐threatening diseases. Current statistical methodology for adaptive survival trials provide type I error rate control only under restrictions. For instance, if we use stage‐wise P values based on increments of the log‐rank test, then the information used for the interim decisions need to be restricted to the primary survival endpoint. However, it is often desirable to base interim decisions also on correlated short‐term endpoints like tumor response. Alternative statistical approaches based on a patient‐wise splitting of the data require unnatural restrictions on the follow‐up times and do not permit to efficiently account for an early rejection of the primary null hypothesis. We therefore suggest new approaches that enable us to use discrete surrogate endpoints (like tumor response status) and also to incorporate interim rejection boundaries. The new approaches are based on weighted Kaplan‐Meier estimates and thereby have additional advantages. They permit us to account for nonproportional hazards and are robust against informative censoring based on the surrogate endpoint. We will show that nonproportionality is an intrinsic and relevant issue in enrichment designs. Moreover, informative censoring based on the surrogate endpoint is likely because of withdrawals and treatment switches after insufficient treatment response. It is shown and illustrated how nonparametric tests based on weighted Kaplan‐Meier estimates can be used in closed combination tests for adaptive enrichment designs, such that type I error rate control is achieved and justified asymptotically.

SiM Longitudinal Data Diagnostics & Prediction · 发表于 2018-09-06

Nonlinear model with random inflection points for modeling neurodegenerative disease progression

Ming Sun, Yuanjia Wang

摘要

Due to a lack of a gold standard objective marker, the current practice for diagnosing a neurological disorder is mostly based on clinical symptoms, which may occur in the late stage of the disease. Clinical diagnosis is also subject to high variance due to between‐ and within‐subject variability of patient symptomatology and between‐clinician variability. Effectively modeling disease course and making early prediction using biomarkers and subtle clinical signs are critical and challenging both for improving diagnostic accuracy and designing preventive clinical trials for neurological disorders. Leveraging the domain knowledge that certain biological characteristics (ie, causal genetic mutation) is part of the disease mechanism, and certain markers (eg, neuroimaging measures, motor and cognitive ability measures) reflect pathological process, we propose a nonlinear model with random inflection points depending on subject‐specific characteristics to jointly estimate the changing trajectories of the markers in the same disease domain. The model scales different markers into comparable progression curves with a temporal order based on the mean inflection point and establishes the relationship between the progression of markers with the underlying disease mechanism. The model also assesses how subject‐specific characteristics affect the dynamic trajectory of different markers, which offers information on designing preventive therapeutics and personalized disease management strategy. We perform extensive simulation studies and apply our method to markers in neuroimaging, cognitive, and motor domains of Huntington's disease using the data collected from a large multisite natural history study of Huntington's disease, where we assess the temporal ordering of disease impairment between domains. We show that atrophy from certain brain area occurs first, followed by motor and cognitive domain, and show that an average patient has already experienced substantial regional brain atrophy when reaching clinical diagnosis age.

SiM Causal Inference · 发表于 2018-09-06

Mediation analysis for common binary outcomes

Sheila M. Gaynor, Joel Schwartz, Xihong Lin

摘要

Mediation analysis provides an attractive causal inference framework to decompose the total effect of an exposure on an outcome into natural direct effects and natural indirect effects acting through a mediator. For binary outcomes, mediation analysis methods have been developed using logistic regression when the binary outcome is rare. These methods will not hold in practice when a disease is common. In this paper, we develop mediation analysis methods that relax the rare disease assumption when using logistic regression. We calculate the natural direct and indirect effects for common diseases by exploiting the relationship between logit and probit models. Specifically, we derive closed‐form expressions for the natural direct and indirect effects on the odds ratio scale. Mediation models for both continuous and binary mediators are considered. We demonstrate through simulation that the proposed method performs well for common binary outcomes. We apply the proposed methods to analyze the Normative Aging Study to identify DNA methylation sites that are mediators of smoking behavior on the outcome of obstructed airway function.

Biometrics High-Dimensional Longitudinal Data Latent Variables & Mixtures · 发表于 2018-09-03

Regularized Latent Class Model for Joint Analysis of High-Dimensional Longitudinal Biomarkers and a Time-to-Event Outcome

Jiehuan Sun, Jose D. Herazo-Maya, Philip L. Molyneaux, Toby M. Maher, Naftali Kaminski, Hongyu Zhao

摘要

Summary: Although many modeling approaches have been developed to jointly analyze longitudinal biomarkers and a time-to-event outcome, most of these methods can only handle one or a few biomarkers. In this article, we propose a novel joint latent class model to deal with high dimensional longitudinal biomarkers. Our model has three components: a class membership model, a survival submodel, and a longitudinal submodel. In our model, we assume that covariates can potentially affect biomarkers and class membership. We adopt a penalized likelihood approach to infer which covariates have random effects and/or fixed effects on biomarkers, and which covariates are informative for the latent classes. Through extensive simulation studies, we show that our proposed method has improved performance in prediction and assigning subjects to the correct classes over other joint modeling methods and that bootstrap can be used to do inference for our model. We then apply our method to a dataset of patients with idiopathic pulmonary fibrosis, for whom gene expression profiles were measured longitudinally. We are able to identify four interesting latent classes with one class being at much higher risk of death compared to the other classes. We also find that each of the latent classes has unique trajectories in some genes, yielding novel biological insights.

SiM Other · 发表于 2018-09-03

Modeling time‐varying effects of multilevel risk factors of hospitalizations in patients on dialysis

Yihao Li, Danh V. Nguyen, Yanjun Chen, Connie M. Rhee, Kamyar Kalantar‐Zadeh, Damla Şentürk

摘要

For chronic dialysis patients, a unique population requiring continuous medical care, methodologies to monitor patient outcomes, such as hospitalizations, over time, after initiation of dialysis, are of particular interest. Contributing to patient hospitalizations is a number of multilevel covariates such as demographics and comorbidities at the patient level and staffing composition at the dialysis facility level. We propose a varying coefficient model for multilevel risk factors (VCM‐MR) to study the time‐varying effects of covariates on patient hospitalization risk as a function of time on dialysis. The proposed VCM‐MR also includes subject‐specific random effects to account for within‐subject correlation and dialysis facility‐specific fixed effect varying coefficient functions to allow for the modeling of flexible time‐varying facility‐specific risk trajectories. An approximate EM algorithm and an iterative Newton‐Raphson approach are proposed to address the challenge of estimation of high‐dimensional parameters (varying coefficient functions) for thousands of dialysis facilities in the United States. The proposed modeling allows for comparisons between time‐varying effects of multilevel risk factors as well as testing of facility‐specific fixed effects. The method is applied to model hospitalization risk using the rich hierarchical data available on dialysis patients initiating dialysis between January 1, 2006 and December 31, 2008 from the United States Renal Data System, a large national database, where 331 443 hospitalizations over time are nested within patients, and 89 889 patients are nested within 2201 dialysis facilities. Patients are followed‐up until December 31, 2013, where the follow‐up time is truncated five years after the initiation of dialysis. Finite sample properties are studied through extensive simulations.

SMMR Other · 发表于 2018-09-03

Measures for concordance and discordance with applications in disease control and prevention

Marc Aerts, Adelino JC Juga, Niel Hens

摘要

Bivariate binary response data appear in many applications. Interest goes most often to a parameterization of the joint probabilities in terms of the marginal success probabilities in combination with a measure for association, most often being the odds ratio. Using, for example, the bivariate Dale model, these parameters can be modelled as function of covariates. But the odds ratio and other measures for association are not always measuring the (joint) characteristic of interest. Agreement, concordance, and synchrony are in general facets of the joint distribution distinct from association, and the odds ratio as in the bivariate Dale model can be replaced by such an alternative measure. Here, we focus on the so-called conditional synchrony measure. But, as indicated by several authors, such a switch of parameter might lead to a parameterization that does not always lead to a permissible joint bivariate distribution. In this contribution, we propose a new parameterization in which the marginal success probabilities are replaced by other conditional probabilities as well. The new parameters, one homogeneity parameter and two synchrony/discordance parameters, guarantee that the joint distribution is always permissible. Moreover, having a very natural interpretation, they are of interest on their own. The applicability and interpretation of the new parameterization is shown for three interesting settings: quantifying HIV serodiscordance among couples in Mozambique, concordance in the infection status of two related viruses, and the diagnostic performance of an index test in the field of major depression disorders.

SiM Latent Variables & Mixtures Bayesian Methods Missing Data & Measurement Error · 发表于 2018-09-03

A Bayesian latent class approach for EHR‐based phenotyping

Rebecca A. Hubbard, Jing Huang, Joanna Harton, Arman Oganisian, Grace Choi, Levon Utidjian, Ihuoma Eneli, L. Charles Bailey, Yong Chen

摘要

Phenotyping, ie, identification of patients possessing a characteristic of interest, is a fundamental task for research conducted using electronic health records. However, challenges to this task include imperfect sensitivity and specificity of clinical codes and inconsistent availability of more detailed data such as laboratory test results. Despite these challenges, most existing electronic health records–derived phenotypes are rule‐based, consisting of a series of Boolean arguments informed by expert knowledge of the disease of interest and its coding. The objective of this paper is to introduce a Bayesian latent phenotyping approach that accounts for imperfect data elements and missing not at random missingness patterns that can be used when no gold‐standard data are available. We conducted simulation studies to compare alternative phenotyping methods under different patterns of missingness and applied these approaches to a cohort of 68 265 children at elevated risk for type 2 diabetes mellitus (T2DM). In simulation studies, the latent class approach had similar sensitivity to a rule‐based approach (95.9% vs 91.9%) while substantially improving specificity (99.7% vs 90.8%). In the PEDSnet cohort, we found that biomarkers and clinical codes were strongly associated with latent T2DM status. The latent T2DM class was also strongly predictive of missingness in biomarkers. Glucose was missing in 83.4% of patients (odds ratio for latent T2DM status = 0.52) while hemoglobin A1c was missing in 91.2% (odds ratio for latent T2DM status = 0.03 ), suggesting missing not at random missingness. The latent phenotype approach may substantially improve on rule‐based phenotyping.

Biometrics Genetics & Omics Latent Variables & Mixtures · 发表于 2018-08-31

A Hidden Markov Model for Identifying Differentially Methylated Sites in Bisulfite Sequencing Data

Farhad Shokoohi, David A. Stephens, Guillaume Bourque, Tomi Pastinen, Celia M. T. Greenwood, Aurélie Labbe

摘要

Summary: DNA methylation studies have enabled researchers to understand methylation patterns and their regulatory roles in biological processes and disease. However, only a limited number of statistical approaches have been developed to provide formal quantitative analysis. Specifically, a few available methods do identify differentially methylated CpG (DMC) sites or regions (DMR), but they suffer from limitations that arise mostly due to challenges inherent in bisulfite sequencing data. These challenges include: (1) that read-depths vary considerably among genomic positions and are often low; (2) both methylation and autocorrelation patterns change as regions change; and (3) CpG sites are distributed unevenly. Furthermore, there are several methodological limitations: almost none of these tools is capable of comparing multiple groups and/or working with missing values, and only a few allow continuous or multiple covariates. The last of these is of great interest among researchers, as the goal is often to find which regions of the genome are associated with several exposures and traits. To tackle these issues, we have developed an efficient DMC identification method based on Hidden Markov Models (HMMs) called “DMCHMM” which is a three-step approach (model selection, prediction, testing) aiming to address the aforementioned drawbacks. Our proposed method is different from other HMM methods since it profiles methylation of each sample separately, hence exploiting inter-CpG autocorrelation within samples, and it is more flexible than previous approaches by allowing multiple hidden states. Using simulations, we show that DMCHMM has the best performance among several competing methods. An analysis of cell-separated blood methylation profiles is also provided.

SiM Causal Inference · 发表于 2018-08-30

Relaxed covariate overlap and margin‐based causal effect estimation

Debashis Ghosh

摘要

In most nonrandomized observational studies, differences between treatment groups may arise not only due to the treatment but also because of the effect of confounders. Therefore, causal inference regarding the treatment effect is not as straightforward as in a randomized trial. To adjust for confounding due to measured covariates, a variety of methods based on the potential outcomes framework are used to estimate average treatment effects. One of the key assumptions is treatment positivity, which states that the probability of treatment is bounded away from zero and one for any possible combination of the confounders. Methods for performing causal inference when this assumption is violated are relatively limited. In this article, we discuss a new balance‐related condition involving the convex hulls of treatment groups, which I term relaxed covariate overlap. An advantage of this concept is that it can be linked to a concept from machine learning, termed the margin. Introduction of relaxed covariate overlap leads to an approach in which one can perform causal inference in a three‐step manner. The methodology is illustrated with two examples.

SiM Survival Analysis · 发表于 2018-08-30

Estimation in generalized linear models under censored covariates with an application to MIREC data

Wan‐Chen Lee, Sanjoy K. Sinha, Tye E. Arbuckle, Mandy Fisher

摘要

In many biological experiments, certain values of a biomarker are often nondetectable due to low concentrations of an analyte or the limitations of a chemical analysis device, resulting in left‐censored values. There is an increasing demand for the analysis of data subject to detection limits in clinical and environmental studies. In this paper, we develop a novel statistical method for the maximum likelihood estimation in generalized linear models with covariates subject to detection limits. Simulations are carried out to study the relative performance of the proposed estimators, as compared to other existing estimators. The proposed method is also applied to a real dataset from the Maternal‐Infant Research on Environmental Chemicals cohort study, where we investigate how different chemical mixtures affect the health outcomes of infants and pregnant women.

SMMR Other · 发表于 2018-08-29

Asymptotic and exact interval estimators of the common odds ratio under the sequential parallel comparison design

Kung-Jong Lui

摘要

When studying treatments for psychiatric or mental diseases in a placebo-controlled trial, we may consider use of the sequential parallel comparison design to reduce the number of patients needed through the reduction of the high placebo response rate. Under the assumption that the odds ratio of responses is constant between phases in the sequential parallel comparison design, we derive the conditional maximum likelihood estimator for the odds ratio. On the basis of the conditional likelihood, we further derive three asymptotic interval and an exact interval estimators for the odds ratio of responses. We employ Monte Carlo simulation to evaluate the performance of these interval estimators in a variety of situations. We find that the asymptotic interval and exact interval estimators developed here can all perform well. We use the double-blind, placebo-controlled study assessing the efficacy of a low dose of aripiprazole adjunctive to antidepressant therapy for treating patients with major depressive disorder to illustrate the use of these estimators.

SiM Causal Inference Testing & Uncertainty · 发表于 2018-08-28

Likelihood‐based inference for bounds of causal parameters

Woojoo Lee, Arvid Sjölander, Anton Larsson, Yudi Pawitan

摘要

It is a common causal inference problem that, even with theoretically infinite samples, we might be able to only provide bounds for the parameters of interest. This problem occurs naturally, for example, in estimating causal interaction between two risk factors and in estimating the average causal effect using the instrumental variable or Mendelian randomization method. Current procedures include linear programming to get the estimated bounds, plus bootstrapping to get confidence intervals. We describe a likelihood‐based procedure that automatically yields the interval estimate from the flat likelihood region and show some theory that allows us to construct confidence intervals from this non–regular likelihood. Finally, we illustrate the procedure with examples from the estimation of causal interaction between two risk factors and the treatment effect under partial compliance.

SiM Longitudinal Data · 发表于 2018-08-28

Computationally efficient methods for fitting mixed models to electronic health records data

K.M. Rhodes, R.M. Turner, R.A. Payne, I.R. White

摘要

Motivated by two case studies using primary care records from the Clinical Practice Research Datalink, we describe statistical methods that facilitate the analysis of tall data, with very large numbers of observations. Our focus is on investigating the association between patient characteristics and an outcome of interest, while allowing for variation among general practices. We explore ways to fit mixed‐effects models to tall data, including predictors of interest and confounding factors as covariates, and including random intercepts to allow for heterogeneity in outcome among practices. We introduce (1) weighted regression and (2) meta‐analysis of estimated regression coefficients from each practice. Both methods reduce the size of the dataset, thus decreasing the time required for statistical analysis. We compare the methods to an existing subsampling approach. All methods give similar point estimates, and weighted regression and meta‐analysis give similar standard errors for point estimates to analysis of the entire dataset, but the subsampling method gives larger standard errors. Where all data are discrete, weighted regression is equivalent to fitting the mixed model to the entire dataset. In the presence of a continuous covariate, meta‐analysis is useful. Both methods are easy to implement in standard statistical software.

SiM Spatial & Time Series · 发表于 2018-08-28

A spatiotemporal back‐calculation approach to estimate cancer incidence measures

Nisheet Nautiyal, Theodore R. Holford

摘要

Incidence rates are an important population‐level disease risk measure. Cancer incidence data in the United States, which are collected by disease registries, have been spatiotemporally sparse. Back‐calculation methods can yield incidence estimates for a spatial domain by solving a convolution equation that relates mortality to incidence through survival estimates. We propose a novel back‐calculation approach that uses spatiotemporal age‐period‐cohort (APC) modeling to estimate incidence for spatial units within a region. The method is applied to state‐specific lung cancer data in the United States for males ages 30 to 84 in years 1975‐2004. SEER data are used to model cancer progression from incidence to mortality along three timescales (APC) and across four regions. Using mortality data from National Vital Statistics System, incidence is back‐calculated for unique birth cohorts in 49 states. A conditionally autoregressive model with cubic splines for temporal effects is used to smooth back‐calculated estimates. Bayesian estimates of model parameters are obtained using integrated nested Laplace approximation. Results show varying time trends in lung cancer risk across states, which may quantify effects of state policies.

SMMR Missing Data & Measurement Error Longitudinal Data Econometrics & Economics · 发表于 2018-08-27

Sensitivity analysis for non-monotone missing binary data in longitudinal studies: Application to the NIDA collaborative cocaine treatment study

Garrett M Fitzmaurice, Stuart R Lipsitz, Roger D Weiss

摘要

Conventional approaches for handling missingness in substance use disorder trials commonly rely upon a single deterministic “worst value” imputation that posits a perfect relationship between missingness and drug use (“missing value = presumed drug use”); this yields biased estimates of treatment effects and their standard errors. Instead, deterministic imputations should be replaced by probabilistic versions that encode researchers prior beliefs that those with missing data are more likely to be using drugs at those occasions. Motivated by this problem, we present a method for handling non-monotone missing binary data in longitudinal studies. Specifically, we consider a joint model that combines a not missing at random (NMAR) selection model with a generalized linear mixed model for longitudinal binary data. The selection model links the distribution of a missing outcome to the corresponding distribution of the outcome for those observed at that occasion via a fixed and known sensitivity parameter. The mixed model for longitudinal binary data assumes the random effects have bridge distributions; the latter yields regression parameters that have both subject-specific and marginal interpretations. This approach is completely transparent about what is being assumed about missing data and can be used as the basis for sensitivity analysis.

SMMR High-Dimensional Networks & Graphs · 发表于 2018-08-27

Robust identification of target genes and outliers in triple-negative breast cancer data

Pieter Segaert, Marta B Lopes, Sandra Casimiro, Susana Vinga, Peter J Rousseeuw

摘要

Correct classification of breast cancer subtypes is of high importance as it directly affects the therapeutic options. We focus on triple-negative breast cancer which has the worst prognosis among breast cancer types. Using cutting edge methods from the field of robust statistics, we analyze Breast Invasive Carcinoma transcriptomic data publicly available from The Cancer Genome Atlas data portal. Our analysis identifies statistical outliers that may correspond to misdiagnosed patients. Furthermore, it is illustrated that classical statistical methods may fail to identify outliers due to their heavy influence, prompting the need for robust statistics. Using robust sparse logistic regression we obtain 36 relevant genes, of which ca. 60% have been previously reported as biologically relevant to triple-negative breast cancer, reinforcing the validity of the method. The remaining 14 genes identified are new potential biomarkers for triple-negative breast cancer. Out of these, JAM3, SFT2D2, and PAPSS1 were previously associated to breast tumors or other types of cancer. The relevance of these genes is confirmed by the new DetectDeviatingCells outlier detection technique. A comparison of gene networks on the selected genes showed significant differences between triple-negative breast cancer and non-triple-negative breast cancer data. The individual role of FOXA1 in triple-negative breast cancer and non-triple-negative breast cancer, and the strong FOXA1-AGR2 connection in triple-negative breast cancer stand out. The goal of our paper is to contribute to the breast cancer/triple-negative breast cancer understanding and management. At the same time it demonstrates that robust regression and outlier detection constitute key strategies to cope with high-dimensional clinical data such as omics data.

JRSSB Networks & Graphs · 发表于 2018-08-26

Random-Walk Models of Network Formation and Sequential Monte Carlo Methods for Graphs

Benjamin Bloem-Reddy, Peter Orbanz

摘要

Summary: We introduce a class of generative network models that insert edges by connecting the starting and terminal vertices of a random walk on the network graph. Within the taxonomy of statistical network models, this class is distinguished by permitting the location of a new edge to depend explicitly on the structure of the graph, but being nonetheless statistically and computationally tractable. In the limit of infinite walk length, the model converges to an extension of the preferential attachment model—in this sense, it can be motivated alternatively by asking what preferential attachment is an approximation to. Theoretical properties, including the limiting degree sequence, are studied analytically. If the entire history of the graph is observed, parameters can be estimated by maximum likelihood. If only the final graph is available, its history can be imputed by using Markov chain Monte Carlo methods. We develop a class of sequential Monte Carlo algorithms that are more generally applicable to sequential network models and may be of interest in their own right. The model parameters can be recovered from a single graph generated by the model. Applications to data clarify the role of the random-walk length as a length scale of interactions within the graph.

JRSSB Nonparametric & Semiparametric · 发表于 2018-08-24

Full Likelihood Inference for Abundance from Continuous Time Capture–Recapture Data

Yang Liu, Yukun Liu, Pengfei Li, Jing Qin

摘要

Summary: Capture–recapture experiments are widely used cost-effective sampling techniques for estimating population sizes or abundances in biology, ecology, demography, epidemiology and reliability studies. For continuous time capture–recapture data, existing estimation methods are based on conditional likelihoods and an inverse weighting estimating equation. The corresponding Wald-type confidence intervals for the abundance may have severe undercoverage, and their lower limits can be below the number of individuals captured. We propose a full likelihood inference approach by combining a parametric or partial likelihood with the empirical likelihood. Under both parametric and semiparametric intensity models, we demonstrate that the maximum likelihood estimator attains the semiparametric efficiency lower bound and that the full likelihood ratio statistic for the abundance is asymptotically χ2 with 1 degree of freedom. Simulations indicate that compared with conditional-likelihood-based methods, the maximum full likelihood estimator has a smaller mean-square error, and the likelihood ratio confidence intervals often have remarkable gains in coverage probability. We illustrate the advantages of the proposed approach by analysing illegal immigrant data for the Netherlands and Prinia flaviventris data from Hong Kong.

第 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 页