2024 年的期刊文章 · 第 7 页

共 1515 篇,按发表时间排,新的在前,每页 40 篇。这一页是 2024-10-07 到 2024-09-29。

按期刊、按主题看 →

第 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 页

SMMR Survival Analysis Causal Inference · 发表于 2024-10-07

Sensitivity analysis for unmeasured confounding in estimating the difference in restricted mean survival time

Seungjae Lee, Ji Hoon Park, Woojoo Lee

摘要

The difference in restricted mean survival time has been increasingly used as an alternative measure to the hazard ratio in survival analysis. Although some statistical methods have been developed for estimating the difference in restricted mean survival time adjusted for measured confounders in observational studies, the impact of unmeasured confounding on the estimate has rarely been assessed. We develop a novel sensitivity analysis for the estimate of the difference in restricted mean survival time with respect to unmeasured confounding. After formulating the sensitivity analysis problem as an optimization problem, we explain how to obtain the sensitivity range of the difference in restricted mean survival time efficiently and assess its uncertainty using the percentile bootstrap confidence interval. Analytic results are provided for some important survival settings. Simulation studies show that the proposed methods perform well in various settings. We illustrate the proposed sensitivity analysis method by analyzing data from the German Breast Cancer Study Group study.

SMMR Longitudinal Data Survival Analysis Diagnostics & Prediction · 发表于 2024-10-07

Joint modeling of zero-inflated longitudinal measurements and time-to-event outcomes with applications to dynamic prediction

Mojtaba Ganjali, Taban Baghfalaki, Narayanaswamy Balakrishnan

摘要

In this article, we present a joint modeling approach for zero-inflated longitudinal count measurements and time-to-event outcomes. For the longitudinal sub-model, a mixed effects Hurdle model is utilized, incorporating various distributional assumptions such as zero-inflated Poisson, zero-inflated negative binomial, or zero-inflated generalized Poisson. For the time-to-event sub-model, a Cox proportional hazard model is applied. For the functional form linking the longitudinal outcome history to the hazard of the event, a linear combination is used. This combination is derived from the current values of the linear predictors of Hurdle mixed effects. Some other forms are also considered, including a linear combination of the current slopes of the linear predictors of Hurdle mixed effects as well as the shared random effects. A Markov chain Monte Carlo method is implemented for Bayesian parameter estimation. Dynamic prediction using joint modeling is highly valuable in personalized medicine, as discussed here for joint modeling of zero-inflated longitudinal count measurements and time-to-event outcomes. We assess and demonstrate the effectiveness of the proposed joint models through extensive simulation studies, with a specific emphasis on parameter estimation and dynamic predictions for both over-dispersed and under-dispersed data. We finally apply the joint model to longitudinal microbiome pregnancy and HIV data sets.

SiM Diagnostics & Prediction Missing Data & Measurement Error · 发表于 2024-10-07

Combining Biomarkers to Improve Diagnostic Accuracy in Detecting Diseases With Group‐Tested Data

Jin Yang, Wei Zhang, Paul S. Albert, Aiyi Liu, Zhen Chen

摘要

We consider the problem of combining multiple biomarkers to improve the diagnostic accuracy of detecting a disease when only group‐tested data on the disease status are available. There are several challenges in addressing this problem, including unavailable individual disease statuses, differential misclassification depending on group size and number of diseased individuals in the group, and extensive computation due to a large number of possible combinations of multiple biomarkers. To tackle these issues, we propose a pairwise model fitting approach to estimating the distribution of the optimal linear combination of biomarkers and its diagnostic accuracy under the assumption of a multivariate normal distribution. The approach is evaluated in simulation studies and applied to data on chlamydia detection and COVID‐19 diagnosis.

SiM Causal Inference · 发表于 2024-10-07

Causal Inference Over a Subpopulation: The Effect of Malaria Vaccine in Women During Pregnancy

Zonghui Hu, Dean Follmann

摘要

Preventing malaria during pregnancy is of critical importance, yet there are no approved malaria vaccines for pregnant women due to lack of efficacy results within this population. Conducting a randomized trial in pregnant women throughout the entire duration of pregnancy is impractical. Instead, a randomized trial was conducted among women of childbearing potential (WOCBP), and some participants became pregnant during the 2‐year study. We explore a statistical method for estimating vaccine effect within the target subpopulation—women who can naturally become pregnant, namely, women who can become pregnant under a placebo condition—within the causal inference framework. Two vaccine effect estimators are employed to effectively utilize baseline characteristics and account for the fact that certain baseline characteristics were only available from pregnant participants. The first estimator considers all participants but can only utilize baseline variables collected from the entire participant pool. In contrast, the second estimator, which includes only pregnant participants, utilizes all available baseline information. Both estimators are evaluated numerically through simulation studies and applied to the WOCBP trial to assess vaccine effect against pregnancy malaria.

SMMR Spatial & Time Series Bayesian Methods Survival Analysis · 发表于 2024-10-07

Analysis of recurrent event data with spatial random effects using a Bayesian approach

Jin Jin, Liuquan Sun, Huang-Tz Ou, Pei-Fang Su

摘要

Recurrent event data, which represent the occurrence of repeated incidences, are common in observational studies. Furthermore, collecting possible spatial correlations in health and environmental data is likely to provide more information for risk prediction. This article proposes a comprehensive proportional intensity model considering spatial random effects for recurrent event data using a Bayesian approach. The spatial information for areal data (where the spatial location is known up to a geographic unit such as a county) and georeferenced data (where the location is exactly observed) is examined. A traditional constant baseline intensity function, as well as a flexible piecewise constant baseline intensity function, are both under consideration. To estimate the parameters, a Markov chain Monte Carlo method with the Metropolis–Hastings algorithm and the adaptive Metropolis algorithm are applied. To assess the performance of model fitting, the deviance information criterion and log pseudo marginal likelihood are proposed. Overall, simulation studies demonstrate that the proposed model is significantly better than models that do not consider spatial effects if spatial correlations exist. Finally, our approach is implemented using a dataset related to the recurrence of cardiovascular diseases, which incorporates spatial information.

SMMR Latent Variables & Mixtures Longitudinal Data Causal Inference · 发表于 2024-10-07

A Bayesian beta-binomial piecewise growth mixture model for longitudinal overdispersed binomial data

Chun-Che Wen, Nathaniel Baker, Rajib Paul, Elizabeth Hill, Kelly Hunt, Hong Li, Kevin Gray, Brian Neelon

摘要

In a recent 12-week smoking cessation trial, varenicline tartrate failed to show significant improvements in enhancing end-of-treatment abstinence when compared with placebo among adolescents and young adults. The original analysis aimed to assess the average effect across the entire population using timeline followback methods, which typically involve overdispersed binomial counts. We instead propose to investigate treatment effect heterogeneity among latent classes of participants using a Bayesian beta-binomial piecewise linear growth mixture model specifically designed to address longitudinal overdispersed binomial responses. Within each class, we fit a piecewise linear beta-binomial mixed model with random changepoints for each study group to detect critical windows of treatment efficacy. Using this model, we can cluster subjects who share similar characteristics, estimate the class-specific mean abstinence trends for each study group, and quantify the treatment effect over time within each class. Our analysis identified two classes of subjects: one comprising high-abstinent individuals, typically young adults and light smokers, in which varenicline led to improved abstinence; and another comprising low-abstinent individuals for whom varenicline showed no discernible effect. These findings highlight the importance of tailoring varenicline to specific participant subgroups, thereby advancing precision medicine in smoking cessation studies.

SiM Causal Inference Functional Data Genetics & Omics · 发表于 2024-10-06

Estimating Time‐Varying Exposure Effects Through Continuous‐Time Modelling in Mendelian Randomization

Haodong Tian, Ashish Patel, Stephen Burgess

摘要

Mendelian randomization is an instrumental variable method that utilizes genetic information to investigate the causal effect of a modifiable exposure on an outcome. In most cases, the exposure changes over time. Understanding the time‐varying causal effect of the exposure can yield detailed insights into mechanistic effects and the potential impact of public health interventions. Recently, a growing number of Mendelian randomization studies have attempted to explore time‐varying causal effects. However, the proposed approaches oversimplify temporal information and rely on overly restrictive structural assumptions, limiting their reliability in addressing time‐varying causal problems. This article considers a novel approach to estimate time‐varying effects through continuous‐time modelling by combining functional principal component analysis and weak‐instrument‐robust techniques. Our method effectively utilizes available data without making strong structural assumptions and can be applied in general settings where the exposure measurements occur at different timepoints for different individuals. We demonstrate through simulations that our proposed method performs well in estimating time‐varying effects and provides reliable inference when the time‐varying effect form is correctly specified. The method could theoretically be used to estimate arbitrarily complex time‐varying effects. However, there is a trade‐off between model complexity and instrument strength. Estimating complex time‐varying effects requires instruments that are unrealistically strong. We illustrate the application of this method in a case study examining the time‐varying effects of systolic blood pressure on urea levels.

JRSSB Causal Inference · 发表于 2024-10-05

Long-term causal inference under persistent confounding via data combination

Guido Imbens, Nathan Kallus, Xiaojie Mao, Yuhao Wang

摘要

We study the identification and estimation of long-term treatment effects by combining short-term experimental data and long-term observational data subject to unobserved confounding. This problem arises often when concerned with long-term treatment effects since experiments are often short-term due to operational necessity while observational data can be more easily collected over longer time frames but may be subject to confounding. In this paper, we tackle the challenge of persistent confounding: unobserved confounders that can simultaneously affect the treatment, short-term outcomes, and long-term outcome. In particular, persistent confounding invalidates identification strategies in previous approaches to this problem. To address this challenge, we exploit the sequential structure of multiple short-term outcomes and develop several novel identification strategies for the average long-term treatment effect. Based on these, we develop estimation and inference methods with asymptotic guarantees. To demonstrate the importance of handling persistent confounders, we apply our methods to estimate the effect of a job training program on long-term employment using semi-synthetic data.

SiM Longitudinal Data · 发表于 2024-10-04

Regression Approaches to Assess Effect of Treatments That Arrest Progression of Symptoms

Ana M. Ortega‐Villa, Martha C. Nason, Michael P. Fay, Sara Alehashemi, Raphaela Goldbach‐Mansky, Dean A. Follmann

摘要

Motivated by a small sample example in neonatal onset multisystem inflammatory disease (NOMID), we propose a method that can be used when the interest is testing for an association between a changes in disease progression with start of treatment compared to historical disease progression prior to treatment. Our method estimates the longitudinal trajectory of the outcome variable and adds an interaction term between an intervention indicator variable and the time since initiation of the intervention. This method is appropriate for a situation in which the intervention slows or arrests the effect of the disease on the outcome, as is the case in our motivating example. By simulation in small samples and restricted sets of treatment initiation times, we show that the generalized estimating equations (GEE) formulation with small sample adjustments can bound the Type I error rate better than GEE and linear mixed models without small sample adjustments. Permutation tests (permuting the time of treatment initiation) is another valid approach that can also be useful. We illustrate the methodology through an application to a prospective cohort of NOMID patients enrolled at the NIH clinical center.

SMMR Bayesian Methods Latent Variables & Mixtures Clinical Trials · 发表于 2024-10-04

Enhancing DHA supplementation adherence: A Bayesian approach with finite mixture models and irregular interim schedules in adaptive trial designs

Sreejata Dutta, Samuel Boyd, Susan E Carlson, Danielle N Christifano, Gene T Lee, Sharla A Smith, Byron J Gajewski

摘要

Docosahexaenoic acid (DHA) supplementation has proven beneficial in reducing preterm births. However, the challenge lies in addressing nonadherence to prescribed supplementation regimens—a hurdle that significantly impacts clinical trial outcomes. Conventional methods of adherence estimation, such as pill counts and questionnaires, usually fall short when estimating adherence within a specific dosage group. Thus, we propose a Bayesian finite mixture model to estimate adherence among women with low baseline red blood cell phospholipid DHA levels (<6%) receiving higher DHA doses. In our model, adherence is defined as the proportion of participants classified into one of the two distinct components in a normal mixture distribution. Subsequently, based on the estimands from the adherence model, we introduce a novel Bayesian adaptive trial design. Unlike conventional adaptive trials that employ regularly spaced interim schedules, the novelty of our proposed trial design lies in its adaptability to adherence percentages across the treatment arm through irregular interims. The irregular interims in the proposed trial are based on the effect size estimation informed by the finite mixture model. In summary, this study presents innovative methods for leveraging the capabilities of Bayesian finite mixture models in adherence analysis and the design of adaptive clinical trials.

Biometrics Clinical Trials Bayesian Methods Optimization & Learning Theory · 发表于 2024-10-03

ROMI: a randomized two-stage basket trial design to optimize doses for multiple indications

Shuqi Wang, Peter F Thall, Kentaro Takeda, Ying Yuan

摘要

Optimizing doses for multiple indications is challenging. The pooled approach of finding a single optimal biological dose (OBD) for all indications ignores that dose-response or dose-toxicity curves may differ between indications, resulting in varying OBDs. Conversely, indication-specific dose optimization often requires a large sample size. To address this challenge, we propose a Randomized two-stage basket trial design that Optimizes doses in Multiple Indications (ROMI). In stage 1, for each indication, response and toxicity are evaluated for a high dose, which may be a previously obtained maximum tolerated dose, with a rule that stops accrual to indications where the high dose is unsafe or ineffective. Indications not terminated proceed to stage 2, where patients are randomized between the high dose and a specified lower dose. A latent-cluster Bayesian hierarchical model is employed to borrow information between indications, while considering the potential heterogeneity of OBD across indications. Indication-specific utilities are used to quantify response-toxicity trade-offs. At the end of stage 2, for each indication with at least one acceptable dose, the dose with highest posterior mean utility is selected as optimal. Two versions of ROMI are presented, one using only stage 2 data for dose optimization and the other optimizing doses using data from both stages. Simulations show that both versions have desirable operating characteristics compared to designs that either ignore indications or optimize dose independently for each indication.

SiM Survival Analysis · 发表于 2024-10-03

Pairwise Accelerated Failure Time Regression Models for Infectious Disease Transmission in Close‐Contact Groups With External Sources of Infection

Yushuf Sharker, Zaynab Diallo, Wasiur R. KhudaBukhsh, Eben Kenah

摘要

Many important questions in infectious disease epidemiology involve associations between covariates (e.g., age or vaccination status) and infectiousness or susceptibility. Because disease transmission produces dependent outcomes, these questions are difficult or impossible to address using standard regression models from biostatistics. Pairwise survival analysis handles dependent outcomes by calculating likelihoods in terms of contact interval distributions in ordered pairs of individuals. The contact interval in the ordered pair is the time from the onset of infectiousness in to infectious contact from to, where an infectious contact is sufficient to infect if they are susceptible. Here, we introduce a pairwise accelerated failure time regression model for infectious disease transmission that allows the rate parameter of the contact interval distribution to depend on individual‐level infectiousness covariates for, individual‐level susceptibility covariates for, and pair‐level covariates (e.g., type of relationship). This model can simultaneously handle internal infections (caused by transmission between individuals under observation) and external infections (caused by environmental or community sources of infection). We show that this model produces consistent and asymptotically normal parameter estimates. In a simulation study, we evaluate bias and confidence interval coverage probabilities, explore the role of epidemiologic study design, and investigate the effects of model misspecification. We use this regression model to analyze household data from Los Angeles County during the 2009 influenza A (H1N1) pandemic, where we find that the ability to account for external sources of infection increases the statistical power to estimate the effect of antiviral prophylaxis.

SiM Spatial & Time Series Latent Variables & Mixtures Optimization & Learning Theory · 发表于 2024-10-03

Latent Archetypes of the Spatial Patterns of Cancer

Thaís Pacheco Menezes, Marcos Oliveira Prates, Renato Assunção, Mônica Silva Monteiro De Castro

摘要

The cancer atlas edited by several countries is the main resource for the analysis of the geographic variation of cancer risk. Correlating the observed spatial patterns with known or hypothesized risk factors is time‐consuming work for epidemiologists who need to deal with each cancer separately, breaking down the patterns according to sex and race. The recent literature has proposed to study more than one cancer simultaneously looking for common spatial risk factors. However, this previous work has two constraints: they consider only a very small (2–4) number of cancers previously known to share risk factors. In this article, we propose an exploratory method to search for latent spatial risk factors of a large number of supposedly unrelated cancers. The method is based on the singular value decomposition and nonnegative matrix factorization, it is computationally efficient, scaling easily with the number of regions and cancers. We carried out a simulation study to evaluate the method's performance and apply it to cancer atlas from the USA, England, France, Australia, Spain, and Brazil. We conclude that with very few latent maps, which can represent a reduction of up to 90% of atlas maps, most of the spatial variability is conserved. By concentrating on the epidemiological analysis of these few latent maps a substantial amount of work is saved and, at the same time, high‐level explanations affecting many cancers simultaneously can be reached.

Biometrics Spatial & Time Series Genetics & Omics Bayesian Methods · 发表于 2024-10-03

Composite dyadic models for spatio-temporal data

Michael R Schwob, Mevin B Hooten, Vagheesh Narasimhan

摘要

Mechanistic statistical models are commonly used to study the flow of biological processes. For example, in landscape genetics, the aim is to infer spatial mechanisms that govern gene flow in populations. Existing statistical approaches in landscape genetics do not account for temporal dependence in the data and may be computationally prohibitive. We infer mechanisms with a Bayesian hierarchical dyadic model that scales well with large data sets and that accounts for spatial and temporal dependence. We construct a fully connected network comprising spatio-temporal data for the dyadic model and use normalized composite likelihoods to account for the dependence structure in space and time. We develop a dyadic model to account for physical mechanisms commonly found in physical-statistical models and apply our methods to ancient human DNA data to infer the mechanisms that affected human movement in Bronze Age Europe.

SMMR Spatial & Time Series · 发表于 2024-10-03

A useful parametric specification to model epidemiological data: Revival of the Richards’ curve

Marco Mingione, Pierfrancesco Alaimo Di Loro, Antonello Maruotti

摘要

A useful parametric specification for the expected value of an epidemiological process is revived, and its statistical and empirical efficacy are explored. The Richards’ curve is flexible enough to adapt to several growth phenomena, including recent epidemics and outbreaks. Here, two different estimation methods are described. The first, based on likelihood maximisation, is particularly useful when the outbreak is still ongoing and the main goal is to obtain sufficiently accurate estimates in negligible computational run-time. The second is fully Bayesian and allows for more ambitious modelling attempts such as the inclusion of spatial and temporal dependence, but it requires more data and computational resources. Regardless of the estimation approach, the Richards’ specification properly characterises the main features of any growth process (e.g. growth rate, peak phase etc.), leading to a reasonable fit and providing good short- to medium-term predictions. To demonstrate such flexibility, we show different applications using publicly available data on recent epidemics where the data collection processes and transmission patterns are extremely heterogeneous, as well as benchmark datasets widely used in the literature as illustrative.

AoS Networks & Graphs Optimization & Learning Theory · 发表于 2024-10-01

Wasserstein generative adversarial networks are minimax optimal distribution estimators

Arthur Stéphanovitch, Eddie Aamari, Clément Levrard

摘要

We provide nonasymptotic rates of convergence of the Wasserstein Generative Adversarial networks (WGAN) estimator. We build neural networks classes representing the generators and discriminators which yield a GAN that achieves the minimax optimal rate for estimating a certain probability measure μ with support in Rp. The probability μ is considered to be the push forward of the Lebesgue measure on the d-dimensional torus Td by a map g⋆:Td→Rp of smoothness β+1. Measuring the error with the γ-Hölder Integral Probability Metric (IPM), we obtain up to logarithmic factors, the minimax optimal rate O(n−β+γ2β+d∨n−12) where n is the sample size, β determines the smoothness of the target measure μ, γ is the smoothness of the IPM (γ=1 is the Wasserstein case) and d≤p is the intrinsic dimension of μ. In the process, we derive a sharp interpolation inequality between Hölder IPMs. This novel result of theory of functions spaces generalizes classical interpolation inequalities to the case where the measures involved have densities on different manifolds.

AoS High-Dimensional · 发表于 2024-10-01

Testing high-dimensional regression coefficients in linear models

Alex Zhao, Changcheng Li, Runze Li, Zhe Zhang

摘要

This paper is concerned with statistical inference for regression coefficients in high-dimensional linear regression models. We propose a new method for testing the coefficient vector of the high-dimensional linear models, and establish the asymptotic normality of our proposed test statistic with the aid of the martingale central limit theorem. We derive the asymptotical relative efficiency (ARE) of the proposed test with respect to the test proposed in Zhong and Chen (J. Amer. Statist. Assoc. 106 (2011) 260–274), and show that the ARE is always greater or equal to one under the local alternative studied in this paper. Our numerical studies imply that the proposed test with critical values derived from its asymptotical normal distribution may retain Type I error rate very well. Our numerical comparison demonstrates the proposed test performs better than existing ones in terms of powers. We further illustrate our proposed method with a real data example.

AoS Other · 发表于 2024-10-01

Spectral statistics of sample block correlation matrices

Zhigang Bao, Jiang Hu, Xiaocong Xu, Xiaozhuo Zhang

摘要

A fundamental concept in multivariate statistics, the sample correlation matrix, is often used to infer the correlation/dependence structure among random variables, when the population mean and covariance are unknown. A natural block extension of it, the sample block correlation matrix, is proposed to take on the same role, when random variables are generalized to random subvectors. In this paper, we establish a spectral theory of the sample block correlation matrices and apply it to group independent tests and related problems, under the high-dimensional setting. More specifically, we consider a random vector of dimension p, consisting of k subvectors of dimension pt’s, where pt’s can vary from 1 to order p. Our primary goal is to investigate the dependence of the k subvectors. We construct a random matrix model called sample block correlation matrix based on N samples for this purpose. The spectral statistics of the sample block correlation matrix include the classical Wilks’ statistic and Schott’s statistic as special cases. It turns out that the spectral statistics do not depend on the unknown population mean and covariance, under the null hypothesis that the subvectors are independent. Further, the limiting behavior of the spectral statistics can be described with the aid of the free probability theory. Specifically, under three different settings of possibly N-dependent k and pt’s, we show that the empirical spectral distribution of the sample block correlation matrix converges to the free Poisson binomial distribution, free Poisson distribution (Marchenko–Pastur law) and free Gaussian distribution (semicircle law), respectively. We then further derive the CLTs for the linear spectral statistics of the block correlation matrix under a general setting. Our results are established under the general distribution assumption on the random vector. It turns out that the CLTs are universal and do not depend on the 4th cumulants of the vector components, due to a self-normalizing effect of the correlation-type matrices. We further derive the CLT under the alternative hypothesis and discuss the power of our statistics. Based on our theory, real data analysis on stock return data and gene data is also conducted.

AoS Testing & Uncertainty Spatial & Time Series · 发表于 2024-10-01

Simultaneous statistical inference for second order parameters of time series under weak conditions

Yunyi Zhang, Efstathios Paparoditis, Dimitris N. Politis

摘要

Strict stationarity is an assumption commonly used in time-series analysis in order to derive asymptotic distributional results for second-order statistics, like sample autocovariances and sample autocorrelations. Focusing on weak stationarity, this paper derives the asymptotic distribution of the maximum of sample autocovariances and sample autocorrelations under weak conditions by using Gaussian approximation techniques. The asymptotic theory for parameter estimators obtained by fitting a (linear) autoregressive model to a general weakly stationary time series is revisited and a Gaussian approximation theorem for the maximum of the estimators of the autoregressive coefficients is derived. To perform statistical inference for the aforementioned second-order parameters of interest, a bootstrap algorithm, the so-called second-order wild bootstrap is applied. Consistency of the bootstrap procedure is proven without imposing strict stationary conditions or structural process assumptions, like linearity. The good finite sample performance of the second-order wild bootstrap is demonstrated by means of simulations.

AoS Survey & Sampling · 发表于 2024-10-01

Quantile processes and their applications in finite populations

Anurag Dey, Probal Chaudhuri

摘要

The weak convergence of the quantile processes, which are constructed based on different estimators of the finite population quantiles, is shown under various well-known sampling designs based on a superpopulation model. The results related to the weak convergence of these quantile processes are applied to find asymptotic distributions of the smooth L-estimators and the estimators of smooth functions of finite population quantiles. Based on these asymptotic distributions, confidence intervals are constructed for several finite population parameters like the median, the α-trimmed means, the interquartile range and the quantile based measure of skewness. Comparisons of various estimators are carried out based on their asymptotic distributions. We show that the use of the auxiliary information in the construction of the estimators sometimes has an adverse effect on the performances of the smooth L-estimators and the estimators of smooth functions of finite population quantiles under several sampling designs. Further, the performance of each of the above-mentioned estimators sometimes becomes worse under sampling designs, which use the auxiliary information, than their performances under simple random sampling without replacement (SRSWOR).

AoS Nonparametric & Semiparametric · 发表于 2024-10-01

Optimal policy evaluation using kernel-based temporal difference methods

Yaqi Duan, Mengdi Wang, Martin J. Wainwright

摘要

We study nonparametric methods for estimating the value function of an infinite-horizon discounted Markov reward process (MRP). We analyze the kernel-based least-squares temporal difference (LSTD) estimate, which can be understood either as a nonparametric instrumental variables method, or as a projected approximation to the Bellman fixed point equation. Our analysis imposes no assumptions on the transition operator of the Markov chain, but rather only conditions on the reward function and population-level kernel LSTD solutions. Using empirical process theory and concentration inequalities, we establish a nonasymptotic upper bound on the error with explicit dependence on the effective horizon H=(1−γ)−1 of the Markov reward process, the eigenvalues of the associated kernel operator, as well as the instance-dependent variance of the Bellman residual error. In addition, we prove minimax lower bounds over subclasses of MRPs, which shows that our guarantees are optimal in terms of the sample size n and the effective horizon H. Whereas existing worst-case theory predicts cubic scaling (H3) in the effective horizon, our theory reveals a much wider range of scalings, depending on the kernel, the stationary distribution, and the variance of the Bellman residual error. Notably, it is only parametric and near-parametric problems that can ever achieve the worst-case cubic scaling.

AoS Testing & Uncertainty · 发表于 2024-10-01

On the existence of powerful p-values and e-values for composite hypotheses

Zhenyuan Zhang, Aaditya Ramdas, Ruodu Wang

摘要

Given a composite null P and composite alternative Q, when and how can we construct a p-value whose distribution is exactly uniform under the null, and stochastically smaller than uniform under the alternative? Similarly, when and how can we construct an e-value whose expectation exactly equals one under the null, but its expected logarithm under the alternative is positive? We answer these basic questions, and other related ones, when P and Q are convex polytopes (in the space of probability measures). We prove that such constructions are possible if and only if Q does not intersect the span of P. If the p-value is allowed to be stochastically larger than uniform under P∈P, and the e-value can have expectation at most one under P∈P, then it is achievable whenever P and Q are disjoint. More generally, even when P and Q are not polytopes, we characterize the existence of a bounded nontrivial e-variable whose expectation exactly equals one under any P∈P. The proofs utilize recently developed techniques in simultaneous optimal transport. A key role is played by coarsening the filtration: sometimes, no such p-value or e-value exists in the richest data filtration, but it does exist in some reduced filtration, and our work provides the first general characterization of this phenomenon. We also provide an iterative construction that explicitly constructs such processes, and under certain conditions it finds the one that grows fastest under a specific alternative Q. We discuss implications for the construction of composite nonnegative (super)martingales, and end with some conjectures and open problems.

AoS Nonparametric & Semiparametric High-Dimensional · 发表于 2024-10-01

Multivariate trend filtering for lattice data

Veeranjaneyulu Sadhanala, Yu-Xiang Wang, Addison J. Hu, Ryan J. Tibshirani

摘要

We study a multivariate version of trend filtering, called Kronecker trend filtering or KTF, for the case in which the design points form a lattice in d dimensions. KTF is a natural extension of univariate trend filtering (Int. J. Comput. Vis. 70 (2006) 214–255; SIAM Rev. 51 (2009) 339–360; Ann. Statist. 42 (2014) 285–323), and is defined by minimizing a penalized least squares problem whose penalty term sums the absolute (higher-order) differences of the parameter to be estimated along each of the coordinate directions. The corresponding penalty operator can be written in terms of Kronecker products of univariate trend filtering penalty operators, hence the name Kronecker trend filtering. Equivalently, one can view KTF in terms of an ℓ1-penalized basis regression problem where the basis functions are tensor products of falling factorial functions, which is a piecewise polynomial (discrete spline) basis that underlies univariate trend filtering. This paper is a unification and extension of the results in (In Advances in Neural Information Processing Systems (2016); in Advances in Neural Information Processing Systems (2017)). We develop a complete set of theoretical results that describe the behavior of kth-order Kronecker trend filtering in d dimensions, for every k≥0 and d≥1. This reveals a number of interesting phenomena, including the dominance of KTF over linear smoothers in estimating heterogeneously smooth functions, and a phase transition at d=2(k+1), a boundary past which (on the high dimension-to-smoothness side) linear smoothers fail to be consistent entirely. We also leverage recent results on discrete splines from (Tibshirani (2020)), in particular, discrete spline interpolation results that enable us to extend the KTF estimate to any off-lattice location in constant-time (independent of the size of the lattice n).

AoS Latent Variables & Mixtures · 发表于 2024-10-01

Leave-one-out singular subspace perturbation analysis for spectral clustering

Anderson Y. Zhang, Harrison Y. Zhou

摘要

The singular subspaces perturbation theory is of fundamental importance in probability and statistics. It has various applications across different fields. We consider two arbitrary matrices where one is a leave-one-column-out submatrix of the other one and establish a novel perturbation upper bound for the distance between the two corresponding singular subspaces. It is well suited for mixture models and results in a sharper and finer statistical analysis than classical perturbation bounds such as Wedin’s theorem. Empowered by this leave-one-out perturbation theory, we provide a deterministic entrywise analysis for the performance of spectral clustering under mixture models. Our analysis leads to an explicit exponential error rate for spectral clustering of sub-Gaussian mixture models. For the mixture of isotropic Gaussians, the rate is optimal under a weaker signal-to-noise condition than that of Löffler et al. (2021).

AoS Other · 发表于 2024-10-01

Joint sequential detection and isolation for dependent data streams

Anamitra Chaudhuri, Georgios Fellouris

摘要

The problem of joint sequential detection and isolation is considered in the context of multiple, not necessarily independent, data streams. A multiple testing framework is proposed, where each hypothesis corresponds to a different subset of data streams, the sample size is a stopping time of the observations, and the probabilities of four kinds of error are controlled below distinct, user-specified levels. Two of these errors reflect the detection component of the formulation, whereas the other two the isolation component. The optimal expected sample size is characterized to a first-order asymptotic approximation as the error probabilities go to 0. Different asymptotic regimes, expressing different prioritizations of the detection and isolation tasks, are considered. A novel, versatile family of testing procedures is proposed, in which two distinct, in general, statistics are computed for each hypothesis, one addressing the detection task and the other the isolation task. Tests in this family, of various computational complexities, are shown to be asymptotically optimal under different setups. The general theory is applied to the detection and isolation of anomalous, not necessarily independent, data streams, as well as to the detection and isolation of an unknown dependence structure.

AoS Other · 发表于 2024-10-01

Improved covariance estimation: Optimal robustness and sub-Gaussian guarantees under heavy tails

Roberto I. Oliveira, Zoraida F. Rico

摘要

We present an estimator of the covariance matrix Σ of random d-dimensional vector from an i.i.d. sample of size n. Our sole assumption is that this vector satisfies a bounded Lp−L2 moment assumption over its one-dimensional marginals, for some p≥4. Given this, we show that Σ can be estimated from the sample with the same high-probability error rates that the sample covariance matrix achieves in the case of Gaussian data. This holds even though we allow for very general distributions that may not have moments of order > p. Moreover, our estimator can be made to be optimally robust to adversarial contamination. This result improves the recent contributions by Mendelson and Zhivotovskiy and Catoni and Giulini, and matches parallel work by Abdalla and Zhivotovskiy (the exact relationship with this last work is described in the paper).

AoS Spatial & Time Series · 发表于 2024-10-01

Gaussian approximation for nonstationary time series with optimal rate and explicit construction

Soham Bonnerjee, Sayar Karmakar, Wei Biao Wu

摘要

Statistical inference for time series such as curve estimation for time-varying models or testing for existence of a change point have garnered significant attention. However, these works are generally restricted to the assumption of independence and/or stationarity at its best. The main obstacle is that the existing Gaussian approximation results for nonstationary processes only provide an existential proof, and thus they are difficult to apply. In this paper, we provide two clear paths to construct such a Gaussian approximation for nonstationary series. While the first one is theoretically more natural, the second one is practically implementable. Our Gaussian approximation results are applicable for a very large class of nonstationary time series, obtain optimal rates and yet have good applicability. Building on such approximations, we also show theoretical results for change-point detection and simultaneous inference in presence of nonstationary errors. Finally, we substantiate our theoretical results with simulation studies and real data analysis.

AoS Other · 发表于 2024-10-01

Exact minimax optimality of spectral methods in phase synchronization and orthogonal group synchronization

Anderson Ye Zhang

摘要

We study the performance of the spectral method for the phase synchronization problem with additive Gaussian noises and incomplete data. The spectral method utilizes the leading eigenvector of the data matrix followed by a normalization step. We prove that it achieves the minimax lower bound of the problem with a matching leading constant under a squared ℓ2 loss. This shows that the spectral method has the same performance as more sophisticated procedures including maximum likelihood estimation, generalized power method, and semidefinite programming, as long as consistent parameter estimation is possible. To establish our result, we first have a novel choice of the population eigenvector, which enables us to establish the exact recovery of the spectral method when there is no additive noise. We then develop a new perturbation analysis toolkit for the leading eigenvector and show it can be well-approximated by its first-order approximation with a small ℓ2 error. We further extend our analysis to establish the exact minimax optimality of the spectral method for the orthogonal group synchronization.

AoS Bayesian Methods Nonparametric & Semiparametric · 发表于 2024-10-01

Estimating a density near an unknown manifold: A Bayesian nonparametric approach

Clément Berenfeld, Paul Rosa, Judith Rousseau

摘要

We study the Bayesian density estimation of data living in the offset of an unknown submanifold of the Euclidean space. In this perspective, we introduce a new notion of anisotropic Hölder for the underlying density and obtain posterior rates that are minimax optimal and adaptive to the regularity of the density, to the intrinsic dimension of the manifold, and to the size of the offset, provided that the latter is not too small—while still allowed to go to zero. Our Bayesian procedure, based on location-scale mixtures of Gaussians, appears to be convenient to implement and yields good practical results, even for quite singular data. *(abstract via OpenAlex)*

AoS High-Dimensional · 发表于 2024-10-01

Environment invariant linear least squares

Jianqing Fan, Cong Fang, Yihong Gu, Tong Zhang

摘要

This paper considers a multi-environment linear regression model in which data from multiple experimental settings are collected. The joint distribution of the response variable and covariates may vary across different environments, yet the conditional expectations of the response variable, given the unknown set of important variables, are invariant. Such a statistical model is related to the problem of endogeneity, causal inference, and transfer learning. The motivation behind it is illustrated by how the goals of prediction and attribution are inherent in estimating the true parameter and the important variable set. We construct a novel environment invariant linear least squares (EILLS) objective function, a multi-environment version of linear least squares regression that leverages the above conditional expectation invariance structure and heterogeneity among different environments to determine the true parameter. Our proposed method is applicable without any additional structural knowledge and can identify the true parameter under a near-minimal identification condition related to the heterogeneity of the environments. We establish nonasymptotic ℓ2 error bounds on the estimation error for the EILLS estimator in the presence of spurious variables. Moreover, we further show that the ℓ0 penalized EILLS estimator can achieve variable selection consistency in high-dimensional regimes. These nonasymptotic results demonstrate the sample efficiency of the EILLS estimator and its capability to circumvent the curse of endogeneity in an algorithmic manner without any additional prior structural knowledge. To the best of our knowledge, this paper is the first to realize statistically efficient invariance learning in the general linear model.

AoS Other · 发表于 2024-10-01

Efficiency in local differential privacy

Lukas Steinberger

摘要

We develop a theory of asymptotic efficiency in regular parametric models when data confidentiality is ensured by local differential privacy (LDP). Even though efficient parameter estimation is a classical and well-studied problem in mathematical statistics, it leads to several nontrivial obstacles that need to be tackled when dealing with the LDP case. Starting from a regular parametric model P=(Pθ)θ∈Θ, Θ⊆Rp, for the i.i.d. unobserved sensitive data X1,…,Xn, we establish local asymptotic mixed normality (along subsequences) of the model Q(n)P=(Q(n)Pθn)θ∈Θ generating the sanitized observations Z1,…,Zn, where Q(n) is an arbitrary sequence of sequentially interactive privacy mechanisms. This result readily implies convolution and local asymptotic minimax theorems. In case p=1, the optimal asymptotic variance is found to be the inverse of the supremal Fisher information supQ∈QαIθ(QP)∈R, where the supremum runs over all α-differentially private (marginal) Markov kernels. We present an algorithm for finding a (nearly) optimal privacy mechanism Qˆ and an estimator θˆn(Z1,…,Zn) based on the corresponding sanitized data that achieves this asymptotically optimal variance.

AoS Causal Inference High-Dimensional · 发表于 2024-10-01

Debiased inverse propensity score weighting for estimation of average treatment effects with high-dimensional confounders

Yuhao Wang, Rajen D. Shah

摘要

We consider estimation of average treatment effects given observational data with high-dimensional pretreatment variables. Existing methods for this problem typically assume some form of sparsity for the regression functions. In this work, we introduce a debiased inverse propensity score weighting (DIPW) scheme for average treatment effect estimation that delivers n-consistent estimates when the propensity score follows a sparse logistic regression model; the outcome regression functions are permitted to be arbitrarily complex. We further demonstrate how confidence intervals centred on our estimates may be constructed. Our theoretical results quantify the price to pay for permitting the regression functions to be unestimable, which shows up as an inflation of the variance of the estimator compared to the semiparametric efficient variance by a constant factor, under mild conditions. We also show that when outcome regressions can be estimated consistently, our estimator achieves semiparametric efficiency. As our results accommodate arbitrary outcome regression functions, averages of transformed responses under each treatment may also be estimated at the n rate. Thus, for example, the variances of the potential outcomes may be estimated. We discuss extensions to estimating linear projections of the heterogeneous treatment effect function and explain how propensity score models with more general link functions may be handled within our framework. An R package dipw implementing our methodology is available on CRAN.

AoS Networks & Graphs · 发表于 2024-10-01

Computational lower bounds for graphon estimation via low-degree polynomials

Yuetian Luo, Chao Gao

摘要

Graphon estimation has been one of the most fundamental problems in network analysis and has received considerable attention in the past decade. From the statistical perspective, the minimax error rate of graphon estimation has been established by (Ann. Statist. 43 (2015) 2624–2652) for both stochastic block model (SBM) and nonparametric graphon estimation. The statistical optimal estimators are based on constrained least squares and have computational complexity exponential in the dimension. From the computational perspective, the best-known, polynomial-time estimator is based on universal singular value thresholding (USVT), but it can only achieve a much slower estimation error rate than the minimax one. It is natural to wonder if such a gap is essential. The computational optimality of the USVT or the existence of a computational barrier in graphon estimation has been a long-standing open problem. In this work, we take the first step toward it and provide rigorous evidence for the computational barrier in graphon estimation via low-degree polynomials. Specifically, in SBM graphon estimation, we show that for low-degree polynomial estimators, their estimation error rates cannot be significantly better than that of the USVT under a wide range of parameter regimes and in nonparametric graphon estimation, we show low-degree polynomial estimators achieve estimation error rates strictly slower than the minimax rate. Our results are proved based on the recent development of low-degree polynomials by (Ann. Statist. 50 (2022) 1833–1858), while we overcome a few key challenges in applying it to the general graphon estimation problem. By leveraging our main results, we also provide a computational lower bound on the clustering error for community detection in SBM with a growing number of communities and this yields a new piece of evidence for the conjectured Kesten–Stigum threshold for efficient community recovery. Finally, we extend our computational lower bounds to sparse graphon estimation and biclustering with additive Gaussian noise, and provide discussion on the optimality of our results.

AoS Other · 发表于 2024-10-01

Computational and statistical thresholds in multi-layer stochastic block models

Jing Lei, Anru R. Zhang, Zihan Zhu

摘要

We study the problem of community recovery and detection in multi-layer stochastic block models, focusing on the critical network density threshold for consistent community structure inference. Using a prototypical two-block model, we reveal a computational barrier for such multilayer stochastic block models that does not exist for its single-layer counterpart: When there are no computational constraints, the density threshold depends linearly on the number of layers. However, when restricted to polynomial-time algorithms, the density threshold scales with the square root of the number of layers, assuming correctness of a low-degree polynomial hardness conjecture. Our results provide a nearly complete picture of the optimal inference in multiple-layer stochastic block models and partially settle the open question in (J. Amer. Statist. Assoc. 118 (2023) 2433–2445) regarding the optimality of the bias-adjusted spectral method.

AoS Nonparametric & Semiparametric · 发表于 2024-10-01

A nonparametric test for elliptical distribution based on kernel embedding of probabilities

Yin Tang, Bing Li

摘要

Elliptical distribution is a basic assumption underlying many multivariate statistical methods. For example, in sufficient dimension reduction and statistical graphical models, this assumption is routinely imposed to simplify the data dependence structure. Before applying such methods, we need to decide whether the data are elliptically distributed. Currently existing tests either focus exclusively on spherical distributions, or rely on bootstrap to determine the null distribution, or require specific forms of the alternative distribution. In this paper, we introduce a general nonparametric test for elliptical distribution based on kernel embedding of the probability measure that embodies the two properties that characterize an elliptical distribution: namely, after centering and rescaling, (1) the direction and length of the random vector are independent, and (2) the directional vector is uniformly distributed on the unit sphere. We derive the asymptotic distributions of the test statistic via von Mises expansion, develop the sample-level procedure to determine the rejection region, and establish the consistency and validity of the proposed test. We also develop the concentration bounds of the test statistic, allowing the dimension to grow with the sample size, and further establish the consistency in this high-dimension setting. We compare our method with several existing methods via simulation studies, and apply our test to a SENIC dataset with and without a transformation aimed to achieve ellipticity.

AoS High-Dimensional · 发表于 2024-10-01

A new test for high-dimensional two-sample mean problems with consideration of correlation structure

Songshan Yang, Shurong Zheng, Runze Li

摘要

This paper is concerned with high-dimensional two-sample mean problems, which receive considerable attention in recent literature. To utilize the correlation information among variables for enhancing the power of two-sample mean tests, we consider the setting in which the precision matrix of high-dimensional data possesses a linear structure. Thus, we first propose a new precision matrix estimation procedure with considering its linear structure, and further develop regularization methods to select the true basis matrices and remove irrelevant basis matrices. With the aid of an estimated precision matrix, we propose a new test statistic for the two-sample mean problems by replacing the inverse of sample covariance matrix in the Hotelling test by the estimated precision matrix. The proposed test is applicable for both the low-dimensional setting and high-dimensional setting even if the dimension of the data exceeds the sample size. The limiting null distributions of the proposed test statistic under both null and alternative hypotheses are derived. We further derive the asymptotical power function of the proposed test and compare its asymptotic power with some existing tests. We find the estimation error of the precision matrix does not have impact on the asymptotical power function. Moreover, asymptotic relative efficiency of the proposed test to the classical Hotelling test tends to infinity when the ratio of the dimension of data to the sample size tends to 1. We conduct a Monte Carlo simulation study to assess the finite sample performance of the proposed precision matrix estimation procedure and the proposed high-dimensional two-sample mean test. Our numerical results imply that the proposed regularization method is able to effectively remove irrelevant basis matrices. The proposed test performs well compared with the existing methods especially when the elements of the vector have unequal variances. We also illustrate the proposed methodology by an empirical analysis of a real-world data set.

AoS Testing & Uncertainty · 发表于 2024-10-01

A conformal test of linear models via permutation-augmented regressions

Leying Guan

摘要

Permutation tests are widely recognized as robust alternatives to tests based on normal theory. Random permutation tests have been frequently employed to assess the significance of variables in linear models. Despite their widespread use, existing random permutation tests lack finite-sample and assumption-free guarantees for controlling type I error in partial correlation tests. To address this ongoing challenge, we have developed a conformal test through permutation-augmented regressions, which we refer to as PALMRT. PALMRT not only achieves power competitive with conventional methods but also provides reliable control of type I errors at no more than 2α, given any targeted level α, for arbitrary fixed designs and error distributions. We have confirmed this through extensive simulations. Compared to the cyclic permutation test (CPT) and residual permutation test (RPT), which also offer theoretical guarantees, PALMRT does not compromise as much on power or set stringent requirements on the sample size, making it suitable for diverse biomedical applications. We further illustrate the differences in a long-Covid study where PALMRT validated key findings previously identified using the t-test after multiple corrections, while both CPT and RPT suffered from a drastic loss of power and failed to identify any discoveries. We endorse PALMRT as a robust and practical hypothesis test in scientific research for its superior error control, power preservation, and simplicity.

AoS Nonparametric & Semiparametric · 发表于 2024-10-01

A Gaussian process approach to model checks

Juan Carlos Escanciano

摘要

This paper proposes a Gaussian process (GP) approach for testing conditional moment restrictions. Tests are based on squared Neyman orthogonal function-parametric processes integrated with respect to a GP distribution. This methodology leads to a general unified framework of kernel-based tests having the following properties: (i) bootstrap tests are easy to implement in the presence of nuisance parameters (they are simple quadratic forms, and there is no need to reestimate the nuisance parameters in each bootstrap replication); and (ii) the new tests are valid under general conditions, including higher-order conditional moments of unknown form, regularized estimators (e.g., Lasso) or parameters at the boundary of the parameter space. Novel applications include distance kernel tests for zero conditional treatment effects. The paper introduces Neyman orthogonal kernels, a new asymptotic theory and a detailed local power analysis. Monte Carlo experiments and a real data application illustrate the sensitivity of tests to the dimension of covariates and to the mean and covariance kernel of the GP.

SMMR Other · 发表于 2024-09-30

On the estimation of population size—A comparison of capture-recapture and multiplier-benchmark methods

Jianing Wang, David M Kline, Laura Forsberg White

摘要

Approaches to population size estimation are of importance across a wide spectrum of disciplines, especially when census and simple random sampling are impractical. The capture-recapture method and the multiplier-benchmark method are two commonly used approaches that use data that partially capture the target population and overlap in a known way. Due to similarities in required data structures, the approaches are often used interchangeably without a critical appraisal of the underlying assumptions, especially in the two-sample case. Here, we describe the similarities and differences of the sampling mechanisms and assumptions underlying both approaches. We emphasize that the capture-recapture method assumes data sources as random samples and describes two-way inclusion histories, while in multiplier-benchmark method, one source captures a fixed sub-population, and the one-way inclusion histories are modeled. We also discuss the implications of these differences through simulation and real data to guide the choice of method in practice. A careful study of the data structures, relationships, and data generation processes is crucial for assessing the appropriateness of using these methods.

SiM Survival Analysis Machine Learning Networks & Graphs · 发表于 2024-09-29

Weighted Expectile Regression Neural Networks for Right Censored Data

Feipeng Zhang, Xi Chen, Peng Liu, Caiyun Fan

摘要

As a favorable alternative to the censored quantile regression, censored expectile regression has been popular in survival analysis due to its flexibility in modeling the heterogeneous effect of covariates. The existing weighted expectile regression (WER) method assumes that the censoring variable and covariates are independent, and that the covariates effects has a global linear structure. However, these two assumptions are too restrictive to capture the complex and nonlinear pattern of the underlying covariates effects. In this article, we developed a novel weighted expectile regression neural networks (WERNN) method by incorporating the deep neural network structure into the censored expectile regression framework. To handle the random censoring, we employ the inverse probability of censoring weighting (IPCW) technique in the expectile loss function. The proposed WERNN method is flexible enough to fit nonlinear patterns and therefore achieves more accurate prediction performance than the existing WER method for right censored data. Our findings are supported by extensive Monte Carlo simulation studies and a real data application.

第 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 页