研究园简易版 · 经典书籍 · 期刊文章 · 有原文 · 完整版(可多选筛选、搜索) · 首页
2025 年的期刊文章 · 第 7 页
共 1491 篇,按发表时间排,新的在前,每页 40 篇。这一页是 2025-10-08 到 2025-09-30。
按期刊、按主题看 →
Biometrics Longitudinal Data · 发表于 2025-10-08
Eleanor M Pullenayegum, Di Shan
摘要
Longitudinal data are often subject to irregular and informative visit times. Weighting generalized estimating equations by the inverse of the visit rate yields asymptotically unbiased estimates of regression coefficients provided that outcomes and visit times are conditionally independent, given the covariates in the visit model. Adding other covariates has no impact on the asymptotic bias of estimated regression coefficients, provided that conditional independence is maintained, but the impact on their variances is unknown. We show that variances are unchanged on adding variables associated with neither outcome nor visit process, and decrease on adding variables associated with outcome but not visit process. Adding variables associated with visits but not outcome may either increase or decrease variances of estimated outcome model regression coefficients, depending on the correlation structure of the covariates and the outcome. Application to a study of major depressive disorder found that the variances of estimated regression coefficients were of a similar magnitude when predictors of outcome but not visits were added to the visit rate model but consistently larger, in some cases by a factor of 2, on adding predictors of visits but not outcome. We recommend that visit process models include variables associated with outcome, but that those unassociated with the outcome be treated with caution.
Biometrics Causal Inference · 发表于 2025-10-08
Jieru Shi, Walter Dempsey
摘要
Advances in wearable technologies and health interventions delivered by smartphones have greatly increased the accessibility of mobile health (mHealth) interventions. Micro-randomized trials (MRTs) are designed to assess the effectiveness of the mHealth intervention and introduce a novel class of causal estimands called “causal excursion effects.” These estimands enable the evaluation of how intervention effects change over time and are influenced by individual characteristics or context. Existing methods for analyzing causal excursion effects assume known randomization probabilities, complete observations, and a linear nuisance function with prespecified features of the high-dimensional observed history. However, in complex mobile systems, these assumptions often fall short: randomization probabilities can be uncertain, observations may be incomplete, and the granularity of mHealth data makes linear modeling difficult. To address this issue, we propose a flexible and doubly robust inferential procedure, called “DR-WCLS,” for estimating causal excursion effects from a meta-learner perspective. We present the bidirectional asymptotic properties of the proposed estimators and compare them with existing methods both theoretically and through extensive simulations. The results show a consistent and more efficient estimate, even with missing observations or uncertain treatment randomization probabilities. Finally, the practical utility of the proposed methods is demonstrated by analyzing data from a multi-institution cohort of first-year medical residents in the United States.
SiM Survey & Sampling Causal Inference · 发表于 2025-10-07
Stephen Salerno, Emily K. Roberts, Belinda L. Needham, Tyler H. McCormick, Fan Li, Bhramar Mukherjee, Xu Shi
摘要
In this work, we are motivated by the problem of estimating racial disparities in health outcomes, specifically the average controlled difference (ACD) in telomere length between Black and White individuals, using data from the National Health and Nutrition Examination Survey (NHANES). To do so, we build a propensity for race to properly adjust for other social determinants while characterizing the controlled effect of race on telomere length. Propensity score methods are broadly employed with observational data as a tool to achieve covariate balance, but how to implement them in complex surveys is less studied—in particular, when the survey weights depend on the group variable under comparison (as the NHANES sampling scheme depends on self‐reported race). We propose identification formulas to properly estimate the ACD in outcomes between Black and White individuals, with appropriate weighting for both covariate imbalance across the two racial groups and generalizability . Via extensive simulation, we show that our proposed methods outperform traditional analytic approaches in terms of bias, mean squared error, and coverage when estimating the ACD for our setting of interest. In our data, we find that evidence of racial differences in telomere length between Black and White individuals attenuates after accounting for confounding by socioeconomic factors and utilizing appropriate propensity score and survey weighting techniques. Software to implement these methods and code to reproduce our results can be found in the R package svycdiff , available through the Comprehensive R Archive Network (CRAN) at cran.r‐project.org/web/packages/svycdiff/ , or in a development version on GitHub at github.com/salernos/svycdiff .
SiM Missing Data & Measurement Error Longitudinal Data · 发表于 2025-10-07
James F. Troendle, Aparajita Sur, Eric S. Leifer, Tiffany Powell‐Wiley
摘要
We discuss practical aspects of conducting sensitivity analyses for missing data with a repeatedly measured outcome. Our motivation is a SMART trial with a repeatedly measured outcome subject to missingness. We discuss and describe delta‐based controlled imputation approaches to conducting sensitivity analyses for such trials that typically use linear mixed models for their primary analysis. We find that delta‐based sensitivity analyses for trials with repeatedly measured outcome variables are enhanced by using MICE for the imputation. Further, including last‐observed‐before‐time covariates is critical for a repeatedly observed outcome. We also develop some novel metrics for judging the adequacy of sensitivity analyses. Trial Registration: Tailoring Mobile Health Technology to Reduce Obesity and Improve Cardiovascular Health in Resource‐Limited Neighborhood Environments: NCT03288207.
SiM Survival Analysis · 发表于 2025-10-07
Xin Chen, Jieli Ding, Liuquan Sun
摘要
Recurrent event data with dependent censoring frequently arise in medical follow‐up studies. In analyzing such data, one main challenge is addressing the complex dependencies among the recurrent events, failure events, and censoring events. In this paper, we focus on additive shared‐frailty models for recurrent event processes and failure times, and propose a robust estimation procedure that accommodates censoring times dependent on both recurrent and failure events, even after conditioning on observed covariates. Notably, our method does not require specifying the exact dependence structure between censoring and recurrent/failure times, nor does it assume a particular frailty distribution. We show that the resulting estimates are consistent and asymptotically normal. We further assess the method's finite‐sample performance through simulation studies, and illustrate its practical utility with a hospitalization dataset.
SiM Causal Inference Diagnostics & Prediction · 发表于 2025-10-07
Christopher B. Boyer, Issa J. Dahabreh, Jon A. Steingrimsson
摘要
Counterfactual prediction methods are required when a model will be deployed in a setting where treatment policies differ from the setting where the model was developed, or when a model provides predictions under hypothetical interventions to support decision‐making. However, estimating and evaluating counterfactual prediction models is challenging because, unlike traditional (factual) prediction, one does not observe the potential outcomes for all individuals under all treatment strategies of interest. Here, we discuss how to estimate a counterfactual prediction model, how to assess the model's performance, and how to perform model and tuning parameter selection. We provide identification and estimation results for counterfactual prediction models and for multiple measures of counterfactual model performance, including loss‐based measures, the area under the receiver operating characteristic curve, and the calibration curve. Importantly, our results allow valid estimates of model performance under counterfactual intervention even if the candidate prediction model is misspecified, permitting a wider array of use cases. We illustrate these methods using simulation and apply them to the task of developing a statin‐naïve risk prediction model for cardiovascular disease.
SiM Longitudinal Data · 发表于 2025-10-07
Daniel K. Sewell, Kelly K. Baker
摘要
Estimating risk factors for the incidence of a disease is crucial for understanding its etiology. For diseases caused by enteric pathogens, off‐the‐shelf statistical model‐based approaches do not consider the biological mechanisms through which infection occurs and thus can only be used to make comparatively weak statements about the association between risk factors and incidence. Building off of established work in quantitative microbiological risk assessment, we propose a new approach to determining the association between risk factors and dose accrual rates. Our more mechanistic approach achieves a higher degree of biological plausibility, incorporates currently ignored sources of variability, and provides regression parameters that are easily interpretable as the dose accrual rate ratio due to changes in the risk factors under study. We also describe a method for leveraging information across multiple pathogens. The proposed methods are available as an R package at https://github.com/dksewell/dare . Our simulation study shows unacceptable coverage rates from generalized linear models, while the proposed approach empirically maintains the nominal rate even when the model is misspecified. Finally, we demonstrated our proposed approach by applying our method to infant data obtained through the PATHOME study ( https://reporter.nih.gov/project‐details/10227256 ), discovering the impact of various environmental factors on infant enteric infections.
SiM Causal Inference · 发表于 2025-10-07
Shuo Feng, Ishani Ganguli, Youjin Lee, John Poe, Andrew Ryan, Alyssa Bilinski
摘要
Difference‐in‐differences (DiD) is a popular observational causal inference method in health policy, employed to evaluate the real‐world impact of policies and programs. To estimate treatment effects, DiD relies on a “parallel trends assumption” that treatment and comparison groups would have had parallel trajectories on average in the absence of an intervention. Recent years have seen both growing use of DiD in health policy and medicine and rapid advancements in DiD methods. To support DiD implementation in these fields, this paper reviews and synthesizes best practices and recent innovations. We provide recommendations to practitioners in four areas: (1) assessing causal assumptions; (2) adjusting for covariates and other approaches to relax causal assumptions; (3) accounting for staggered treatment timing; and (4) conducting robust inference, especially when normal‐based clustered standard errors are inappropriate. For each, we explain challenges and common pitfalls in traditional DiD and recommend methods to address these. We explore current treatment of these topics through a focused literature review of medical DiD studies.
SiM Longitudinal Data Bayesian Methods · 发表于 2025-10-07
Lucas Kock, Nadja Klein, David J. Nott
摘要
Mixtures of linear mixed models are widely used for modeling longitudinal data for which observation times differ between subjects. In typical applications, temporal trends are described using a basis expansion, with basis coefficients treated as random effects varying by subject. Additional random effects can describe variation between mixture components or other known sources of variation in complex designs. A key advantage of these models is that they provide a natural mechanism for clustering. Current versions of mixtures of linear mixed models are not specifically designed for the case where there are many observations per subject and complex temporal trends, which require a large number of basis functions to capture. In this case, the subject‐specific basis coefficients are a high‐dimensional random effects vector, for which the covariance matrix is hard to specify and estimate, especially if it varies between mixture components. To address this issue, we consider the use of deep mixture of factor analyzers models as a prior for the random effects. The resulting deep mixture of linear mixed models is well suited for high‐dimensional settings, and we describe an efficient variational inference approach to posterior computation. The efficacy of the method is demonstrated in biomedical applications and on simulated data.
SMMR Networks & Graphs Causal Inference Survival Analysis · 发表于 2025-10-07
TingFang Lee, Ashley L Buchanan, Natallia Katenka, Laura Forastiere, M Elizabeth Halloran, Georgios Nikolopoulos
摘要
Estimating causal effects in the presence of spillover among individuals within a social network poses challenges due to missing information. Spillover effects refer to the impact of an intervention on individuals not directly exposed themselves but connected to intervention recipients within the network. In network-based studies, outcomes may be missing due to study termination or participant dropout, termed censoring. We introduce an inverse probability censoring weighted estimator which extends the inverse probability weighted estimator for network-based observational studies to handle possible outcome censoring. We prove the consistency and asymptotic normality of the proposed estimator and derive a closed-form estimator for its asymptotic variance. Applying the inverse probability censoring weighted estimator, we assess spillover effects in a network-based study of a nonrandomized intervention with outcome censoring. A simulation study evaluates the finite-sample performance of the inverse probability censoring weighted estimator, demonstrating its effectiveness with sufficiently large sample sizes and number of connected subnetworks. We then employ the method to assess spillover effects of community alerts on self-reported human immunodeficiency virus risk behavior among people who inject drugs and their contacts in the Transmission Reduction Intervention Project (TRIP), from 2013 to 2015, Athens, Greece. Results suggest that community alerts may help reduce human immunodeficiency virus risk behavior for both the individuals who receive them and others in their network, possibly through shared information. In this study, we found that the risk of human immunodeficiency virus behavior was reduced by increasing the proportion of a participant’s immediate contacts exposed to community alerts.
SiM Causal Inference Missing Data & Measurement Error · 发表于 2025-10-07
Jessie K. Edwards, Bonnie E. Shook‐Sa, Giorgos Bakoyannis, Paul N. Zivich, Michael E. Herce, Stephen R. Cole
摘要
Misclassification between causes of death can produce bias in estimated cumulative incidence functions. When estimating causal quantities, such as comparing the cumulative incidence of death due to specific causes under interventions, such bias can lead to suboptimal decision making. Here, a consistent semiparametric estimator of the cumulative incidence function under interventions in settings with misclassification between two event types is presented. The measurement parameters for this estimator can be informed by validation data or expert knowledge. Moreover, a modified bootstrap approach to variance estimation is proposed for confidence interval construction. The proposed estimator was applied to estimate the cumulative incidence of AIDS‐related mortality in the Multicenter AIDS Cohort Study under single‐ versus combination‐drug antiretroviral therapy regimens that may be subject to confounding. The proposed estimator is shown to be consistent and performed well in finite samples via a series of simulation experiments.
SiM Other · 发表于 2025-10-07
Stefan Embacher, Andrea Berghold, Kirsten Maertens, Sereina A. Herzog
摘要
An optimally designed experiment reaches results quicker, at a lower cost, or with fewer observations and is therefore crucial in maximizing resource efficiency in research. In immunization studies, the primary goal is often to characterize antibody kinetics—the change in antibody concentration over time. However, nonlinear models for antibody kinetics present substantial challenges for study design, particularly the need to provide information on the parameters of interest. We propose a novel framework to facilitate the design of immunization studies using simple, understandable information. We assume that the mean antibody concentration follows the structural form of the beta density until reaching a plateau. Using the time and height of the maximum and the time and height of the plateau, we can uniquely determine the antibody kinetics curve. Optimal sampling schedules are determined using D‐optimality, with D‐efficiency used to compare designs. In a robustness analysis across 12 scenarios, we analyzed the framework's sensitivity to misspecification in the initial information. When misspecifying one parameter at a time, the median D‐efficiencies exceeded 0.95 and the first quartiles were greater than or equal to 0.9 for all parameters, highlighting the robustness of the framework. Misspecification in the height of the plateau and time of the maximum affected the D‐efficiency the most. The great advantage of the framework is that we only need intuitive information from the medical professionals to design an immunization study, in which determining the antibody kinetics is the main goal.
SiM Diagnostics & Prediction · 发表于 2025-10-07
Arís Fanjul‐Hevia, Juan Carlos Pardo‐Fernández, Wenceslao González‐Manteiga
摘要
The ROC curve is a statistical tool that analyzes the accuracy of a diagnostic test in which a variable is used to decide whether an individual is healthy or not. Along with that diagnostic variable, it is usual to have information on some other covariates. In some situations, it is advisable to incorporate that information into the study, as the performance of the ROC curves can be affected by them. Using the covariate‐adjusted, the covariate‐specific, or the pooled ROC curves, we discuss the implications of excluding or including the covariates in the analysis. Motivated by the above, a new test for comparing the covariate‐adjusted and the pooled ROC curve is proposed, and the problem is illustrated by analyzing a real database.
SiM Survival Analysis Missing Data & Measurement Error · 发表于 2025-10-07
Xiao Song, Ching‐Yun Wang
摘要
In survival analysis under the proportional hazards model, covariates may be subject to both measurement error and detection limits. Most existing approaches only address one of these two complications and can lead to substantial bias and erroneous inference when dealing with both simultaneously. There is very limited research that addresses both these problems at the same time. These approaches are exclusively based on likelihood and require distribution assumptions on the underlying true covariates, as well as restricted independence assumptions on the censoring time. We propose a novel corrected score approach that relieves such stringent assumptions and is simpler in computation. The estimator is shown to be consistent and asymptotically normal. The finite sample performance of the proposed estimator is assessed through simulation studies and illustrated by application to data from an AIDS clinical trial. The approach can be used in the case of replicate data or instrumental data. It can also be extended to more general models and outcomes.
Biometrika Bayesian Methods · 发表于 2025-10-06
Mana Sakai, Takeru Matsuda, Tatsuya Kubokawa
摘要
Summary: Asymptotically unbiased priors, introduced by Hartigan (1965), are designed to achieve second-order unbiasedness of Bayes estimators. This paper extends Hartigan’s framework to non-independent-and-identically-distributed models by deriving a system of partial differential equations that characterizes asymptotically unbiased priors. Furthermore, we establish a necessary and sufficient condition for the existence of such priors and propose a simple procedure for constructing them. The proposed method is applied to the linear regression model and the nested error regression model (also known as the random effects model). Simulation studies evaluate the frequentist properties of the Bayes estimator under the asymptotically unbiased prior for the nested error regression model, highlighting its effectiveness in small-sample settings.
Biometrika Testing & Uncertainty Causal Inference · 发表于 2025-10-06
E Smucler, J M Robins, A Rotnitzky
摘要
Summary: This paper examines the construction of confidence sets for parameters defined as linear functionals of a function of $ W $ and $ X $ whose conditional mean given $ Z $ and $ X $ equals the conditional mean of another variable $ Y $ given $ Z $ and $ X $. Many estimands of interest in causal inference can be expressed in this form, including the average treatment effect in proximal causal inference and treatment effect contrasts in instrumental variable models. We derive a necessary condition for a confidence set to be uniformly valid over a model that allows for the dependence between $ W $ and $ Z $ given $ X $ to be arbitrarily weak. We show that, for any such confidence set, there must exist some laws in the model under which, with high probability, the confidence set has a diameter greater than or equal to the diameter of the parameter’s range. In particular, consistent with the weak instrument literature, Wald confidence intervals are not uniformly valid over the aforementioned model when the parameter’s range is infinite. Furthermore, we argue that inverting the score test, a successful approach in that literature, generally fails for the broader class of parameters considered here. We present a method for constructing uniformly valid confidence sets when all variables, but possibly $ Y $, are binary, discuss its limitations and emphasize that developing valid confidence sets for the class of parameters considered here remains an open problem.
SMMR Clinical Trials · 发表于 2025-10-06
Rajenki Das, Nina Deliu, Mark R Toshner, Sofía S Villar
摘要
Although response-adaptive randomisation (RAR) has gained substantial attention in the literature, it still has limited use in clinical trials. Amongst other reasons, the implementation of RAR in real world trials raises important practical questions, often neglected in the technical literature. Motivated by an innovative phase-II stratified RAR rare-disease trial, this paper addresses two challenges: (1) How to ensure that RAR allocations are desirable, that is, both acceptable and faithful to the intended probabilities, particularly in small samples? and (2) What adaptations to trigger after interim analyses in the presence of missing data? To answer (1), we propose a Mapping strategy that discretises the randomisation probabilities into a vector of allocation ratios, resulting in improved frequentist errors. Under the implementation of Mapping , we answer (2) by analysing the impact of missing data on operating characteristics in selected scenarios. Finally, we discuss additional concerns including: pooling data across trial strata, analysing the level of blinding in the trial, and reporting safety results.
AoS High-Dimensional · 发表于 2025-10-01
Matias D. Cattaneo, Ricardo P. Masini, William G. Underwood
摘要
Yurinskii’s coupling is a popular theoretical tool for nonasymptotic distributional analysis in mathematical statistics and applied probability, offering a Gaussian strong approximation with an explicit error bound under easily verifiable conditions. Originally stated in ℓ2-norm for sums of independent random vectors, it has recently been extended both to the ℓp-norm, for 1≤p≤∞, and to vector-valued martingales in ℓ2-norm, under some strong conditions. We present as our main result a Yurinskii coupling for approximate martingales in ℓp-norm, under substantially weaker conditions than those previously imposed. Our formulation further allows for the coupling variable to follow a more general Gaussian mixture distribution, and we provide a novel third-order coupling method, which gives tighter approximations in certain settings. We specialize our main result to mixingales, martingales, and independent data, and derive uniform Gaussian mixture strong approximations for martingale empirical processes. Applications to nonparametric partitioning-based and local polynomial regression procedures are provided, alongside central limit theorems for high-dimensional martingale vectors.
AoS Other · 发表于 2025-10-01
Roberto I. Oliveira, Lucas Resende
摘要
It is well known that trimmed sample means are robust against heavy tails and data contamination. This paper analyzes the performance of trimmed means and related methods in two novel contexts. The first one consists of estimating expectations of functions in a given family, with uniform error bounds; this is closely related to the problem of estimating the mean of a random vector under a general norm. The second problem considered is that of regression with quadratic loss. In both cases, trimmed-mean-based estimators are the first to obtain optimal dependence on the (adversarial) contamination level. Moreover, they also match or improve upon the state of the art in terms of heavy tails. Experiments with synthetic data show that a natural “trimmed mean linear regression” method often performs better than both ordinary least squares and alternative methods based on median-of-means.
AoS Functional Data · 发表于 2025-10-01
Hang Zhou, Dongyi Wei, Fang Yao
摘要
Functional data analysis is an important research field in statistics which treats data as random functions drawn from some infinite-dimensional functional space, and functional principal component analysis (FPCA) based on eigen-decomposition plays a central role for data reduction and representation. After nearly three decades of research, there remains a key problem unsolved, namely, the perturbation analysis of covariance operator for diverging number of eigencomponents obtained from noisy and discretely observed data. This is fundamental for studying models and methods based on FPCA, while there has not been substantial progress since Hall, Müller and Wang (Ann. Statist. 34 (2006) 1493–1517)’s result for a fixed number of eigenfunction estimates. In this work, we aim to establish a unified theory for this problem, obtaining upper bounds for eigenfunctions with diverging indices in both the L2 and supremum norms, and deriving the asymptotic distributions of eigenvalues for a wide range of sampling schemes. Our results provide insight into the phenomenon when the L2 bound of eigenfunction estimates with diverging indices is minimax optimal as if the curves are fully observed, and reveal the transition of convergence rates from nonparametric to parametric regimes in connection to sparse or dense sampling. We also develop a double truncation technique to handle the uniform convergence of estimated covariance and eigenfunctions. The technical arguments in this work are useful for handling the perturbation series with noisy and discretely observed functional data and can be applied in models or those involving inverse problems based on FPCA as regularization, such as functional linear regression.
AoS High-Dimensional Networks & Graphs · 发表于 2025-10-01
Kartik G. Waghmare, Tomas Masak, Victor M. Panaretos
摘要
We consider the problem of recovering conditional independence relationships between p jointly distributed Hilbertian random elements given n realizations thereof. We operate in the sparse high-dimensional regime, where n≪p and no element is related to more than d≪p other elements. In this context, we propose an infinite-dimensional generalization of the graphical lasso. We prove model selection consistency under natural assumptions and extend many classical results to infinite dimensions. In particular, we do not make additional structural assumptions. The plug-in nature of our method makes it applicable to heterogeneous data measured under any observational regime, whether sparse or dense, and indifferent to serial dependence between samples. In addition, it does not require dimensionality reduction by truncation. Importantly, our method can be understood as naturally arising from a coherent maximum likelihood philosophy.
AoS Other · 发表于 2025-10-01
Alberto Bordino, Thomas B. Berrett
摘要
We study the problem of testing whether the missing values of a potentially high-dimensional dataset are Missing Completely at Random (MCAR). We relax the problem of testing MCAR to the problem of testing the compatibility of a collection of covariance matrices, motivated by the fact that this procedure is feasible when the dimension grows with the sample size. Our first contributions are to define a natural measure of the incompatibility of a collection of correlation matrices, which can be characterised as the optimal value of a Semidefinite Programming (SDP) problem, and to establish a key duality result allowing its practical computation and interpretation. By analysing the concentration properties of the natural plug-in estimator for this measure, we propose a novel hypothesis test, which is calibrated via a bootstrap procedure and demonstrates power against any distribution with incompatible covariance matrices. By considering key examples of missingness structures, we demonstrate that our procedures are minimax rate optimal in certain cases. We further validate our methodology with numerical simulations that provide evidence of validity and power, even when data are heavy tailed. Furthermore, tests of compatibility can be used to test the feasibility of positive semidefinite matrix completion problems with noisy observations, and thus our results may be of independent interest.
AoS Nonparametric & Semiparametric High-Dimensional · 发表于 2025-10-01
Louis Goldwater Christie, John A. D. Aston
摘要
In this paper, we present the framework of symmetry in nonparametric regression. This generalises the framework of covariate sparsity, where the regression function f:[0,1]d→R depends only on at most s<d of the covariates, which is a special case of translation symmetry with linear orbits. In general, this extends to other types of functions that capture lower dimensional behavior even when these structures are nonlinear. We show both that known symmetries of regression functions can be exploited to give similarly faster rates, and that unknown symmetries with Lipschitz actions can be estimated sufficiently quickly to adaptively obtain the same rates. This is done by explicit constructions of partial symmetrisation operators that are then applied to usual estimators, and with a two-step M-estimator of the maximal symmetry of the regression function. We also demonstrate the finite sample performance of these estimators on synthetic data.
AoS Nonparametric & Semiparametric · 发表于 2025-10-01
Jinhang Chai, Jianqing Fan
摘要
The problem of structured matrix estimation has been studied mostly under strong noise dependence assumptions. This paper considers a general framework of noisy low-rank-plus-sparse matrix recovery, where the noise matrix may come from any joint distribution with arbitrary dependence across entries. We propose an incoherent-constrained least-square estimator and prove its tightness both in the sense of deterministic lower bound and matching minimax risks under various noise distributions. To attain this, we establish a novel result asserting that the difference between two arbitrary low-rank incoherent matrices must spread energy out across its entries; in other words, it cannot be too sparse, which sheds light on the structure of incoherent low-rank matrices and may be of independent interest. We then showcase the applications of our framework to several important statistical machine learning problems. In the problem of estimating a structured Markov transition kernel, the proposed method achieves the minimax optimality and the result can be extended to estimating the conditional mean operator, a crucial component in reinforcement learning. The applications to multitask regression and structured covariance estimation are also presented. We propose an alternating minimization algorithm to approximately solve the potentially hard optimization problem. Numerical results corroborate the effectiveness of our method which typically converges in a few steps.
AoS Spatial & Time Series Nonparametric & Semiparametric · 发表于 2025-10-01
Rafail Kartsioukas, Stilian Stoev, Tailen Hsing
摘要
The spectral density function describes the second-order properties of a stationary stochastic process on Rd. This paper considers the nonparametric estimation of the spectral density of a continuous-time stochastic process taking values in a separable Hilbert space. Our estimator is based on kernel smoothing and can be applied to a wide variety of spatial sampling schemes including those in which data are observed at irregular spatial locations. Thus, it finds immediate applications in spatial statistics, where irregularly sampled data naturally arise. The rates for the bias and variance of the estimator are obtained under general conditions in a mixed-domain asymptotic setting. When the data are observed on a regular grid, the optimal rate of the estimator matches the minimax rate for the class of operator-covariance functions that decay according to a power law. The asymptotic normality of the spectral density estimator is also established under general conditions for Gaussian Hilbert-space valued processes. Finally, with a view towards practical applications the asymptotic results are specialized to the case of discretely-sampled functional data in a reproducing kernel Hilbert space.
AoS Other · 发表于 2025-10-01
Qiyu Han, Will Wei Sun, Yichen Zhang
摘要
The study of online decision-making problems that leverage contextual information has drawn notable attention due to their significant applications in fields ranging from healthcare to autonomous systems. In modern applications, contextual information can be rich and is often represented as a matrix. Moreover, while existing online decision algorithms mainly focus on reward maximization, less attention has been devoted to statistical inference. To address these gaps, in this work, we consider an online decision-making problem with a matrix context where the true model parameters have a low-rank structure. We propose a fully online procedure to conduct statistical inference with adaptively collected data. The low-rank structure of the model parameter and the adaptive nature of the data collection process make this difficult: standard low-rank estimators are biased and cannot be obtained in a sequential manner while existing inference approaches in sequential decision-making algorithms fail to account for the low-rankness and are also biased. To overcome these challenges, we introduce a new online debiasing procedure to simultaneously handle both sources of bias. Our inference framework encompasses both parameter inference and optimal policy value inference. In theory, we establish the asymptotic normality of the proposed online debiased estimators and prove the validity of the constructed confidence intervals for both inference tasks. Our inference results are built upon a newly developed low-rank stochastic gradient descent estimator and its convergence result, which are also of independent interest.
AoS Machine Learning · 发表于 2025-10-01
Weidong Liu, Jiyuan Tu, Xi Chen, Yichen Zhang
摘要
Reinforcement learning has emerged as one of the prominent topics attracting attention in modern statistical learning, with policy evaluation being a key component. Unlike the traditional machine learning literature on this topic, our work emphasizes statistical inference for the model parameters and value functions of reinforcement learning algorithms. While most existing analyses assume random rewards to follow standard distributions, we embrace the concept of robust statistics in reinforcement learning by simultaneously addressing issues of outlier contamination and heavy-tailed rewards within a unified framework. In this paper, we develop a fully online robust policy evaluation procedure, and establish the Bahadur-type representation of our estimator. Furthermore, we develop an online procedure to efficiently conduct statistical inference based on the asymptotic distribution. This paper connects robust statistics and statistical inference in reinforcement learning, offering a more versatile and reliable approach to online policy evaluation. Finally, we validate the efficacy of our algorithm through numerical experiments conducted in simulations and real-world reinforcement learning experiments.
AoS Networks & Graphs · 发表于 2025-10-01
Jian Ding, Hang Du, Zhangsong Li
摘要
Given two Erdős–Rényi graphs with n vertices whose edges are correlated through a latent vertex correspondence, we study complexity lower bounds for the associated correlation detection problem for the class of low-degree polynomial algorithms. We prove that no degree-O(ρ−1) polynomial algorithm can succeed for detection under an appropriate definition of success, where ρ is the edge correlation. Furthermore, in the sparse regime where the edge density q=n−1+o(1), we prove that no degree-d polynomial algorithm can succeed for detection under an appropriate definition of success, as long as d=exp(o( logn lognq∧logn)) and the correlation ρ<α where α≈0.338 is the Otter’s constant. Our result suggests that several state-of-the-art algorithms on correlation detection and exact matching recovery may be essentially the best possible.
AoS Testing & Uncertainty Diagnostics & Prediction · 发表于 2025-10-01
Yixiang Luo, William Fithian, Lihua Lei
摘要
The knockoff filter of (Ann. Statist. 43 (2015) 2055–2085) is a flexible framework for multiple testing in supervised learning models, based on introducing synthetic predictor variables to control the false discovery rate (FDR). Using the conditional calibration framework of (Ann. Statist. 50 (2022) 3091–3118), we introduce the calibrated knockoff procedure, a method that uniformly improves the power of any fixed-X or model-X knockoff procedure. We show theoretically and empirically that the improvement is especially notable in two contexts where knockoff methods can be nearly powerless: when the rejection set is small, and when the structure of the design matrix in fixed-X knockoffs prevents us from constructing good knockoff variables. In these contexts, calibrated knockoffs even outperform competing FDR-controlling methods like the (dependence-adjusted) Benjamini–Hochberg procedure in many scenarios.
AoS Genetics & Omics High-Dimensional Econometrics & Economics · 发表于 2025-10-01
Fei Xue, Bingxin Zhao
摘要
Linkage disequilibrium score regression (LDSC) has emerged as an essential tool for genetic and genomic analyses of complex traits, utilizing high-dimensional data derived from genome-wide association studies (GWAS). LDSC computes the linkage disequilibrium (LD) scores using an external reference panel, and integrates the LD scores with only summary data from the original GWAS. In this paper, we investigate LDSC within a fixed-effect data integration framework, underscoring its ability to merge multisource GWAS data and reference panels. In particular, we take account of the genome-wide dependence among the high-dimensional GWAS summary statistics, along with the block-diagonal dependence pattern in estimated LD scores. Our analysis uncovers several key factors of both the original GWAS and reference panel datasets that determine the performance of LDSC. We show that it is relatively feasible for LDSC-based estimators to achieve asymptotic normality when applied to genome-wide genetic variants (e.g., in genetic variance and covariance estimation), whereas it becomes considerably challenging when we focus on a much smaller subset of genetic variants (e.g., in partitioned heritability analysis). Moreover, by modeling the disparities in LD patterns across different populations, we show that LDSC can be expanded to conduct cross-ancestry analyses using data from genetically distinct global populations. We validate our theoretical findings through extensive numerical evaluations using real genetic data from the UK Biobank study.
AoS Machine Learning · 发表于 2025-10-01
Liangyu Zhang, Yang Peng, Jiadong Liang, Wenhao Yang, Zhihua Zhang
摘要
In this paper, we study distributional reinforcement learning from the perspective of statistical efficiency. We investigate distributional policy evaluation, aiming to estimate the complete return distribution (denoted ηπ) attained by a given policy π. We use the certainty equivalence method to construct our estimator ηˆnπ, based on a generative model. In this circumstance, we need a dataset of size O˜(|S||A|ε−2p(1−γ)−(2p+2)) to guarantee the supremum p-Wasserstein metric between ηˆnπ and ηπ less than ε with high probability. This implies the distributional policy evaluation problem can be solved with sample efficiency. Also, we show that under different mild assumptions a dataset of size O˜(|S||A|ε−2(1−γ)−4) suffices to ensure the supremum Kolmogorov-Smirnov metric and supremum total variation metric between ηˆnπ and ηπ is below ε with high probability. Furthermore, we investigate the asymptotic behavior of ηˆnπ. We demonstrate that the “empirical process” n(ηˆ nπ−ηπ) converges weakly to a Gaussian process in the space of bounded functionals on a Lipschitz function class ℓ∞(FW 1), also in the space of bounded functionals on an indicator function class ℓ∞(FKS) and a bounded measurable function class ℓ∞(FTV) when some mild conditions hold. Our findings give rise to a unified approach to statistical inference of a wide class of statistical functionals of ηπ.
AoS Bayesian Methods Nonparametric & Semiparametric · 发表于 2025-10-01
Ismaël Castillo, Thibault Randrianarisoa
摘要
Deep Gaussian processes have recently been proposed as natural objects to fit, similarly to deep neural networks, possibly complex features present in modern data samples, such as compositional structures. Adopting a Bayesian nonparametric approach, it is natural to use deep Gaussian processes as prior distributions, and use the corresponding posterior distributions for statistical inference. We introduce the deep Horseshoe Gaussian process Deep–HGP, a new simple prior based on deep Gaussian processes with a squared-exponential kernel, that in particular enables data-driven choices of the key lengthscale parameters. For nonparametric regression with random design, we show that the associated posterior distribution recovers the unknown true regression curve optimally in terms of quadratic loss, up to a logarithmic factor, in an adaptive way. The convergence rates are simultaneously adaptive to both the smoothness of the regression function and to its structure in terms of compositions. The dependence of the rates in terms of dimension are explicit, allowing in particular for input spaces of dimension increasing with the number of observations.
AoS Causal Inference · 发表于 2025-10-01
Yihong Gu, Cong Fang, Peter Bühlmann, Jianqing Fan
摘要
Pursuing causality from data is a fundamental problem in scientific discovery, treatment intervention, and transfer learning. This paper introduces a novel algorithmic method for addressing nonparametric invariance and causality learning in regression models across multiple environments, where the joint distribution of response variables and covariates varies, but the conditional expectations of outcome given an unknown set of quasi-causal variables are invariant. The challenge of finding such an unknown set of quasi-causal or invariant variables is compounded by the presence of endogenous variables that have heterogeneous effects across different environments. The proposed Focused Adversarial Invariant Regularization (FAIR) framework utilizes an innovative minimax optimization approach that drives regression models toward prediction-invariant solutions through adversarial testing. Leveraging the representation power of neural networks, FAIR neural networks (FAIR-NN) are introduced for causality pursuit. It is shown that FAIR-NN can find the invariant variables and quasi-causal variables under a minimal identification condition and that the resulting procedure is adaptive to low-dimensional composition structures in a nonasymptotic analysis. Under a structural causal model, variables identified by FAIR-NN represent pragmatic causality and provably align with exact causal mechanisms under conditions of sufficient heterogeneity. Computationally, FAIR-NN employs a novel Gumbel approximation with decreased temperature and a stochastic gradient descent ascent algorithm. The procedures are demonstrated using simulated and real-data examples.
AoS Bayesian Methods High-Dimensional · 发表于 2025-10-01
Jeyong Lee, Minwoo Chae, Ryan Martin
摘要
Uncovering genuine relationships between a response variable and a large collection of covariates is a fundamental and practically important problem. In the context of Gaussian linear models, both the Bayesian and non-Bayesian literature is well-developed and there are no substantial differences in the model selection consistency results available from the two schools. For generalized linear models (GLMs), however, Bayesian model selection consistency results are lacking in several ways. In this paper, we construct a Bayesian posterior distribution using an appropriate data-dependent prior and develop its asymptotic concentration properties using new theoretical techniques. In particular, we leverage Spokoiny’s powerful nonasymptotic theory to obtain sharp quadratic approximations of the GLM’s log-likelihood function, which leads to tight bounds on the errors associated with the model-specific maximum likelihood estimators and the Laplace approximation of our Bayesian marginal likelihood. In turn, these improved bounds lead to significantly stronger, near-optimal Bayesian model selection consistency results, for example, far weaker beta-min conditions, compared to those available in the existing literature. In particular, our results are applicable to the Poisson regression model, in which the score function is not sub-Gaussian.
AoS Other · 发表于 2025-10-01
Ruijian Han, Yiming Xu
摘要
The Plackett–Luce model has been extensively used for rank aggregation in social choice theory. A central statistical question in this model concerns estimating the utility vector that governs the model’s likelihood. In this paper, we investigate the asymptotic theory of utility vector estimation by maximizing different types of likelihood, such as full, marginal, and quasi-likelihood. Starting from interpreting the estimating equations of these estimators to gain some initial insights, we analyze their asymptotic behavior as the number of compared objects increases. In particular, we establish both uniform consistency and asymptotic normality of these estimators and discuss the trade-off between statistical efficiency and computational complexity. For generality, our results are proven for deterministic graph sequences under appropriate graph topology conditions. These conditions are shown to be informative when applied to common sampling scenarios, such as nonuniform random hypergraph models and hypergraph stochastic block models. Numerical results are provided to support our findings.
SMMR Causal Inference · 发表于 2025-09-30
Pei-Hsuan Hsia, An-Shun Tai, Shih-Chen Fu, Sheng-Hsuan Lin
摘要
Mechanistic interaction concerns how exposures affect the outcome. When investigating mechanisms, synergism is the most mentioned type in the fields of genetic study and pharmacology. Synergism is defined under the framework of sufficient component cause model, which is difficult to be quantified directly. Sufficient cause interaction (SCI) is the only alternative metric to imply the existence of synergism. VanderWeele and Robins provided empirical tests for SCIs. However, this test only assesses the lower bound of SCIs rather than estimate SCIs directly due to the lack of the degree of freedom, which causes low power. To address this issue, in this study, we propose a novel method to estimate the probability of individual with SCI by introducing a new factor named quasi-instrumental variable, which is necessary for the background condition of SCI. We also develop a corresponding hypothesis test and show that it is more powerful than the existing empirical test. We demonstrate this method by applying it to estimate the synergistic effects between intestinal bacteria on the formation of Parkinson's disease.