2025 年的期刊文章 · 第 3 页

共 1491 篇,按发表时间排,新的在前,每页 40 篇。这一页是 2025-12-02 到 2025-11-27。

按期刊、按主题看 →

第 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 页

JASA Other · 发表于 2025-12-02

Testing and Support Recovery in Population-Based Image Data

Lianqiang Qu, Jian Huang, Liuquan Sun, Hongtu Zhu, for the Alzheimer’s Disease Neuroimaging Initiative

摘要

In this article, we propose a multiscale adaptive test to detect differences between two samples of intrinsically smoothed image data in high-dimensional context. The test aggregates data from nearby locations using adaptive weights, significantly enhancing statistical power. We demonstrate that the test statistic converges to a Gumbel extreme value distribution under the null hypothesis. Moreover, we investigate its multiscale nature, showing that the chosen scales can grow at a specific polynomial rate of the sample size. We also evaluate its power against sparse alternatives and establish that with probability approaching one, the proposed method can identify the locations where the two means differ from each other. Additionally, we extend the proposed method to multi-sample ANOVA tests. Simulation results suggest that the proposed test outperforms the non-multiscale method that ignores spatial features of imaging data. The procedures are illustrated using a real dataset from the Alzheimer’s Disease Neuroimaging Initiative study. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work. *(abstract via OpenAlex)*

JASA Bayesian Methods · 发表于 2025-12-02

Spatiotemporal Besov Priors for Bayesian Inverse Problems

Shiwei Lan, Mirjeta Pasha, Shuyi Li, Weining Shen

摘要

Fast development in science and technology has driven the need for proper statistical tools to capture special data features such as abrupt changes or sharp contrast. Many inverse problems in data science require spatiotemporal solutions derived from a sequence of time-dependent objects with these spatial features, for example, the dynamic reconstruction of computerized tomography (CT) images with edges. Conventional methods based on Gaussian processes (GP) often fall short in providing satisfactory solutions since they tend to offer oversmooth priors. Recently, the Besov process (BP), defined by wavelet expansions with random coefficients, has emerged as a more suitable prior for Bayesian inverse problems of this nature. While BP excels in handling spatial inhomogeneity, it does not automatically incorporate temporal correlation inherited in the dynamically changing objects. In this article, we generalize BP to a novel spatiotemporal Besov process (STBP) by replacing the random coefficients in the series expansion with stochastic time functions as Q-exponential process (Q-EP) which governs the temporal correlation structure. We thoroughly investigate the mathematical and statistical properties of STBP. Simulations, two limited-angle CT reconstruction examples, a highly nonlinear inverse problem involving Navier-Stokes equation, and a spatiotemporal temperature imputation problem are used to demonstrate the advantage of the proposed STBP compared with the classic STGP and a time-uncorrelated approach. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work. *(abstract via OpenAlex)*

SMMR High-Dimensional Nonparametric & Semiparametric · 发表于 2025-12-02

Penalized estimation of general frailty Poisson models for recurrent count events

Minggen Lu, Chin-Shang Li

摘要

We study spline-based efficient estimation of frailty models for panel count data using a penalization technique. An easy-to-implement and computationally efficient two-stage iterative expectation-maximization algorithm is proposed for the analysis. A general quasi-likelihood estimation that does not specify the stochastic model of the underlying counting process is developed to provide flexibility for model fitting. A powerful score test is discussed to detect the presence of overdispersion in count data. The proposed methods are assessed via an extensive simulation and further illustrated by analyzing data from a non-melanoma skin cancer chemoprevention study.

SiM Latent Variables & Mixtures · 发表于 2025-12-02

Integrating Multiple Clustering Techniques and Performance Measures via Ranking for scRNA‐Seq Data

Owen Visser, Somnath Datta

摘要

As single‐cell gene expression data analysis continues to grow, the need for reliable clustering techniques has become increasingly important. This growth has also led to a rise in heuristic means for technique choice, which could lead to inaccurate reports if a comprehensive evaluation of the resulting clusters is omitted. Previous work in the field of microarray data provided measures of stability to evaluate clustering techniques for highly correlated data. Additional work on aggregation in the same era presented a way to combine ranked lists using several performance measures. In this paper, we adapt the stability measures from the microarray era to function on single‐cell data and employ them alongside several existing measures to evaluate characteristics of clustering techniques at varying parameter choices. We then compare individual measures alongside an aggregation method (AM) on all measures to rank these techniques for five datasets with known groups and one without known groups. Our findings show that techniques ranked highest by a single validation measure tend to have mediocre performance for other measures for multiple datasets. Alternatively, our method of aggregating techniques based on their ranked performance on all measures ensures that techniques with a strong overall performance are ranked highest. The techniques selected in this fashion had above average performance in most of the measured clustering characteristics and perform well in other ways, such as consistently estimating cluster counts that closely match the true number of biological groups.

Biometrika High-Dimensional · 发表于 2025-12-02

High-dimensional covariance estimation by pairwise likelihood truncation

A. Casa, D Ferrari, Z Huang

摘要

Summary: Pairwise likelihood is an approximation of the full likelihood function that facilitates the analysis of high-dimensional covariance models. By combining marginal bivariate likelihoods, it effectively simplifies high-dimensional dependencies, making the estimation process more manageable. We introduce estimation of sparse high-dimensional covariance matrices by maximizing a truncated version of the pairwise likelihood function, obtained by including pairwise terms corresponding to nonzero covariance elements. To achieve truncation, we propose a novel approach that minimizes the $ L_{2} $ distance between pairwise and full likelihood scores, supplemented by an $ L_{1} $ penalty to discourage the inclusion of uninformative terms. Unlike existing regularization methods, our criterion emphasizes the selection of entire pairwise likelihood objects instead of shrinking individual covariance parameters, thus preserving the unbiasedness of the pairwise likelihood estimating equations. The resulting pairwise likelihood estimator is consistent and converges to the oracle maximum likelihood estimator, which assumes prior knowledge of nonzero covariance entries, even as the data dimension increases exponentially with the sample size.

SiM Networks & Graphs Clinical Trials · 发表于 2025-12-02

Graph Based, Adaptive, Multiarm, Multiple Endpoint, Two‐Stage Designs

Cyrus Mehta, Ajoy Mukhopadhyay, Martin Posch

摘要

The graph‐based approach to multiple testing is an intuitive method that enables a study team to represent clearly, through a directed graph, its priorities for hierarchical testing of multiple hypotheses, and for propagating the available type‐1 error from rejected or dropped hypotheses to hypotheses yet to be tested. Although originally developed for single‐stage nonadaptive designs, we show how it may be extended to two‐stage designs that permit early identification of efficacious treatments, adaptive sample size re‐estimation, dropping of hypotheses, and changes in the hierarchical testing strategy at the end of stage one. Two approaches are available for preserving the familywise error rate in the presence of these adaptive changes, the value combination method, and the conditional error rate method. In this investigation, we will present the statistical methodology underlying each approach and will compare the operating characteristics of the two methods in a large simulation experiment.

Biometrika Optimization & Learning Theory · 发表于 2025-12-02

Geodesic optimal transport regression

Changbo Zhu, Hans-Georg Müller

摘要

Summary: Classical regression models do not cover non-Euclidean data that reside in a general metric space, while the current literature on non-Euclidean regression has, by and large, focused on scenarios where either predictors or responses are random objects, i.e., non-Euclidean, but not both. In this paper we propose geodesic optimal transport regression models for the case where both predictors and responses lie in a common geodesic metric space, and predictors may include not only one, but also several random objects. This provides an extension of classical multiple regression to the case where both predictors and responses reside in non-Euclidean metric spaces, a scenario that has not been considered before. It is based on the concept of optimal geodesic transports, which we define as an extension of the notion of optimal transports in distribution spaces to more general geodesic metric spaces, where we characterize optimal transports as transports along geodesics. The proposed regression models cover the relation between non-Euclidean responses and vectors of non-Euclidean predictors in many spaces of practical statistical interest. These include one-dimensional distributions viewed as elements of the 2-Wasserstein space and multi-dimensional distributions with the Fisher–Rao metric that are represented as data on the Hilbert sphere. Also included are data on finite-dimensional Riemannian manifolds, with an emphasis on spheres, covering directional and compositional data, as well as data that consist of symmetric positive definite matrices. We illustrate the utility of geodesic optimal transport regression with data on summer temperature distributions and human mortality.

Biometrics Causal Inference Missing Data & Measurement Error · 发表于 2025-12-02

Flexible and efficient estimation of causal effects with error-prone exposures: a control variates approach for measurement error

Keith Barnatchez, Rachel Nethery, Bryan E Shepherd, Giovanni Parmigiani, Kevin P Josey

摘要

Exposure measurement error is a ubiquitous but often overlooked challenge in causal inference with observational data. Existing methods accounting for exposure measurement error largely rely on restrictive parametric assumptions, while emerging data-adaptive estimation approaches allow for less restrictive assumptions but at the cost of flexibility, as they are typically tailored toward rigidly defined statistical quantities. There remains a critical need for assumption-lean estimation methods that are both flexible and possess desirable theoretical properties across a variety of study designs. In this paper, we introduce a general framework for estimation of causal quantities in the presence of exposure measurement error, adapted from the method of control variates. Our method can be implemented in various two-phase sampling study designs, where one obtains gold-standard exposure measurements for a small subset of the full study sample, called the validation data. The control variates framework leverages both the error-prone and error-free exposure measurements by augmenting an initial consistent estimator from the validation data with a variance reduction term formed from the full data. We show that our method inherits double-robustness properties under standard causal assumptions. Simulation studies show that our approach performs favorably compared to leading methods under various two-phase sampling schemes. We illustrate our method with observational electronic health record data on HIV outcomes from the Vanderbilt Comprehensive Care Clinic.

SMMR Survival Analysis Nonparametric & Semiparametric · 发表于 2025-12-02

Estimation of the short-term and long-term hazard ratios for interval-censored and truncated data

Rui Wang, Yiwei Fan

摘要

Survival analysis is a vital field in statistics with widespread applications. The short-term and long-term hazard ratio model is a novel semiparametric framework designed to handle crossing survival curves, encompassing the proportional hazards and proportional odds models as special cases. In this paper, we extend the short-term and long-term hazard ratio model to accommodate interval-censored and truncated data with covariates. The identifiability challenges arising from truncation are also discussed. We first prove that the nonparametric maximum likelihood estimation of the baseline survival function retains piecewise constant. Then an efficient iterative convex minorant algorithm, enhanced with a half-stepping strategy, is developed for computation. Additionally, we present a straightforward Wald test for hypothesis testing under a simplified yet commonly encountered practical scenario. Extensive simulation studies under diverse censoring and truncation scenarios demonstrate the robustness and accuracy in estimation of the proposed approach, particularly when traditional proportional hazards or proportional odds assumptions are violated. Applications to three real-world datasets further demonstrate the model’s ability to capture varying covariate effects on survival probabilities across early and late stages, offering valuable insights for clinical practice and decision-making.

JASA Other · 发表于 2025-12-02

Construction of Asymmetric Nested Orthogonal Arrays

Shanqi Pang, Xiao Lin, Mingyao Ai, Peter Chien

摘要

Nested orthogonal arrays (NOAs), which consist of a pair of orthogonal arrays with one array nested within the other, are extensively used in computer experiments and statistics. They have diverse applications, including data fusion, digital twins, model validation, sequential model evaluation, stochastic programming, chance-constraint problems, nonparametric function estimation, and parameter linking. We propose several general methods for constructing asymmetric NOAs with flexible run sizes, number of levels, and strengths. These methods can generate numerous new classes of NOAs, achieving the maximal number of factors with the minimal run size for both the smaller and larger arrays. A slightly relaxed definition of saturatedness, termed flawless, is introduced for NOAs. Based on the saturated or flawless criteria for the smaller and larger arrays, we classify NOAs into nine types and construct seven new types of NOAs. The newly constructed NOAs with small and moderate run sizes are tabulated for practical use. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work. *(abstract via OpenAlex)*

Biometrics Latent Variables & Mixtures Spatial & Time Series Nonparametric & Semiparametric · 发表于 2025-12-02

A semiparametric Gaussian Mixture Model with spatial dependence and its application to whole-slide image clustering analysis

Baichen Yu, Jin Liu, Hansheng Wang

摘要

We develop here a semiparametric Gaussian Mixture Model (SGMM) for unsupervised learning with valuable spatial information taken into consideration. Specifically, we assume for each instance a random location. Then, conditional on this random location, we assume for the feature vector a standard Gaussian Mixture Model (GMM). The proposed SGMM allows the mixing probability to be nonparametrically related to the spatial location. Compared with a classical GMM, SGMM is considerably more flexible and allows the instances from the same class to be spatially clustered. To estimate the SGMM, novel EM algorithms are developed and rigorous asymptotic theories are established. Extensive numerical simulations are conducted to demonstrate our finite sample performance. For a real application, we apply our SGMM method to the CAMELYON16 dataset of whole-slide images for breast cancer detection. The SGMM method demonstrates outstanding clustering performance.

SiM Longitudinal Data High-Dimensional · 发表于 2025-12-02

A New Streaming K‐Nearest Neighbor Algorithm for Status Prediction in Block‐Sparse, Autocorrelated, Irregular Longitudinal Data

Xin Zhao, Xiaokai Nie, Yu Zhao, Kaida Cai

摘要

In streaming longitudinal data, status prediction becomes challenging when input variables are block‐sparse, autocorrelated, and irregular in both dimension and distribution. General methods cannot model such data directly, especially when the classes are extremely imbalanced. This research proposes a K‐Nearest Neighbor (KNN) algorithm where distance is measured by Kullback–Leibler (KL) divergence. The algorithm uses features extracted from metric conditional density, both with and without first‐order lag. The developed streaming KNN algorithm is further applied to simulation data. Results show that when differences originate from the location hyperparameters of the Gaussian distribution or both the shape and scale hyperparameters of the inverse gamma distribution, the method performs quite well, as expected, with an AUC close to 1. Additionally, a numerical method is proposed for general distributions that lack an analytical expression in real data. This method is applied to a big medical streaming dataset with similar properties. Results indicate that the AUC value gradually increases to 0.913, with a sensitivity of 0.851 and a specificity of 0.816.

AoS Nonparametric & Semiparametric High-Dimensional · 发表于 2025-12-01

The empirical copula process in high dimensions: Stute’s representation and applications

Axel Bücher, Cambyse Pakzad

摘要

The empirical copula process, a fundamental tool for copula inference, is studied in the high dimensional regime where the dimension is allowed to grow to infinity exponentially in the sample size. Under natural, weak smoothness assumptions on the underlying copula, it is shown that Stute’s representation is valid in the following sense: all low-dimensional margins of fixed dimension of the empirical copula process can be approximated by a functional of the low-dimensional margins of the standard empirical process, with the almost sure error term being uniform in the margins. The result has numerous potential applications, and is exemplary applied to the problem of testing pairwise stochastic independence in high dimensions, leading to various extensions of recent results in the literature: for certain test statistics based on pairwise association measures, type-I error control is obtained for models beyond mutual independence. Moreover, bootstrap-based critical values are shown to yield strong control of the familywise error rate for a large class of data generating processes.

Biometrics Survival Analysis · 发表于 2025-12-01

Super learner for survival prediction in case-cohort and generalized case-cohort studies

Haolin Li, Haibo Zhou, David Couper, Jianwen Cai

摘要

The case-cohort study design is often used in modern epidemiological studies of rare diseases, as it can achieve similar efficiency as a much larger cohort study with a fraction of the cost. Previous work focused on parameter estimation for case-cohort studies based on a particular statistical model, but few discussed the survival prediction problem under such type of design. In this article, we propose a super learner algorithm for survival prediction in case-cohort studies. We further extend our proposed algorithm to generalized case-cohort studies. The proposed super learner algorithm is shown to have asymptotic model selection consistency as well as uniform consistency. We also demonstrate our algorithm has satisfactory finite sample performances. Simulation studies suggest that the proposed super learners trained by data from case-cohort and generalized case-cohort studies have better prediction accuracy than the ones trained by data from the simple random sampling design with the same sample sizes. Finally, we apply the proposed method to analyze a generalized case-cohort study conducted as part of the Atherosclerosis Risk in Communities Study.

AoS Other · 发表于 2025-12-01

Semi-supervised U-statistics

Ilmun Kim, Larry Wasserman, Sivaraman Balakrishnan, Matey Neykov

摘要

Semi-supervised datasets are ubiquitous across diverse domains where obtaining fully labeled data is costly or time-consuming. The prevalence of such datasets has consistently driven the demand for new tools and methods that exploit the potential of unlabeled data. Responding to this demand, we introduce semi-supervised U-statistics enhanced by the abundance of unlabeled data, and investigate their statistical properties. We show that the proposed approach is asymptotically Normal and exhibits notable efficiency gains over classical U-statistics by effectively integrating various powerful prediction tools into the framework. To understand the fundamental difficulty of the problem, we derive minimax lower bounds in semi-supervised settings and showcase that our procedure is semi-parametrically efficient under regularity conditions. Moreover, tailored to bivariate kernels, we propose a refined approach that outperforms the classical U-statistic across all degeneracy regimes, and demonstrate its optimality properties. Simulation studies are conducted to corroborate our findings and to further demonstrate our framework.

AoS Genetics & Omics Optimization & Learning Theory · 发表于 2025-12-01

Optimal sequencing depth for single-cell RNA-sequencing in Wasserstein space

Jakwang Kim, Sharvaj Kubal, Geoffrey Schiebinger

摘要

How many samples should one collect for an empirical distribution to be as close as possible to the true population? This question is not trivial in the context of single-cell RNA-sequencing. With limited sequencing depth, profiling more cells comes at the cost of fewer reads per cell. Therefore, one must strike a balance between the number of cells sampled and the accuracy of each measured gene expression profile. In this paper, we analyze an empirical distribution of cells and obtain upper and lower bounds on the Wasserstein distance to the true population. Our analysis holds for general, nonparametric distributions of cells, and is validated by simulation experiments on a real single-cell dataset.

AoS Nonparametric & Semiparametric · 发表于 2025-12-01

Online estimation with rolling validation: Adaptive nonparametric estimation with streaming data

Tianyu Zhang, Jing Lei

摘要

Online nonparametric estimators are gaining popularity due to their efficient computation and competitive generalization abilities. An important example includes variants of stochastic gradient descent. These algorithms often take one sample point at a time and incrementally update the parameter estimate of interest. In this work, we consider model selection/hyperparameter tuning for such online algorithms. We propose a weighted rolling validation procedure, an online variant of leave-one-out cross-validation, that costs minimal extra computation for many typical stochastic gradient descent estimators and maintains their online nature. Similar to batch cross-validation, it can boost base estimators to achieve better heuristic performance and adaptive convergence rate. Our analysis is straightforward, relying mainly on some general statistical stability assumptions. The simulation study underscores the significance of diverging weights in practice and demonstrates its favorable sensitivity even when there is only a slim difference between candidate estimators.

AoS Spatial & Time Series Testing & Uncertainty · 发表于 2025-12-01

Near-optimal inference in adaptive linear regression

Koulik Khamaru, Yash Deshpande, Tor Lattimore, Lester Mackey, Martin J. Wainwright

摘要

When data is collected in an adaptive manner, even simple methods like ordinary least squares can exhibit nonnormal asymptotic behavior. As an undesirable consequence, hypothesis tests and confidence intervals based on asymptotic normality can lead to erroneous results. We propose a family of online debiasing estimators to correct these distributional anomalies in least squares estimation. Our proposed methods take advantage of the covariance structure present in the dataset and provide sharper estimates in directions for which more information has accrued. We establish an asymptotic normality property for our proposed online debiasing estimators under mild conditions on the data collection process and provide asymptotically exact confidence intervals. We additionally prove a minimax lower bound for the adaptive linear regression problem, thereby providing a baseline by which to compare estimators. There are various conditions under which our proposed estimators achieve the minimax lower bound. We demonstrate the usefulness of our theory via applications to multi-armed bandit, autoregressive time series estimation, and active learning with exploration.

AoS Other · 发表于 2025-12-01

Kurtosis-based projection pursuit for matrix-valued data

Una Radojičić, Klaus Nordhausen, Joni Virta

摘要

We develop projection pursuit for data that admit a natural representation in matrix form. For projection indices, we propose extensions of the classical kurtosis and Mardia’s multivariate kurtosis. The first index estimates projections for both sides of the matrices simultaneously, while the second index finds the two projections separately. Both indices are shown to recover the optimally separating projection for two-group Gaussian mixtures in the absence of any label information. We further establish the strong consistency of the corresponding sample estimators, as well as the asymptotic normality and high-dimensional consistency for the first estimator. Simulations and real data examples on hand-written postal codes and video data are used to demonstrate the method.

AoS High-Dimensional · 发表于 2025-12-01

High-dimensional Hilbert–Schmidt linear regression with Hilbert manifold variables

Changwon Choi, Byeong U. Park

摘要

In this paper, we propose a novel high-dimensional linear regression technique for variables taking values in Hilbert manifolds. Our approach offers a flexible framework where the response and covariates originate from distinct spaces and are interconnected by Hilbert–Schmidt operators. Our methodology is designed for situations where the number of the covariates grows exponentially fast as the sample size increases and some of the covariates together with the response take values in infinite dimensional spaces. It is formulated under a general penalization scheme that includes various nonconvex penalty functions. Leveraging modern statistical theory for data residing on Hilbert manifolds, we establish the oracle property and derive error bounds for the proposed estimators. We also provide an efficient computational algorithm to solve the associated constrained optimization problem. The practical performance of the proposed method is demonstrated via numerical simulation and real data applications.

AoS Networks & Graphs · 发表于 2025-12-01

Fundamental limits of community detection from multi-view data: Multi-layer, dynamic and partially labeled block models

Xiaodong Yang, Buyu Lin, Subhabrata Sen

摘要

Multi-view data arises frequently in modern network analysis for example, relations of multiple types among individuals in social network analysis, longitudinal measurements of interactions among observational units, annotated networks with noisy partial labeling of vertices etc. We study community detection in these disparate settings via a unified theoretical framework, and investigate the fundamental thresholds for community recovery. We characterize the mutual information between the data and the latent parameters, provided the degrees are sufficiently large. Based on this general result, (i) we derive a sharp threshold for community detection in an inhomogeneous multi-layer block model (Ann. Statist. 50 (2022) 2664–2693), (ii) characterize a sharp threshold for weak recovery in a dynamic stochastic block model (J. R. Stat. Soc. Ser. B. Stat. Methodol. 79 (2017) 1119–1141), and (iii) identify the limiting mutual information in an unbalanced partially labeled block model. Finally, we introduce iterative algorithms based on Approximate Message Passing for community detection in these problems.

SiM Causal Inference Machine Learning Testing & Uncertainty · 发表于 2025-12-01

Explaining Individualized Treatment Rules: Integrating LIME and SHAP With Xgboost in Precision Medicine

Zihuan Liu, Xin Huang

摘要

Precision medicine relies on accurate and interpretable predictive models to identify patient subgroups and biomarkers that can guide individualized treatment strategies. While extreme gradient boosting (XGBoost) often achieves state‐of‐the‐art predictive performance, its complexity can impede understanding of how input variables influence outcomes. Building upon existing XGBoost frameworks for estimating individualized treatment rule (ITR), we introduce a global permutation test within this framework to assess treatment effect heterogeneity. Additionally, we incorporate two model‐agnostic explanation techniques, local interpretable model‐agnostic explanations (LIME) and SHapley Additive exPlanations (SHAP), to enhance interpretability at both global and individual levels. Through simulations and analyses of real‐world clinical trial datasets, we illustrate that our permutation‐based pipeline can detect empirical signals of treatment effect heterogeneity, while LIME and SHAP offer exploratory insights into feature contributions and ITR.

AoS Causal Inference Latent Variables & Mixtures Longitudinal Data · 发表于 2025-12-01

Counterfactual inference in sequential experiments

Raaz Dwivedi, Katherine Tian, Sabina Tomkins, Predrag Klasnja, Susan Murphy, Devavrat Shah

摘要

We consider after-study statistical inference for sequentially designed experiments wherein multiple units are assigned treatments for multiple time points using treatment policies that adapt over time. Our goal is to provide inference guarantees for the counterfactual mean at the smallest possible scale—mean outcome under different treatments for each unit and each time—with minimal assumptions on the adaptive treatment policy. Without any structural assumptions on the counterfactual means, this challenging task is infeasible due to more unknowns than observed data points. To make progress, we introduce a latent factor model over the counterfactual means that serves as a nonparametric generalization of the nonlinear mixed effects model and the bilinear latent factor model considered in prior works. For estimation, we use a nonparametric method, namely a variant of nearest neighbors, and establish a nonasymptotic high probability error bound for the counterfactual mean for each unit and each time. Under regularity conditions, this bound leads to asymptotically valid confidence intervals for the counterfactual mean as the number of units and time points grows to ∞ together at suitable rates. We illustrate our theory via several simulations and a case study involving data from a mobile health clinical trial HeartSteps.

AoS Latent Variables & Mixtures Bayesian Methods Nonparametric & Semiparametric · 发表于 2025-12-01

Clustering risk in nonparametric hidden Markov and I.I.D. models

Élisabeth Gassiat, Ibrahim Kaddouri, Zacharie Naulet

摘要

We conduct an in-depth analysis of the Bayes risk of clustering in the context of hidden Markov and i.i.d. models. In both settings, we identify the situations where this risk is comparable to the Bayes risk of classification and those where its minimizer, the Bayes clusterer, can be derived from the Bayes classifier. While we demonstrate that clustering based on the Bayes classifier does not always match the optimal Bayes clusterer, we show that this difference is primarily theoretical and that the Bayes classifier remains nearly optimal for clustering. A key quantity emerges, capturing the fundamental difficulty of both classification and clustering tasks. Furthermore, by leveraging the identifiability of HMMs, we establish bounds on the clustering excess risk of a plug-in Bayes classifier in the general nonparametric setting, offering theoretical justification for its widespread use in practice. Simulations further illustrate our findings.

AoS Latent Variables & Mixtures · 发表于 2025-12-01

Clustering by hill-climbing: Consistency results

Ery Arias-Castro, Wanli Qiao

摘要

We consider several hill-climbing approaches to clustering as formulated by Fukunaga and Hostetler (IEEE Trans. Inf. Theory IT-21 (1975) 32–40) in the 1970s. We study both continuous-space and discrete-space (i.e., medoid) variants and establish their consistency.

AoS Causal Inference Networks & Graphs · 发表于 2025-12-01

Causal effect estimation under network interference with mean-field methods

Sohom Bhattacharya, Subhabrata Sen

摘要

We study causal effect estimation from observational data under interference. The interference pattern is captured by an observed network. We adopt the chain graph framework of (J. Amer. Statist. Assoc. 116 (2021) 833–844), which allows (i) interaction among the outcomes of distinct study units connected along the graph and (ii) long range interference, whereby the outcome of an unit may depend on the treatments assigned to distant units connected along the interference network. For “mean-field” interaction networks, we develop a new scalable iterative algorithm to estimate the causal effects. For Gaussian weighted networks, we introduce a novel causal effect estimation algorithm based on Approximate Message Passing (AMP). Our algorithms are provably consistent under a “high temperature” condition on the underlying model. We estimate the (unknown) parameters of the model from data using maximum pseudo-likelihood and establish n-consistency of this estimator in all parameter regimes. Finally, we prove that the downstream estimators obtained by plugging in estimated parameters into the aforementioned algorithms are consistent at high temperature. Our methods can accommodate dense interactions among the study units—a setting beyond reach using existing techniques. Our algorithms originate from the study of variational inference approaches in high-dimensional statistics; overall, we demonstrate the usefulness of these ideas in the context of causal effect estimation under interference.

Biometrics Causal Inference · 发表于 2025-12-01

Bridging the gap between design and analysis: randomization inference and sensitivity analysis for matched observational studies with treatment doses

Jeffrey Zhang, Siyu Heng

摘要

Matching is a commonly used causal inference study design in observational studies. Through matching on measured confounders between different treatment groups, valid randomization inferences can be conducted under the no unmeasured confounding assumption, and sensitivity analysis can be further performed to assess robustness of results to potential unmeasured confounding. However, for many common matched designs, there is still a lack of valid downstream randomization inference and sensitivity analysis methods. Specifically, in matched observational studies with treatment doses (eg, continuous or ordinal treatments), with the exception of some special cases such as pair matching, there is no existing randomization inference or sensitivity analysis method for studying analogs of the sample average treatment effect (ie, Neyman-type weak nulls), and no existing valid sensitivity analysis approach for testing the sharp null of no treatment effect for any subject (ie, Fisher’s sharp null) when the outcome is nonbinary. To fill these important gaps, we propose new methods for randomization inference and sensitivity analysis that can work for general matched designs with treatment doses, applicable to general types of outcome variables (eg, binary, ordinal, or continuous), and cover both Fisher’s sharp null and Neyman-type weak nulls. We illustrate our methods via comprehensive simulation studies and a real data application. All the proposed methods have been incorporated into $\tt {R}$ package $\tt {doseSens}$.

AoS Testing & Uncertainty Nonparametric & Semiparametric · 发表于 2025-12-01

Asymptotically-exact selective inference for quantile regression

Yumeng Wang, Snigdha Panigrahi, Xuming He

摘要

In modern data analysis, it is common to select a model before performing statistical inference. Selective inference tools make adjustments for the model selection process in order to ensure reliable inference post selection. In this paper, we introduce an asymptotic pivot to infer about the effects of selected variables on conditional quantile functions. Utilizing estimators from smoothed quantile regression, our proposed pivot is easy to compute and yields asymptotically-exact selective inference without making strict distributional assumptions about the response variable. At the core of our pivot is the use of external randomization variables, which allows us to utilize all available samples for both selection and inference, without partitioning the data into independent subsets or discarding samples at any step. From simulation studies, we find that: (i) the asymptotic confidence intervals based on our pivot achieve the desired coverage rates, even in cases where sample splitting fails due to insufficient sample size for inference; (ii) our intervals are consistently shorter than those produced by sample splitting across various models and signal settings. We report similar findings when we apply our approach to study risk factors for low birth weights in a publicly accessible dataset of US birth records from 2022.

SiM Survival Analysis · 发表于 2025-12-01

An Augmented Likelihood Approach Incorporating Error‐Prone Auxiliary Data Into a Survival Analysis

Noorie Hyun, Lillian Boe, Pamela A. Shaw

摘要

In this big data era, we can readily access extensive clinical data from large observational studies or electronic health records (EHR). Data accuracy can vary according to the measurement method. For example, clinical variables extracted by automated computer algorithms or obtained from participant self‐reported medical history can be error‐prone. Precise data, such as those obtained from a chart review or a gold standard diagnostic test, may only be available on a subset of individuals due to cost or participant burden. We propose a method to augment a regression analysis of a gold standard time‐to‐event outcome with available error‐prone disease diagnoses for the setting where the gold standard is observed on a subset. The proposed model addresses left‐truncation and interval‐censoring in time‐to‐event outcomes while leveraging information from the self‐reported disease diagnosis in a joint likelihood for the gold standard and error‐prone outcomes. The proposed model is applied to the Hispanic Community Health Study/Study of Latinos data to quantify risk factors associated with diabetes onset.

AoS Networks & Graphs · 发表于 2025-12-01

A two-way heterogeneity model for dynamic networks

Binyan Jiang, Chenlei Leng, Ting Yan, Qiwei Yao, Xinyang Yu

摘要

Analysis of networks that evolve dynamically requires the joint modelling of individual snapshots and time dynamics. This paper proposes a new flexible two-way heterogeneity model towards this goal. The new model equips each node of the network with two heterogeneity parameters, one to characterize the propensity to form ties with other nodes statically and the other to differentiate the tendency to retain existing ties over time. With n observed networks each having p nodes, we develop a new asymptotic theory for the maximum likelihood estimation of 2p parameters when np→∞. We overcome the global nonconvexity of the negative log-likelihood function by the virtue of its local convexity, and propose a novel method of moment estimator as the initial value for a simple algorithm that leads to the consistent local maximum likelihood estimator (MLE). To establish the upper bounds for the estimation error of the MLE, we derive a new uniform deviation bound, which is of independent interest. The theory of the model and its usefulness are further supported by extensive simulation and the analysis of some real network data sets.

Biometrics Nonparametric & Semiparametric · 发表于 2025-12-01

A semiparametric method for addressing underdiagnosis using electronic health record data

Weidong Ma, Jordana B Cohen, Jinbo Chen

摘要

Effective treatment of medical conditions begins with an accurate diagnosis. However, many conditions are often underdiagnosed, either being overlooked or diagnosed after significant delays. Electronic health records (EHRs) contain extensive patient health information, offering an opportunity to probabilistically identify underdiagnosed individuals. The rationale is that both diagnosed and underdiagnosed patients may display similar health profiles in EHR data, distinguishing them from condition-free patients. Thus, EHR data can be leveraged to develop models that assess an individual’s risk of having a condition. To date, this opportunity has largely remained unexploited, partly due to the lack of suitable statistical methods. The key challenge is the positive-unlabeled EHR data structure, which consists of data for diagnosed (“positive”) patients and the remaining (“unlabeled”) that include underdiagnosed patients and many condition-free patients. Therefore, data for patients who are unambiguously condition-free, essential for developing risk assessment models, are unavailable. To overcome this challenge, we propose ascertaining condition statuses for a small subset of unlabeled patients. We develop a novel statistical method for building accurate models using this supplemented EHR data to estimate the probability that a patient has the condition of interest. We study the asymptotic properties of our method and assess its finite-sample performance through simulation studies. Finally, we apply our method to develop a preliminary model for identifying potentially underdiagnosed non-alcoholic steatohepatitis patients using data from Penn Medicine EHRs.

AoS Nonparametric & Semiparametric · 发表于 2025-12-01

A geometrical analysis of kernel ridge regression and its applications

Georgios Gavrilopoulos, Guillaume Lecué, Zong Shang

摘要

We obtain upper bounds for the estimation error of Kernel Ridge Regression (KRR) for all nonnegative regularization parameters, offering a geometric perspective on various phenomena in KRR. As applications: 1. We address the Multiple Descents problem, unifying the proofs of (In Proceedings of Thirty Third Conference on Learning Theory (2020) 2683–2711 PMLR) and (Ann. Statist. 49 (2021) 1029–1054) for polynomial kernels in nonasymptotic regime and we establish Multiple Descents for the generalization error of KRR for polynomial kernel under sub-Gaussian design in asymptotic regimes. 2. In the nonasymptotic regime, we have established a one-sided isomorphic version of the Gaussian Equivalence Conjecture for sub-Gaussian design vectors. 3. We offer a novel perspective on the linearization of kernel matrices of nonlinear kernels, extending it to the power regime for polynomial kernels. 4. Our theory extends the results in (J. Mach. Learn. Res. 24 (2023) Paper No. [123]) under weak moment assumption. Our proof is based on three mathematical tools developed in this paper that can be of independent interest: 1. Dvoretzky–Milman theorem for ellipsoids under (very) weak moment assumptions. 2. Restricted isomorphic property in reproducing kernel Hilbert spaces with embedding index conditions. 3. A concentration inequality for finite-degree polynomial kernel functions.

AoS Other · 发表于 2025-12-01

A flexible defense against the winner’s curse

Tijana Zrnic, William Fithian

摘要

Across science and policy, decision-makers often need to draw conclusions about the best candidate among competing alternatives. For instance, researchers may seek to infer the effectiveness of the most successful treatment or determine which demographic group benefits most from a specific treatment. Similarly, in machine learning, practitioners are often interested in the population performance of the model that performs best empirically. However, cherry-picking the best candidate leads to the winner’s curse: the observed performance for the winner is biased upwards, rendering conclusions based on standard measures of uncertainty invalid. We introduce the zoom correction, a novel approach for valid inference on the winner. Our method is flexible: it can be employed in both parametric and nonparametric settings, can handle arbitrary dependencies between candidates, and automatically adapts to the level of selection bias. The method easily extends to important related problems, such as inference on the top k winners, inference on the value and identity of the population winner, and inference on “near-winners.

AoS Causal Inference Clinical Trials Missing Data & Measurement Error · 发表于 2025-12-01

A common-cause principle for eliminating selection bias in causal estimands through covariate adjustment

Maya B. Mathur, Tyler J. VanderWeele, Ilya Shpitser

摘要

Average treatment effects (ATEs) may be subject to selection bias when they are estimated among only a nonrepresentative subset of the target population. Selection bias can sometimes be eliminated by conditioning on a “sufficient adjustment set” of covariates, even for some forms of missingness not at random (MNAR). Without requiring full specification of the causal structure, we consider sufficient adjustment sets to allow nonparametric identification of conditional ATEs in the target population. Covariates in the sufficient set may be collected among only the selected sample. We establish that if a sufficient set exists, then the set consisting of common causes of the outcome and selection, excluding the exposure and its descendants, also suffices. We establish simple graphical criteria for when a sufficient set will not exist, which could help indicate whether this is plausible for a given study. Simulations considering selection due to missing data indicated that sufficiently-adjusted complete-case analysis (CCA) can considerably outperform multiple imputation under MNAR and, if the sample size is not large, sometimes even under missingness at random. Analogous to the common-cause principle for confounding, these sufficiency results clarify when and how selection bias can be eliminated through covariate adjustment.

SiM Longitudinal Data · 发表于 2025-12-01

A Random‐Effects Approach to Generalized Linear Mixed Model Analysis of Incomplete Longitudinal Data

Thuan Nguyen, Jiangshan Zhang, Jiming Jiang

摘要

We propose a random‐effects approach to missing values for generalized linear mixed model (GLMM) analysis of longitudinal data. The method converts a GLMM with missing covariates to another GLMM without missing covariates. The standard GLMM analysis tools then apply. The method applies, in particular, to the cases of linear mixed models (LMMs) and logistic regression. Performance of the method is evaluated empirically, and compared with alternative approaches, including the popular MICE procedure of multiple imputation (MI). Theoretical justification of the method is given, and explained, for the patterns observed in the simulation studies. Two real‐data examples from healthcare studies are discussed.

SiM High-Dimensional Causal Inference · 发表于 2025-11-28,收录于 2026-10-20

Group Lasso Based Selection for High-Dimensional Mediation Analysis

Allan Jérolon, Flora Alarcon, Florence Pittion, Magali Richard, Olivier François, Etienne Birmelé, Vittorio Perduca

摘要

Mediation analysis aims to identify and estimate the effect of an exposure on an outcome that is mediated through one or more intermediate variables. In the presence of multiple intermediate variables, two pertinent methodological questions arise: estimating mediated effects when mediators are correlated, and performing high-dimensional mediation analyses when the number of mediators exceeds the sample size. This paper presents a two-step procedure for high-dimensional mediation analyses. The first step selects a reduced number of candidate mediators using an ad-hoc lasso penalty. The second step applies a procedure we previously developed to estimate the mediated effects, accounting for the correlation structure among the retained candidate mediators. We compare the performance of the proposed two-step procedure with state-of-the-art methods using simulated data. Additionally, we demonstrate its practical application by estimating the causal role of DNA methylation (DNAm) in the pathway between smoking and rheumatoid arthritis (RA) using real data.

Biometrics Bayesian Methods Nonparametric & Semiparametric Machine Learning · 发表于 2025-11-28

Flexible Bayesian quantile regression for counts via generative modeling

Yuta Yamauchi, Genya Kobayashi, Shonosuke Sugasawa

摘要

Count data frequently arises in biomedical applications, such as the length of hospital stay. However, their discrete nature poses significant challenges for appropriately modeling conditional quantiles, which are crucial for understanding heterogeneous effects and variability in outcomes. To solve the practical difficulty, we propose a novel general Bayesian framework for quantile regression tailored to count data. We seek the regression parameter on the conditional quantile by minimizing the expected loss with respect to the distribution of the conditional quantile of the latent continuous variable associated with the observed count response variable. By modeling the unknown conditional distribution through a Bayesian nonparametric kernel mixture for the joint distribution of the count response and covariates, we obtain the posterior distribution of the regression parameter via a simple optimization. We numerically demonstrate that the proposed method improves bias and estimation accuracy of the existing crude approaches to count quantile regression. Furthermore, we analyze the length of hospital stay for acute myocardial infarction and demonstrate that the proposed method gives more interpretable and flexible results than the existing ones.

Biometrics Latent Variables & Mixtures Genetics & Omics · 发表于 2025-11-28

Entrywise splitting cross-validation in generalized factor models: from sample splitting to entrywise splitting

Zhijing Wang

摘要

The generalized factor models have been widely employed for dimension reduction across various types of multivariate data, including binary choices, counts, and continuous observations. While determining the number of factors in such models has received significant scholarly attention, it remains an open challenge in the field. In this paper, we propose a cross-validation (CV) method based on entrywise splitting (ES), rather than sample splitting, to address this problem. Similar to traditional cross-validation, this approach primarily prevents the underestimation of the number of factors. We then introduce a penalized entrywise splitting cross-validation criterion, which integrates the original CV with information theoretic criteria by adding a penalty term. Its consistency is established under mild conditions in a high-dimensional setting, where both the sample size and the number of features grow to infinity. Furthermore, we extend our methodology to random missing data with different probability scenarios. We evaluate the performance of the proposed method through comprehensive simulations and apply it to a mouse brain single-cell RNA sequencing dataset.

SiM Causal Inference Clinical Trials · 发表于 2025-11-27

Using Individualized Treatment Effects to Assess Treatment Effect Heterogeneity

Konstantinos Sechidis, Cong Zhang, Sophie Sun, Yao Chen, Asher Spector, Björn Bornkamp

摘要

Assessing treatment effect heterogeneity (TEH) in clinical trials is crucial, as it provides insights into the variability of treatment responses among patients, influencing key decisions related to drug development. Furthermore, it can lead to personalized medicine by tailoring treatments to individual patient characteristics. This paper introduces novel methodologies for assessing treatment effects using the individualized treatment effect as a basis. To estimate this effect, we use a doubly robust (DR) learner to infer a pseudo‐outcome that reflects the causal contrast. This pseudo‐outcome is then used to perform three objectives: (1) a global test for heterogeneity, (2) ranking covariates based on their influence on effect modification, and (3) providing estimates of the individualized treatment effect. We compare the DR‐learner with various alternatives and competing methods in a simulation study, and also use it to assess heterogeneity in a pooled analysis of five Phase III trials in psoriatic arthritis (PsA). By integrating these methods with the recently proposed Workflow to Assess Treatment Effect Heterogeneity in Drug Development for Clinical Trial Sponsors (WATCH) workflow, we provide a robust framework for analyzing TEH, offering insights that enable more informed decision‐making in this challenging area.

SMMR Clinical Trials · 发表于 2025-11-27

Adaptive sample size re-estimation designs for a two-stage randomized trial with binary outcome

Zhixin Tang, Guogen Shan

摘要

A parallel randomized trial is frequently used to investigate the treatment effectiveness as compared to the gold standard. In early phase trials, a group sequential design has the potential to reduce the expected sample size as compared to the traditional one-stage design, and protect participants when a new treatment is not as effective as expected. When the outcome is binary, a group sequential design based on exact binomial distribution is preferable as compared to the asymptotic limiting distribution. To improve the design efficiency, we propose to develop new parallel two-stage adaptive design and promising zone design allowing sample size adjustment in the second stage based on the outcome from the first stage. The conditional probability is guaranteed in the proposed designs when a trial proceeds to the second stage. All these designs control the type I error rate, but only the proposed two designs guarantee the conditional probability constraint. We used a real example from a completed cancer trial to illustrate the application of the proposed designs. The adaptive design substantially increases unconditional power but requires a large sample size as compared to the group sequential design. The promising zone design achieves a good balance between statistical power and the expected sample size.

第 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 页