Metric Conformal Prediction via the Conditional Expected Local Radius

stat.ML cs.LG Rui Qiu, Fang Yao, Zhou Yu · Oct 22, 2026
Local to this browser
What it does
Conformal prediction for non-Euclidean responses is underdeveloped because conventional scores require residuals or densities that assume a vector-space structure. This paper introduces the conditional expected local radius,...
Why it matters
This paper introduces the conditional expected local radius, $R_\beta(\omega|x)=\frac{1}{\beta}\int_0^\beta Q_x(\omega,\tau)\,d\tau$, as a nonconformity measure in general metric spaces, and estimates the conditional distance profile, the...
Main concern
The paper makes a credible contribution to conformal prediction for random objects. The CELR construction is geometrically natural and theoretically tractable, and the unified forest estimator brings substantial computational savings over...
Community signal
0
0 up · 0 down
Sign in to vote with arrows
AI Review AI reviewed
Plain-language introduction

Conformal prediction for non-Euclidean responses is underdeveloped because conventional scores require residuals or densities that assume a vector-space structure. This paper introduces the conditional expected local radius, $R_\beta(\omega|x)=\frac{1}{\beta}\int_0^\beta Q_x(\omega,\tau)\,d\tau$, as a nonconformity measure in general metric spaces, and estimates the conditional distance profile, the CELR, and its conditional distribution from a single metric distributional random forest. The result is a computationally cheaper alternative to the conditional profile score method of Zhou and Müller (2025) with uniform consistency and asymptotic conditional validity guarantees.

Critical review
Verdict
Bottom line

The paper makes a credible contribution to conformal prediction for random objects. The CELR construction is geometrically natural and theoretically tractable, and the unified forest estimator brings substantial computational savings over the transport-based CPS baseline. Theorems 5–7 establish uniform consistency of the forest estimators in RKHS norm, CDP, and CELR, while Theorem 8 proves asymptotic conditional validity under regularity conditions. Simulations across Euclidean, spherical, SPD, and Wasserstein spaces, together with real-data applications to NYC taxi networks and U.S. energy shares, support practical utility. That said, the method leaves open how to choose the locality level $\beta$, how to search over infinite candidate spaces in general, and whether the strong Lipschitz continuity conditions required for asymptotic validity hold in practice. No public code is indicated.

“$\mathbb{P}(Y_{0}\in\hat{C}_{1-\alpha}(X_{0})\mid X_{0})=1-\alpha+o_{p}(1).$”
paper · Theorem 8
“Setting 4 ... ELR (s) 73.3 ... CPS (s) 22,208.7 ... Speedup 303.14”
paper · Table 1
What holds up

The strongest element is the unified estimation strategy: a single MDRF fit supplies the weights for the conditional distance profile, the CELR, and the conditional score transform. This avoids the repeated local linear fits and pairwise transport comparisons required by Zhou and Müller (2025). The computational gains are dramatic, especially in multivariate settings, and the theory is correspondingly rigorous. The authors derive a uniform convergence rate over covariates, candidate centers, and radii by treating the forest as a growing-order U-statistic and proving a maximal inequality for the associated U-process. They are also admirably self-critical in Remark 1, noting that these bounds do not establish a general rate advantage over local linear methods.

“ELR fits the MDRF once and reuses its weights to estimate CDPs, CELRs, and the conditional distribution functions that define the scores. CPS instead repeatedly applies local smoothing to construct calibration scores and prediction sets, with additional comparisons between conditional distance profiles.”
paper · Section 5.3
“These bounds do not establish a general rate advantage for forests.”
paper · Remark 1, Section 4.2
Main concerns

Several practical and theoretical gaps remain. First, the locality level $\beta$ is a free hyperparameter that directly controls how much probability mass enters the local radius; the paper offers no selection criterion beyond a heuristic grid search over $[0.1,0.25]$. Second, because prediction set membership is determined pointwise by $\hat{S}(\hat{R}_\beta(\omega|X_0)|X_0)\leq\hat{Q}_{1-\alpha}$, constructing the actual set requires evaluating candidates $\omega$ in a potentially infinite metric space. The paper only states that this is done on a finite candidate set suited to the response space, which ducks the hard general case. Third, asymptotic conditional validity rests on Assumption A6, which requires the conditional CDF of the CELR to be jointly Lipschitz in score threshold and covariate. This is a strong, effectively untestable regularity condition, and its failure would break the $o_p(1)$ conditional coverage.

“In the numerical studies, we consider candidate values of $\beta$ in $[0.1,0.25]$ to balance locality and robustness.”
paper · Section 2
“In numerical work, this rule is evaluated on a finite candidate set suited to the response space.”
paper · Section 3.2.2
“(1) $S(z|x)$ is Lipschitz continuous in $z$ uniformly over $x\in\mathcal{X}$. (2) $S(z|x)$ is Lipschitz continuous in $x$ uniformly over $z\geq 0$.”
paper · Assumption A6, Section 4.2
Evidence and comparison

The simulation evidence is generally convincing but not uniformly favorable. In the single-index model of Setting 4, CPS with a correctly specified index achieves smaller absolute conditional coverage errors than the nonparametric forest, as one would expect; ELR wins on computation, not accuracy, in this regime. The paper is honest about this trade-off. Real-data applications to SPD-valued taxi networks and compositional energy shares are imaginative and show that the sets adapt to heterogeneity. However, conditional coverage is assessed visually and via binned averages rather than formal inferential tests, and noticeable undercoverage appears near discontinuities in Figure 2. The theoretical comparison to local linear rates is also fair and nuanced.

“CPS, which exploits the correctly specified single-index structure, achieves smaller absolute conditional coverage errors for both $p=5$ and $p=10$. Forest-based ELR offers a nonparametric alternative without imposing this structural assumption, albeit with somewhat larger coverage errors in this experiment.”
paper · Section 5.2
Reproducibility

An independent reproduction would face several obstacles. The method chains together multiple complex components: MMD-based splitting in a distributional random forest, kernel mean embedding with a space-dependent characteristic kernel, quantile integration for the CELR, and conditional CDF estimation. Hyperparameter choices for the forest, kernel bandwidth, and $\beta$ are relegated to Appendix S.3, which is not available in the excerpt. The main text does not reference any public code repository. The real datasets are publicly available (NYC TLC and EIA SEDS), which helps, but the SPD construction from taxi flows involves preprocessing choices (scaling, symmetrizing, matrix exponential) that would need to be exactly replicated. Without released code, reproducing the timing benchmarks and coverage accuracy claims would be time-consuming.

“Appendix S.3 describes the hyperparameter choices.”
paper · Section 5
Abstract

We introduce the conditional expected local radius (CELR) and develop a new conformal prediction method for non-Euclidean responses in general metric spaces. CELR measures local conditional probability concentration, allowing prediction sets to accommodate heterogeneity and multimodality without requiring densities or a vector space structure. Its conditional distribution yields a nonconformity score that is comparable across covariate values and avoids costly transport comparisons between distance profiles. We further adapt a metric distributional random forest that handles multivariate covariates and nonlinear interactions, while a single forest fit supplies all score components, reducing computation by eliminating repeated local fitting. We establish uniform consistency of the estimators and asymptotic conditional validity under suitable regularity conditions, together with finite-sample marginal coverage under exchangeability. Numerical studies demonstrate effective uncertainty quantification across different metric spaces and substantial computational savings over the conditional profile score method.

Challenge the Review

Pick a starting point or write your own. Challenges run in the background, so you can keep reading while the AI investigates.

No challenges yet. Disagree with the review? Ask the AI to revisit a specific claim.