Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
1579 papers
Trending mixes fresh papers with community signal.
0
cs.MAcs.AI Sarath Shekkizhar, Prathyusha Jwalapuram, Zixuan Ke et al. · Oct 14, 2026

Agents are increasingly expected to negotiate and collaborate across organizational boundaries where each party maintains private tools, documents, and incentives. This paper studies how agent-to-agent (A2A) systems fail under these conditions, introducing A2A²-Failures, a taxonomy of 20 failure modes derived from over 2,500 sandboxed runs spanning cooperative to competitive scenarios. Its central thesis is that evaluating only final outcomes masks critical behavioral breakdowns—such as unverified peer claims, private data leakage, and scope distortion—making per-agent principal-alignment auditing essential for safe cross-boundary deployment.

Agents are increasingly interacting with other agents that act for different principals -- people or organizations on whose behalf they work -- e.g., a buyer's personal agent negotiating with an enterprise's seller agent. In such agent-to-agent (A2A) scenarios, each agent has its own environment and holds information and authority that the other cannot see. Moreover, the interests of each agent may be aligned (cooperative), partly aligned (mixed-motive), or opposed (competitive). Existing multi-agent system failure studies assume only one orchestrator, shared workspace, or principal. We ask how A2A systems fail when these assumptions are removed. We study more than 2,500 recorded runs of A2A systems built from different agent harnesses and models, spanning 488 scenarios across eight families (legal, CRM, security, commerce, etc.). From these traces, we derive $A^2$-Failures, a taxonomy of 20 A2A failure modes in four categories: (i) discovery and delegation, (ii) grounding and record consistency, (iii) verification, and (iv) conduct and fidelity. Three observations hold across the harnesses, models, and scenarios studied: (1) Agents match tasks to peer names mentioned in the prompt rather than actively searching for available peers; (2) Agents never fact-check each other unprompted; (3) Scoring only the final output rewards the lead agent while hiding internal coordination, verification, and behavioral breakdowns. Our study makes a case for comprehensive evaluations where agents are scored individually against their own objectives in addition to task outcome. We release the run logs behind the taxonomy at https://huggingface.co/datasets/a2a-salesforce/a2-failures.
0
cs.CLcs.AI LLM-jp: Chaoran Liu, Daisuke Kawahara, Hideyuki Tachibana et al. · Oct 14, 2026

LLM-jp-4 is a family of Japanese sovereign language models—an 8B dense Transformer and a 32B-A3B mixture-of-experts—trained from scratch on roughly 12 trillion tokens with an explicit emphasis on transparency, legal reproducibility, and practical deployment. The authors impose strict open-source selection criteria on data, external models, and software, and they document every stage from tokenizer design through pre-training, mid-training, and post-training. The work aims to provide a publicly verifiable reference for sovereign AI development in Japan.

This paper presents LLM-jp-4, a family of Japanese sovereign large language models (LLMs) developed with an emphasis on transparency, reproducibility, and practical usability. LLM-jp-4 comprises an 8B dense model and a 32B-A3B mixture-of-experts model, both trained from scratch on approximately 12 trillion tokens. To support independent verification and reproduction, we establish explicit criteria for selecting training data, external models, and software, and make the development process publicly available. Evaluation results demonstrate substantial improvements over previous LLM-jp models and competitive performance against open-weight models of similar scale. By documenting the development principles, training procedures, and empirical findings of LLM-jp-4, we aim to provide a reference for future sovereign AI development.
0
cs.AI Shuang Zeng, Yunwen Lei, Yiming Ying · Oct 14, 2026

Minimax optimization underlies adversarial training, GANs, and AUC maximization, yet biased stochastic gradient descent-ascent methods—zeroth-order and clipped variants—have had no generalization theory. This paper develops the first stability framework for biased SGDA in convex-concave smooth problems, replacing the standard bounded-gradient assumption with a bounded second-moment condition. It derives generalized Lipschitz-type stability bounds and proves that zeroth-order and clipped SGDA can achieve the minimax-optimal $O(1/\sqrt{n})$ excess risk.

Minimax optimization refers to a class of optimization problems with some variables to minimize and other variables to maximize. Biased stochastic gradient methods have shown practical success in solving minimax problems to either improve robustness, enhance communication efficiency, or decrease computational costs. These successes motivate a lot of theoretical works to study the convergence of biased stochastic gradient methods, while their generalization analysis remains untouched. In this paper, we present the first framework to study the stability and generalization of biased stochastic gradient methods for minimax problems. We establish a connection between stability and generalization for minimax problems by relaxing the existing bounded gradient assumption to a bounded second moment condition. We then introduce a generalized Lipschitz-type condition on bias and gradient estimators, and derive a general stability bound to clarify the connection among bias, gradient estimators, and stability. We apply our general analysis to Zeroth-order and Clipped stochastic gradient descent ascent (SGDA), and derive stability bounds that match those of SGDA under appropriate smoothing/clipping parameters. We combine stability and convergence analyses together, and derive optimal excess risk bounds of order $1/\sqrt{n}$, where $n$ is the sample size.
0
cs.LGstat.ML Yuxuan Xia, Xiao-Tong Yuan · Oct 14, 2026

This paper claims the first global joint lower bound for zeroth-order nonconvex optimization under unrestricted spatial queries and sample reuse. The core idea is to force any algorithm to advance through $T\asymp\min\{\Delta H,L_0^2\}/\epsilon^2$ hidden geometric stages and to prove that each fresh stage requires $\Omega(dL_0^2/\epsilon^2)$ adaptive scalar evaluations, yielding an overall $\Omega(dL_0^2\min\{\Delta H,L_0^2\}/\epsilon^4)$ bound. If correct, this would settle the open problem posed by Kornowski and Shamir (2024), though the manuscript is dated 14 October 2026, cites several future works, and explicitly states that its mathematics was primarily AI-generated.

Recent work has sought to transfer first-order nonconvex optimization guarantees to zeroth-order methods through gradient estimators, typically incurring a factor linear in $d$. \citet{kornowski2024} obtained an $\mathcal{O}(d\delta^{-1}\epsilon^{-3})$ oracle complexity for nonsmooth nonconvex optimization and asked whether its dependence on all three parameters is jointly optimal. Although the dimension dependence and the first-order dependence on $(\delta,\epsilon)$ are separately known to be unavoidable, a matching zeroth-order lower bound has remained open. We answer this question in the unrestricted full-space setting. For smooth stochastic nonconvex optimization, we establish a scalar-oracle lower bound of $\Omega\!\left(dL_0^2\min\{\Delta H,L_0^2\}/\epsilon^4\right)$ assuming a smooth, globally lower-bounded population objective and a second-moment bound on sample Lipschitz constants. A smooth reduction then yields a lower bound for Goldstein stationarity, proving the joint minimax optimality of the dependence on $(d,\delta,\epsilon)$ under explicit high-dimensional and small-accuracy conditions. Crucially, our results allow algorithms to query arbitrary points in $\mathbb{R}^d$, adaptively select sample-function labels, reuse the same sampled function at any number of locations, and output points without spatial restrictions. Thus, unlike lower bounds based on bounded query regions or fresh evaluation noise, our guarantees apply to a fully adaptive, reusable-sample scalar oracle. We also establish a separate noiseless exact-value lower bound against randomized algorithms, and hence also against deterministic methods. Our proof combines a globally defined sequential nonconvex construction with an exact Gaussian scalar channel, multistage random-field estimates, and an antithetic finite-sample realization that preserves information hardness under adaptive reuse.
0
stat.MLcs.LG Keisuke Hanada, Futoshi Futami · Oct 14, 2026

In medical and crowdsourced annotation, the absence of clean ground truth biases standard expected calibration error (ECE) evaluation because annotator errors confound predictor miscalibration. This paper proposes Noise Corrected ECE (NC-ECE), which inverts annotator-specific class-conditional noise channels to recover clean-label ECE, and provides methods to estimate those channels from repeated annotations alone. It then derives post-hoc recalibration algorithms with either clean-risk or calibration guarantees. The work is directly motivated by settings such as medical imaging, where expert disagreement is common and reliable uncertainty assessment is essential.

In medical annotation and crowdsourcing, multiple annotators assign labels to each example, but these labels may be incorrect. Treating such noisy labels as ground truth can bias calibration evaluation. To address this problem, we propose methods for evaluating and recalibrating a fixed binary predictor under the underlying clean-label distribution, using only noisy annotations. First, given annotator-specific noise probabilities, we propose Noise Corrected ECE (NC-ECE), a binned estimator of expected calibration error (ECE) under class-conditional noise. We derive non-asymptotic bounds on the estimator's bias. Then, we propose practical algorithms for estimating unknown noise probabilities under conditional independence and label-orientation assumptions. We also develop loss-based and histogram post-hoc recalibration with clean-risk and calibration guarantees, respectively. Experiments on semi-synthetic benchmarks show that the proposed ECE estimator closely tracks its clean-label oracle counterpart and that the recalibration methods substantially improve latent-label calibration, whereas uncorrected recalibration against noisy annotations can degrade it.
0
stat.MLcs.LG Kun Ryu, Yeo Jin Jung, Shyue Ping Ong et al. · Oct 14, 2026

Density functional theory (DFT) is accurate but expensive, while pretrained machine-learned interatomic potentials (MLIPs) are fast yet erratically wrong across configurations. This paper frames the decision of when to trust an MLIP and when to fall back to DFT as a risk-controlled selection problem solved with conformal risk control (CRC). A lightweight, chemistry-informed descriptor feeds a small neural network that estimates MLIP-DFT disagreement in energy and forces; CRC then calibrates a threshold so the expected retained error stays below a user-chosen fraction $\alpha$ of the fitting-set mean. The method cuts DFT costs—by 7–14% at $\alpha=0.3$ versus committee baselines—without requiring access to the target MLIP's internals, which matters for practitioners who want certified savings on a fixed, pretrained model.

Automated materials discovery requires evaluating large pools of candidate configurations, with density functional theory (DFT) as a major throughput bottleneck. Pretrained machine-learned interatomic potentials (MLIPs) approximate DFT cheaply, but their errors vary by orders of magnitude across configurations, making it difficult to decide when to trust the MLIP predictions and when to fall back to DFT. We frame this decision as a risk-controlled selection problem and solve it within a conformal risk control (CRC) framework. Each configuration is mapped from atomic numbers and Cartesian coordinates to a fixed geometric descriptor, which a lightweight predictor uses to estimate an MLIP-DFT disagreement score in energy, average force, and maximum force. CRC then calibrates this score into a selection threshold for DFT labeling such that the MLIP error on the unselected configurations, which keep their MLIP labels, stays below a user-chosen fraction $\alpha$ of the expected error. Under an identical guarantee across eight dataset-MLIP pairs, our predictor routes 7% and 14% fewer configurations to DFT at $\alpha=0.3$ than committee baselines. Because committee disagreement overlooks errors the MLIPs share, our gains are largest when the DFT labels and MLIP training data differ in DFT functional and basis set, and narrow when the two agree. Without model access, the structure-only predictor also ranks errors as well as the target MLIP's latent representation and outperforms widely used descriptors such as Smooth Overlap of Atomic Positions (SOAP) and Atom-Centered Symmetry Functions (ACSF).
0
stat.MLcs.ITcs.LG Xuheng Li, Qingyue Zhao, Quanquan Gu · Oct 14, 2026

Feel-Good Thompson Sampling (FGTS) addresses slow exploration in vanilla TS by adding an optimism term to the posterior. This paper proves the first high-probability regret bounds for both cumulative and current-step FGTS under general realizable function approximation, showing that in linear contextual bandits the regret scales as $O(d\sqrt{T}\log(2T)+\sqrt{T}\log(1/\delta))$ with probability at least $1-\delta$. The core technique is applying Markov's inequality to exponential quantities derived from the posterior normalizer, avoiding explicit confidence-set constructions.

Feel-good Thompson sampling (FGTS) augments the posterior of vanilla Thompson sampling with an exploration term that favors reward functions with high predicted optimal values. This modification achieves minimax-optimal regret up to logarithmic factors in linear contextual bandits, but existing analyses of its two standard variants establish regret guarantees in expectation. In this paper, we derive the first high-probability regret bounds for both cumulative and current-step FGTS in contextual bandits with general realizable function approximation. Our bounds depend on the corresponding decoupling coefficients and the prior mass near the true reward function. In the $d$-dimensional linear setting, both variants satisfy $\mathrm{Regret}(T)=O\big(d\sqrt T\log(2T)+\sqrt T\log(1/\delta)\big)$ with probability at least $1-\delta$, where $T$ is the time horizon. This bound matches the dimension and horizon dependence of algorithms based on the upper confidence bounds, up to logarithmic factors. Relative to the expected-regret guarantees, the cost of controlling the regret with high probability is confined to additive terms with at most linear dependence on $\log(1/\delta)$. The proof ideas are partially developed by GPT-6 Astra under the authors' guidance.
0
stat.MEstat.ML Yundi Kong, Min Yang, Ping-Shou Zhong · Oct 14, 2026

This paper tackles measurement-constrained linear regression, where responses are expensive to collect and must be selected from a large candidate pool before being observed. The authors propose Expected Loss Optimal Selection (ELOS), which derives an A-optimality-type criterion that depends only on covariates and remains valid under potential model misspecification. The core insight is that averaging the expected prediction loss over uniformly random misspecification directions recovers the same trace-inverse criterion as under a correctly specified model, yielding a principled response-free selection rule.

In many modern applications, obtaining response variables is costly, time-consuming, or technically challenging, making it impractical to measure outcomes for all available units. In such settings, covariates may be available for a large pool of candidates, but responses can only be collected for a small, carefully selected subset, making the choice of which units to measure a consequential decision. Most existing subsampling methods are developed for massive datasets, emphasizing the trade-off between statistical accuracy and computational cost, and typically relying on the assumption of a correctly specified model. These features limit their suitability in measurement-constrained settings, where statistical efficiency is paramount and model misspecification is often unavoidable. To address these challenges, we develop a new subset selection framework for linear regression that accommodates potential model misspecification. The proposed approach targets predictive expected loss and yields an A-optimality-type criterion that depends only on covariate information, requiring no response observations at the selection stage. We refer to this method as Expected Loss Optimal Selection (ELOS). By focusing on predictive risk rather than model-based optimality, ELOS remains well-defined and robust under misspecification. Simulation studies and real data applications demonstrate that ELOS achieves strong predictive performance and compares favorably with existing methods across a range of scenarios.
0
stat.MLcs.LG Ruihang Han, Li-Hsiang Lin · Oct 14, 2026

Sequential conformal prediction struggles when the recent past is irrelevant and similar predictive states recur at nonadjacent times. This paper proposes State-Matched Sequence Conformal Prediction (SMSCP), which constructs an interpretable local-linear pre-target state and uses Mahalanobis similarity to select past calibration scores for ordinary conformal cutoff estimation. The work matters because it replaces fragile recency assumptions with an explicit state-matching mechanism, offering both modular implementation and a quantile-targeted theory that isolates when state matching helps and when it fails.

Sequential conformal prediction needs to decide which past errors should calibrate uncertainty for the current target. Recency and online error feedback are useful when recent observations remain relevant, but the recent past can be a poor reference when comparable states recur at nonadjacent times, with the recurrence pattern generally unknown. We propose State-Matched Sequence Conformal Prediction (SMSCP), which constructs an explicit one-sided local-linear state from pre-target information, uses state similarity to select a matched reference set of past calibration scores, and then applies the ordinary unweighted conformal order statistic. In contrast to existing approaches, SMSCP uses state similarity to identify calibration observations relevant to the target score quantile. This motivates a theoretical analysis of whether nearby states have comparable target score quantiles under temporal dependence. We establish control of the resulting conformal cutoff and characterize predictive information not captured by the chosen state. Simulations show that state matching is most effective when score-relevant states recur across nonadjacent times, while revealing settings in which its advantage weakens or reverses. Across solar irradiance and bike-demand benchmarks, SMSCP improves interval score over recency, weighted, adaptive, and HopCPT comparators, and achieves coverage closer to the nominal 0.90 level than ResCP on five of six benchmarks.
0
stat.MLcs.LG Isaias Banales, Arturo Jaramillo · Oct 14, 2026

This paper addresses non-parametric estimation of the background intensity in Hawkes and ETAS models by treating the background as an unknown finite positive measure with a regular density. The core idea is to derive a distribution-valued Wasserstein-Fisher-Rao (WFR) gradient from the Hawkes likelihood and then project it onto finite-dimensional statistical manifolds, yielding an explicit finite-dimensional ODE system. This avoids spatial discretization and is motivated by seismic applications, though the practical algorithmic and statistical guarantees remain partially conditional.

We consider the problem of estimating the background intensity of a Hawkes process when the triggering mechanism is known, treating the background as an unknown finite positive measure with a regular density. We propose a likelihood-based variational approach based on the Wasserstein-Fisher-Rao geometry. In this setting, the relevant first variations are naturally distribution-valued and therefore fall outside the classical gradient-flow formulation. We develop a distributional framework for the resulting dynamics and give them a finite-dimensional meaning through projections onto statistical manifolds. We identify the true background as the unique zero of a limiting generalized gradient and, under suitable stability, compactness, integrability and approximation conditions, establish a conditional consistency theorem for measurable estimators satisfying the empirical projected equations on events whose probabilities tend to one. Finally, we specialize the construction to Gaussian-mixture manifolds and obtain an explicit finite-dimensional scheme.
0
math.OCcs.LGstat.ML Zijun Chen, Zihan Zhang · Oct 14, 2026

Random reshuffling (RR) is the de facto standard for training machine learning models, yet theory has long lagged practice for last-iterate convergence. Existing guarantees required stepsizes as small as $1/(nL)$, while averaged-iterate analyses allowed $1/L$. Chen and Zhang close this gap for smooth convex objectives, proving that the last iterate of RR-SGD converges with stepsizes up to $1/(L(1+\log(nK)))$---removing the explicit $1/n$ barrier at the cost of only logarithmic factors. The result matters because practitioners return the final parameter, not an average, and large constant stepsizes are common in deep learning.

Random reshuffling stochastic gradient descent (RR-SGD) is widely used for finite-sum optimization in machine learning. For convex $L$-smooth components, recent work establishes convergence guarantees for an averaged iterate with component stepsizes as large as order $1/L$. However, the final iterate is a natural output in practice, and existing last-iterate guarantees in this setting require stepsizes that scale inversely with the number of components $n$. We establish an expected objective-gap bound for the last iterate of standard RR-SGD on unconstrained problems with a constant component stepsize satisfying $0<\eta\lesssim 1/(L(1 + \log(nK)))$, where $K$ is the number of epochs. By retaining the sampling bias at random comparison points, we remove the explicit $1/n$ factor from the stepsize restriction. Combined with existing small-step bounds, our result matches the corresponding averaged-iterate convergence rate up to logarithmic factors.
0
cs.CV Chih-Chung Hsu · Oct 14, 2026

RGB vision-language-action models struggle to distinguish waste objects that appear identical in color but differ spectrally. SPECTRA-VLA learns a compact, base-orthogonal spectral residual that enriches frozen visual tokens at their native width without retraining the visual encoder or action decoder. On the SpectralWaste dataset, the method improves category balanced accuracy across 86 held-out acquisition sessions while retaining within-category spectral shape better than category-level codes.

Hyperspectral imaging distinguishes RGB-similar objects, but a pretrained vision-language-action model needs a state its frozen decoder can use. SPECTRA-VLA provides a native-width spectral upgrade without retraining the visual encoder or action decoder. A learned continuous residual enriches each target token through its own normalized false-color reference; projection, norm control and validation-calibrated injection regulate the change. Across 86 held-out acquisitions, category balanced accuracy rises from 0.812 to 0.883. With identical residuals and scale, own-token addition improves reuse of an external category-derived probe on frozen decoder logits: 0.701 versus 0.590 with pooled replacement, at similar image-disjoint recognition. Five grouped tests covering the same 86 acquisitions recover within-category spectral shape with $R^2=0.802/0.337$ from continuous and posterior-code states. Category-matched spectral swaps further show that own-token composition approximately doubles the target-specific recovery increment after frozen decoding. Spectral enrichment and receiving-token preservation thus work together at the pretrained interface.
0
cs.CV Tianyu Zhang, Haiyi Ren, Zhilun Zhang et al. · Oct 14, 2026

Arctic coastal polynyas drive critical ocean-atmosphere heat exchange and sea-ice production, yet mapping them from passive microwave sea ice concentration (SIC) is fraught with ambiguity because narrow coastal openings share SIC ranges with the marginal ice zone and open ocean. The authors develop a daily mapping framework that couples hierarchical SIC partitioning, connected-component analysis, and differentiated region growing to separate enclosed low-concentration polynyas from ocean-connected water, then apply it to September–May seasons from 2002/03 to 2024/25. Their central finding is that absolute polynya extent is highly sensitive to both the upper SIC threshold and the input product—varying by up to roughly 65% across thresholds and showing 68% MAPE across products—while broad temporal patterns remain comparatively stable. This makes a clear case that reproducible long-term monitoring requires a fixed, explicitly documented configuration rather than ad hoc threshold choices.

Accurately delineating Arctic coastal polynyas from sea ice concentration data remains challenging because of complex coastal geometry and spatially heterogeneous ice conditions. We develop a daily sea ice concentration (SIC) mapping framework based on hierarchical partitioning, connected-component analysis, and differentiated region growing for polynya and open-water regions. Applied to September-May ice seasons from 2002/03 to 2024/25, the framework achieves a mean overall accuracy of 96.74% and a mean kappa coefficient of 0.93 in the 63-scene visual assessment. Sensitivity experiments reveal a consistent pattern: the absolute magnitude of SIC-defined polynya extent is strongly configuration-dependent, whereas major temporal features are comparatively more stable. Relative to a 75% upper SIC threshold, seasonal extent integrals differ by 13.48%, 32.47%, and 65.04% at thresholds of 80%, 85%, and 90%, respectively, while the broad interannual structure remains recognizable. The response is also strongly regional and seasonal, with the largest threshold sensitivity in the Central Arctic Ocean, very weak sensitivity in the Gulf of St. Lawrence, and greater pan-Arctic curve separation from January onward. At an 80% threshold, product-comparison MAPE is 68.19% between the 6.25 and 25 km products and 11.47% between the 12.5 and 25 km products under their respective comparison periods and reference definitions. Regional product disagreement is likewise heterogeneous. Together, these results show that reproducible long-term polynya monitoring requires a fixed and explicitly documented combination of SIC product, threshold, and spatial classification rules, while broad temporal patterns can remain informative even when absolute extent differs substantially.
0
stat.MLcs.LGmath.ST Ruyu Zhou, Fang Liu · Oct 14, 2026

Bayesian posterior sampling offers a potentially 'free' source of differential privacy, but existing guarantees are fragmented and often require strong boundedness assumptions. This paper develops a unified Rényi-divergence framework that characterizes the inherent privacy loss of One-Posterior-Sampling (OPS) through exponential moments of the single-record log-likelihood ratio. The results yield exact, tighter bounds for a broader class of models and clarify how prior strength, sample size, and neighboring relations jointly shape privacy.

Differential Privacy (DP) provides a rigorous framework for quantifying privacy guarantees. While most methods achieve DP by injecting calibrated random noise, the intrinsic randomness of certain procedures such as sampling can yield DP guarantees ``for free''. In this work, we develop a unified R\'enyi divergence framework to characterize the inherent DP guarantees of sampling from a Bayesian posterior distribution. We show that the privacy loss incurred by One-Posterior-Sampling (OPS) is governed by posterior exponential moments of the single-record log-likelihood ratio, and establish explicit DP guarantees under uniformly bounded, sub-Gaussian, or sub-exponential tail regimes. We apply the framework to representative Bayesian models, including categorical likelihoods with arbitrary priors, Gaussian-Gaussian conjugate pair, generalized linear models from the exponential family and linear regression with Gaussian likelihood, both with Gaussian priors on the regression coefficients. Our results elucidate sample size, model structure, neighboring relations in DP (bounded or unbounded), and how prior if applicable, jointly determine the inherent DP guarantees of OPS. Furthermore, our results recover the existing DP guarantees for OPS as special cases -- often with tighter privacy loss bounds -- and substantially broaden the class of Bayesian models for which the inherent DP guarantees of OPS can be rigorously characterized.
0
cs.CV Rui Chen, Xingyu Chen, Pengxin Xu et al. · Oct 14, 2026

HyrCap addresses inaccurate temporal localization and low-quality proposals in long untrimmed videos by treating dense query-based predictions as an over-complete temporal event hypothesis space rather than final detections. It hybridizes complementary video representations—InternVideo2 for strong proposal quality and V-JEPA2 for localization reliability—and recalibrates proposal confidence via cross-representation consensus, localization quality estimation, and redundancy suppression. This matters because reliable temporal proposals are framed as a critical interface between detection and LLM-driven semantic understanding, motivating a new two-stage evaluation protocol that decouples localization from segment-level semantics.

Temporal action detection in long untrimmed videos suffers from inaccurate localization and low-quality proposals, especially with sparse annotations and ambiguous boundaries. For open-ended video understanding and LLM-driven event analysis, reliable proposals connect temporal localization, event annotation, and semantic understanding. However, conventional temporal action detection (TAD) pipelines lack explicit modeling of proposal localization quality, cross-representation support, and inter-proposal relations. We propose Hybrid Rank-Calibration of Action Proposals (HyrCap), a proposal-centric query-based TAD framework for temporal event understanding. Hybrid combines complementary video features with different localization cues, while Rank-Calibration adjusts proposal ranking confidence to reflect localization reliability and candidate competition. HyrCap treats dense query-based predictions as an over-complete temporal event hypothesis space. Cross-Representation Consensus Calibration, Localization Quality Estimation, and Proposal Redundancy Suppression improve proposal ranking reliability, localization quality, and candidate discrimination. Inspired by LLMs' capabilities in fine-grained semantic recognition, event description, and reasoning, we introduce HyrCap for Semantic Action Understanding, using calibrated proposals for standard TAD and as inputs to LLM-based semantic understanding. We define a staged evaluation protocol to separately measure event localization, segment-level semantic understanding, and combined event understanding performance. Experiments on public benchmarks show that HyrCap achieves state-of-the-art performance across multiple metrics and provides a finer-grained paradigm and evaluation protocol for query-based event segmentation and annotation.
0
cs.CVcs.LG Zeyang Zhang, Linxiang Gao, Meiqi Gu et al. · Oct 14, 2026

The paper tackles whether iterative image generation with flow matching can actually perform deep sequential reasoning, or whether the many sampling steps are merely an illusion of compute. It proves that vanilla flow matching collapses to constant-depth circuits because each ODE step changes state by only $O(1/K)$, but shows that self-conditioning—feeding back an endpoint prediction as an internal scratchpad—breaks this barrier and can reach $\mathsf{P/poly}$ and even $\mathsf{PSPACE/poly}$. The result is a sharp theoretical and empirical argument that how information flows between sampling steps matters more than how many steps you take.

Recent work has explored visual reasoning through image generation, where models solve visual-reasoning problems by directly generating solution images. Intuitively, iterative samplers such as flow matching are well suited to this task, since each sampling step may resemble one reasoning step. However, in this work, from a circuit complexity perspective, we show that this intuition is misleading. We prove that as long as the model outputs satisfy certain mild regularity conditions, the trajectory of the vanilla flow-matching sampler can be simulated by a constant number of sequential rounds of parallel model evaluations. Consequently, additional sampling steps cannot increase the expressive power of a constant-depth backbone model under the standard complexity-theoretic model of transformers. We then reveal that self-conditioning, which conditions the model on the previous step's estimate of the final image, plays a previously unrecognized role in removing this bottleneck. Controlled experiments on diverse visual-reasoning tasks show that flow matching with self-conditioning achieves higher accuracy and greater reasoning depth than vanilla flow matching, and its performance improves with more sampling steps. Theoretically, we prove that with self-conditioning, a constant-depth backbone can achieve expressive power equivalent to that of space-bounded Turing machines. Our study suggests a design principle for future visual reasoning research: carry more information between sampling steps, so that additional steps translate into deeper reasoning.
0
cs.CVcs.GR Chia-Ming Lee, Yu-Jou Hsiao, Ming-Ching Chang et al. · Oct 14, 2026

Cameras and foundation models recognize what a 3D scene contains, but not what it is made of: surfaces of the same colour can be different materials. Spectral World Renderer tackles this by unifying world generation and hyperspectral unmixing inside 3D Gaussian splatting, so that each Gaussian carries material abundances decoded before ray compositing. The resulting SWR-Bench provides eight synthetic worlds with exact per-pixel material labels, enabling verifiable decomposition benchmarks and real-time material queries.

Cameras and the foundation models built on them recognize what a 3D scene contains, but not what it is made of: surfaces of the same colour can be different materials. Hyperspectral unmixing explains each spectrum as a mixture of material signatures, yet in 3D it is applied to rendered images after the views are composited, or tied to slow implicit fields, and no multi-view data with known composition exist to check the result. We present the Spectral World Renderer (SWR), which unifies world generation and unmixing. A coding agent builds executable 3D worlds that are rendered with measured spectra, so every hyperspectral image comes with exact labels and sub-pixel proportions; the resulting SWR-Bench provides eight indoor and outdoor worlds in which decompositions can be verified. SWR then unmixes inside rendering: each Gaussian of a compact 3D representation is decoded into material abundances before compositing, so one render yields spectra and material maps, and any surface can be queried by material name, a clicked pixel or a reference spectrum. Without material labels, SWR identifies materials best in all eight worlds, has the best mean PSNR on real captures, trains 3.7-12.9x faster than unmixing baselines, renders 34.9 labelled views/s and separates same-coloured materials.
0
cs.CV Yuanyuan Gao, Zhirui Liu, Yuning Gong et al. · Oct 14, 2026

Holi-Spatial 360 targets a key data bottleneck for spatial intelligence: creating large-scale, photorealistic, semantically grounded 3D indoor environments without costly LiDAR or dense video capture. The pipeline converts sparse real-estate panoramas into coherent 3D Gaussian Splatting scenes by anchoring optimization with cross-view correspondences from a large reconstruction model, then densifies trajectories with adapted image and video generative priors. The output is Holi360, a dataset of over 1,000 multi-room scenes with dense RGB-D, 3D instance annotations, and 2 million spatial question-answer pairs, plus a benchmark for VLM spatial reasoning.

Spatial intelligence requires scalable 3D environments that are both photorealistic and semantically grounded, yet existing indoor datasets are dominated by room-scale captures and costly LiDAR acquisition. Online real-estate platforms offer abundant panoramas of diverse multi-room homes, but sparse viewpoints and texture-poor regions make reconstruction severely under-constrained. We introduce Holi-Spatial 360, a generative reconstruction and data curation framework for converting these panoramas into annotated multi-room 3D environments. Because reconstruction quality bounds subsequent generation, our Correspondence-Guided Geometric Optimization converts feed-forward reconstruction priors into reliable cross-view constraints and builds a coherent 3D Gaussian Splatting representation as 3D spatial memory. Adapted single-image and video priors then restore appearance and complete continuous trajectories while preserving observed content. The reconstructed scenes support arbitrary RGB-D rendering and an automated curation pipeline that combines end-to-end 3D grounding with VLM-based verification. Holi360 contains over 1K multi-room 3DGS scenes, more than 100K instance annotations, and 2M spatial question-answer pairs. We also introduce the Holi360 benchmark to evaluate the spatial understanding of VLMs in real-world, multi-room indoor environments. Experiments demonstrate superior reconstruction and curation quality under sparse panoramic inputs, while fine-tuning VLMs on Holi360 substantially improves spatial reasoning capabilities.
0
cs.CV Dikai Li, Weijia Wang, Yuan-Gen Wang · Oct 14, 2026

Active visual recognition fixes both field of view and observation count, yet images vary in the scale and amount of evidence they need. This paper extends the public AdaptiveNN-DeiT-S pipeline with a controllable observation interface that jointly adapts fixation geometry via a learned scale action, local evidence quality via scale-gated foveation and a residual detail-token branch, and observation count via label-grounded confidence-conditioned stop heads. The resulting single checkpoint exposes threshold-controlled accuracy-compute trade-offs without retraining, directly addressing the mismatch between uniform observation budgets and heterogeneous image complexity.

Visual recognition models usually process a fixed view under a fixed computation budget, although images often benefit from different scales and amounts of spatial evidence. Active vision can adapt by observing a coarse scene and then selecting informative fixations, but the public AdaptiveNN-DeiT-S pipeline still fixes both field of view and observation count. We extend this fixed-step recognizer with a controllable observation interface that adapts both the field of view and the number of fixations to the input. Specifically, the model predicts a per-fixation scale that sets its field of view, refines each selected crop with optional scale-gated foveation and a residual high-resolution detail-token branch, and uses label-grounded stop heads for input-dependent early termination. Experiments across fine-grained benchmarks, full ImageNet-1K, and ImageNet-A/R-derived classification splits show that the interface remains competitive with fixed-step references while exposing a controllable observation budget. The same checkpoint enables threshold-controlled accuracy-compute trade-offs without per-threshold retraining. On sequential ImageNet-1K, the learned stop rule outperforms fixed-step truncation of the same checkpoint, sustaining 81.9% top-1 using 2.45 of the four focus steps and exceeding three-step truncation at lower cost. On each benchmark, a variant combining scale control and detail-token fusion achieves the highest accuracy among the tested component-added non-exit variants. Our code is available at https://github.com/GZHU-DVL/LI-Dikai.
0
cs.CV Jia Chen, Ruyang Zhao, Jun Bai et al. · Oct 14, 2026

Single-image reconstruction of standalone garments remains under-supported by existing benchmarks, which mostly target clothed humans or rigid objects. MagicGarment introduces a dataset of 1,518 synthetic assets across 17 composite types, paired with aligned multimodal annotations and a unified evaluation protocol. The authors also propose a garment-aware baseline that adapts a frozen Hunyuan3D backbone via input-level semantic refinement (GSR) and a dynamic timestep- and routing-conditioned LoRA (FTR-LoRA), demonstrating that domain-specific adaptation improves over generic 3D priors on this benchmark.

Single-image 3D reconstruction has advanced rapidly, yet standalone garments remain challenging due to thin-shell geometry, open boundaries, and layered structures. Existing datasets and evaluation protocols provide limited support for systematic evaluation in this setting. We introduce MagicGarment, a benchmark for single-image standalone 3D garment reconstruction with 1,518 professionally constructed assets across 17 composite garment types, aligned multimodal annotations, and a unified evaluation protocol. We further establish a garment-aware reference baseline by adapting a pretrained image-to-3D backbone at two levels: Grounded Semantic Refinement (GSR) provides garment-focused visual conditioning, while Flow-Time-Route LoRA (FTR-LoRA) adapts the frozen 3D generative backbone using flow-timestep, token-routing, and expert-load information. Experiments demonstrate MagicGarment's benchmark utility and the effectiveness of garment-aware adaptation. Project page: https://1019538157.github.io/MagicGarment/.