Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
797 papers in cs.LG
Trending mixes fresh papers with community signal.
0
cs.CLcs.AIcs.LG Taro Yano, Yoichi Ishibashi, Masafumi Oyamada · Oct 14, 2026

Best-of-N sampling improves LLM output quality by generating multiple candidates and selecting the highest reward, yet its scaling behavior under imperfect reward models is poorly understood. This paper recasts BoN as extreme-value competition between the upper tails of correct and incorrect reward distributions, yielding phase transitions that explain both monotonic gains and reward hacking. Using extreme value theory, the authors derive finite-sample scaling laws showing polynomial rather than exponential convergence, and propose a lightweight tail-tension criterion for label-free early stopping. The work matters because it replaces vague intuitions about reward hacking with precise, testable distributional conditions and a practical inference-time safeguard.

Best-of-N sampling is a simple inference-time scaling strategy for large language models, yet its behavior under incomplete reward models remains poorly understood. We study Best-of-N as a competition between the extreme reward tails of correct and incorrect responses. This view shows that success depends not only on the probability of sampling a correct response, but also on whether correct responses dominate incorrect ones in the upper tail. Using extreme value theory, we characterize three asymptotic regimes: correct-tail-dominant, incorrect-tail-dominant, and critical explaining both monotonic gains and reward-hacking-induced degradation. We further derive finite-sample scaling laws for representative reward distributions, showing that, under Gaussian rewards, incorrect responses with sufficiently large variance can dominate selection even when their mean reward is lower. Unlike oracle selection, convergence with an incomplete selector can be polynomial rather than exponential. Finally, we propose a lightweight tail-tension criterion to estimate when additional sampling may become harmful. Experiments on synthetic data and real reward model scores are consistent with the theoretically predicted regimes, scaling laws, and diagnostic behavior, suggesting that tail competition provides a unified lens on Best-of-N sampling for verifiable problems.
0
cs.AIcs.CLcs.LG Weilun Xu (EPFL), Zipeng Sun (McGill University, Mila) · Oct 14, 2026

Activation steering is used to steer language models toward named behaviors, but standard baselines cannot tell whether a vector controls a specific concept or a neighboring one. This paper introduces the competing-target test, which compares a steering vector with the matched vector for a competing target and bounds their difference with an equivalence test. In three open-weight models, the authors show that vectors for Kantian deontology and act utilitarianism are largely interchangeable---they move both framework scores alike---whereas explicit prompting separates them, and the same construction does separate optimistic and pessimistic tones.

Activation steering adds a vector to a model's hidden states to control a named behaviour. A gain on that behaviour, however, does not show that the vector controls it directly: it may act through a component shared with neighbouring behaviours, which unsteered and random baselines cannot separate. We introduce the competing-target test: a vector is compared with the vector built the same way for a competing target, and an equivalence test states when their difference is below a useful margin. We apply it in open-weight models to vectors for Kantian deontology, which judges an act by the rule it follows, and act utilitarianism, which judges it by the welfare it produces. On held-out situations, prompting a framework raises its score and lowers the other's, whereas vectors for either framework move both scores alike, and none reaches the margin. The two vectors share most of their direction, a request to apply some framework; the same construction separates an optimistic from a pessimistic tone, whose vectors share much less. What a vector shares with its competitors therefore sets what it controls: steering a perspective can deliver a mixture, and measuring a disposition can measure its neighbours, unless tested against the competing target.
0
cs.LGcs.AImath.ST Katy Blumer, Da-Cheng Juan, Jon Kleinberg et al. · Oct 14, 2026

This paper studies the infinite-generation limit of autoregressive transformers. Rather than fixing sequence length, the authors let generation time tend to infinity and ask whether the model's empirical state converges. Their core result is that, for a broad class of architectures, the stochastic generation process tracks a deterministic ODE on a slow time scale, and every fixed transformer has a finite temperature threshold above which it converges to a unique limit. However, no uniform temperature works for all models; for any finite temperature, some transformer can fail to converge, even with just one layer and three tokens.

In this paper we study the behavior of transformer networks generating text over long periods of time. We show that even a three-token, single-layer attention-only transformer can fail to converge. We then study a rich class of transformers with arbitrary finite depth, layer normalization, MLPs, RoPE encodings, and an arbitrary mix of local and global layers. Every transformer in this class has a softmax temperature threshold above which its empirical cache distribution converges to a unique limit, independent of initial conditions. We show further that, while each transformer has a temperature threshold, the supremum of this set is infinite, so there is no global minimal temperature that forces all transformers to converge.
0
cs.LGstat.ML Yuxuan Xia, Xiao-Tong Yuan · Oct 14, 2026

This paper claims the first global joint lower bound for zeroth-order nonconvex optimization under unrestricted spatial queries and sample reuse. The core idea is to force any algorithm to advance through $T\asymp\min\{\Delta H,L_0^2\}/\epsilon^2$ hidden geometric stages and to prove that each fresh stage requires $\Omega(dL_0^2/\epsilon^2)$ adaptive scalar evaluations, yielding an overall $\Omega(dL_0^2\min\{\Delta H,L_0^2\}/\epsilon^4)$ bound. If correct, this would settle the open problem posed by Kornowski and Shamir (2024), though the manuscript is dated 14 October 2026, cites several future works, and explicitly states that its mathematics was primarily AI-generated.

Recent work has sought to transfer first-order nonconvex optimization guarantees to zeroth-order methods through gradient estimators, typically incurring a factor linear in $d$. \citet{kornowski2024} obtained an $\mathcal{O}(d\delta^{-1}\epsilon^{-3})$ oracle complexity for nonsmooth nonconvex optimization and asked whether its dependence on all three parameters is jointly optimal. Although the dimension dependence and the first-order dependence on $(\delta,\epsilon)$ are separately known to be unavoidable, a matching zeroth-order lower bound has remained open. We answer this question in the unrestricted full-space setting. For smooth stochastic nonconvex optimization, we establish a scalar-oracle lower bound of $\Omega\!\left(dL_0^2\min\{\Delta H,L_0^2\}/\epsilon^4\right)$ assuming a smooth, globally lower-bounded population objective and a second-moment bound on sample Lipschitz constants. A smooth reduction then yields a lower bound for Goldstein stationarity, proving the joint minimax optimality of the dependence on $(d,\delta,\epsilon)$ under explicit high-dimensional and small-accuracy conditions. Crucially, our results allow algorithms to query arbitrary points in $\mathbb{R}^d$, adaptively select sample-function labels, reuse the same sampled function at any number of locations, and output points without spatial restrictions. Thus, unlike lower bounds based on bounded query regions or fresh evaluation noise, our guarantees apply to a fully adaptive, reusable-sample scalar oracle. We also establish a separate noiseless exact-value lower bound against randomized algorithms, and hence also against deterministic methods. Our proof combines a globally defined sequential nonconvex construction with an exact Gaussian scalar channel, multistage random-field estimates, and an antithetic finite-sample realization that preserves information hardness under adaptive reuse.
0
stat.MLcs.LG Keisuke Hanada, Futoshi Futami · Oct 14, 2026

In medical and crowdsourced annotation, the absence of clean ground truth biases standard expected calibration error (ECE) evaluation because annotator errors confound predictor miscalibration. This paper proposes Noise Corrected ECE (NC-ECE), which inverts annotator-specific class-conditional noise channels to recover clean-label ECE, and provides methods to estimate those channels from repeated annotations alone. It then derives post-hoc recalibration algorithms with either clean-risk or calibration guarantees. The work is directly motivated by settings such as medical imaging, where expert disagreement is common and reliable uncertainty assessment is essential.

In medical annotation and crowdsourcing, multiple annotators assign labels to each example, but these labels may be incorrect. Treating such noisy labels as ground truth can bias calibration evaluation. To address this problem, we propose methods for evaluating and recalibrating a fixed binary predictor under the underlying clean-label distribution, using only noisy annotations. First, given annotator-specific noise probabilities, we propose Noise Corrected ECE (NC-ECE), a binned estimator of expected calibration error (ECE) under class-conditional noise. We derive non-asymptotic bounds on the estimator's bias. Then, we propose practical algorithms for estimating unknown noise probabilities under conditional independence and label-orientation assumptions. We also develop loss-based and histogram post-hoc recalibration with clean-risk and calibration guarantees, respectively. Experiments on semi-synthetic benchmarks show that the proposed ECE estimator closely tracks its clean-label oracle counterpart and that the recalibration methods substantially improve latent-label calibration, whereas uncorrected recalibration against noisy annotations can degrade it.
0
stat.MLcs.LG Kun Ryu, Yeo Jin Jung, Shyue Ping Ong et al. · Oct 14, 2026

Density functional theory (DFT) is accurate but expensive, while pretrained machine-learned interatomic potentials (MLIPs) are fast yet erratically wrong across configurations. This paper frames the decision of when to trust an MLIP and when to fall back to DFT as a risk-controlled selection problem solved with conformal risk control (CRC). A lightweight, chemistry-informed descriptor feeds a small neural network that estimates MLIP-DFT disagreement in energy and forces; CRC then calibrates a threshold so the expected retained error stays below a user-chosen fraction $\alpha$ of the fitting-set mean. The method cuts DFT costs—by 7–14% at $\alpha=0.3$ versus committee baselines—without requiring access to the target MLIP's internals, which matters for practitioners who want certified savings on a fixed, pretrained model.

Automated materials discovery requires evaluating large pools of candidate configurations, with density functional theory (DFT) as a major throughput bottleneck. Pretrained machine-learned interatomic potentials (MLIPs) approximate DFT cheaply, but their errors vary by orders of magnitude across configurations, making it difficult to decide when to trust the MLIP predictions and when to fall back to DFT. We frame this decision as a risk-controlled selection problem and solve it within a conformal risk control (CRC) framework. Each configuration is mapped from atomic numbers and Cartesian coordinates to a fixed geometric descriptor, which a lightweight predictor uses to estimate an MLIP-DFT disagreement score in energy, average force, and maximum force. CRC then calibrates this score into a selection threshold for DFT labeling such that the MLIP error on the unselected configurations, which keep their MLIP labels, stays below a user-chosen fraction $\alpha$ of the expected error. Under an identical guarantee across eight dataset-MLIP pairs, our predictor routes 7% and 14% fewer configurations to DFT at $\alpha=0.3$ than committee baselines. Because committee disagreement overlooks errors the MLIPs share, our gains are largest when the DFT labels and MLIP training data differ in DFT functional and basis set, and narrow when the two agree. Without model access, the structure-only predictor also ranks errors as well as the target MLIP's latent representation and outperforms widely used descriptors such as Smooth Overlap of Atomic Positions (SOAP) and Atom-Centered Symmetry Functions (ACSF).
0
stat.MLcs.ITcs.LG Xuheng Li, Qingyue Zhao, Quanquan Gu · Oct 14, 2026

Feel-Good Thompson Sampling (FGTS) addresses slow exploration in vanilla TS by adding an optimism term to the posterior. This paper proves the first high-probability regret bounds for both cumulative and current-step FGTS under general realizable function approximation, showing that in linear contextual bandits the regret scales as $O(d\sqrt{T}\log(2T)+\sqrt{T}\log(1/\delta))$ with probability at least $1-\delta$. The core technique is applying Markov's inequality to exponential quantities derived from the posterior normalizer, avoiding explicit confidence-set constructions.

Feel-good Thompson sampling (FGTS) augments the posterior of vanilla Thompson sampling with an exploration term that favors reward functions with high predicted optimal values. This modification achieves minimax-optimal regret up to logarithmic factors in linear contextual bandits, but existing analyses of its two standard variants establish regret guarantees in expectation. In this paper, we derive the first high-probability regret bounds for both cumulative and current-step FGTS in contextual bandits with general realizable function approximation. Our bounds depend on the corresponding decoupling coefficients and the prior mass near the true reward function. In the $d$-dimensional linear setting, both variants satisfy $\mathrm{Regret}(T)=O\big(d\sqrt T\log(2T)+\sqrt T\log(1/\delta)\big)$ with probability at least $1-\delta$, where $T$ is the time horizon. This bound matches the dimension and horizon dependence of algorithms based on the upper confidence bounds, up to logarithmic factors. Relative to the expected-regret guarantees, the cost of controlling the regret with high probability is confined to additive terms with at most linear dependence on $\log(1/\delta)$. The proof ideas are partially developed by GPT-6 Astra under the authors' guidance.
0
stat.MLcs.LG Ruihang Han, Li-Hsiang Lin · Oct 14, 2026

Sequential conformal prediction struggles when the recent past is irrelevant and similar predictive states recur at nonadjacent times. This paper proposes State-Matched Sequence Conformal Prediction (SMSCP), which constructs an interpretable local-linear pre-target state and uses Mahalanobis similarity to select past calibration scores for ordinary conformal cutoff estimation. The work matters because it replaces fragile recency assumptions with an explicit state-matching mechanism, offering both modular implementation and a quantile-targeted theory that isolates when state matching helps and when it fails.

Sequential conformal prediction needs to decide which past errors should calibrate uncertainty for the current target. Recency and online error feedback are useful when recent observations remain relevant, but the recent past can be a poor reference when comparable states recur at nonadjacent times, with the recurrence pattern generally unknown. We propose State-Matched Sequence Conformal Prediction (SMSCP), which constructs an explicit one-sided local-linear state from pre-target information, uses state similarity to select a matched reference set of past calibration scores, and then applies the ordinary unweighted conformal order statistic. In contrast to existing approaches, SMSCP uses state similarity to identify calibration observations relevant to the target score quantile. This motivates a theoretical analysis of whether nearby states have comparable target score quantiles under temporal dependence. We establish control of the resulting conformal cutoff and characterize predictive information not captured by the chosen state. Simulations show that state matching is most effective when score-relevant states recur across nonadjacent times, while revealing settings in which its advantage weakens or reverses. Across solar irradiance and bike-demand benchmarks, SMSCP improves interval score over recency, weighted, adaptive, and HopCPT comparators, and achieves coverage closer to the nominal 0.90 level than ResCP on five of six benchmarks.
0
stat.MLcs.LG Isaias Banales, Arturo Jaramillo · Oct 14, 2026

This paper addresses non-parametric estimation of the background intensity in Hawkes and ETAS models by treating the background as an unknown finite positive measure with a regular density. The core idea is to derive a distribution-valued Wasserstein-Fisher-Rao (WFR) gradient from the Hawkes likelihood and then project it onto finite-dimensional statistical manifolds, yielding an explicit finite-dimensional ODE system. This avoids spatial discretization and is motivated by seismic applications, though the practical algorithmic and statistical guarantees remain partially conditional.

We consider the problem of estimating the background intensity of a Hawkes process when the triggering mechanism is known, treating the background as an unknown finite positive measure with a regular density. We propose a likelihood-based variational approach based on the Wasserstein-Fisher-Rao geometry. In this setting, the relevant first variations are naturally distribution-valued and therefore fall outside the classical gradient-flow formulation. We develop a distributional framework for the resulting dynamics and give them a finite-dimensional meaning through projections onto statistical manifolds. We identify the true background as the unique zero of a limiting generalized gradient and, under suitable stability, compactness, integrability and approximation conditions, establish a conditional consistency theorem for measurable estimators satisfying the empirical projected equations on events whose probabilities tend to one. Finally, we specialize the construction to Gaussian-mixture manifolds and obtain an explicit finite-dimensional scheme.
0
math.OCcs.LGstat.ML Zijun Chen, Zihan Zhang · Oct 14, 2026

Random reshuffling (RR) is the de facto standard for training machine learning models, yet theory has long lagged practice for last-iterate convergence. Existing guarantees required stepsizes as small as $1/(nL)$, while averaged-iterate analyses allowed $1/L$. Chen and Zhang close this gap for smooth convex objectives, proving that the last iterate of RR-SGD converges with stepsizes up to $1/(L(1+\log(nK)))$---removing the explicit $1/n$ barrier at the cost of only logarithmic factors. The result matters because practitioners return the final parameter, not an average, and large constant stepsizes are common in deep learning.

Random reshuffling stochastic gradient descent (RR-SGD) is widely used for finite-sum optimization in machine learning. For convex $L$-smooth components, recent work establishes convergence guarantees for an averaged iterate with component stepsizes as large as order $1/L$. However, the final iterate is a natural output in practice, and existing last-iterate guarantees in this setting require stepsizes that scale inversely with the number of components $n$. We establish an expected objective-gap bound for the last iterate of standard RR-SGD on unconstrained problems with a constant component stepsize satisfying $0<\eta\lesssim 1/(L(1 + \log(nK)))$, where $K$ is the number of epochs. By retaining the sampling bias at random comparison points, we remove the explicit $1/n$ factor from the stepsize restriction. Combined with existing small-step bounds, our result matches the corresponding averaged-iterate convergence rate up to logarithmic factors.
0
stat.MLcs.LGmath.ST Ruyu Zhou, Fang Liu · Oct 14, 2026

Bayesian posterior sampling offers a potentially 'free' source of differential privacy, but existing guarantees are fragmented and often require strong boundedness assumptions. This paper develops a unified Rényi-divergence framework that characterizes the inherent privacy loss of One-Posterior-Sampling (OPS) through exponential moments of the single-record log-likelihood ratio. The results yield exact, tighter bounds for a broader class of models and clarify how prior strength, sample size, and neighboring relations jointly shape privacy.

Differential Privacy (DP) provides a rigorous framework for quantifying privacy guarantees. While most methods achieve DP by injecting calibrated random noise, the intrinsic randomness of certain procedures such as sampling can yield DP guarantees ``for free''. In this work, we develop a unified R\'enyi divergence framework to characterize the inherent DP guarantees of sampling from a Bayesian posterior distribution. We show that the privacy loss incurred by One-Posterior-Sampling (OPS) is governed by posterior exponential moments of the single-record log-likelihood ratio, and establish explicit DP guarantees under uniformly bounded, sub-Gaussian, or sub-exponential tail regimes. We apply the framework to representative Bayesian models, including categorical likelihoods with arbitrary priors, Gaussian-Gaussian conjugate pair, generalized linear models from the exponential family and linear regression with Gaussian likelihood, both with Gaussian priors on the regression coefficients. Our results elucidate sample size, model structure, neighboring relations in DP (bounded or unbounded), and how prior if applicable, jointly determine the inherent DP guarantees of OPS. Furthermore, our results recover the existing DP guarantees for OPS as special cases -- often with tighter privacy loss bounds -- and substantially broaden the class of Bayesian models for which the inherent DP guarantees of OPS can be rigorously characterized.
0
cs.CVcs.LG Zeyang Zhang, Linxiang Gao, Meiqi Gu et al. · Oct 14, 2026

The paper tackles whether iterative image generation with flow matching can actually perform deep sequential reasoning, or whether the many sampling steps are merely an illusion of compute. It proves that vanilla flow matching collapses to constant-depth circuits because each ODE step changes state by only $O(1/K)$, but shows that self-conditioning—feeding back an endpoint prediction as an internal scratchpad—breaks this barrier and can reach $\mathsf{P/poly}$ and even $\mathsf{PSPACE/poly}$. The result is a sharp theoretical and empirical argument that how information flows between sampling steps matters more than how many steps you take.

Recent work has explored visual reasoning through image generation, where models solve visual-reasoning problems by directly generating solution images. Intuitively, iterative samplers such as flow matching are well suited to this task, since each sampling step may resemble one reasoning step. However, in this work, from a circuit complexity perspective, we show that this intuition is misleading. We prove that as long as the model outputs satisfy certain mild regularity conditions, the trajectory of the vanilla flow-matching sampler can be simulated by a constant number of sequential rounds of parallel model evaluations. Consequently, additional sampling steps cannot increase the expressive power of a constant-depth backbone model under the standard complexity-theoretic model of transformers. We then reveal that self-conditioning, which conditions the model on the previous step's estimate of the final image, plays a previously unrecognized role in removing this bottleneck. Controlled experiments on diverse visual-reasoning tasks show that flow matching with self-conditioning achieves higher accuracy and greater reasoning depth than vanilla flow matching, and its performance improves with more sampling steps. Theoretically, we prove that with self-conditioning, a constant-depth backbone can achieve expressive power equivalent to that of space-bounded Turing machines. Our study suggests a design principle for future visual reasoning research: carry more information between sampling steps, so that additional steps translate into deeper reasoning.
0
cs.CVcs.LG Jingjing Liu, Pei Tai, Xianchao Xiu et al. · Oct 14, 2026

Unsupervised feature selection often forces practitioners to hand-tune regularization parameters in sparse PCA models or to collect large labeled datasets for deep learning. This paper proposes MDUFS-Net and MDUFS-Net+, which unfold an ADMM solver for $\ell_{2,0}$-norm regularized PCA into a trainable deep network, embed a Stiefel manifold projection to preserve orthogonality, and optionally add element-wise $\ell_0$ sparsity. The work matters because it tries to retain the interpretability of model-driven optimization while automating parameter adaptation via gradient-based learning.

Unsupervised feature selection (UFS) is of great significance in image processing and pattern recognition. Nevertheless, existing model-based methods often rely on manually tuned hyperparameters, while deep learning-based methods generally require massive training data. To address these issues, this paper proposes an efficient manifold deep unfolding feature selection network (MDUFS-Net). Technically, we first incorporate the $\ell_{2,0}$-norm into the classic principal component analysis (PCA) framework, then unfold the alternating direction method of multipliers (ADMM)-based iterative algorithm into an end-to-end trainable network, thereby enabling automatic parameter learning. Moreover, a manifold optimization strategy is developed to improve the numerical robustness. On this basis, we further extend MDUFS-Net into an enhanced variant called MDUFS-Net+ by introducing the $\ell_{0}$-norm for more discriminative feature representations. Extensive experiments validate that our proposed MDUFS-Net and MDUFS-Net+ outperform state-of-the-art methods in the UFS task, with promising performance in clustering. Our code is available at https://github.com/xianchaoxiu/MDUFS.
0
cs.LGcs.CVeess.SP Akshay Malhotra, Nicolas Zilberstein, Shahab Hamidi-Rad · Oct 14, 2026

The paper solves zero-shot stitching of autoencoders: enabling an encoder from one independently trained model to work with a decoder from another. The core idea is a training-time topological regularizer based on 0-dimensional persistent homology (MST edges) that preserves the input data's geometric skeleton in each latent space, so that after training only a lightweight affine map is needed. This matters for distributed and privacy-sensitive settings where encoders and decoders cannot be jointly optimized or share weights.

As large, powerful pre-trained models become more prevalent, there is growing interest in developing methods that allow different neural networks to be seamlessly combined with little or no direct communication between them. Take autoencoder-based data compression as an example: the ability to independently choose architectures and train encoder and decoder models, while still ensuring they work together, could fundamentally transform how such models are built, deployed, and updated. In this work, we introduce a novel approach that leverages topological regularization to align the latent spaces of two independently trained autoencoder models, entirely eliminating the need for coordination during training. We provide a conditional theoretical analysis showing how the structural agreement encouraged by our regularizer can translate into approximate geometric compatibility between independently learned representations. Reconstruction experiments validate this approach empirically, substantially narrowing the interoperability gap across multiple datasets.
0
cs.LGcs.CV Vahid Jebraeeli, Hamid Krim, Keisuke Fujii · Oct 14, 2026

The paper proposes a two-loop inference architecture inspired by System 1/System 2 cognition: a fast loop (MobileNetV3-Large) classifies an image and, if confidence is low, a medium-speed loop (DINOv2-B) processes additional evidence. The authors evaluate this REASON framework on four fine-grained image classification benchmarks under distribution shift and synthetic corruptions, showing gains over the fast loop alone at roughly half the computation of the full medium model.

We seek a hierarchical resolution of residual error under a composite learning objective as a principled mechanism for identifying and exploiting additional information, particularly under distribution shift and perturbation. Inspired by the System 1/System 2 paradigm, we formulate this principle as a two-loop mechanism serving a common inference goal. A fast, System 1-like loop resolves the residual addressable by the available evidence; the remaining epistemic residual triggers a medium speed, System 2-like loop that actively acquires additional evidence and measures its informational value through residual reduction. Over nested solution spaces, the medium-loop optimum is provably no worse than the fast-loop optimum. Experiments show that the resulting two-loop model consistently improves upon the fast loop at approximately half the computation of the medium loop, including under unseen corruptions, and, when provided a cleaner observation, outperforms staged classifiers and learning-to-defer methods at equal computational cost.
0
cs.CVcs.LG Pedro Manoel Herminio Alves, Dalton C\'ezane Gomes Valadares, Cl\'audio de Souza Baptista · Oct 14, 2026

This paper tackles the practical problem of choosing detectors and trackers for multi-pedestrian tracking across scenes with different densities. It carries out a broad empirical comparison of the YOLO11, RT-DETR, and YOLO26 detector families paired with ByteTrack and BoT-SORT on MOT17, MOT20, and SOMPT22, including an ablation of NMS versus end-to-end inference for YOLO26. The study offers a useful survey of quality-speed trade-offs, although its conclusions are constrained by out-of-the-box COCO weights and very small benchmark slices.

Pedestrian tracking in video is important for applications such as surveillance and scene analysis, but it becomes more challenging in crowded scenarios with frequent occlusions and rapid motion. This paper analyzes how detector architecture, model scale, scene density, and inference regime affect the tracking of multiple pedestrians. We compare the YOLO11, RT-DETR, and YOLO26 detector families with the ByteTrack and BoT-SORT trackers on sequences from the MOT17, MOT20, and SOMPT22 benchmarks. For YOLO26, we also compare traditional overlap filtering via Non-Maximum Suppression (NMS) with end-to-end inference. The RT-DETR family achieved the highest mean scores on the HOTA tracking quality metric across all three benchmarks with both trackers, with a more pronounced advantage on MOT20, albeit at a higher computational cost. On MOT17 and SOMPT22, YOLO26 variants, especially YOLO26-L with NMS, offered favorable combinations of quality and speed compared with RT-DETR. In the YOLO26 inference comparison, the end-to-end mode did not yield consistent tracking gains over the NMS-based regime. Taken together, these results provide a practical guide for selecting detectors and trackers for this task based on application priorities.
0
cs.LGcs.CV Iren\'e Tematelewo · Oct 14, 2026

This PhD thesis tackles novelty detection across weather sensor networks and computer vision. For sensor networks, the core problem is detecting blocked rain gauges that falsely report zero rainfall—a failure mode that is hard to catch because zero is also the most frequent correct reading. The work benchmarks existing quality-control methods and proposes new joint-reasoning algorithms (PCSD-SAT, PCSD-JIGM, PCSD-JIKR) to improve detection of spatially clustered faults. For computer vision, it claims to introduce the NOVEL-SS benchmark and a Detect-Characterize-Accommodate (DCA) baseline for handling multiple simultaneous visual novelties. The research matters because reliable precipitation data underpins agriculture and disaster management in data-scarce regions, while real-world vision systems must cope with diverse, concurrent anomalies rather than single-type novelties.

Novelty detection is crucial in various technological and scientific domains. Its importance spans from ensuring the reliability of sensor networks to enhancing the adaptability of computer vision systems. As AI systems become increasingly sophisticated and complex, effective anomaly detection is essential for maintaining reliability and accuracy. This work addresses novelty detection in weather sensor networks and computer vision. In weather sensor networks, particularly for monitoring rainfall, detecting blocked rain gauges can significantly impact data reliability, food security, and disaster management. This work evaluates four existing quality control methods for detecting blocked rain gauges and demonstrates their limitations, particularly in detecting clusters of faulty sensors. By comparing methods such as the Conditional Mixture Model (CMM), PSWQ (Fz-filter), Kernel Regression, and Gaussian Method, we identify their shortcomings and propose three novel quality control techniques that integrate probabilistic fault detection and consistency-based diagnosis framework to improve timely detection of blocked sensors, while reducing false alarms. In the realm of computer vision, current systems often fail to handle multiple types of novelty due to their focus on single-novelty scenarios. We highlight the need for integrated systems capable of handling multiple types of novelty. To support this, we introduce the Novel Snapshot Serengeti (NOVEL-SS) dataset, derived from the Snapshot Serengeti camera trap data, which includes various forms of novelty. We also present the DCA (Detect, Characterize, and Accommodate) baseline system, designed to handle multiple novelty by detecting, characterizing, and accommodating them. This work aims to advance the robustness and adaptability of novelty detection systems across both weather sensor networks and computer vision applications.
0
cs.LGcs.AIcs.LG v3 Junyi An, Xinyu Lu, Chao Qu et al. · May 29, 2025

Equivariant GNNs for molecular modeling are bottlenecked by Clebsch-Gordan tensor products, which suffer from high complexity and limited non-linearity. This paper proposes the Equivariant Spherical Transformer (EST), a plug-and-play module that applies self-attention over sampled points on the spherical spatial domain of group representations, using a Fibonacci Lattice to preserve approximate SO(3) equivariance. The work matters because it reports state-of-the-art results on OC20 and QM9 while empirically breaking the degree-limited expressiveness barrier that constrains traditional tensor-product architectures.

Equivariant Graph Neural Networks (GNNs) have significantly advanced the modeling of 3D molecular structure by leveraging group representations. However, their message passing, heavily relying on Clebsch-Gordan tensor product convolutions, suffers from restricted expressiveness due to the limited non-linearity and low degree of group representations. To overcome this, we introduce the Equivariant Spherical Transformer (EST), a novel plug-and-play framework that applies a Transformer-like architecture to the Fourier spatial domain of group representations. EST achieves higher expressiveness than conventional models while preserving the crucial equivariant inductive bias through a uniform sampling strategy of spherical Fourier transforms. As demonstrated by our experiments on challenging benchmarks like OC20 and QM9, EST-based models achieve state-of-the-art performance. For the complex molecular systems within OC20, small models empowered by EST can outperform some larger models and those using additional data. In addition to demonstrating such strong expressiveness,we provide both theoretical and experimental validation of EST's equivariance as well, paving the way for new research in this area.
0
cs.LG Siqi Zhu, Suozhi Huang, Kaixuan Zhang et al. · Oct 1, 2026

Multi-teacher on-policy distillation (MOPD) fuses specialized RL teachers into one student, but the mechanistic path from supervision choices to parameter changes and task capabilities has been unclear. This paper traces that path through controlled experiments on Qwen3-1.7B and SmolLM3-3B, using identical student parameters, responses, and optimizer states to compare gradients, Adam updates, and learning curves across loss-averaging rules and vocabulary truncations. Its core insight is that stronger gradient approximations do not necessarily yield better task performance; instead, outcomes depend heavily on implicit response weighting and optimizer dynamics that prior recipes treat as secondary.

Multi-teacher on-policy distillation (MOPD) aims to combine the strengths of RL-trained teachers in a single student, but how teacher signals affect parameter changes remains underexplored. We study Qwen3-1.7B with four domain teachers trained with RL from the same initialization as the student, comparing gradients, optimizer updates, and task learning curves, with additional SmolLM3-3B diagnostics. We find that several factors influence teacher signals. First, loss averaging implicitly weights responses: token averaging favors longer responses, and equalizing domain contributions retains this weighting within domains. Second, Adam's first moment reduces differences in parameter updates: the cosine similarity is 0.83 between teachers and 0.96 between averaging rules, despite differences in raw gradients. Third, BF16 rounding hides small changes: about 97\% of FP32 master weights differ from initialization, but only 7--11\% of BF16 weights do. Finally, the top-64 intersection KL gradient closely matches Qwen's full-vocabulary gradient, but the effect on task performance depends on averaging: mathematics accuracy is 2.6 points higher than with sampled-token policy-gradient (PG) under response averaging and 2.1 points lower under global token averaging.
0
cs.LGq-bio.MN Jianru Shen · Oct 1, 2026

The paper asks whether effective resistance in tissue-specific protein interaction networks can flag which protein-function predictions a graph neural network will get wrong. Because effective resistance on these networks is almost completely determined by inverse degree, the author strips out that degenerate component and tests whether the residual predicts per-node loss beyond standard uncertainty scores. The study concludes that a reproducible but tiny signal exists across 24 interactomes, and that degree degeneration strongly bounds how useful resistance can ever be on this class of biological graphs.

Protein function annotation needs to know which predictions to distrust, not only what a model predicts. We ask whether tissue-specific interaction structure carries that information. Our candidate signal is effective resistance, used previously to relieve over-squashing by rewiring. Across 24 tissue-specific interactomes it is dominated by inverse degree, and the degeneration deepens as the co-expression filtered network grows, with a Spearman correlation of -0.955. The residual departure from that limit exceeds degree-preserving null graphs in all 24 networks. Controlling for predictive entropy, degree, annotation cardinality, local structure and feature-only difficulty, the residual explains additional per-node loss in 19 of 24 held-out networks once a permutation floor is subtracted, at every depth, and the effect strengthens monotonically with depth. The increment reaches 0.37% of the variance the controls leave unexplained, 5.6 times a permutation floor, against 1.5 times when the model is retrained in a degree-preserving null world. Selective prediction improves negligibly. The signal is reproducible; degree degeneration bounds it.