Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
1579 papers
Trending mixes fresh papers with community signal.
0
cs.LGcs.AI Mehmet Baygin, Sengul Dogan, Turker Tuncer · Oct 1, 2026

This tutorial reframes model validation as the design of a performance estimator rather than a mere software setting. It surveys splits from hold-out to nested group cross-validation, links geometric fold choices to the correct independent unit (record, subject, center), and provides eight controlled leakage scenarios grounded in biomedical examples such as EEG epochs and paired-eye OCT. The core argument is that an elaborate fold structure is scientifically invalid if applied to the wrong unit, and that even a simple hold-out can be rigorous when the unit, size, and isolation constraints are correct.

Model validation estimates the performance of a complete learning procedure on new data. However, an invalid split can produce an optimistic and stable result. This tutorial reviews hold-out validation, train/validation/test designs, repeated random subsampling, k-fold and repeated stratified cross-validation, leave-one-out and leave-p-out schemes, group-aware validation, and nested group cross-validation. General machine-learning principles are linked to EEG epochs, paired-eye OCT images, repeated clinical measurements, and multicenter data. Eight controlled scenarios compare flawed and leakage-safe designs: seven use locked confusion matrices with auditable metrics, and one uses a reproducible repeated-study simulation. The scenarios cover global feature selection, normalization leakage, dependent records, center mixing, repeated test-set use, and estimator instability. Bias, variance, metric aggregation, uncertainty, and computational cost are also examined. A data-size matrix, a decision tree, and reporting checklists are provided. Reproducible MATLAB templates and scikit-learn counterparts are included. The results show that no validation method is universally best. The independent unit must match the intended deployment target. Every data-dependent operation must also exclude the observations used for performance estimation.
0
cs.CLcs.LG Rocker D'Antonio, Thomas Benton Townsend, Dimitrios Michael Manias · Oct 1, 2026

Technical documentation preserves collaborative context, but sentence-level specificity predictors were trained on general-domain prose. This paper audits whether two such predictors—SpeciTeller and a pinned post-publication implementation of Ko et al.'s domain-adapted model—produce stable, useful signals when applied to technical corpora (GitHub, Ansible, Python docs) and used to rank LLM-generated revisions. Using a three-stage evidence structure, the authors separate score interpretation, local correspondence with humans and controlled edits, and bounded decision value for post-generation candidate selection.

Collaboration depends on shared context, and technical documentation is one way that context persists across people and AI teammates. Specificity, the amount and exactness of detail expressed in language, shapes what information documentation captures and how precisely that information is communicated. This work audits sentence-specificity scoring artifacts on technical documentation and tests whether scores applied only after generation help choose among fixed LLM-generated revisions. Across Wikipedia and three technical-documentation corpora, the fixed general-domain predictor SpeciTeller and the pinned post-publication author-repository implementation of Ko et al.'s target-adapted predictor produce different corpus orders and same-sentence rank agreement from -0.066 to 0.510. Strict filtering and token-length adjustment change these patterns without reconciling them. In the Gemma set, SpeciTeller ranking raises direction-valid selection from 71.7% to 83.3% (+11.7 points; 95% source-case bootstrap interval +1.7 to +21.7); in the GPT-OSS-120B set, SpeciTeller ranking raises direction-valid selection from 51.7% to 56.7% (+5.0 points; 95% source-case bootstrap interval -6.7 to +16.7), and every primary single-score GPT-OSS-120B interval includes zero. These findings tie score interpretation and decision value to the predictor and candidate set.
0
cs.ROcs.LGcs.MA Yifan Hu, Luhang Hong, Mingkang Long et al. · Oct 1, 2026

Coordinated multi-humanoid loco-manipulation is notoriously difficult because it couples high-dimensional whole-body control with decentralized decision making and scalability. MASkillBlender addresses this by learning a shared decentralized high-level multi-agent RL policy that blends frozen, pre-trained single-humanoid primitive skills, eliminating the need for task-specific motion references or painstaking per-task reward engineering. The authors further introduce a permutation-based data augmentation strategy and prove, under a homogeneous Markov game formulation, that it preserves the policy-gradient direction. Simulated experiments across cooperative manipulation and locomotion tasks suggest broad versatility across robot embodiments and simulators, though the work stops short of real-world validation and is limited to small, homogeneous teams.

Coordinated multi-humanoid loco-manipulation is promising yet challenging due to high-dimensional whole-body control, decentralized decision making, and scalability. While recent reinforcement learning methods have improved single-humanoid whole-body control, extending them to the multi-humanoid setting remains nontrivial and often requires substantial reward engineering or task-specific design. We propose MASkillBlender, a general multi-agent reinforcement learning framework to achieve decentralized multi-humanoid whole-body coordination. By learning a shared decentralized high-level policy over reusable pre-trained single-humanoid skills, MASkillBlender enables coordinated behaviors using only task-level rewards, without requiring task-specific motion references. To improve learning efficiency, we further introduce a permutation-based data augmentation strategy for homogeneous multi-humanoid systems, and theoretically show that the permuted samples preserve the policy-gradient direction of the original samples under the homogeneous Markov game formulation. We evaluate MASkillBlender on multiple multi-humanoid coordination tasks across two humanoid embodiments. Simulation results demonstrate that the proposed framework consistently achieves strong task performance and enables coordinated behaviors across different tasks and humanoid embodiments.
0
cs.LG Jimin Seo, Gyubok Lee, Yeonsik Jo et al. · Oct 1, 2026

Training hybrid Transformer-SSM models requires expensive per-scale learning rate (LR) tuning. This paper empirically shows that "naïve" Maximal Update Parameterization (μP) — as originally prescribed for pure Transformers, with no SSM-specific modifications — combined with AdamW achieves near-zero LR transfer gap across hybrid architectures from width 256 to 2048 (8×) and depth 4 to 32 (8×), up to billion parameters and on a production Nemotron-H model. The authors propose a two-condition decomposition (global update-to-weight invariance from μP, local per-component balance from AdamW's g/√v normalization) to explain why coordinate checks fail while transfer still succeeds.

We study learning rate (LR) scaling for hybrid architectures combining Transformer and State-Space Model (SSM) blocks, a class adopted by several recent production language models. In particular, we focus on the gap between the theoretical scaling rules derived for SSMs under zero-order-hold (ZOH) discretization at infinite width with growing state size, and the field-standard practical implementations using simplified-ZOH Mamba at fixed state size. Surprisingly, in this practical regime hybrid architectures achieve a near-zero LR transfer gap across widths 256-2048 and depths 4-32 up to billion-parameter scale using only the original $\mu$P prescription, even though SSM operations fall outside its Tensor Programs representability conditions and every parameterization we test fails the standard coordinate-check diagnostic of $\mu$P correctness. We attribute this to a two-condition decomposition of LR transfer in hybrid architectures: a global update-to-weight invariance, enforced by $\mu$P's initialization and LR scaling; and a local per-component balance, provided by AdamW's per-parameter normalization. Our observations show that the optimal LR is invariant to width up to 8$\times$, that this width invariance holds across depth, sequence length, batch size, and Transformer-to-SSM ratio, and that it transfers to Nemotron-H, a production hybrid outside our custom architecture set. We hope these findings fill the gap between theoretical scaling rules and practical hybrid implementations, and stimulate further research toward bridging it.
0
cs.LG Seongcheol Jeong, Masahiro Suzuki, Yutaka Matsuo · Oct 1, 2026

Model merging for LLMs typically requires expensive benchmark evaluations to tune combination coefficients. This paper proposes SLIM, which treats coefficient selection as a classical mixture experiment on the simplex. It builds a quadratic surrogate of aggregate performance using only $T(T+1)/2$ evaluations—individual experts and equal-weight pairs—then optimizes the surrogate without further measurements. The core finding is that this minimal structured design predicts unseen mixtures accurately and yields competitive merges at a fraction of the cost of evolutionary or surrogate baselines, though restricting coefficients to the simplex may limit absolute performance.

Optimizing merging coefficients for large language models can require many costly benchmark evaluations. We propose \textbf{Simplex-Lattice Interpolation Merging (SLIM)}, which constructs a quadratic surrogate of aggregate performance on the coefficient simplex using a classical mixture design. Evaluations of individual experts and equal-weight pairs determine the surrogate with the minimum number of measurements needed to identify a general quadratic on this domain. SLIM then optimizes the surrogate without further target-metric evaluations. Experiments on two model architectures demonstrate accurate prediction of unseen multi-expert mixtures and competitive merge performance under limited evaluation budgets. Matched-budget comparisons show that structured evaluation points improve prediction fidelity over random designs, including those using regularized fitting.
0
cs.LGcs.AImath.ST Yunrui Guan, Krishnakumar Balasubramanian, Shiva Prasad Kasiviswanathan · Oct 1, 2026

Counterfactual generation aims to sample the distribution of outcomes that would occur if a treatment were applied to an entire population, but observational data suffer from selection bias because treated individuals differ systematically from the target population. This paper develops a flow-matching method that learns to transport observed outcomes to counterfactual targets using a learned source-target coupling, a doubly robust training objective, and a score-corrected stochastic sampler with Gaussian smoothing. The core theoretical result is a finite-step KL bound governed by the coupling displacement moment $D_5$ rather than worst-case regularity, yielding near-linear dimension scaling and an end-to-end nonparametric sample-complexity guarantee; experiments on synthetic and semi-synthetic image data support the predicted coupling dependence and show that stochastic sampling can outperform deterministic counterparts at limited discretization budgets.

Counterfactual generation seeks to sample outcomes under a hypothetical intervention or decision using observational data collected under the factual assignment mechanism. We develop a flow-matching approach that combines a sample-split, doubly robust training objective with a learned coupling between observed source outcomes and target outcomes drawn from a fitted conditional outcome model. To enable finite-step generation, we leverage a score-corrected stochastic sampler based on a Gaussian-smoothed interpolation. Our main theoretical contribution is a coupling-sensitive KL bound for constant-step Euler discretization: the error is controlled by moments of the source--target displacement under the chosen coupling, rather than by global uniform regularity of the velocity field, and has near-linear dependence on the ambient dimension. We also establish finite-sample non-parametric guarantees for the learned velocity and score fields when both the conditional outcome model and the source-target coupling are estimated from data. These bounds separate approximation, coupling-replacement, nuisance-estimation, generalization, and Monte Carlo errors and, combined with the sampler analysis, yield an end-to-end guarantee for counterfactual generation. Experiments on synthetic and semi-synthetic image benchmarks support the coupling-dependent theory and show that, at finite discretization budgets, the stochastic sampler can outperform the corresponding deterministic ODE sampler.
0
cs.LGcs.AIcs.DB Roberto Stanzione, Jules Barbe, Magali Parrino et al. · Oct 1, 2026

Time series anomaly detection benchmarks traditionally optimize for detection accuracy while neglecting explainability and interpretability. This paper introduces SHAD, a real-world benchmark comprising 215 high-dimensional multivariate time series collected from distributed cloud storage systems, complete with per-dimension labels and rich semantic annotations. The authors evaluate 18 detection algorithms, probe spatial attribution for explainability, and test frozen LLMs for interpretability, demonstrating that accurate detection does not guarantee diagnostic utility and that zero-shot semantic interpretation remains largely unresolved.

Time Series Anomaly Detection has received increasing attention, driven by the growing availability of complex time series data. This surge has led to the development of numerous detection methods, as well as a variety of benchmarks aimed at thoroughly evaluating their performance. However, most existing detectors remain largely agnostic to domain context, overlooking explainability and interpretability. One of the main reasons for this gap is that current benchmarks primarily focus on detection accuracy, and only few of them evaluate spatial explainability. Moreover, no benchmark currently provides sufficiently rich semantic annotations to support the generation of human-understandable interpretations of anomalies. To address these limitations, we introduce SHAD (Scality High-dimensional Anomaly Detection benchmark), a fully annotated benchmark composed of 215 multivariate, high-dimensional time series collected from real-world distributed cloud storage systems operated by Scality. The proposed dataset includes rich contextual information, covering three families of anomalies with varying degrees of severity. As further contribution, we provide a foundation for future work by evaluating baseline methods for Detection, Explainability, and Interpretability, covering all stages of a TSAD pipeline. For Detection, we benchmark a wide range of existing anomaly detectors, testing their effectiveness on the proposed real-world dataset. Then, we consider explainability by evaluating whether measuring the contribution of each dimension in the generated anomaly score can provide accurate anomaly attributions. Finally, for interpretability, we investigate the effectiveness of frozen LLM baselines in localizing and interpreting anomalies.
0
cs.LGcs.CL Shengye Tao, Yinzhu Cheng, Haihua Xie · Oct 1, 2026

Most interpretability studies ablate or probe a single training checkpoint, leaving it unclear whether observed depth-dependent sensitivities are stable or transient. This paper tracks whole-block identity bypass across five released pretraining trajectories and eleven model-domain combinations to ask what persists and what shifts. The core finding is that the relative depth ordering of block sensitivities remains recognizable even as the magnitudes redistribute, and that the intervention pathway itself evolves differently across models and perturbation scales. The work matters because it cautions against treating single-checkpoint ablation profiles as static descriptions of a model's internal organization.

Layer interventions are widely used to probe the internal organization of language models, yet most analyses examine a single training checkpoint even though model representations and computations evolve throughout pretraining. This leaves open which depth-dependent intervention responses reflect persistent organization and which are transient consequences of training. We study this question using single-block identity bypass on fixed teacher-forced contexts across five released trajectories and 11 model-domain combinations. We find that block-bypass responses retain recognizable depth ordering while their magnitudes redistribute: nearby checkpoints preserve stronger rank correspondence than distant ones, and large changes concentrate at positions that recur across text samples and transfer across evaluation domains. Controlled experiments further show that changes in the natural bypass effect cannot be reduced to a single downstream sensitivity: in replicated Pythia runs, local missing-update magnitude grows while the pooled matched downstream response decreases, whereas OLMo-2 7B exhibits a different balance. These matched responses also depend on perturbation strength and direction, without identifying targeted compensation. Together, our results show that longitudinal layer sensitivity is structured but not static, and that single-checkpoint intervention responses should be interpreted in the context of how the underlying perturbation pathway evolves during training.
0
stat.MEcs.LGmath.ST Hansheng Jiang · Oct 1, 2026

The nonparametric maximum likelihood estimator (NPMLE) of a Gaussian mixture is a convex program over an infinite-dimensional space, yet its maximizers can be nonunique and are only known to have at most $n$ atoms. This paper shows that a vanishingly small random reweighting of the likelihood---using independent Gamma weights that concentrate around one---selects a unique maximizer with polylogarithmically many atoms in any fixed dimension $d$. The resulting estimator retains a Hellinger rate that is parametric up to logarithmic factors, solving the open problem of exact sparsity for multivariate Gaussian NPMLEs without any support penalty.

The nonparametric maximum likelihood estimator (NPMLE) of a Gaussian location mixture maximizes the likelihood over the infinite-dimensional space of mixing distributions. The maximizing mixing distribution can be nonunique, and the classical bound on its number of atoms grows linearly with the sample size $n$. We show that a vanishingly small random perturbation of the likelihood yields exact polylogarithmic sparsity. The resulting randomly reweighted NPMLE maximizes a weighted likelihood whose independent weights, taken to be Gamma in our analysis, concentrate around one as $n$ grows. With high probability, it is unique, has $O\{(\log n/\log\log n)^d+\log n\}$ atoms in dimension $d$, nearly maximizes the ordinary likelihood, and estimates the mixture density at a Hellinger rate that is parametric up to logarithmic factors. This sparsity holds for the estimator itself, not for an approximation of it, and requires no support penalty. The proof rests on an effective-dimension principle for positive kernel mixtures: low-dimensional variation of the fitted values controls the support of every extreme point of the set of maximizers. Numerical illustrations verify that the reweighted NPMLE has Hellinger risk and support size comparable to those of the ordinary NPMLE.
0
cs.LGcs.AI Di He, Pengxiang Li, Da Chang et al. · Oct 1, 2026

Looped Transformers reuse shared blocks to scale depth without adding parameters, but MoE variants degrade beyond two loops. This paper diagnoses two bottlenecks—hidden-state drift and expert selection collapse—and proposes LOOM, combining residual scaling, embedding re-injection, per-loop routers, and a Looping Residual. It matters because it attempts to establish recurrent depth as a genuine, compute-efficient scaling axis for sparse LLMs.

Looped Transformers introduce recurrent depth as a new scaling axis for LLMs: by repeatedly applying shared Transformer blocks, they increase effective depth without increasing parameter count. However, the benefits of looping remain unclear for large MoE LLMs under FLOPs-matched comparisons. The main reason is that the gains from additional iterations diminish quickly and can even turn into degradation, so the extra FLOPs spent on looping yield little substantial improvement. Consequently, prior work typically settles on two loops. We identify two main obstacles to scaling looped MoE. First, looping inherits and amplifies the curse of depth: hidden-state variance grows with each iteration as residual updates accumulate, which destabilizes deep recurrence and causes representations to drift. Second, looped MoE suffers from expert selection collapse: routers repeatedly select the same experts across loops, so extra iterations add computation without adding computational diversity. Guided by this diagnosis, we propose LOOM, built on a single principle: each loop should contribute new computation while keeping the recurrent state stable. LOOM stabilizes recurrence by scaling residual updates to bound variance growth and re-injecting the input embedding at every loop, and diversifies it through per-loop routers that engage different experts and a Looping Residual that carries earlier outputs forward. Experiments across 100M-1.7B models show stable scaling to 9-12 loops. Under near-iso-FLOP, the 700M model performs best at 5 loops, reducing perplexity from 18.36 to 16.54 and improving average zero-shot accuracy from 38.84% to 39.53% over the non-looped baseline. Without FLOP matching, the 1.7B model trained on 60B tokens peaks at 9 loops, reducing perplexity from 9.62 to 7.77 and improving average zero-shot accuracy from 42.4% to 47.7%. Code is available https://github.com/hed-ucas/LOOM.
0
quant-phcs.LG Sota Hashimoto, Akinori Kawachi · Oct 1, 2026

Hashimoto and Kawachi study Hamiltonian function learning: predicting $\operatorname{Tr}[f(H)\rho]$ from classical descriptions of a Hamiltonian $H$ and state $\rho$ when the function $f$ is fixed and known. Their core result is a rigorous average-case classical hardness proof for two explicit instances—$f_{\cos,\pi}(\lambda)=\cos(\pi\lambda)$ and $f_{\exp,\beta}(\lambda)=e^{-\beta\lambda}$—obtained by reducing from the hardness of factoring random RSA moduli via Shor's algorithm embedded in projector Hamiltonians. This settles an open problem left by Morohoshi et al. and gives a computational quantum advantage in a quantum machine learning task that has already been demonstrated experimentally on superconducting devices.

Morohoshi, Nakayama, Manabe, and Mitarai proposed a physically motivated quantum machine learning problem in which the goal is to predict quantities of the form $\operatorname{Tr}[f(H)\rho]$ from classical descriptions of a Hamiltonian $H$ and a quantum state $\rho$, where $f$ is an unknown function. We call this problem Hamiltonian function learning in this paper. They constructed an efficient quantum learning algorithm under suitable conditions, while leaving a rigorous proof of average-case classical hardness open. In this paper, we rigorously prove the average-case classical hardness for two distribution-specific Hamiltonian function learning problems for $f_{\cos,\pi}(\lambda)=\cos(\pi\lambda)$ and $f_{\exp,\beta}(\lambda)=e^{-\beta\lambda}$ discussed in the paper of Morohoshi et al. under the assumption of the average-case hardness of factoring random RSA moduli. More specifically, we show that an efficient classical randomized learner under squared loss whose output hypotheses are evaluable in classical polynomial time for either problem would yield a classical randomized polynomial-time algorithm for factoring random RSA moduli.
0
cs.LG Chaiho Shin, Kwangsoo Kim · Oct 1, 2026

GLoC-EHR addresses clinical outcome prediction and reasoning over structured EHRs by equipping a language model with two complementary memories: a compact global trajectory summary and a bounded local set of selected events. The architecture aligns both routes with clinical text through hospital-course generation and masked-concept description recovery, then learns record-grounded, evidence-cited reasoning via GRPO with rewards for answer correctness and lexical evidence matching. Its core contribution is showing that a small multimodal LLM can match strong direct-prediction AUROCs while producing interpretable rationales tied to the patient record.

Structured electronic health records (EHRs) contain a patient's clinical trajectory as a sequence of clinical codes. Answering clinical questions from such records requires both the context of the whole trajectory and the specific events that support the answer. We introduce GLoC-EHR, a multimodal language model that reads a contextual encoding of the record through a fixed-size global memory of the trajectory and a local memory of selected events. The model learns to generate hospital-course summaries from the global memory and descriptions of masked concepts from the local memory, aligning both with clinical text. It is then trained to cite evidence before answering, through rationale fine-tuning followed by group relative policy optimization (GRPO) with rewards for correct answers and record-supported evidence. On three MIMIC-IV outcome tasks, GLoC-EHR attains the highest macro AUROC among the compared models when it answers directly, whereas zero-shot LLMs reading the serialized record fall far behind. With evidence-cited reasoning, it stays close to its direct multi-task counterpart in macro AUROC, and the evidence terms of the objective reduce unsupported evidence at a similar macro AUROC. The local memory adds distinct supported findings, particularly under strict matching, without a detectable change in macro AUROC. Without retraining, GLoC-EHR transfers to EHRSHOT on par with EHR-BERT and answers two unseen laboratory questions better than zero-shot prompting of its own backbone.
0
cs.LG Laziz U. Abdullaev, Minh-Hieu Pham, Bach Do et al. · Oct 1, 2026

This paper tackles the rigidity of standard Difference-in-Means (DiM) activation steering, which applies a single global vector to all activations and ignores nonlinear manifold structure. The authors propose Kernelized Activation Steering (KAS), lifting steering into a reproducing kernel Hilbert space so that each activation receives a locally adaptive, implicit update based on kernel similarities to source and target reference sets. The framework strictly generalizes DiM—recovering it under a linear kernel—and connects activation steering to maximum mean discrepancy witness functions, with empirical evaluations on jailbreaking, behavioral control, and image style generation.

Activation steering provides a simple, training-free mechanism for controlling attributes of generative models such as sentiment, style, and helpfulness. However, standard approaches such as Difference-in-Means apply a single input-independent steering vector across all activations, limiting expressivity and ignoring the local geometry of the activation space. We propose Kernelized Activation Steering (KAS), a unifying framework that lifts activation steering into a reproducing kernel Hilbert space. KAS formulates steering as an optimization problem expressed purely via kernel evaluations, yielding an implicit, activation-dependent steering score without constructing explicit feature maps. Unlike DiM, KAS induces locally adaptive steering: each activation is modified according to its relative position with respect to source and target reference sets, producing a nonlinear steering field over the representation space. Importantly, DiM is recovered as a special case under a linear kernel, while richer kernels enable geometry-aware interventions. Across standard activation steering tasks, including jailbreaking LLMs and image style control, KAS outperforms or is on par with the existing methods.
0
stat.MLcs.LGstat.ME Jie Tang, Chuanlong Xie, Lixing Zhu · Oct 1, 2026

Most fairness tests ask whether a model treats groups exactly equally, but real audits often need to decide whether a disparity exceeds a legally or practically meaningful tolerance. This paper formalizes tolerance-based fairness auditing as two distinct statistical objectives—formal violation certification and early-warning sensitivity screening—and develops empirical-likelihood procedures calibrated to each. Constrained empirical likelihood (CEL) controls false violation declarations over a tolerance region, while split empirical likelihood (SEL) and an adjusted variant (ASEL) use an adaptive boundary-proxy principle to increase detection near the boundary. The work matters because it translates abstract fairness requirements into actionable, objective-dependent statistical guarantees.

As artificial intelligence is increasingly deployed, algorithmic unfairness has raised growing concerns and intensified demands for transparent fairness auditing. In practice, the tolerable degree of algorithmic unfairness depends on the specific legal, ethical, or application context. Given a prespecified tolerance threshold, an important statistical question is how to determine whether a group disparity exceeds the allowable tolerance across different auditing objectives. To address this problem, we develop a unified tolerance-based fairness auditing framework for two complementary auditing objectives: violation certification, which prioritizes control of false violation declarations, and sensitivity screening, which prioritizes reducing missed violations. For the first objective, we develop a constrained empirical likelihood test for formal settings that uses least-favorable-point calibration and can be combined with false flagging rate control for simultaneous subgroup auditing. For the second objective, we develop split empirical likelihood and adjusted split empirical likelihood tests using an adaptive boundary-proxy principle for early-warning settings. Numerical experiments show the distinct error-control--sensitivity trade-offs of these procedures. A COMPAS analysis illustrates the framework in predictive fairness auditing.
0
stat.MLcs.LGstat.ME Marco Pollanen · Oct 1, 2026

Treating model release as a design problem rather than a convention, this paper asks how many of $k$ automated tests a model should pass before deployment to guarantee a stated reliability target while retaining as many good models as possible. Using a two-class Gaussian latent-factor model with common within-class correlation $\rho$, the author proves that precision rises strictly with the required pass count $r$, so the optimal gate is the most lenient $r$-of-$k$ rule that meets the target. This matters because teams often default to pass-all gating, which can decimate the pool of acceptable models when tests are even modestly correlated; the paper shows that misjudging dependence by a factor of two can hurt more than shifting the gate by one test.

Before a machine learning model ships, it often has to pass a suite of automated tests. Requiring every test to pass looks safe, yet it can reject many models that would have served users well, and it does not say how trustworthy a passing model actually is. We treat the release gate as a design problem: choose how many tests a model must pass so that cleared models meet a stated reliability target, while keeping as many good models as possible. A two-class latent-factor model makes both costs explicit and reduces each calculation to a one-dimensional integral. We prove that when both classes share the same latent correlation, a stricter gate always raises reliability, so the gate that keeps the most good models is the most lenient one that still meets the target. Under pass-all gating, any reliability target short of perfection is attainable within the model, but the share of good models kept tends to zero as the suite grows. Correlation between tests sets the price. In one configuration, a 99 percent target needs 8 independent tests, but 74 tests at a latent correlation of 0.3 and 5,182 at 0.5, where the gate keeps fewer than one good model in ten. We also give a validation procedure, built on exact binomial bounds, that certifies a gate from labelled data even when the gate is chosen from a fixed shortlist.
0
cs.LG Jonathan Williams, Esin Tureci Karthik R. Narasimhan · Oct 1, 2026

The paper identifies a failure mode in the standard RLVR pipeline: training one policy with reinforcement learning from verifiable rewards (RLVR) improves single-sample accuracy but can hurt majority-vote performance because RLVR increases correlation among voter errors and collapses output diversity. The proposed fix is an "adapter thicket" — splitting the same training budget across $K$ independent LoRA adapters, each trained on a disjoint random data shard. Across 16 (model, $K$) settings and four models (1.5B–8B), thickets consistently out-vote the fully trained single adapter, and for $K \geq 4$ they protect the base model's vote while keeping most of the single-sample gain.

Majority voting over sampled completions is the workhorse of test-time scaling, and reinforcement learning with verifiable rewards (RLVR) is the workhorse for making each completion better. The standard pipeline composes the two: train one policy with RLVR, then sample it many times and vote. We show that this composition is lossy. A vote can only overturn mistakes that its voters do not share, and RLVR sharpens a policy so that its samples increasingly make the same mistakes. With every method drawing exactly $160$ completions per problem, training a single LoRA adapter on the full RLVR budget raises single-sample accuracy on every model we test ($1.5$B-$8$B). Yet on three of four models it leaves the majority vote below that of the untrained base model, by up to $4.8$ points. The damage builds during training: voter errors grow steadily more correlated, and the majority vote accuracy peaks early before falling by up to $7.0$ points. The cause is concentration, not RLVR itself. We split the same data and training budget across $K$ LoRA adapters, each trained on its own random disjoint shard, and call the result an adapter thicket. Thickets out-vote the fully trained adapter in all $16$ (model, $K$) settings, and for $K{\geq}4$ they stay within $0.8$ points of the base model or above it. A single adapter stopped early, at a thicket member's step count, is a strong control that matches thickets for small $K$. For $K{\geq}8$, thickets keep more of RLVR's single-sample gain and out-vote this control in six of eight settings. The cost of concentration also grows with the number of votes: from $16$ to $160$ votes, the thicket's lead over the fully trained adapter widens from $1.3$ to $3.3$ points. When the plan is to sample and vote, an RLVR budget is better spent broad than deep.
0
cs.LGq-bio.BM Shan Yu, Xuening Wu · Oct 1, 2026

Detecting cryptic ligand-binding pockets from unbound protein structures is difficult because the pockets are often absent or closed in apo conformations. The authors propose an algebraic counting field (ACF) that maps explicit local structural features into compact, integer-weighted lookup tables so that every residue score can be mechanically reconstructed from training counts and spatial aggregation. The goal is to achieve competitive cryptic-pocket prediction while keeping the inference fully auditable, without relying on sequence homology, structural templates, or deep learning at inference time.

Cryptic ligand-binding pockets are not apparent in experimentally determined apo structures, making them difficult to identify from unbound receptor geometry. A complementary challenge is to make the structural measurements and learned evidence behind each prediction directly inspectable. We introduce a supervised algebraic counting field (ACF) for predicting cryptic-pocket residues from apo structures. ACF compiles explicit geometric, physicochemical, and topological features into compact, integer-weighted lookup tables. Each prediction score can be reconstructed from feature values, training counts, table weights, and spatial aggregation, without sequence search, structural-template transfer, or a protein language model at inference. We evaluate ACF on CryptoBench and two locked external collections, separating ranking performance from the effects of residue-calling budgets. On an external set of 57 post-CryptoBench apo-holo units, ACF exceeded P2Rank by +0.044 in mean paired ROC-AUC (multiplicity-adjusted 95% CI [+0.010, +0.079]). The advantage was dataset-dependent: official-fold ROC-AUC and matched-budget F1 differences against P2Rank remained unresolved, and a second external evaluation did not confirm gains from added structural features. ACF thus provides a compact predictor with externally validated signal and an inspectable path from structural measurements and training counts to residue scores.
0
cs.LGcs.RO Oliver Obst, Frieder Stolzenburg · Oct 1, 2026

In model-predictive control with the cross-entropy method, a learned world model scores candidate action sequences and refits the Gaussian proposal for the next search iteration, creating planner-induced query shift. The authors disentangle these two roles by saving every CEM candidate pool from four surrogate models, executing all candidates in a resettable environment for a ground-truth ranking, and rescoring each pool with every model in a crossed design; they then splice the first elite set with environment-ranked elites to trace causal consequences through later iterations. Their results show that standard proposal distances contract even as ranking agreement stays near chance and mean disagreement grows, and that a single environment-guided elite update lowers final selected cost—demonstrating that world-model quality must be judged by its effect on the proposal, not just on candidate scoring.

The cross-entropy method (CEM) uses world-model scores to select action sequences and fit the distribution sampled in its next iteration. A scoring error can therefore change both the present decision and the candidates considered later. We evaluate these two roles separately. Four types of predictive model generate CEM traces, and every model rescores every saved candidate pool. Executing the same candidates in the environment provides a reference elite set and proposal update. Across twelve independently trained task-seed units on Walker and Cheetah, the pre-specified proposal distance falls from the first to the final CEM iteration in every unit. Proposal widths contract and fitted means separate relative to the remaining search width. Pairwise ranking agreement stays near chance on Walker and declines on Cheetah; elite-set agreement does not improve. This comparison shows greater variation between scorers than between pool sources on Cheetah; Walker has variation in both and in their pairings. We use the original six units to select Random nonlinear for a one-update intervention, without inspecting intervention outcomes. Replacing its first model-ranked update with an environment-ranked update lowers final realised selected-sequence cost in those six units and in six further units held out from the selection.
0
cs.LG Tilen Cadez, Sanghoon Lee, Kyoung-Min Kim · Oct 1, 2026

This work investigates how Kolmogorov-Arnold Networks (KANs) scale with training dataset size across three recent variants—BSRBF-KAN, Gottlieb-KAN, and Faster-KAN—on MNIST, Fashion-MNIST, and a magnetic-parameter regression task. The authors fit test loss versus dataset size with a smoothly broken power law, report regime crossings from random-guess to faster- and slower-scaling branches in classification, and analyze how the shapes of learnable edge functions evolve as data grows. The central takeaway is that KAN scaling is architecture-dependent and task-dependent, and that Gottlieb-KAN edge functions collapse into a single shape family rather than diversifying symbolically.

Kolmogorov-Arnold Networks (KANs) represent a compelling alternative to traditional Multi-Layer Perceptron (MLP)-based neural networks. By employing activation functions as learnable elements, KANs offer superior interpretability, making them suited for scientific domains. In this work, we investigate the neural scaling laws of KANs and the structural evolution of their learnable activation functions under dataset expansion. Specifically, we evaluate the scaling behavior of three KAN variants---BSRBF-KAN, Gottlieb-KAN, and Faster-KAN---across standard image classification benchmarks (MNIST and Fashion-MNIST) and a specialized scientific regression task (magnetic parameter estimation from domain images of moir\'e magnetic textures). Our results demonstrate that the test loss ${\cal L}$ exhibits a broken neural scaling law (BNSL) behavior as a function of the dataset size $N_D$. After passing through a random-guess regime, the loss follows architecture- and task-dependent scaling behavior. The loss crosses from a faster- to a slower-scaling branch, ${\cal L}\propto N_D^{-\alpha}$ and ${\cal L}\propto N_D^{-\beta}$ with $\alpha>\beta$ for image classification tasks. The exponents $\alpha$ and $\beta$ depend strongly on both the specific network architecture and the dataset-size regime, ranging from 0.4 to 1.5 and from 0.06 to 0.6, respectively. For the magnetic parameter-regression task, the loss follows a single scaling law with its exponent ranging from 1.28 to 2.59. Additionally, we provide a structural analysis of how activation functions refine their complexity as data volume increases, finding that dataset expansion drives a transition from simple linear-like approximations toward stable, interpretable symbolic forms. These findings provide a quantitative roadmap for the efficient application of KANs while managing the trade-off between model expressivity and computational overhead.
0
cs.LG Junke Wang, Hongshun Ling, Li Zhang et al. · Oct 1, 2026

HADRec targets two key gaps in AI-driven medication recommendation: drugs are usually treated as anonymous tokens, and predictions ignore the hierarchical structure of the ATC taxonomy. The proposed framework fuses LLaMA-7B–encoded clinical text with ChemBERTa molecular embeddings via cross-attention, then generates prescriptions through a four-level top-down ATC predictor constrained by a novel consistency loss. This is important because grounding recommendations in both chemical structure and medical ontology could improve accuracy, interpretability, and clinical trustworthiness.

Accurate medication recommendation is central to clinical decision-making, directly determining therapeutic efficacy and patient safety. However, existing methods suffer from two key limitations: drugs are often abstracted as discrete tokens, ignoring their molecular structures and pharmacological mechanisms, and the commonly used "flat" recommendation paradigm fails to leverage the hierarchical logic of the internationally standardized Anatomical Therapeutic Chemical (ATC) classification system. To address these issues, we propose HADRec, a Hierarchy-Aware Drug Recommendation framework that integrates molecular knowledge with electronic health records (EHRs). HADRec employs LLaMA-7B to encode clinical notes for rich patient representations and ChemBERTa to encode drug Simplified Molecular Input Line Entry System strings, building a global molecular knowledge base. A cross-attention mechanism then performs deep multimodal fusion between patient states and drug features. The framework further incorporates a hierarchical predictor and a novel consistency constraint loss to enforce strict adherence to ATC logical dependencies. Extensive experiments on MIMIC-III demonstrate that HADRec achieves state-of-the-art performance across Jaccard, F1, and PR-AUC. External validation on MIMIC-IV confirms strong generalization under distribution shifts, and calibration analysis shows well-calibrated predictive confidence on MIMIC-IV with ECE = 0.04, and Brier = 0.06. Counterfactual evaluation reveals clinically aligned reasoning, disentangling disease-specific treatments from general care. Together, these results establish HADRec as a high-performance, interpretable, and clinically grounded pathway toward safe and reliable AI-driven medication recommendation.