Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
797 papers in cs.LG
Trending mixes fresh papers with community signal.
0
cs.CYcs.HCcs.LG Hitoshi Inoue, Koichi Yasutake · Oct 1, 2026

This paper confronts the design problem of building dashboards for novel computational techniques whose real-world meaning is still contested. It introduces TopoLA, a system applying Zigzag Persistent Homology to learning-management data, and derives three principles for managing interpretive uncertainty: separating measurement from interpretation, graduated disclosure, and explicit acknowledgment of methodological limits. The argument is timely because fields from explainable AI to bioinformatics increasingly face the same gap between analytical power and interpretive consensus.

Topological Data Analysis (TDA) offers novel methods for understanding temporal dynamics in complex systems, yet its application in information systems design faces a fundamental challenge: how should systems present analytical outputs when interpretation frameworks are still developing? This paper reports on the development of TopoLA, a dashboard system applying Zigzag Persistent Homology to learning management system data, and proposes three early design principles for interpretation support in emerging analytics: (1) separation of objective measurement from contextual interpretation, (2) graduated disclosure from metrics through patterns to reflective prompts, and (3) explicit acknowledgment of methodological uncertainty. The system implements a modular three-stage pipeline--feature extraction, topological computation, and interpretation support--enabling extension to additional analytical methods. This work contributes to information systems research by articulating preliminary design knowledge for systems that must communicate analytical insights from methods lacking established interpretation norms--a challenge increasingly common as novel computational techniques enter applied domains.
0
cs.ROcs.CVcs.LG Kartik B. Kapse · Oct 1, 2026

Autonomous driving system designers face a persistent dilemma: should they build a decomposed modular pipeline or train an end-to-end neural policy? This survey-style paper addresses that question by comparing modular, imitation-learning, reinforcement-learning, and hybrid architectures across interpretability, scalability, and robustness. Its central contribution is a practical twelve-criterion, four-dimensional framework intended to guide practitioners in selecting the right paradigm for a given deployment context.

Autonomous driving systems have become a central focus of intelligent transportation research, with End-to-End Learning and Modular Architectures offering two prominent design paradigms for their implementation. E2E Learning uses deep learning algorithms to map raw sensory inputs directly to driving actuators, providing a streamlined and adaptable solution. while Modular Architectures employ a pipeline-based approach, dividing the system into distinct subsystems for perception, cognition, planning, and control. This paper presents a comprehensive comparative analysis of these paradigms, focusing on their strengths, limitations, and trade-offs to provide insights into their suitability for various autonomous driving applications. The study evaluates key factors such as interpretability, scalability, robustness, and real-world applicability. While End-to-End Learning emphasizes simplicity and adaptability in dynamic environments, it lacks transparency and is highly dependent on large datasets. Conversely, Modular Architectures offer superior interpretability and task-specific optimization, but face challenges related to integration complexity and scalability. To address these limitations, hybrid approaches that combine the strengths of both paradigms have emerged, offering a promising direction for overcoming these challenges. Beyond this comparative synthesis, following work proposes a Four-Dimensional Architecture Selection Framework, comprising twelve binary criteria across safety, operating environment, data/computational resources, and deployment context, and validate it against ten published autonomous driving systems, correctly recommending 7/10 deployed architectures. This work synthesizes existing literature to highlight key trade-offs between the paradigms and identifies hybrid architectures as a promising direction for future research.
0
cs.ROcs.AIcs.LG Seungyeon Kim, Junhoo Lee, Baekseung Kim et al. · Oct 1, 2026

World Action Models (WAMs) jointly predict visual futures and robot actions, yet they often hallucinate locally plausible trajectories that never execute the critical state transition needed to finish the task. This paper identifies "task-incomplete imagination" as a failure mode arising from the mismatch between long-horizon video pretraining and short-horizon control generation, and proposes Completion Aware Guidance (CAG), a training-free sampling method that up-weights instruction tokens already attended to by the model. Across two WAM architectures, CAG boosts success rates and cuts incomplete-imagination failures, offering a lightweight inference-time fix for a structural objective mismatch.

World Action Models (WAMs) predict visual futures and robot actions, yet they remain susceptible to task-incomplete imagination, where plausible, action-consistent predictions omit the transition needed for task completion. In this paper, we show that this failure is not inherent to the world model backbone, but emerges when adapted for short-chunk control, which can repeatedly favor plausible local continuations over task-completing transitions. To address this, we introduce Completion Aware Guidance (CAG), a training-free sampling method that guides generation toward task completion. Across representative WAMs, CAG improves success from 64% to 70% on a RoboTwin 2.0 subset and from 69% to 75% in zero-shot simulation, while reducing task-incomplete imagination from 79% to 40%.
0
cs.LG Jiajun He, Denis Blessing, Mouyang Cheng et al. · Oct 1, 2026

Sampling from discrete, unnormalized distributions without curated data is a fundamental bottleneck in physics, chemistry, and combinatorics, because the state space is exponential and Markov chains mix too slowly. This paper introduces DIG-IN (Discrete Gibbs Iterative Neural Sampler), which trains masked diffusion models via fixed-point iteration by using Gibbs soft labels—local single-site conditionals derived from energy differences—as rich supervision instead of one-hot reconstruction targets. The method tempers importance weights by effective sample size to stabilize the bootstrap, and it scales to high-dimensional systems such as $D=2500$ lattice spin models and alloy phase diagrams.

Sampling from discrete, unnormalized distributions without access to data is a challenging problem. Neural samplers offer a promising approach by training generative models from density evaluations directly. Despite recent progress, existing discrete neural samplers are prone to mode collapse, come without convergence guarantees when trained via fixed-point iterations, and are often tied to a specific reference process such as masked or uniform diffusion. In this work, we introduce Discrete Gibbs Iterative Neural Sampler, a fixed-point neural sampler that addresses these limitations, enabling efficient, scalable learning, substantially reducing mode collapse in practice. Our framework builds on masked diffusion and also extends to transport between pairs of distributions. We demonstrate that the resulting method scales effectively to high-dimensional systems, supports amortized sampling across different conditions, and enables accurate estimation of alloy phase diagrams.
0
cs.CYcs.LG Hitoshi Inoue, Koichi Yasutake · Oct 1, 2026

Asynchronous online learning structurally fragments learner communities, and cohort-level topological indicators like $\beta_0$ can misleadingly suggest convergence when learners simply drop out. This paper tests whether $\beta_0$ from Zigzag Persistent Homology is participation-sensitive and whether deadline-driven fragmentation–convergence cycles replicate across all 22 OULAD courses. Clarifying this matters because AI-augmented dashboards risk spreading systematically misleading cohesion narratives if they misread attrition-driven $\beta_0$ declines.

Asynchronous online learning offers temporal flexibility at a structural cost: learning communities tend to fragment rather than cohere. $\beta_0$, the number of disconnected behavioral clusters from Zigzag Persistent Homology, serves as a cohort-level indicator of this structure. Two questions remained unverified at scale: (1) does apparent $\beta_0$ convergence reflect genuine behavioral alignment or learner dropout? and (2) do assessment deadlines produce reproducible fragmentation-convergence cycles? We address both across all 22 OULAD courses (N > 22,000; 857 week-pairs). Changes in $\beta_0$ strongly co-vary with active learner changes (pooled r = 0.387; median per-course r_delta = 0.459, 20/22 courses), identifying $\beta_0$ as a participation-sensitive indicator: $\beta_0$ and active learner counts co-respond to deadline events rather than one causing the other. Deadlines produced fragmentation in 82.6% of assessments and the full Fragment First, Converge Later (FFCL) cycle in 60.2%. 3-phase analysis confirmed structural fragmentation as the dominant long-term trajectory (90.9% of courses), moderated by curriculum structure. These findings establish $\beta_0$ as a participation-sensitive structural indicator with direct implications for AI-augmented learning analytics design.
0
cs.LGcs.RO Takumi Hara, Kanata Suzuki · Oct 1, 2026

Latent world models plan by scoring action sequences with latent-space distances, yet physical success criteria demand precision finer than these models typically encode. This work proposes a training-only auxiliary loss that supervises encoder and predictor outputs against the exact success-criterion quantities via a shared linear head, then discards the head at test time so planning remains unchanged. On manipulation tasks the approach yields statistically significant absolute gains of 3-5%, with the key insight that a task's success criterion itself should dictate what the latent state must retain.

Latent world models plan by scoring candidate action sequences with distances in latent space. However, task success is judged by physical quantities, which we call the success-criterion quantities. In all four latent world models we examine, the end-effector position is encoded in the latent state with an error larger than the success criterion allows. Such a latent state cannot separate successful candidates from failing ones. We propose an auxiliary loss that uses success-criterion quantities as training targets, whereas existing latent world models take them only as inputs. During training, a linear head on the encoder and predictor outputs regresses the success-criterion quantities, and the regression error is added to the training loss. The head is discarded after training, so the model, its cost, and its inputs at test time are unchanged. This loss alone improves the success rate on PushT and cube by 3.5% and 3.4% (absolute), respectively, and both improvements are statistically significant. A success criterion thus specifies what a world model must retain in its latent state, and we show that it can serve directly as a training target.
0
cs.LGcond-mat.dis-nnstat.ML Haotian Gu, Yizhou Xu, Lenka Zdeborov\'a · Oct 1, 2026

This paper studies nonlinear in-context learning via single-index models, comparing a kernel learner (fixed spherical-harmonic features followed by linear attention) against a feature learner (linear attention on raw inputs followed by a learned nonlinear readout). Using the replica method, the authors derive predictions for memorization and generalization errors across varying pretraining data, task diversity, and context lengths, and validate them numerically over a broad parameter range. The analysis reveals phase diagrams for architectural advantage and qualitatively different context-length scalings: the kernel learner needs $L = \Theta(d^k)$ to recover degree-$k$ harmonics, while the feature learner exploits all teacher components at $L = \Theta(d)$.

In-context learning (ICL) enables a pretrained model to infer a task from demonstrations without updating its parameters. While much of the existing theory focuses on linear target functions, in this paper we study nonlinear cases by comparing two one-layer attention architectures on the same family of single-index tasks. A kernel learner first maps inputs through a fixed nonlinear feature map and then applies linear attention, whereas a feature learner applies attention to the original input, followed by a learned nonlinear readout. We derive predictions for their memorization and generalization errors using the replica method, retaining the effects of pretraining size, task-pool diversity, and training and inference context lengths. The resulting predictions closely match numerical experiments across a broad range of regimes. Our analysis yields phase diagrams that characterize when each architecture is advantageous as the amount of pretraining data, task diversity, and context lengths vary. We further identify qualitatively different context-length scalings for the two learners. Together, these results clarify how architectural choices interact with the dataset and govern nonlinear in-context learning.
0
cs.LG Zihan Liu, Xurong Xie · Oct 1, 2026

This work tackles algorithmic mathematical reasoning, where final-answer rewards fail to expose intermediate errors and successful code execution does not guarantee correctness. The proposed Function-Structured Graph Reinforcement Learning (FSG-RL) framework connects typed subproblem graphs to executable Python nodes, then trains a policy with supervised fine-tuning followed by Group Relative Policy Optimization (GRPO) using multi-verifier rewards and span-level credit assignment. The core claim is that verifying interface compliance, local functional behavior, and final consistency together pushes a 9B parameter model past a 27B API baseline, while also providing statistically significant gains over a strong SFT stage.

Algorithmic mathematical reasoning requires reliable decomposition, computation, and aggregation. Final-answer rewards provide limited guidance on intermediate errors, while successful execution does not guarantee mathematical correctness. This work proposes Function-Structured Graph Reinforcement Learning (FSG-RL), connecting subproblem graphs and Python implementations with multi-verifier feedback. The policy first learns to generate code from function graphs through supervised fine-tuning (SFT). Group Relative Policy Optimization (GRPO) then optimizes the policy using answer-gated rewards and span-level credit assignment. The framework also supports teacher supervision and structured memory. A benchmark curated from Grade School Math 8K (GSM8K), MathQA, MATH, and Omni-MATH pairs public function graphs with private verification specifications. Under a unified evaluation protocol, GRPO improves final-answer accuracy from 43.25% to 67.50% and full solution success from 32.25% to 52.25% over SFT. Continued reinforcement learning (RL) with teacher supervision yields additional gains. The gains extend beyond producing correctly formatted code, supporting verifier-guided reinforcement learning for mathematical reasoning. Code is available at https://github.com/ZihanLiummyycc/FSG-RL.
0
cs.LGcs.AI David Berghaus · Oct 1, 2026

Instead of hand-designing or training a neural network for time-series anomaly detection, this paper outsources the job to an LLM-driven autonomous research loop. The agent iteratively edits a short NumPy program, scoring candidates against synthetic anomalies in a held-out training slice, until it discovers compact spectral-Gaussian novelty detectors. The resulting univariate and multivariate programs reportedly top the TSB-AD benchmark while running on a single CPU, offering an unusual blend of accuracy, speed, and interpretability.

Time-series anomaly detection trades off predictive accuracy, computational efficiency, and interpretability. We use a large language model not as the detector but as the author of one: an autonomous research loop in which the model repeatedly edits a single short NumPy program under a leakage-free objective, keeping the best-scoring detector it finds. The loop discovers two compact detectors, one for univariate and one for multivariate series, that describe short windows by their local spectral features and compare them with the training-region distribution through a covariance-aware distance. On the TSB-AD benchmark these detectors lead the field across metrics, ahead of the strongest classical, deep, and foundation-model baselines including Time-RCD, yet they train no network and use no GPU, and the multivariate detector is faster than every similarly performing baseline. LLM-driven program search is thus a practical route to accurate, efficient, and transparent detectors.
0
cs.LGcs.CL Ivan Ilin, Peter Richt\'arik · Oct 1, 2026

QK-Wanda attacks a blind spot in activation-aware LLM pruning: Wanda scores query and key weights independently even though their dot products jointly determine attention. The paper derives closed-form single-deletion costs under a coupled QK reconstruction objective, letting queries and keys share a pruning budget without gradients or weight updates. Across 15 models up to 72B parameters, the method cuts local QK reconstruction error by roughly half, yet downstream gains are uneven—Llama 2 and Qwen2.5 improve while Llama 3 degrades—highlighting that local reconstruction fidelity is an imperfect proxy for end-to-end model quality.

Wanda (Sun et al., 2024) prunes large language models by scoring weights independently within each linear projection, although queries and keys interact through dot products. We introduce QK-Wanda, which scores query and key weights by their individual deletion costs under an unmasked pre-RoPE reconstruction objective. It augments Wanda scores with information from the opposite projection (keys for query weights, and queries for key weights), allowing both projections to share a pruning budget. Its closed-form scores require no gradients or weight updates; full pruning takes 1.3% longer than Wanda on A100 and 3.1% longer on H200 with the calibration used in our main experiments. We evaluate QK-only pruning across 15 models from TinyLlama, Llama 2, Llama 3, and Qwen2.5, spanning 0.5B-72B parameters. Relative to Wanda, QK-Wanda reduces QK reconstruction error by an average of 60% at 50% sparsity and 45% at 80%. Downstream gains depend on the model. At 80% sparsity on Llama 2 70B, WikiText-2 and C4 perplexity decrease by 20.3% and 13.5%, while mean zero-shot accuracy rises by 5.94 percentage points. Qwen2.5-72B also improves, but Llama-3.1-70B has substantially higher perplexity despite lower reconstruction error. These results show both the promise of coupled pruning criteria and the limits of local reconstruction as a predictor of model quality.
0
cs.LG Jan Tauberschmidt, Jephte Abijuru, Samuel Okon et al. · Oct 1, 2026

Many physical systems are driven and observed only on lower-dimensional submanifolds embedded in a larger ambient domain, forcing classical solvers to waste computation on full volumetric states and preventing black-box surrogates from reusing a fixed medium representation. This paper introduces the Green’s Observation Operator (GObO), which learns a time-dependent Green’s kernel restricted to the source and observation submanifolds so that, after a single conditioning pass on the ambient medium, evaluating an entirely new source requires only a cheap lower-dimensional integral with no additional network inference. The idea is supported by exponential spectral approximation guarantees, an exact finite streaming state, and strong empirical speedups and source-generalization gains on three-dimensional heat and advection–diffusion problems.

Many physical systems are driven and observed only on lower-dimensional submanifolds of a larger spatial domain, while their dynamics are governed by the ambient medium occupying that domain. Examples include laser-heated parts imaged by an infrared camera, and ground-level emissions measured on a sensor plane. Full-domain solvers, however, compute the entire volume for every new source although only the observation submanifold is needed, and black-box surrogates do not exploit that the ambient medium remains fixed. We introduce the \emph{Green's Observation Operator (GObO)}, which maps the ambient medium once to the Green's kernel of a linear PDE restricted to the source and observation submanifolds. New sources then cost one lower-dimensional integral and no network evaluation. Exponential rates in the kernel yield an exact finite streaming state with horizon-independent memory; we prove its stability and an approximation rate for the restricted heat kernel. On three-dimensional heat conduction and advection--diffusion with collocated and distinct source and observation geometries, GObO trained on static sources predicts responses to moving sources zero-shot with 4--8$\times$ lower error than black-box surrogates, at 1.4\,ms per query after a single conditioning pass. The same kernel transfers across resolutions and admits corrections for mild nonlinearities, including radiative losses and temperature-dependent conductivity, without retraining, at the cost of lower in-distribution accuracy.
0
cs.LGcs.AImath.OC Jakob Paul Zimmermann, Moritz Grillo, Andrei Balakin et al. · Oct 1, 2026

Understanding when neural-network loss landscapes contain spurious local minima is a foundational problem in deep learning. This paper studies shallow bias-free ReLU networks in a Gaussian teacher-student setting and proves that a learned linear skip connection eliminates all spurious local minima for planar teacher features with positive output weights once the student is at least as wide as the teacher. In contrast, without the skip, spurious minima can persist at every width—a striking separation between architectural bias and overparameterization.

Understanding loss landscapes is central to explaining neural-network training, yet their structure remains only partially understood even in simple models. We study the Gaussian population loss of shallow, bias-free ReLU networks in the teacher--student setting. This provides a simple model for studying essential aspects such as feature learning and overparameterization. For teacher networks with positive output weights and planar features, we show that including a learned linear skip removes all spurious local minima with non-negative student output weights once the student network is at least as wide as the teacher network. In contrast, without the skip, we construct a fixed teacher network with positive output weights and only three hidden neurons in input dimension two whose spurious local minima persist at every student width at least three. Thus, a learned linear skip can remove spurious minima that persist under arbitrary overparameterization. Furthermore, we show that a positive output weight student network always learns the subspace spanned by the teacher features: student features at local minima with non-negative student output weights lie in the span of the teacher features. For ReLU networks in two dimensions, even heavily overparameterized student networks have effective width controlled by the teacher width: every critical point with positive student output weights has at most twice as many distinct student feature directions as teacher neurons. Finally, we transfer the benignity result to empirical minima over parameter balls of any prescribed radius, with the required sampling accuracy depending on that radius.
0
cs.LGeess.SP Haochen Chai, Xinbi Luo, Zining Liu et al. · Oct 1, 2026

Wrist electrodermal activity differs in amplitude from person to person, so affect-recognition models normalize the signal before classification. A hidden protocol choice is whether the normalization statistics come from training subjects only or from the held-out user's own complete recording, which retroactively gives the model a calibration that a newly worn device lacks. The paper introduces SAFE-EDA, a compact convolutional network pretrained on expert artifact annotations, and shows that its measured benefit over training from scratch ranges from 0.020 to 0.227 depending on this normalization choice, with the larger gains occurring in the realistic first-use setting. The authors also survey fifty published WESAD studies and find only ten percent report the source of their normalization statistics, making published scores difficult to compare.

Wrist electrodermal activity (EDA) differs in amplitude from one person to the next, so affect-recognition models normalize their input before classification. Studies that test such models on held-out subjects seldom report where the normalization statistics come from, yet statistics computed from the held-out subject's own recording give the model information that a device does not have when it is first worn. We asked how this choice alters the measured benefit of pretraining. A compact convolutional network, SAFE-EDA, was pretrained on expert artifact annotations from 43 subjects and compared with the same network trained from scratch on the Wearable Stress and Affect Detection (WESAD) dataset (15 subjects, leave-one-subject-out), with two normalization sources crossed with four window hops. When the statistics came only from training subjects, pretraining raised macro-F1 by 0.078 to 0.227; when they came from the held-out user's full recording, the gain fell to between 0.020 and 0.050 and was no longer significant. Artifact supervision was far more useful than self-supervised pretraining on the same recordings (0.078 versus 0.008). Across 13 configurations in two datasets, the pretrained network was better in 12, but on the second dataset (26 subjects) per-user normalization increased the gain instead of reducing it, so the interaction depends on the data. Only five of 50 published WESAD studies state which data were used for normalization. Reporting this choice is necessary to separate first-use performance from performance after calibration.
0
cs.LG Ryunyi Lee, Kangjun Noh, Somin Kim et al. · Oct 1, 2026

Range-GRPO addresses semi-supervised LLM post-training when labeled data is scarce by treating LLM-as-a-Judge scores as conformally calibrated reward intervals instead of scalars. Its core idea is to replace standard GRPO pointwise comparisons with pairwise comparisons of interval midpoints, weighting each pair by $\omega_{ij}=\lambda/(h_i+h_j+\lambda)$ so that uncertain rewards can actually flip the direction of the learning signal. When all intervals collapse to points ($h_i=0$), the method exactly recovers Dr.GRPO, and experiments suggest it improves both in-distribution and out-of-distribution reasoning with a smaller compute budget.

As the use of large language models (LLMs) expands, post-training has become increasingly important for adapting them to downstream tasks. However, obtaining reliable supervision remains costly, especially in domains without reference answers or executable verifiers. LLM-as-a-Judge provides scalable pseudo-rewards for unlabeled responses, but a single point score does not explicitly represent reward uncertainty. This motivates representing pseudo-rewards as conformally calibrated reward ranges. We propose Range-GRPO, a semi-supervised post-training framework that combines limited labeled data with unlabeled prompts. In Group Relative Policy Optimization (GRPO), learning signals depend on relative reward comparisons within each rollout group. The proposed objective compares reward ranges pairwise rather than reducing them to point rewards, allowing interval uncertainty to affect both the magnitude and direction of these signals. Our theoretical analysis characterizes this distinction and shows that the proposed objective recovers the Dr.GRPO advantage when all reward ranges collapse to points. Empirically, Range-GRPO achieves the highest in-distribution and out-of-distribution average performance among the evaluated semi-supervised methods while requiring fewer training resources.
0
cs.LG Yihao Ding, Daniel Yitian Su, Yiran Zhang et al. · Oct 1, 2026

The paper tackles autoregressive modelling of mineral-exploration drillholes, where lithology is revealed sequentially from shallow to deep. It introduces DrillBench, a 49,671-hole benchmark across Western Australia with a graded transfer spectrum from local prediction to cross-province generalisation, evaluating next-layer prediction (macro-F1) and free-running generation (joint $\mathrm{KL}(\text{true}\|\text{generated})$). The core finding is a stark transfer boundary: spatial and geochemical conditioning boosts local accuracy but collapses under shift, while sequence-only autoregressive models degrade more gracefully. To address this, the authors propose a backbone-agnostic recipe combining large-scale pretraining on historical archives with spatial retrieval of neighbouring lithology, showing that retrieval aids local cover prediction and pretraining aids bedrock and cross-province transfer.

Autoregressive modelling has achieved remarkable success in language and sequence tasks by learning to predict future states from previous observation. Mineral-exploration drillholes provide a natural but largely unexplored setting for this paradigm: as drilling proceeds, lithology is revealed sequentially from shallow to deep, making prediction of deeper strata inherently autoregressive. Existing drillhole modelling, however, is dominated by spatial interpolation and reconstruction, or largely rely on masked modelling, leaving strictly autoregressive prediction largely underexplored. We introduce DrillBench, a benchmark of 49,671 Western Australian drillholes for next-layer prediction and autoregressive stratigraphic generation across a graded transfer spectrum, from local prediction through spatial shift to cross geological province transfer. Benchmarking classical, geostatistical, and neural models reveals a clear \emph{transfer boundary}: spatial and geochemical conditioning provides large local gains but deteriorates sharply under stronger shift, whereas lithology-sequence autoregressive models transfer more robustly. Guided by this finding, we develop a backbone-agnostic recipe combining large-scale pretraining on historical drillholes with spatial retrieval of neighbouring lithology. Retrieval is most effective in weathered cover, when local spatial continuity remains informative, whereas pretraining contributes more strongly in bedrock and under broader geological shift. Together, they retain strong local performance while improving generalisation under spatial and cross-province shift, most markedly on the most distant splits. The benchmark and code are available at https://github.com/yihaoding/drillbench.
0
cs.LGcs.AI Feiyu Gavin Zhu, Qi Xu, Zhifei Deng et al. · Oct 1, 2026

Existing methods for structured imitation learning rely on extensive human input or static LLM knowledge that can conflict with expert demonstrations. This paper proposes a closed-loop framework that treats policy development like software debugging: an LLM writes diagnostic analysis code to test semantic latents from tabular rollouts, identifies structure-demonstration misalignment, and iteratively edits the symbolic policy structure before re-fitting continuous parameters through imitation learning. The work matters because it automates refinement of interpretable policies and shows on two control tasks that it can outperform zero-shot LLM structures while using far less subsequent RL compute.

Structured policies improve efficiency, robustness, and interpretability in imitation learning by introducing task-specific inductive bias, but existing structure generation methods rely either on extensive human input or on static domain knowledge encoded in LLMs, which may be inconsistent with the expert demonstrations. We propose a closed-loop framework that iteratively refines structured policies using LLM-guided analysis of policy rollouts. By logging rollouts as semantically meaningful tabular data and prompting the LLM to generate diagnostic analysis code, our method identifies suboptimalities in the policy structure and iteratively corrects them without requiring human instruction. Experiments on car racing and door opening tasks show that our approach improves imitation learning performance by up to 15% over zero-shot LLM-generated structures and requires 75% less compute to achieve the same reinforcement learning performance. These results demonstrate that tabular rollout analysis provides an effective feedback signal to align LLM-generated policy structures with expert demonstrations, and we can utilize it to generate good policy structures automatically.
0
math.OCcs.AIcs.LG Jinhwan Sul, Alex Oshin, Evangelos A. Theodorou · Oct 1, 2026

Primal-dual hybrid gradient methods can solve large linear programs on GPUs, but their speed depends on delicately coordinated step sizes, restarts, and acceleration heuristics. GALLOP replaces these hand-tuned rules with a reinforcement learning policy that jointly picks continuous parameters and discrete restart decisions inside a generalized PDHG update. The approach is notable because the learned policy is dimension-agnostic and reportedly generalizes from small training instances to LPs hundreds of times larger without retraining.

Primal-dual hybrid gradient (PDHG) methods solve large-scale linear programs (LPs) using GPU-friendly matrix-vector products and projections, but their practical performance depends on coordinating algorithm parameters, acceleration, and restarts. We introduce GALLOP, which uses reinforcement learning to jointly learn continuous algorithm parameters and discrete restart decisions without differentiating through the solver. Its generalized accelerated PDHG update combines separate primal and dual extrapolation, history corrections, and restart anchoring with independently adjustable coefficients. We train a dimension-agnostic feedback policy using a groupwise proximal policy optimization objective that clips likelihood ratios separately for different control groups and excludes inactive acceleration controls on restart transitions. We evaluate GALLOP on six LP families and a public item-placement benchmark. On the main evaluation settings across the six families, GALLOP reduces iteration counts by factors of $1.9$-$5.6$ and achieves up to a $16.0\times$ speedup in algorithm wall-clock time over MPAX. With one policy trained per family, the learned policies generalize without retraining to within-family LPs $3\times$-$400\times$ larger than the largest training instances, including Transport LPs with $10.24$ million variables.
0
cs.LGmath.OC Rim Hajal, Mathieu Besan\c{c}on, J\'er\^ome Malick · Oct 1, 2026

Low-budget active learning seeks a tiny labeled subset—a coreset—that still trains an accurate model, which is crucial in medical domains where labeling is expensive. The authors propose using the Sinkhorn divergence, an entropic optimal transport distance, as a coreset quality criterion, and develop a Frank–Wolfe warm-started swap heuristic (FW-Swap) to optimize it. Their framework yields dimension-free generalization guarantees and shows competitive or superior accuracy on vision and EEG benchmarks with very small budgets.

We consider low-budget active learning, which consists of selecting a limited number of points, the coreset, such that a model can be trained to high accuracy on the selection only. This problem is particularly relevant in contexts where labeling requires costly expert intervention, as in medical applications. We leverage features extracted from a pretrained self-supervised model to represent the data, and perform coreset selection directly in this feature space. In this paper, we use entropic optimal transport, specifically the Sinkhorn divergence, as the coreset selection criterion, which first allows us to get dimension-free sample complexity results, and second admits computationally efficient gradient evaluations. This opens the way to using gradient-based algorithms to rapidly compute solution candidates, further improved by a swap-based local search, with guarantees on the solution quality. Experiments on image benchmarks and medical datasets show that our method outperforms state-of-the-art heuristics in low-budget settings.
0
cs.LG Changliang Zhou, Yuanyao Chen, Rongsheng Chen et al. · Oct 1, 2026

MiLoop addresses a key inefficiency in constructive neural combinatorial optimization: dynamic-embedding methods typically rebuild subproblem representations from scratch at each step with deep attention stacks, and often depend on external solution labels or aggressive training-time pruning. The paper proposes Memory-in-the-Loop (MiLoop), an autoregressive framework that propagates a global node-wise memory matrix across construction steps, fusing current inputs with historical context before shallow attention layers and updating memory selectively via adaptive gates. By leveraging the multi-step rollouts already required for RL, MiLoop enables a three-layer policy to learn effective dynamic embeddings without external labels. Strong results on four COPs from 100 to 10 million nodes demonstrate both high solution quality and cross-scale generalization.

Constructive neural combinatorial optimization (NCO) has emerged as a promising paradigm that learns to construct solutions to combinatorial optimization problems (COPs) step by step, which reduces reliance on handcrafted rules and enables fast inference. While many methods with dynamic embeddings generalize well, they typically rebuild subproblem representations from scratch at each step using deep attention stacks. Many high-performing methods in this category rely on solution labels or pseudo-labels for efficient training, or on aggressive search space pruning during reinforcement learning (RL). To address these limitations, we propose Memory-in-the-Loop (MiLoop), a purely RL-based constructive framework that leverages the multi-step computation already required by a rollout for selective memory propagation. Each rollout provides solution-quality feedback for learning while propagating historical representations, thereby enabling a shallow policy to learn effective dynamic embeddings without external solution labels or training-time search-space pruning. Specifically, MiLoop fuses current embeddings with historical memory before the attention layers and applies adaptive gated updates afterward. The updated representations support both current decisions and stepwise reuse. Extensive experiments across four COPs demonstrate that MiLoop consistently produces high-quality solutions on instances ranging from 100 to 10 million nodes, highlighting its strong generalization ability.
0
cs.LG Adir Dayan, Yam Eitan, Haggai Maron · Oct 1, 2026

Cross-architecture weight-space transformations map trained networks into different architectures (e.g., compression, upscaling), yet prior equivariant weight-space models only handle fixed architectures. CrossGMN addresses this by treating the task as refining a target initialization using a source network, making equivariance well-defined: invariant to source permutations and equivariant to target permutations. The authors prove universality for continuous cross-architecture operators and show strong empirical speedups for knowledge distillation, especially on implicit neural representations.

Weight-space networks operate directly on parameters of other neural networks, enabling tasks such as predicting model properties, editing trained models, and generating weights. Weight-space symmetries such as neuron permutations make equivariance a key design principle. However, existing equivariant weight-space architectures have primarily been studied for transformations that preserve the network architecture. In contrast, many practical transformations, including model compression and upscaling, map a trained source network into a target network with a different architecture. In this setting, the source and target permutation symmetries act on different parameter spaces, making equivariance less straightforward to formulate. Our key idea for addressing this mismatch is to reformulate cross-architecture operators with two inputs: a trained source network and an initialization of the target network. This lets us define equivariant cross-architecture operators that refine the initialization of the target network using information from the source network, while being invariant to source-network permutations and equivariant to target-network permutations. Based on this formulation, we introduce CrossGMN, a graph metanetwork that jointly processes both networks through symmetry-preserving cross-network message passing. We prove CrossGMN is universal for continuous cross-architecture operators on compact sets under a general-position assumption. We evaluate CrossGMN for model compression, predicting a smaller network's parameters to accelerate subsequent knowledge distillation. Across 2-D and 3-D INRs and image classification with MLPs, CNNs, and Vision Transformers, CrossGMN speeds up distillation by up to 8.89x, transfers across datasets without retraining (3.78x), and a single model can accelerate compression from heterogeneous source architectures into a common target architecture.