Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
797 papers in cs.LG
Trending mixes fresh papers with community signal.
0
stat.MEcs.AIcs.LG Xiaojing Sun, Yuhan Zeng, Xiao Wang · Oct 22, 2026

AI agents that act as statistical analysts evolve through model upgrades, prompt edits, and new tools, but each change risks inflating Type I error. This paper introduces continual validation: before any update is deployed, it is frozen and tested on newly simulated null data using exact binomial confidence bounds with a decaying per-update risk budget. The result is a lifetime guarantee that no invalid version passes, which matters because classical fixed-procedure guarantees break under adaptive, open-ended evolution.

AI agents increasingly act as analysts whose decision can often be cast as hypothesis tests. Classical tests control the Type I error rate, the probability of rejecting a true null hypothesis, for fixed procedures. However, AI analysts introduce internal randomness and can evolve continuously over time. As AI analysts evolve, the risk of approving versions with Type I error rates above the target can accumulate, and adaptive use of evaluation feedback can lead to overfitting. We introduce continual validation, which evaluates each proposed AI analyst version before deployment using simulated data under the null hypothesis, with scenarios that can be randomized and expanded over time. We prove that, regardless of how updates are chosen or how many are proposed, the lifetime probability of ever deploying a version whose Type I error rate exceeds the allowed level remains bounded. This guarantees that every subsequent decision controls the Type I error rate at the target level across these scenarios. At the same time, updates with sufficiently low Type I error rates pass validation with high probability, allowing the analyst to continuously improve its performance without sacrificing rigor. In two examples involving evolving AI analysts for bioequivalence studies and product A/B tests, Type I error rates reached 0.098 and 0.183 without continual validation, compared with at most 0.045 and 0.044 with it, while retaining 82% and 96% of the power from optimally selected valid updates.
0
cs.GTcs.LG Manoj Saravanan, Rohit Kumar Salla, Shrikar Reddy Kota · Oct 14, 2026

Pairwise comparison data power modern preference learning, but disagreement in such data can mean persistent heterogeneity, random noise, or hidden non-binary responses. This paper develops a nonparametric latent semantic model with three querywise quantities—aggregate preference $\mu_q$, persistent disagreement $\tau_q$, and non-binary mass $\alpha_q$—and proves sharp identifiability frontiers. Anonymous binary feedback point-identifies only $\mu_q$, while same-annotator repeats identify $\tau_q$ via covariance and abstention identifies $\alpha_q$ directly; only their combination recovers the full semantic triple. The results imply that semantics-aware decisions like denoising versus personalization cannot be justified from anonymous forced-choice data alone.

Pairwise comparison data are a standard supervision signal in preference learning, but disagreement in such data can reflect stable latent heterogeneity, ephemeral stochasticity, or non-binary responses hidden by a forced-choice interface. We study which of these semantic distinctions are identifiable from the feedback channel itself. We introduce a nonparametric latent semantic model with three querywise quantities: aggregate directional preference $\mu_q$, persistent disagreement $\tau_q$, and non-binary mass $\alpha_q$. Under the anonymous binary channel, we prove an exact semantic fiber theorem: $\mu_q$ is point-identified, whereas $(\tau_q, \alpha_q)$ vary over an explicit feasible region compatible with the same binary law. Same-annotator repeats identify $\tau_q$ through a covariance identity, abstention-enabled feedback identifies $\alpha_q$ directly, and together they point-identify the full semantic triple. We also derive finite-sample estimators, nonasymptotic concentration bounds, and semantics-aware action-recovery guarantees, and validate the theory on theorem-matched synthetic data.
0
cs.CVcs.LG Tom\'a\v{s} \v{C}\'i\v{z}ek, Matej Straka, Illia Volkov et al. · Oct 14, 2026

SAM3RL replaces the hand-crafted FIFO memory rule in SAM-based visual trackers with a lightweight controller learned by reinforcement learning. It frames memory-bank eviction as a Markov Decision Process and trains a 3.2 M-parameter MLP with PPO on bounding-box LaSOT sequences to maximize tracking quality. The resulting policy sets a new state of the art on 10 of 12 benchmarks for both SAM 2 and SAM 3 backbones, while remaining fully online and running without extra feature extraction.

Segment Anything Model 3 (SAM 3) is a foundation model for image and video segmentation that sets the state of the art in visual object tracking. Its tracker, inherited from SAM 2, stores information from past frames in a memory bank, managed by a simple First-In-First-Out rule, allowing temporal consistency in complex videos. Several recent methods improve SAM 2 with hand-crafted memory update rules, each targeting a specific failure mode, such as distractors, occlusions, or object motion. However, their gains transfer only partially to the stronger SAM 3 backbone. We instead present a more general, data-driven approach that frames memory control as a sequential decision-making task. SAM3RL is an extension of the SAM 3 tracker with a lightweight memory controller, trained by reinforcement learning, that decides which frames enter the memory bank in order to maximize tracking performance. SAM3RL sets a new state of the art on 10 of 12 tracking and video object segmentation benchmarks, outperforming all hand-crafted rules without any runtime overhead. The same approach applied to SAM 2 gives SAM2RL, which outperforms hand-crafted rules on 9 of the 12 benchmarks, showing the generality of our method across model generations.
0
cs.LG Zhiyuan Zhou, Sergey Levine · Oct 14, 2026

Offline RL promises to outperform the data but is notoriously unstable, whereas imitation learning is stable yet bounded by data quality. This paper introduces Advantage Guidance (AG), a policy extraction method that retains a simple supervised-learning objective—training a flow policy conditioned on advantage estimates—while correcting the failure mode where naïve conditioning is ignored by the network. At test time, AG uses a derived contrastive diffusion guidance to target the KL-regularized optimal policy $\pi_{\mathrm{KL}}^*(a \mid s) \propto \hat{\pi}(a \mid s)\exp(A(s,a)/\beta)$. On 26 long-horizon sparse-reward manipulation tasks, the method outperforms strong actor-critic, supervised-learning, and diffusion-guidance baselines.

Reinforcement learning (RL) holds the promise of learning a policy that can outperform what is shown in the data. However, in practice, such systems suffer from instability and hyperparameter sensitivity. In contrast, supervised learning provides a stable and scalable training objective, but is fundamentally limited by the quality of the demonstrated behavior. In this paper, we ask whether we can perform policy optimization with something as simple and stable as supervised learning but as performant as RL. Unfortunately, naively training the policy with supervised learning and conditioning on future rewards or advantages typically underperform dedicated RL methods. We introduce a new policy extraction method, Advantage Guidance, that retains the simple supervised learning structure with advantage conditioning while outperforming prior RL methods through effective conditional training and contrastive diffusion guidance during sampling. We show that Advantage Guidance can significantly improve a model's ability to respond to conditional advantage signals, and the contrastive guidance during sampling can use the learned advantage-conditioned policy to target the KL-regularized optimal policy. Empirically, we find that Advantage Guidance significantly outperforms prior state-of-the-art RL methods on 26 long-horizon, sparse reward tasks across datasets with varying degrees of optimality.
0
cs.LG Rocco Zaccagnino, Martina Girolamo, Alberto Lombardi et al. · Oct 14, 2026

Population health stratification traditionally groups patients by clinical complexity, yet these descriptive frameworks offer little guidance on how to prioritize limited care resources. PROMETHEUS reformulates this task as a multi-treatment causal ranking problem: instead of estimating precisely calibrated treatment effects for every patient, it learns a global priority ordering over patient–profile opportunities by combining cross-fitted doubly robust pseudo-outcomes with a Siamese contrastive neural network. This matters because it separates clinical need from actionability, allowing health systems to identify which eligible patients should receive more intensive care first when capacity is constrained.

Population health stratification frameworks, such as the Italian DM77, organize patients by clinical need and care pathways but offer limited guidance on which care changes to prioritize under constrained resources. We present PROMETHEUS (Proactive Resource Optimization through Multi-treatment Effect-based Targeting in Healthcare Environments Using Stratification), a framework that formulates population health stratification as a multi-treatment causal ranking problem. Its objective is to order eligible patient-treatment opportunities by expected incremental benefit rather than obtain perfectly calibrated individual treatment-effect estimates. Each clinically admissible care intensification is compared with maintaining the patient's current pathway. Treatments are learned jointly to produce a globally comparable ranking across patients and care profiles, within domains sharing a reference condition, outcome, follow-up horizon, and benefit scale. This separates clinical need, treatment benefit, and resource-constrained allocation. PROMETHEUS combines doubly robust causal signals with a Siamese neural ranking model and contrastive representation pretraining. The shared representation captures similarities across care transitions, supporting prioritization under capacity constraints. Synthetic experiments and semi-synthetic experiments using real administrative covariates from ASL Benevento evaluate ranking quality, allocation value, robustness, and failure modes. The results support the framework's ability to recover generated benefit orderings and prioritize care opportunities in the evaluated settings. PROMETHEUS provides a preclinical approach to actionable stratification; validation with observed treatment-outcome data is required before clinical use.
0
cond-mat.mtrl-scics.LGphysics.chem-ph Hongrui Sheng, Shutian Liang, Reid A. Coyle et al. · Oct 14, 2026

ActMOF addresses the challenge of optimizing metal-organic framework (MOF) syntheses when experimental data are sparse and outcomes noisy, by introducing an experimentally grounded benchmark for comparing active-learning policies. Starting from only 95 measured microwave syntheses of an aluminum-carboxylate MOF, the authors emulate a landscape of over six million encoded conditions and evaluate 39 policies—Gaussian processes, tree ensembles, and large language models—before transferring the best strategy to six wet-lab syntheses. The demonstration that all six campaigns yielded crystalline products within a 12-experiment budget makes the work relevant as both a reproducible testbed and a proof of concept for transferable, AI-guided reticular chemistry.

Reticular chemistry allows metal-organic frameworks (MOFs) to be designed from their building units, yet their synthesis remains constrained by sparse experimental data, noisy crystallization outcomes, and the absence of benchmarks for comparing active-learning strategies. While data-driven approaches such as Bayesian optimization (BO) can improve synthesis success rates, selecting appropriate optimizers beforehand for mapping MOF crystallization landscapes remains largely empirical. Here we present ActMOF, an experiment-grounded benchmark for comparing search strategies in aluminum-carboxylate MOF synthesis. ActMOF is emulated from experimentally measured microwave syntheses with each encoded condition assigned a crystallinity index calculated based on diffraction peak intensity and full width at half-maximum. By benchmarking policies guided by Gaussian processes (GP), tree ensembles and large language models (LLM), ActMOF placed the GP family among the leading policies for active learning in sparse synthesis landscapes. It then demonstrated transferability by guiding the microwave synthesis of six reticularly related aluminum MOFs. All six campaigns gave crystalline products within a fixed budget of 12 experiments each, and established a reusable testbed for AI-driven MOF synthesis.
0
cs.LG Zefeng He, Yunkai Chai, Xiaoyang Chen et al. · Oct 14, 2026

Looped Mixture-of-Experts models reuse parameters across depth, yet prior work treats each loop visit identically. This paper shows that loop visits learn strongly asymmetric residual scales—the first visit updates representations far less than the second—and proposes LatentLoop, which compresses the first pass into a latent sequence and reallocates saved FLOPs to model width. Extensive scaling experiments up to $7$B parameters show consistent validation and downstream gains, framing asymmetric compute allocation as a principled way to improve looped MoE efficiency.

Looped Mixture-of-Experts (MoE) models combine parameter reuse with sparse computation to improve performance under matched budgets. Prior work demonstrates that different loop visits can play different roles even when they share parameters. To probe the contributions of different loop visits, we learn separate residual coefficients in a model that applies a shared block twice, observing a smaller scale in the first visit. Fixed coefficient experiments show that reducing the first visit's scale preserves or improves performance, whereas the same reductions to the second hurt it. This asymmetry motivates us to explore asymmetric compute allocation. We propose \textbf{LatentLoop}, which compresses the first visit's sequence, retains full resolution in the second, and reallocates saved computation to increase the hidden size. We further learn how strongly the first visit updates the full sequence, and share MoE weights across visits while using separate attention parameters to accommodate their different sequence resolutions. Across 15 configurations spanning 1.3B--7B parameters, with the largest budget exceeding $10^{21}$ FLOPs, LatentLoop consistently lowers validation NLL. At a fitted NLL of 1.988, predicted compute savings are 19.0\% and 7.9\% relative to vanilla MoE and the looped baseline. It also improves average scores on nine benchmarks at all sizes in 0-shot and 5-shot settings. These results suggest asymmetric compute allocation is a promising direction for looped MoE models.
0
cs.LGstat.ML Timo Klein, Thomas Lang, Andrii Shkabrii et al. · Oct 14, 2026

Goal-conditioned RL in complex mazes suffers from a geometric mismatch: Euclidean embedding distances model straight-line proximity, yet walls can make actual route distances highly tree-like and deceptive. This paper introduces Hyperbolic CRL, a drop-in replacement of the critic's Euclidean distance with a hyperbolic geodesic distance on the hyperboloid. Its central finding is that this geometric alignment allows a depth-64 hyperbolic network to outperform a 1024-layer Euclidean baseline on hard humanoid maze tasks while training more than $12\times$ faster and using roughly $13\times$ fewer parameters.

Scaling self-supervised contrastive reinforcement learning (CRL) to 1000-layer Euclidean neural networks has enabled state-of-the-art goal-reaching performance, yet wall-clock time scales linearly with depth. We find that changing the geometry achieves stronger performance with far shallower networks. This matters in complex navigation environments, where walls can make route distance deviate substantially from Euclidean distance. In a U-shaped maze, we show that the longer the route, the more it deviates from Euclidean distance. Hyperbolic CRL addresses this mismatch by replacing Euclidean distances in CRL's contrastive objective with geodesic distances in hyperbolic space. On hard navigation tasks, inductive bias beats scale: depth 64 hyperbolic agents outperform 1024-layer-deep Euclidean networks while training more than $12 \times$ faster and using about $13 \times$ fewer parameters. We observe that hyperbolic agents behave qualitatively better in hard humanoid mazes, where they follow corridors to reach goals, whereas Euclidean agents try straight-line shortcuts over walls. Our results show that matching the representation geometry to the task can substitute for substantial network depth. Code is at https://github.com/Probabilistic-and-Interactive-ML/HypGCRL .
0
cs.LG Jeffrey B. Lai, John Quinn, Anthony Bao et al. · Oct 14, 2026

Foundation models for dynamical systems can roll out unseen PDEs and ODEs, but it is unclear whether they genuinely learn in-context forecasting strategies or merely memorize. This paper proposes Test-Time Forecasting (TTF), a framework in which looped transformers use recurrent depth to perform gradient-descent iterations on a latent forecasting objective at inference time. A lightweight TTF model trained only for one-step prediction can generalize to harder, out-of-distribution system dynamics during autoregressive rollout, suggesting that recurrent depth offers a principled, parameter-efficient path to in-context learning for continuous dynamics.

Foundation models for dynamical systems can forecast unseen partial differential equations (PDEs), ordinary differential equations (ODEs), and time series during inference. However, it remains an open question whether these foundation models truly learn generalizable in-context forecasting strategies. We show that looped transformers are capable of emulating propagators for dynamical systems in-context by first establishing a link between linear attention and (extended) dynamic mode decomposition. We then generalize this insight into the $\textit{Test-Time Forecasting}$ (TTF) framework in which a one-step forecaster leverages iterations of gradient descent as recurrent depth. We demonstrate that lightweight TTF models trained on ODEs and PDEs generalize to out-of-distribution system dynamics during autoregressive rollout after being trained for one-step prediction. Our results reinforce TTF as a theoretically motivated framework for designing recurrent depth models capable of forecasting unseen dynamical systems at test-time.
0
cs.LGcs.NI Calvin Jary, Nafiseh Kahani · Oct 14, 2026

Predicting which cellular region a mobile user will visit next lets operators cache content and allocate resources proactively, yet a predictor that never abstains commits to choices even when its evidence is weak.
This work applies MetaModelSelect, a lightweight post-hoc metamodel that scores the trustworthiness of a frozen RNN's top-1 next-location decision using only its output logits: a learned embedding of the predicted region, the four largest softmax probabilities, and a global concentration statistic.
By filtering predictions through this learned correctness score rather than retraining the backbone, the paper shows how to trade coverage for selective risk in a compact, deployable wrapper.

Next-location prediction can support proactive mobile-network decisions, but acting on unreliable predictions can waste resources. We apply MetaModelSelect, a lightweight post-hoc confidence metamodel, to selective cellular next-location prediction. The mobility-specific model combines a learned embedding of the predicted location with the four largest softmax probabilities and Softmax Concentration. It learns whether a frozen recurrent neural network's top-1 prediction is correct, using only its outputs and without retraining the backbone. On path-balanced Changchun cellular mobility trajectories, we evaluate backbones trained with cross-entropy (CE) and self-adaptive training plus entropy minimization (SAT+EM), comparing against eight scalar confidence scores, two location-aware lookup methods, and a raw-logit multilayer perceptron. Relative to maximum softmax probability, MetaModelSelect achieves mean per-run reductions in area under the risk--coverage curve (AURC), excess AURC (E-AURC), and area under the generalized risk--coverage curve (AUGRC) of 2.6%, 4.2%, and 3.0% for CE, and 2.0%, 3.3%, and 1.9% for SAT+EM. It also achieves the lowest reported mean risk at every evaluated partial coverage. The results show that MetaModelSelect improves confidence ranking in this mobility setting while leaving the underlying location predictor unchanged.
0
cs.CLcs.CYcs.LG Zhangqi Duan, Simon Woodhead, Maya Miller-Vedam et al. · Oct 14, 2026

Traditional student models only use responses to standalone questions, ignoring the rich, fine-grained evidence embedded in tutoring dialogues. This paper proposes URF-QD, a framework that rewrites tutor-posed mathematical subtasks as self-contained questions and models them jointly with original items on a shared item response theory scale. The key novelty is a relative-order regularization that uses tutor pedagogical moves to constrain consecutive subtask difficulties, enabling dynamic tracking of student ability across both questions and dialogues. The authors show consistent improvements on two real-world math datasets, though the approach leans heavily on LLM annotations and modest sample sizes.

Existing student models in educational applications largely focus on student responses to questions. However, as tutoring becomes more accessible at large scale, it is important to analyze dialogues between tutors and students, which may reveal fine-grained evidence on student knowledge. In this work, we propose a unified framework that models both student responses to questions and tutor-posed subtasks during dialogues on a shared item response theory (IRT) scale. We first identify mathematical subtasks in tutoring dialogues, rewrite them into self-contained questions, and identify the correctness of student responses to these subtasks. We then develop an IRT framework that estimates question/subtask difficulty from text, tracks students' evolving abilities across question-answering and dialogue interactions, and a novel method to leverages tutor moves between consecutive subtasks to regularize their difficulty values. We evaluate our framework on two real-world math education datasets containing both human- and AI-tutored dialogues. Results show that our framework outperforms strong baselines on both question difficulty prediction and response correctness prediction.
0
cs.LG Quoc-Anh Hoang Nguyen, Xinyu Zhang, Daolang Huang et al. · Oct 14, 2026

Batch black-box optimization requires selecting many parallel queries across only a few expensive rounds, yet conventional Bayesian optimization suffers from costly joint acquisition maximization and per-task surrogate refitting. This paper proposes Flow Matching for Thompson-Sampling Refinement (FMTR), an amortized approach that offline-learns a continuous, history-conditioned proposal distribution over query locations from which variable-size batches can be directly sampled at test time with fixed parameters. By marrying in-context adaptation to a generative flow model, FMTR aims to eliminate online acquisition optimization while preserving sample efficiency.

Batch black-box optimization is important for expensive systems where many candidates can be evaluated in parallel, yet only a few rounds of evaluation are affordable. In this regime, effective batch construction must identify multiple promising regions while avoiding redundant evaluations, and conventional Bayesian optimization can require increasingly difficult batch-selection procedures as the batch size grows. We introduce Flow Matching for Thompson-Sampling Refinement (FMTR), an amortized approach that learns offline a continuous, history-conditioned proposal distribution from which variable-size batches can be sampled. FMTR is trained offline by conditional flow matching on Thompson-sampling argmaxes refined toward high-value regions via a horizon-dependent Langevin pushforward map, adapting the exploration-exploitation tradeoff over the optimization horizon. At test time, the model parameters remain fixed and batch generation requires neither task-specific surrogate refitting nor numerical acquisition optimization. FMTR achieves strong performance against batch BO and in-context baselines on synthetic and real-world benchmarks, while substantially reducing the computational cost of batch selection.
0
cs.LG Tongxi Wang · Oct 14, 2026

This paper studies whether learning an epsilon-optimal average-reward policy from a single continuing trajectory must pay an extra navigation cost compared with generative access. It develops an adaptive algorithm that learns a low-cost sampling allocation via inverse-count exploration and converts nonuniform samples into an all-state policy certificate using a transient-corrected quantile bound. For broad model classes and sufficiently high accuracy, it proves that the worst-case sample complexity matches the generative lower bound up to logarithmic factors, removing the extra diameter factor that plagued prior continuing-access bounds.

In reinforcement learning, an agent must explore an unknown environment to learn how to make good decisions. Unlike methods that can freely sample any state--action pair, an agent learning from a single trajectory must spend additional time navigating between states. It is therefore natural to expect that learning from a single trajectory requires more experience. In this paper, we show that this additional cost is not always necessary. For average-reward reinforcement learning, we develop an algorithm that learns where to collect information while ensuring that the required samples can be obtained efficiently. We establish an upper bound on the number of interactions needed to identify a near-optimal policy. Furthermore, we prove a matching information theoretic lower bound, showing that, for a broad class of environments and at sufficiently high accuracy, learning from a single trajectory is no harder in the worst case than learning with unrestricted access to state action samples. Our results reveal that the additional complexity cost of navigation can be avoided by adapting information gathering requirements to how the environment provides information.
0
cs.LG Junlin Liao, Harshit Kondle, Di Liu et al. · Oct 14, 2026

Vision-language models are moving onto battery-powered edge devices, yet their total-system energy footprint on NPU-equipped single-board computers has remained largely unmeasured. This paper presents a hardware-instrumented study of Qwen2-VL-2B-Instruct inference on a Raspberry Pi 5 with a Hailo-10H NPU and a Jetson Orin Nano Super, separating fixed request energy from per-token decode costs. It shows that NPU offloading cuts Pi energy per token by roughly two-thirds, that text generation dominates vision encoding at typical response lengths, and that the Pi-NPU and Orin-GPU stacks have comparable per-token energy with a crossover near 40 output tokens. The findings are practically useful for engineers choosing deployment stacks under power and thermal constraints.

Vision-language models (VLMs) are moving onto edge devices, but little is known about how much energy they draw on single-board computers with NPU or GPU accelerators, or where that energy goes. We measure total-system energy, latency, and thermal behavior of Qwen2-VL-2B-Instruct and its text-only sibling on a Raspberry Pi 5 with a Hailo-10H NPU and on a Jetson Orin Nano Super, on both CPU and accelerator, and separate the fixed energy of each request from the energy that grows with output length. Because the accelerators use different quantization and serving software, we compare deployment stacks rather than silicon. Three findings stand out. First, NPU offloading makes the Pi a much more efficient VLM platform: it cuts energy per generated token by about two-thirds, leaves the host CPU largely free, and avoids the thermal throttling that the CPU backend reaches in sustained use. Second, an image adds both fixed and per-token energy, but at typical response lengths generating the answer costs far more than processing the image. Third, the Jetson GPU favors short responses through its lower fixed cost per request, whereas the Pi NPU favors longer ones through its lower cost per output token; their energy curves cross near 40 output tokens.
0
cs.LG Siddhant Setia, Junichi Suzuki, Tadashi Nakano · Oct 14, 2026

Molecular communication simulators are computationally expensive, so machine learning models are often trained to estimate performance metrics like round-trip time, but protocol evaluation proceeds sequentially from simple to complex settings and causes catastrophic forgetting when models are fine-tuned. This paper proposes Affine Memory Replay (AMR), a continual learning method that stores past simulation samples and synthesizes additional replay samples through affine interpolation and extrapolation to regularize a small neural network. AMR aims to retain knowledge from earlier experimental settings while adapting to new ones, offering a practical way to amortize simulation costs in molecular communication research.

This paper considers reliable in-sequence molecular communication, where bio-nanomachines exchange molecule-encoded information in a specified order, and investigates a new simulation-based method to incrementally evaluate communication protocols by gradually increasing the complexity of experimental settings. The proposed method, called Affine Memory Replay (AMR), builds a continual learning (CL) model to estimate communication performance between bio-nanomachines. AMR stores past simulation samples and synthesizes additional replay samples through interpolation and extrapolation between past samples. Through incremental performance estimation tasks, it replays both past and synthetic samples to regularize model updates, helping the model adapt to new experimental settings while retaining knowledge from earlier ones. Experimental results show that AMR significantly outperforms existing CL methods in maintaining overall estimation accuracy across sequentially learned estimation tasks. It effectively balances memory stability and learning plasticity under moderate training cost.
0
cs.LGcs.SYeess.SY Samuela Rokocakau, Panagiotis Kakosimos, Giulia Tresca et al. · Oct 14, 2026

This paper tackles offline parameter identification for a non-ideal DC-DC buck converter using Physics-Informed Neural Networks (PINNs). The core idea is a staged training schedule that progressively unfreezes physical parameters—inductance, capacitance, and parasitic resistances—to improve convergence and interpretability. The work matters because accurate component-level estimates enable condition monitoring and predictive maintenance without intrusive frequency-response tests.

A staged physics-informed neural network (PINN) is proposed for identifying the inductance, capacitance and parasitic resistances of a DC buck converter from time-domain data. Gradients are released in the order of L to C to rL to rC, a sequence derived from sensitivity analysis. The five-stage schedule recovers L and C to within 5% and the series ESR to 10%, while a three-stage variant attains the same accuracy 11% faster. An 84 factorial sweep confirms that the trained PINN remains accurate for simultaneous 8% perturbations of all four components, achieving a waveform RMSE of 2.6 x 10-2 over 5 ms-an order-of-magnitude better than a simultaneous-training baseline.
0
cs.LG Weixin Wang, Wei Deng, Anderson Schneider et al. · Oct 14, 2026

Training-free inference-time scaling aims to improve LLM reasoning without updating model weights or relying on external reward models. Existing reward-free methods sharpen the full sequence distribution, which can suppress diverse reasoning paths that support the same correct answer, and suffer from path collapse in Sequential Monte Carlo samplers. This paper proposes Decoupled Marginal Sharpening (DMS), a two-stage framework that separately controls reasoning-path concentration and answer-marginal consensus via independent exponents, paired with a novel Fully Adapted Annealed SMC sampler. The authors report the highest mean pass@1 across three base models and four benchmarks, including mathematics, science, and code tasks.

We study how to improve LLM reasoning at inference time without updating model weights or using external reward models. Recent reward-free power-sampling methods define the sequence-level power target $\pi_\alpha(y\mid x)\propto p_0(y\mid x)^\alpha$, where $\alpha>1$, which increases the relative probability of completions that are already likely under the base model. Existing methods use Metropolis--Hastings or Sequential Monte Carlo (SMC) to approximately sample from this target. However, two challenges arise at different levels. At the target level, full-sequence sharpening can concentrate probability on a few exact reasoning--answer trajectories, suppressing alternative paths that support the same answer. At the sampler level, finite-particle SMC can suffer from path collapse when resampling repeatedly duplicates a few high-weight prefixes. To address these challenges, we propose Decoupled Marginal Sharpening (DMS), which separately controls how strongly the model favors particular reasoning paths and how strongly it favors final answers after aggregating support across those paths. At the target level, DMS first samples from a sharpened reasoning distribution, then marginalizes the model's answer probabilities over the resulting weighted reasoning population and sharpens the induced answer marginal. Separate exponents allow mild reasoning sharpening to encourage exploration of diverse paths, followed by stronger answer-marginal sharpening to concentrate probability on answers with greater aggregate support across those paths. At the sampler level, we develop Fully Adapted Annealed SMC, which combines an annealed sequence of power targets with locally fully adapted proposals and predictive ancestor resampling. Experiments on MATH500, GPQA-Diamond, HumanEval, and AIME24/25 across three base models show that DMS achieves the highest mean pass@1 among the compared methods in all tasks.
0
cs.LG Jon Sporring · Oct 14, 2026

This critical review reframes interactive segmentation, active learning, and machine teaching through a shared information-theoretic lens. It separates target information gain from predictive distortion reduction and human effort, exposing why predicting a teacher's clicks does not by itself improve reusable learning. By formalizing corrective interactions as nested memory records, the paper shows that current-mask refinement and reusable-model training are distinct objectives requiring different evaluation assumptions.

When does a human correction become useful learning, and what establishes better segmentation at matched human effort? This critical narrative review follows feedback through its selection, learner update, and evaluation. It compares active learning, machine teaching, interactive segmentation, and sequential predictive evaluation using a common mathematical account of target information, predictive error, response predictability, and human work. An exact Bayesian update converts evaluation-label information into expected log-loss improvement; an excess-risk decomposition explains what an approximate learner can lose. Conditional information decompositions separate the roles of selected locations, labels, and displayed context. Empirical comparisons show why response protocols, update mechanisms, and effort denominators matter, distinguishing current-mask refinement from reusable learning and simulated interaction from human evidence. We identify what logs can reveal, what requires independent evaluation, and what remains model-dependent. The resulting research priorities are to test what selection reveals, whether using it improves assimilation, and whether the resulting interaction policy benefits segmentation at matched effort. These are distinct claims: predicting a teacher's responses need not identify human intentions or establish better learning. No new acquisition algorithm or empirical superiority is claimed.
0
cs.LG Shigeyasu Uno · Oct 14, 2026

CktHGVAE tackles analog/mixed-signal CMOS circuit automation by learning a joint latent manifold of design parameters and transistor-level operating states. The core idea is a symmetric heterogeneous graph VAE that treats SPICE-derived state variables and design variables equally as inputs and outputs, enabling closed-loop design verification without a separate surrogate model. This is significant because prior graph learning approaches for analog circuits largely rely on macromodel abstractions or topology generation, leaving fine-grained operating-state modeling underexplored.

We propose CktHGVAE, a heterogeneous graph variational autoencoder for transistor-level analog/mixedsignal CMOS circuits that takes not only design variables but also state variables as its inputs and outputs. With a single hyperparameter configuration without topology-specific tuning, comparison between model-generated and SPICE-simulated circuit operational states gives median R2 values above 0.9 for typical single-ended voltage amplifiers and the CMOS inverter, and 0.81-0.96 for differential amplifiers with larger datasets. Latent-space optimization in the PCA-reduced latent space with Bayesian optimization, evolutionary search, random search, and quasi-exhaustive search is demonstrated for a common-source voltage amplifier with NMOS input and resistive load, where the objective function is defined as a penalty for deviation from required circuit specifications. For each search strategy, 93.3 - 100% of all design candidates suggested by the model satisfy the required circuit specifications at the decoder output, and SPICE simulations verify that 90 - 100% of them indeed satisfy the requirements. The model pretrained on a batch of topologies can be transferred to unseen topologies without retraining at all, with zero-shot reconstruction median R2 values of 0.72-0.90 in three of four scenarios, including transfer from single-ended to differential topologies, although the transfer fidelity depends on the choice of pretraining topologies. Our demonstrations suggest that the proposed model can potentially serve as a basis for AMS CMOS circuit design automation.
0
cs.LG Yaomengxi Han, Debarghya Ghoshdastidar · Oct 14, 2026

This paper asks how shallow transformers learn on unbounded-length inputs and whether layer-wise training can be decoupled. It proves that a one-step attention-then-output schedule fails to learn the occurrence language, while a three-phase output-attention-output schedule succeeds in both population and finite-sample settings. The finding is significant because it formally explains why attention weights often lag behind the output layer during training, challenging the feedforward intuition that feature learning must come first.

The success of transformers is attributed to several factors, including their capacity to express formal languages over variable-length inputs, and ability of the attention mechanism to focus on relevant input features. However, there is limited understanding of the training dynamics of shallow transformers, specifically how to decouple the learning of the attention and the output (feedforward) layer. A natural extension of the theory of one-step gradient feature learning in feedforward networks suggests that one could first learn the attention weights with a single gradient step, and then train the output layer. We show that this fails for a shallow transformer trained to recognize a star-free language from unbounded-length input. We prove that the transformer can be trained to recognize the language with a three-phase gradient descent: the output layer is updated first, followed by an attention update, and the output layer is fine-tuned in the third phase. In contrast, the language cannot be learned by training only the attention or output layer, or by a single attention-layer update followed by finetuning the output layer. We empirically show that ``attention learning lagging output layer learning" is beneficial in other language recognition, regression, and in-context learning tasks as well.