Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
797 papers in cs.LG
Trending mixes fresh papers with community signal.
0
cs.LG Maedeh Saberi, Amir Barati Farimani, Safa Jamali · Oct 22, 2026

RheOPT addresses the data bottleneck in non-Newtonian flow simulation by pretraining a transformer-based neural operator on inexpensive Newtonian simulations before fine-tuning on a handful of complex-fluid examples. The core hypothesis is that geometry-conditioned momentum transport—not the Newtonian constitutive law itself—transfers across the rheological boundary. In geometry-matched settings, the authors show that a model fine-tuned on as few as four non-Newtonian samples can match or exceed one trained from scratch on sixteen.

Despite advances in numerical methods, non-Newtonian flow simulations remain computationally expensive because velocity and stress must be advanced together through rate- and history-dependent constitutive dynamics. Neural-operator surrogates reduce inference cost after training, but their training data require the same expensive simulations they aim to replace, making data-efficient learning essential when only a few non-Newtonian simulations can be afforded. Here, we introduce the Rheological Operator Pretrained Transformer (RheOPT), which pretrains a transformer-based neural operator on inexpensive Newtonian simulations and fine-tunes it on a small number of non-Newtonian samples. Rather than transferring the Newtonian constitutive response itself, RheOPT reuses geometry-conditioned transport structure that remains useful after the stress model changes. We evaluate RheOPT in two geometry-matched settings: a $4{:}1$ contraction channel for Giesekus, Oldroyd-B, and Bingham fluids, and the oscillatory wake behind a triangular obstacle for Oldroyd-B flow. In the contraction, Newtonian pretraining substantially improves few-shot prediction, and a model fine-tuned on four target samples can match or exceed a from-scratch model trained on four times as many. This benefit is reliable under reversible instance normalization (RevIN) but dataset dependent under Global normalization, a difference we trace to the dynamic range of each fluid's velocity and stress fields. In the wake, where relative $L_2$ error alone cannot verify that vortex shedding is recovered, phase-insensitive diagnostics show that pretraining recovers the shedding frequency and wake fluctuation amplitude that are suppressed by the from-scratch model in the few-shot regime. Overall, RheOPT establishes Newtonian simulation as a physically grounded pretraining source for data-efficient non-Newtonian operator learning.
0
cs.ROcs.CVcs.LG Chenyuan Chen, Ran Ding, Lechen Zhang et al. · Oct 22, 2026

Whole-body vision-language-action (VLA) policies for humanoid loco-manipulation usually condition only on the current view, so they fail when brief object cues vanish before the robot must act. This paper proposes WholeBodyMem, which uses a frozen SAM3 to track task objects, detects object events (appear, disappear, move, change shape) to causally select up to $B_{\max}=7$ key frames, and feeds those native tokens together with mask-pooled object tokens into a flow-matching action expert via cross-attention and FiLM. On the new HuMeGo benchmark and standard SIMPLE tasks, the method raises the $\Psi_0$ base policy's simulated success from $29.1\%$ to $72.6\%$ and real-world Unitree G1 success from $36.7\%$ to $88.3\%$, while also improving reactive tasks to $86.9\%$.

Humanoid loco-manipulation in dynamic scenes is non-Markovian: cues vanish as objects change or are hidden, or leave the view as the robot turns and walks, yet whole-body vision-language-action (VLA) policies see only the present. We present WholeBodyMem, an object-guided perceptual memory that keeps the pre-history of object events seen before the robot acts on its goal. SAM3 tracks the task objects, and their events causally select key frames within an adaptive budget, which the action expert reads by cross-attention together with object tokens encoding appearance, geometry and time. We also contribute HuMeGo, a humanoid memory benchmark with six simulated and six real-world Unitree G1 tasks. Keeping the right frames rather than more frames, WholeBodyMem surpasses memoryless and uniform-memory baselines, raising its base policy's success from 29.1% to 72.6% in simulation and from 36.7% to 88.3% on the real robot, while also improving the standard SIMPLE tasks (70.2% to 86.9%).
0
cs.LG Yuhang Xie, Cheng Li, Chenliang Li et al. · Oct 22, 2026

High-quality presentation generation remains labor-intensive, and existing agentic frameworks rely mostly on foundation-model priors without task-specific training. This paper presents a unified training pipeline integrating cross-validated data synthesis, guided teacher enhancement for supervised fine-tuning, and verifiable aesthetic rewards via GRPO-based reinforcement learning. Experiments on PresentBench and GDPVal show that the pipeline improves both content quality and visual design, with compact models surpassing larger zero-shot baselines.

PowerPoint presentations (PPTs) are a dominant medium for communication across diverse domains, yet high-quality PPT generation still depends heavily on labor-intensive human effort. Recent advances in large language models (LLMs) for agentic tasks have created both new opportunities and challenges (Chen et al., 2026) for automatic PPT generation. In this work, we present a unified training framework for automatic PPT generation toward presentation intelligence, integrating cross-validated data synthesis, guided teacher enhancement, and verifiable reward optimization. We first construct a cross-validated pipeline for data synthesis, with explicit control over both difficulty and validity. We then develop a teacher-enhancement framework grounded in rules and prior knowledge to substantially strengthen the instructional capacity of teacher models. Building on this, we further improve supervised fine-tuning (SFT) through a mixed-teacher strategy and a lightweight outcome-driven trajectory filtering method. Finally, based on the resulting SFT models, we introduce a suite of verifiable aesthetic metrics together with a GRPO-based reinforcement learning framework to optimize slide-level visual attributes beyond text-only supervision. Experiments show that our enhanced SFT pipeline improves Qwen-3.6-27B and Qwen-3.6-35B-A3B by 7.45 and 9.35 points on PresentBench, respectively, surpassing GLM-5.2 while maintaining strong generalization. Reinforcement learning further improves performance across five aesthetic dimensions, compensating for the limitations of SFT in visual refinement. Overall, the results demonstrate the effectiveness of our framework for high-quality PPT generation.
0
cs.LG Parnian Fazel, Mohammad M Maheri, Hamed Haddadi · Oct 22, 2026

The paper studies whether facts deleted from knowledge-graph embeddings stay deleted under ordinary continued training. It shows that standard approximate unlearners fail because entity embeddings are shared between forgotten and new facts, and proposes Kernel-Anticipated Unlearning (KAU), which uses the tangent kernel to predict and counteract this relearning inside the forgetting objective. This matters for the right to be forgotten in search, recommendation, and question-answering systems built on evolving knowledge graphs.

Approximate unlearning answers a deletion request on a knowledge-graph embedding by editing entity embeddings instead of retraining from scratch. These embeddings keep being updated as new facts arrive. Under this ordinary continued training, forgotten facts recover more than in the exact-unlearning baseline, a model retrained without them and given the same continued training. We trace this relearning to entity embeddings shared by forgotten and new facts. To our knowledge, this is the first study of relearning in knowledge-graph embeddings. Relearning-robust methods developed for deep networks do not account for the graph structure underlying this recovery. We propose Kernel-Anticipated Unlearning (KAU), which uses the tangent kernel to model how continued training changes forgotten facts' scores through these shared parameters. KAU expresses this first-order response in closed form and differentiates through it inside the forgetting loss. The objective steers edits toward directions that continued training reverses less. We compare KAU with state-of-the-art knowledge-graph unlearners and relearning-robust methods under identical continued training, measuring leakage beyond the exact-unlearning baseline. Across three backbones, KAU reduces the strongest knowledge-graph unlearner's leakage by 46-63% on FB15k-237 and 50-82% on CoDEx-L, at higher retained utility.
0
stat.MLcs.LGstat.AP Ryan Heejoon Byun, Dayeon Yoon, Won Chang · Oct 22, 2026

Standard computer-model calibration focuses on parameter posteriors, not the predictive accuracy of the calibrated simulator. The authors propose a two-layer framework: a flow-matching model amortizes posterior inference, then conformal risk control tunes parameter sets so the simulator pushforward hits a target miscoverage on synthetic calibration data. This targets the quantity that actually matters downstream—predictive coverage—while exploiting amortization to avoid expensive per-observation MCMC. Experiments on synthetic and real epidemiological data show roughly 5× sharper bands than KOH–MCMC with near-nominal coverage.

Computer-model calibration is usually undertaken in service of prediction, yet neither Bayesian Kennedy-O'Hagan (KOH) calibration nor amortized simulation-based inference is built to control the predictive error of the calibrated simulator. When parameters are weakly identified or the data-model discrepancy is misspecified, the simulator-output bands induced by a nominal posterior level can be far from nominal. We propose a two-layer framework that targets predictive miscoverage directly. First, a conditional flow-matching model learns an amortized posterior for the calibration parameters, trained on simulator outputs perturbed with Gaussian-process discrepancies of varying structure. Second, conformal risk control arranges posterior draws for the target observation into nested candidate sets and selects the smallest one whose fixed-rank pointwise bands attain a prescribed time-averaged miscoverage on a synthetic calibration sample. Under exchangeability of calibration and target observations, the bands control expected miscoverage in finite samples. In a synthetic benchmark, the proposed bands are roughly 20% the width of KOH-MCMC bands with miscoverage near the 10% target. In calibrating an age-structured SEIR model to the 2010 Malawi measles outbreak, they are again sharper and near-nominal, and the weeks they fail to cover coincide with the asymmetric epidemic decline, exposing structural inadequacy of the mechanistic model.
0
cs.LG Ihsan Ul Haq (1, 2), James Brusey (1) et al. · Oct 22, 2026

The paper tackles occupational activity recognition for construction workers using wearable IMUs. It shows that headline ~99% accuracies on the VTT-ConIoT benchmark collapse to ~77% mean under strict leave-one-subject-out evaluation, with a 27pp per-subject spread. The work systematically maps how sensor placement, window length, classifier choice, augmentation, and personalised calibration affect true subject-independent performance.

Wearable inertial measurement unit (IMU) systems for construction worker human activity recognition (HAR) routinely report aggregate accuracies above 95 %, rarely under genuine subject-independent (leave-one-subject-out (LOSO)) evaluation, masking the per-individual variance that determines real-world deployment performance. Using the VTT-ConIoT benchmark, we conduct, to our knowledge, the first systematic configuration sensitivity analysis of this dataset: six classifiers across five sensor placements and three window sizes under a single LOSO protocol, a personalised-calibration pilot, and a validated comparison of tabular GAN-based and standard time-series augmentation. Per-subject LOSO accuracy for the main multi-sensor, 16-class configuration ranges from 61.9 % to 88.7 % (mean 77.5 %), a 27 pp spread, though all data are laboratory-collected. Multi-sensor fusion and longer windows both improve accuracy; standard augmentation gives small, consistent gains, while Conditional Tabular GAN (CTGAN) augmentation actively harms accuracy with a demonstrated distributional-fidelity mechanism; and personalised calibration recovers 16.8 pp for the weakest participants from just 30 % of their own data. These findings provide evidence-grounded configuration guidance for scaling occupational body sensor networks towards field deployment
0
cs.LG Zhaoyi Zhou, Frank Wu, Andrea Zanette · Oct 22, 2026

Masked diffusion models freeze tokens once revealed, making decoding errors irreversible and bounding compute by sequence length. This paper reformulates MDM inference as a Markov chain over the clean sequence space via a remask-denoise kernel, derives a KL contraction bound that disentangles timestep schedule from model error, and proposes Random Remask-Denoise (R2D) inference and Trajectory Correction Training (TCT). The result is a reward-free, finetuning-free test-time scaling procedure that reports near-log-linear accuracy gains on hard Sudoku and 3-SAT and modest improvements on a coding benchmark.

Masked diffusion models (MDMs) generate sequences by progressively unmasking tokens, but errors introduced during decoding are typically irreversible. Recent work has shown that iterative correction can improve sample quality, yet existing theory fails to explain this given a learned, imperfect denoiser model. We re-formulate MDM inference as a Markov chain on the clean sequence space, defined by a remask-denoise kernel that randomly re-introduces masks and then denoises. This helps us analyze the actual denoising trajectory towards the data distribution. The analysis motivates Random Remask-Denoise (R$^2$D) inference, a purely test-time, finetuning-free, reward-free procedure. To further improve performance, we propose Trajectory Correction Training (TCT), a denoiser-training procedure that exposes the model to its own errors along the generation trajectory. On logical tasks, our approach exhibits a striking near-log-linear test-time scaling, achieving over 97% accuracy on hard Sudoku puzzles and over 99% accuracy on 3-SAT. Our approach also applies to pretrained models on actual language tasks, beating iterative correction baselines and the official Q-mode accuracy of LLaDA2.1-mini on HumanEval+.
0
cs.LG Angela Tang, Vishesh Anand, Gon\c{c}alo Paulo · Oct 22, 2026

Large language models can pick up hidden behavioral preferences—termed subliminal learning—when trained on data generated by other models. This paper investigates whether such transfer occurs in pretrained base models under hard-label and on-policy soft-label distillation, testing across different initializations, data orders, corpora, and architectures. By tracing how the abilities to transmit and receive a trait develop separately during pretraining, the authors challenge the notion that shared model origins are a prerequisite for unwanted preference transfer.

Large language models trained on data generated by other models can sometimes inherit traits unrelated to that data, a phenomenon called subliminal learning. We study both hard label distillation, where students train on numbers generated by a biased teacher, and on-policy soft label distillation, where students generate the data and the teacher's logits provide the learning signal. Using Pythia, PolyPythia, and DataDecide OLMo models, we find that transfer persists in both settings across differences in weight initialization, pretraining data order, pretraining corpus, model size, and architecture. Across pretraining checkpoints, the ability to transmit a preference and the ability to acquire one develop separately: some checkpoints are more effective teachers but weaker students, and vice versa. Consistent with this distinction, cross-model transfer can be strongly asymmetric in magnitude when teacher and student roles are reversed. To investigate what carries the preference signal, we construct synthetic number sequences that match the teacher's generated number frequencies but have no dependence on the prompt or preceding numbers and find that these still induce substantial transfer in the hard-label setting. In top-$K$ soft-label distillation, removing animal tokens from the loss reduces transfer, although not completely in the same-model setting. In our experiments, soft label distillation produces more consistent transfer with less extensive training than hard label distillation. The growing use of on-policy distillation in model post-training makes this a particularly relevant setting for assessing unintended preference transfer.
0
cs.LG Sophia Sklaviadis, Wu Lin, Andre Martins et al. · Oct 22, 2026

The paper attacks a structural restriction in the Bayesian Learning Rule (BLR): its reliance on KL geometry ties it to fixed-support exponential families, ruling out posteriors with adaptive tails or bounded support. The authors show that mixed-space Bregman discrepancies—specifically Fenchel-Young discrepancies—generalize the BLR while preserving its efficient additive canonical-coordinate updates. This matters because it yields a principled framework for scalable variational optimizers, such as $q$-VON, that use heavy-tailed or bounded-support $q$-Gaussian posteriors and can be implemented by modifying only a few constants in existing code.

The Bayesian learning rule (BLR) exploits the relation between Bayesian updating and the Kullback-Leibler divergence (KLD) to derive efficient additive updates for exponential family variational posteriors. The KL geometry is powerful but restrictive: combined with posterior families with parameter-dependent support it can lead to undefined objectives. We ask which non-KL geometries preserve the additive BLR computation. Previous works that use $f$-divergences suggest that this is only possible with the KLD. Here, we show that this is not true. We show that additive information-geometric optimization algorithms can be derived for the class of mixed-space Bregman or Fenchel-Young discrepancies. These discrepancies induce generalized maximum-entropy families, dual coordinates, and generalized-BLR canonical gradient updates, recovering the classical BLR. The generalized BLR leads to new algorithms that \textit{cannot} be derived from the KL-based BLR. For the Tsallis negentropy with quadratic statistics, the generalized BLR yields bounded-support and heavy-tailed $q$-Gaussian posteriors and an easy Newton-like implementation. Experiments up to CIFAR-100 illustrate controllable support and tail behavior and competitive performance.
0
cs.CVcs.LG Yudhistira Arditya Pratama, Yi-Zeng Hsieh · Oct 22, 2026

GM-GReFEL attacks two coupled problems in dynamic facial expression recognition (DFER): the quadratic cost of self-attention in long clips and noisy crowdsourced labels. It replaces a spatiotemporal Vision Transformer with a Modulated GroupMamba backbone that scans six channel groups—four spatially and two temporally—at linear cost $\mathcal{O}(N)$, re-mixing them via a Channel Affinity Modulation gate. A geometry-aware reliability module blends the classifier output with trainable facial-landmark anchors, weighted by per-sample normalized entropy, to fall back on anatomy when the prediction is uncertain. The authors report best-fold results within 0.3 points of the top method on DFEW and ahead on MAFW, while openly noting that five-fold means are more mixed.

Recognizing facial expressions in unconstrained video suffers from two coupled problems: self-attention grows quadratically in cost with clip length, and crowdsourced labels are noisy. We present GM-GReFEL, a spatiotemporal state-space network with a geometry-aware decision stage. Its Modulated GroupMamba backbone replaces a spatiotemporal Vision Transformer. Six channel groups are scanned separately, four over the frame plane and two over time, so the cost grows linearly with sequence length ($\mathcal{O}(N)$); after each layer, a Channel Affinity Modulation gate mixes the groups again. On top of the backbone, a GReFEL reliability module turns the normalized entropy of each prediction into a mixing weight between the classifier output and a vote from trainable geometric anchors, so that facial geometry counts for more when the network is unsure. The model is initialized by static-to-dynamic weight transfer and trained with a Triple Loss. In five-fold cross-validation, the best fold scores 66.57\%/76.46\% UAR/WAR on DFEW, 0.3 points or less below the strongest compared method, and 45.66\%/62.27\% on MAFW, ahead of all compared methods; on FERV39k the mean over five splits, 42.30\%/52.66\%, is competitive. The five-fold means are 64.07\%/74.54\% on DFEW, on par with recent large pre-trained models, and 38.90\%/54.37\% on MAFW, below the best of them. A paired $t$-test on DFEW indicates a modest benefit of temporal modeling (+1.61 UAR points, one-sided $p=0.031$). Attention stays on plausible facial regions, and latency is close to a ViT-B/16 baseline (47.4 vs.\ 46.8 ms per clip). Code: https://github.com/ardiytama/GroupMamba-DFER.
0
math.NAcs.LGcs.NA Edison V\'azquez, Yingdong Lu, Tomasz Nowicki · Oct 22, 2026

This paper tackles certified neural approximation of the Dirichlet Monge--Amp\`ere equation, a fully nonlinear PDE whose solutions must be convex. The authors study implicit-depth equilibrium networks built from softplus units with nonnegative weights, proving that a resolvent--curvature cancellation improves the Hessian growth bound from $(1-q)^{-3}$ to the sharp exponent $(1-q)^{-2}$. They then derive residual-based a posteriori estimates and validate them with interval-arithmetic certificates on trained models, yielding rigorous uniform evaluation guarantees for implicit neural PDE solvers.

Equilibrium neural networks define their hidden state as the fixed point of a contraction, so their effective depth is set at evaluation time rather than by the architecture. Using them for fully nonlinear PDEs raises two issues that explicit networks avoid: second derivatives may grow with the effective depth, and the potential is only ever evaluated approximately. We study nonnegative softplus equilibrium networks with contraction factor $q<1$, a convex class suited to the Monge--Amp\`ere equation. A positivity cancellation in the resolvent shows that the Hessian grows at most like $(1-q)^{-2}$, rather than the $(1-q)^{-3}$ of a direct estimate, and an explicit one-neuron family shows that this exponent is sharp; third derivatives satisfy a sharp $(1-q)^{-3}$ bound. Residual-based a posteriori estimates then control the state, its input derivatives and, in two dimensions, the Hessian determinant at an approximate equilibrium. Combined with interval arithmetic on complete covers of the domain, they yield rigorous uniform bounds on the Monge--Amp\`ere residual and, through a comparison argument, on the solution error of a fixed trained network. On two manufactured Dirichlet problems on the unit disk, all six trained models are certified with residual below $0.25$ and boundary error below $0.01$. Adaptive stopping halves float64 evaluation time at best, whereas certified adaptive evaluation remains costlier than fixed depth.
0
cs.LGcs.CL Arvid Frydenlund, FuTe Wong, Katherine Lambert et al. · Oct 22, 2026

Language models fail to learn shortest-path search on unseen symbolic graphs as graphs scale beyond about 50 nodes, a wall this paper diagnoses and breaks through. The authors show that next-token prediction provides too little and too skewed supervision, while standard tokenization introduces routing and permutation artifacts. By combining multi-token prediction—which densely supervises all sub-paths and implicitly mixes hop lengths—with structural annotation (STAN) and a node list (+NN), they stably train small transformers on graphs up to 125 nodes with far lower variance. The work makes a strong case that objective design and input formatting matter more than model size for latent multi-hop reasoning.

Given an unseen graph, a start node, $s$, and an end node, $t$, can a language model generate the shortest path from $s$ to $t$? Prior work has found that models fail to learn this task as the graphs scale. We show that this failure has two causes: the supervision signal and the tokenization. First, we theoretically establish and empirically demonstrate the effectiveness of multi-token prediction (MTP), and show that the benefits of MTP are topologically agnostic. Second, we introduce alternative tokenizations and show that the two causes are orthogonal. Using these methods, we break through the scaling wall observed by prior work, consistently and stably learning to solve the task at scales far beyond previous limits.
0
cs.CVcs.LG Yue Zhou, Shujun Zhao, Xue Yang et al. · Oct 22, 2026

This survey argues that the central bottleneck for advancing remote sensing vision-language models has shifted from architectural innovation to data curation. It introduces GeoChef, an end-to-end framework that maps dataset taxonomy, construction pipelines, fine-tuning recipes, and evaluation protocols onto a culinary metaphor. By cataloging over 120 datasets and launching a community-driven warehouse, the authors aim to turn small academic teams into proactive data chefs rather than passive consumers of foundation models.

During the deep learning era, innovations in remote sensing (RS) vision models primarily focused on optimizing network architectures for specific tasks and conducting end-to-end training. However, with the advent of the Vision-Language Models (VLMs) era, constrained by substantial computational resource demands, the mainstream research paradigm has shifted towards adapting general-purpose VLMs using RS vertical domain data for fine-tuning, rather than modifying their core architectures. This transition marks a change in the innovation pathway from model-centric to data-centric. Despite the increasing importance of data, the academic community still lacks a systematic, data-centric survey to guide researchers in constructing high-quality RS vision-language datasets for various application scenarios and in conducting effective model fine-tuning and performance evaluation based on these datasets. To address this gap, this paper presents a systematic review of the development status of RS datasets tailored for VLMs. It further provides a comprehensive practical guide for RS researchers in the large model era, covering the entire pipeline from data construction to fine-tuning and evaluation. This paper aims to encourage the academic community to build more diverse and higher-quality vision-language datasets for specialized RS sub-fields. Ultimately, the goal is to converge these efforts into a comprehensive RS vision-language corpus that offers extensive task coverage and a wide geographical distribution, thereby laying a solid data foundation for advancing towards general artificial intelligence in RS.
0
cs.CRcs.CLcs.LG Ehsan Saleh, Roozbeh Nahavandi, Sama Salarian et al. · Oct 22, 2026

LLM agents with persistent external memory often leave derived artifacts—such as summaries—intact after a user deletes a source record, creating a gap between storage-level deletion and behavioral privacy. AfterDeleteBench introduces a paired behavioral audit that compares an exposed-then-deleted agent against a never-exposed twin to attribute post-deletion secret recovery to the original exposure. The paper shows that exact reconstruction can persist even when no verbatim copy of the secret survives, and that the response interface itself is part of the measurement system, making the benchmark a useful narrow probe into a broader agent-memory privacy problem.

Many LLM agents maintain external persistent memory and derive additional state from past interactions, such as summaries. Deleting an original memory record therefore need not remove information carried by its descendants. We introduce AfterDeleteBench, a controlled behavioral audit for this failure mode in fixed-weight LLM agents. For each synthetic secret, we compare an exposed-then-deleted agent with an otherwise matched agent that was never exposed to the secret, allowing post-deletion recovery to be attributed to the original exposure. In our primary setting, a single query recovers the deleted secret from Qwen2.5-7B-Instruct in roughly two thirds of cases, while matched never-exposed controls have zero recovery. Crucially, recovery does not require a surviving verbatim copy: when the complete secret string is absent and only separately stored components remain under a public composition rule, exact reconstruction succeeds in 62-99% of cases across Qwen, Mistral, and Phi-3. We also show that the response interface is part of the measurement system: target-bearing replies can be scored as failures when the requested format and parser are misaligned. Finally, we separate reconstruction from write-back and fresh-session recall. Provenance-aware closure eliminates observed recovery in the tested positive-baseline settings, whereas an exact-literal write filter blocks reinsertion but cannot erase information already present. Together, these results show that source deletion should be evaluated behaviorally at the level of the agent and its memory system, not only as a storage operation.
0
cond-mat.str-elcond-mat.stat-mechcs.LG Ali Rayat, Acacia Lee, Gia-Wei Chern · Oct 22, 2026

Collective ordering in correlated electron systems produces emergent, non-Markovian dynamics that cannot be closed at the level of coarse-grained observables alone. This paper proposes a graph-recurrent neural network (GRNN) that fuses gated recurrent memory with graph message passing to learn finite-time evolution maps directly from trajectories, bypassing repeated microscopic force evaluations. Site-resolved hidden states encode unresolved history and communicate across neighboring sites via graph-coupled hidden messages, giving a scalable, translationally invariant update rule. The authors demonstrate the approach on charge-density-wave domain coarsening in the semiclassical Holstein model, showing quantitative agreement with kernel-polynomial-method reference dynamics.

Collective ordering in correlated electron systems emerges from microscopic dynamics, yet the evolution of observable textures need not admit a closed, memoryless description. We introduce a graph-recurrent neural network (GRNN) framework that learns such emergent dynamics directly from trajectories without specifying microscopic equations of motion. The framework integrates gated recurrent memory with graph message passing: local hidden states encode information beyond the instantaneous observables, while spatial coupling allows this information to propagate between sites. The observable and hidden fields evolve jointly through a shared local rule, providing a scalable representation of dynamics with spatial interactions and temporal memory. We demonstrate this framework on the emergent dynamics of charge-density-wave order in the semiclassical Holstein model, successfully reproducing temporal and spatial correlations and dynamical scaling during domain coarsening. By learning finite-time evolution directly, the GRNN offers a route to efficient, data-driven descriptions of collective dynamics with unresolved microscopic degrees of freedom.
0
cs.LGcs.CL Zhizhuo Kou, Sizai Hou, Long Chen et al. · Oct 22, 2026

The paper challenges the widespread assumption that reinforcement learning (RL) invents the reflection marker "wait" in reasoning models. Using historical-linguistics-inspired "grammaticalization" tracking, the authors trace the word through 120 open-model checkpoints and find it almost always arrives from training data—mid-training, fine-tuning on reasoning traces, or reasoning-rich pretraining—while zero-RL alone rarely coins it.

Reinforcement learning (RL) is credited with teaching reasoning models to write {wait} before reconsidering a step, yet large RL accuracy gains do not require the word. This view can confuse what RL discovers with what a model inherits from its training data. We trace the word through open models' training histories, reading it with label-free indices of frequency, position, form and usage and an injected-error test, all computed from sampled outputs. We find that zero-RL almost never coins the marker: on bases that lack the word, RL raises MATH-500 accuracy substantially while {wait} stays near absent. It arrives with training data: mid-training in OLMo-3, and fine-tuning on reasoning traces installs it in most models whose base lacks it. Where the base already uses it, both released RL-Zero recipes (OLMo-3, MiMo) multiply it, whereas KL-free GRPO from the same base does not; OLMo-3's recipe wears down its form and makes it a more sensitive but more liberal alarm; RL after supervised fine-tuning barely changes it, and our GRPO recipe erases a marker seeded by fine-tuning. Finally, we show that marker frequency alone does not indicate RL-induced reasoning and caution against LLM-as-a-judge revision metrics, as automated judges can reverse human-labelled trends.
0
cs.LG Yen-Ku Liu, Hongjie Chen, Franck Dernoncourt et al. · Oct 22, 2026

Time-series dataset similarity is task-dependent: no single metric reliably predicts downstream transfer error across models and protocols. This paper proposes DISC, a learnable aggregation framework that calibrates a base mixture of standardized similarity metrics with a rank-based prior gate. On a shared 46-dataset split, DISC raises the average source-wise Pearson correlation with forecasting error by about 10% over the best single metric, supporting the claim that learned integration is a stronger proxy for transfer behavior than manual metric selection.

The growth of time-series datasets and foundation models has made dataset comparison a central part of time-series workflows. Assessing source-target transfer before model adaptation requires similarity estimates that can summarize transfer-related dataset relationships without exhaustive source-target evaluation over every candidate pair. Many metrics have been proposed for measuring similarity between time-series datasets, but they capture different dataset relationships and vary in how well they align with downstream utility across tasks. We evaluate this gap by measuring the correlation between source-target similarity scores and downstream forecasting errors in out-of-distribution and transfer-learning settings. We propose Domain-Integrated Similarity Cost (DISC), a learnable aggregation framework that uses calibration transfer observations to select, weight, and combine similarity metrics for different downstream tasks. By integrating complementary metric values, DISC better distinguishes source-target dataset differences that matter for downstream behavior. After calibration, DISC scores source-target pairs using only their similarity-metric values and yields higher alignment than single-metric references on the reported split. These results show that time-series dataset similarity is task-dependent, and that learned metric integration provides a stronger proxy for downstream transfer behavior than manually selecting one similarity metric.
0
cs.LGcs.CL Khouloud Saadi, Di Wang · Oct 22, 2026

On-policy self-distillation improves reasoning by training a model on its own trajectories with dense token-level guidance from a reference-conditioned teacher. The authors identify a critical flaw: because any single reference is just one valid realization of reasoning, conditioning the teacher on the full reference makes the target distribution overly sensitive to that specific solution's wording, ordering, and path. They propose Monte Carlo Privileged Distillation (MCPD), which averages the teacher's next-token distributions over multiple randomly masked partial views of the same reference to produce a more stable marginal target. Across math and science benchmarks, MCPD consistently outperforms standard full-reference distillation.

On-policy self-distillation (OPSD) improves reasoning by training a model on its own trajectories with dense token-level supervision from a privileged copy conditioned on a reference solution. Existing methods typically use a single teacher distribution conditioned on the complete reference. We identify a limitation of this formulation: a reference is only one realization of the reasoning process. Although it provides evidence about the answer, it also encodes an ordering, phrasing, and solution path. Full-reference conditioning can therefore produce correct targets that depend excessively on information unavailable to the student at inference. We show that replacing one valid reference with another, while holding the problem and student state fixed, can substantially alter the teacher distribution, a phenomenon we call reference-induced target instability. To address this instability, we introduce Monte Carlo Privileged Distillation (MCPD), which models privileged context as a distribution over partial reference views and distills the marginal teacher distribution. MCPD evaluates the teacher under multiple views and averages the resulting next-token distributions. We show that this probability-space average is the exact target induced by minimizing the expected teacher-to-student KL divergence over privileged views. Across mathematical and scientific reasoning benchmarks, we show that MCPD produces more reference-consistent supervision and consistently improves over full-reference OPSD.
0
cs.ROcs.LG Mateusz Odrowaz-Sypniewski, Michael Amir, Jasmine Bayrooti et al. · Oct 22, 2026

This paper asks whether robot learning must rely on embodied data by training in-context action predictors entirely on procedurally generated, non-robotic mathematical abstractions—tabular MDPs, contextual bandits, and linear dynamical systems. Using a Prior-Data Fitted Network framework, the authors show that these synthetic control priors achieve non-trivial zero-shot action prediction on held-out simulated and real-world robots, including manipulators, wheeled vehicles, quadrupeds, and aerial platforms. The work matters because it cheaply decouples structural prior acquisition from expensive physical data collection, offering a scalable complement to embodied foundation model pipelines.

Real robot data, rich across tasks and morphologies, is often treated as the bottleneck for training robot learning models, including embodied foundation models that aim for zero-shot physical transfer. In this paper, we investigate the degree to which such models can acquire necessary structure using data from systems without embodiment. To this end, we test if inexpensive, procedurally generated synthetic data can yield useful priors before a model observes any real-world behavior. We study this through robot action prediction, a natural pretraining objective and a direct test of whether structure learned from arbitrary synthetic tasks transfers to embodied settings. We introduce three data generation pipelines that model mathematical abstractions of robotic control, and use them as pretraining priors for a Transformer. We demonstrate that a model trained purely on this non-robotic data attains non-trivial zero-shot prediction performance on unseen physical robot tasks via an in-context learning mechanism, and that our specialized control priors notably improve upon generic causal priors. We also compare against a compute-matched baseline trained on real robot data, and find that it outperforms our model but only on the datasets it was trained on. These findings suggest that procedurally generated, mathematical abstractions can yield useful robotic priors, offering a potential complement to expensive embodied data collection.
0
cs.ETcs.LG Rodion Novkin, Hussam Amrouch · Oct 22, 2026

This paper proposes replacing the physics-based BSIM-CMG compact model with tiny MLPs (8–16 neurons) to predict drain current and charges for a 3 nm nanosheet, then embedding them in Verilog-A to perform a full standard cell library characterization and subsequent static timing analysis on industrial-scale circuits. The authors claim sub-percent delay and power errors alongside up to 8× faster library characterization, positioning the approach as a viable alternative to equation-based transistor models in modern EDA flows.

Neural network (NN)-based transistor models have proven to be a promising solution to accelerate device modeling. Although these models demonstrated remarkable speedup in circuit simulations, they were not rigorously tested in complex tasks within standard EDA tool flows for chip design, which require very high transistor model precision to provide accurate results and converge properly. To investigate their full potential and promise, we develop NN-based transistor models that accurately predict the drain current and various charges for a 3nm nanosheet, and employ the models for a standard cell library characterization. This enables us to evaluate the accuracy and speedup under a very wide range of SPICE simulations, benchmarking our models against an industry-standard implementation. Since standard cell library characterization involves thousands of SPICE simulations, it serves as a great benchmark for transistor model quality and consistency. To further evaluate model accuracy, we also perform analog- and digital-level simulations for various complex circuits. Our experiments reveal that NN-based models are a valid alternative to existing transistor compact models, capable of producing accurate delay and power estimates with a much higher speed and convergence time compared to the conventional Verilog-A-based industry-standard (BSIM-CMG) transistor compact model. Our NNs achieve sub-0.11% and 0.76% errors for delay and total power evaluation on a wide range of circuits, while taking up to 8 times less time during the standard cell library characterization. Additionally, we provide comprehensive information and guidance on NN accuracy, unveiling the relationship between NN size and its effect on circuit simulation precision.