Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
797 papers in cs.LG
Trending mixes fresh papers with community signal.
0
cs.LG Xu Wang, Shuhan Yi, Zhen Cheng · Oct 22, 2026

Wrist PPG heart rate monitoring is vulnerable to motion artifacts, and naively applying corrections can lower average error while damaging individual windows. This paper proposes a selective correction framework organized as an agent around a fixed core estimator: signal-analysis modules extract pulse and motion evidence, a temporal memory module generates candidate heart rates, and a decision module predicts each candidate's benefit and harm before a separate risk gate chooses to retain, correct, or reject the output. The authors train the auxiliary modules on PPG-DaLiA and evaluate frozen weights on three additional public datasets plus a prototype wearable stream, reporting macro-averaged MAE reductions up to 44.5%. The core idea—explicitly trading off predicted gains against harms rather than universally replacing estimates—is a clear contribution to wearable heart rate analysis, though deployment readiness is weakened by calibration transfer failures and an extremely limited prototype.

Wrist photoplethysmography (PPG) heart rate estimates are vulnerable to motion artifacts, and corrections that reduce mean error can worsen individual windows. We propose an agent architecture with tools and memory around a fixed heart rate estimator. Pulse, motion, and limited historical evidence generate candidate estimates, whose predicted benefits and harms guide selection. An independent risk gate determines whether to retain, correct, or reject each output. We trained the architecture on PPG-DaLiA and tested it on Wrist Exercise, GalaxyPPG, and WildPPG with frozen weights. Across these four public datasets, mean absolute error (MAE), macro-averaged over ten estimators, decreased by up to 44.5%, with the largest reduction on GalaxyPPG. Beneficial and harmful corrections decreased and increased absolute error by more than 1 bpm, respectively. Their ten-estimator macro-averaged proportions ranged from 16.06% to 36.64% and from 1.68% to 6.77%, respectively, across the four datasets. At 60% and 80% target coverage, numerical correction on the same accepted windows contributed more to total error reduction than window selection. We implemented real-time wearable acquisition, Bluetooth reception, and smartphone deployment of a selected estimator and the framework. In backend analysis of four prototype recordings from one participant, ten-estimator macro-averaged MAE decreased from 9.09 to 4.45 bpm without additional rejection. Under the evaluated conditions, the architecture improved average accuracy while quantifying correction benefits and harms, supporting wearable heart rate analysis that considers error, correction risk, and coverage.
0
cs.AIcs.LG Qijin Zhang, Hanzhen Wang, Yuehan Zhao et al. · Oct 22, 2026

LLM agents can execute prohibited actions when tool responses omit safety-relevant facts, even if every returned statement is true and the user request is benign. EpiSEM-Bench introduces 300 matched unsafe/safe task pairs across six domains with controlled evidence suppression and an optional audit-based recovery tool. The work shows that robustness to missing evidence and useful recovery are distinct capabilities that single-score benchmarks conceal, making joint evaluation essential for safe agent deployment.

Tool-using language model agents rely on environmental facts to decide whether an action is permitted. When a tool response omits a safety-relevant fact, an agent may carry out a prohibited action even though the user request is benign and every returned statement is true. We introduce \bench{}, an executable benchmark for evaluating unsafe execution, safety boundaries, and evidence recovery in LLM agents under missing evidence. It contains 300 matched unsafe/safe task pairs across six domains. By systematically suppressing critical facts, the benchmark measures unsafe execution under critical evidence omission and determines the minimum observed failure cardinality, including failures with full evidence and cases with no observed failure after exhaustive testing. An independent audit tool tests whether agents seek missing facts and then withhold prohibited actions while completing permissible tasks. The benchmark reveals substantial variation across the ten models in omission robustness, evidence acquisition, and appropriate action. Resistance to missing evidence does not necessarily translate into useful recovery. Recovery access reduces unsafe execution for all ten models, but agents differ in whether they actively obtain the missing facts and use them to act appropriately in both worlds.
0
cs.LG Shruti Bothe, Illyyne Saffar, Ayush K. Varshney · Oct 22, 2026

This paper studies handover prediction in cellular networks, where time-series models must meet a hard 40 ms inference deadline and a tight energy budget on user equipment. Rather than ranking by accuracy alone, the authors propose a protocol that filters models by tail latency feasibility then ranks survivors on measured per-inference energy—including feature computation. They benchmark eight architectures and find that gradient-boosted trees dominate the accuracy–energy–latency frontier, while the top accuracy-only neural model (CNN-1D, F1=0.914) costs over 3× more energy and trails in F1. The work challenges standard benchmarks by showing that duty-cycled measurement and full-pipeline accounting can invert model rankings.

AI models, and time-series models in particular are typically ranked by accuracy and deployed under constraints absent from that ranking. In this paper, we study a real setting where these constraints are explicit and measurable: handover pre- diction in cellular networks, where inference runs on the User Equipment once per 40 ms measurement period and must complete before the network acts. The timing bound is hard: a late prediction is superseded by the measurement it was predicting, while energy is a cumulative budget spent for the life of the device. Neither appears in the objective these models are selected on. We evaluate eight architectures under a protocol that screens for deadline feasibility at the tail rather than the mean, then ranks the feasible models on measured inference energy, count- ing the feature computation that precedes the forward pass and is usually omitted. Gradient-boosted trees on handcrafted temporal features are the most accurate model (F1=0.974) and among the cheapest to run, while the neural architecture an accuracy-only benchmark would rank first (CNN-1D, F1=0.914) costs over 3 times more energy per inference under a realistic duty-cycled deployment pattern. We give three conditions under which this outcome should be expected, so the finding applies beyond telecommunications. Accuracy-only benchmarking does not merely under-report deployment cost. It can rank first a model that cannot be deployed.
0
cs.LG Khouloud Saadi, Di Wang · Oct 22, 2026

This paper shows that large language models fail to treat co-referring molecular identifiers—such as trivial names, IUPAC names, and SMILES strings—as interchangeable routes to the same knowledge. The authors introduce ChemIDBench, a controlled benchmark of 896 approved drugs, and demonstrate a striking double dissociation: lexical names unlock entity-associated facts like therapeutic indications, while structural identifiers unlock structure-computable properties like benzene-ring presence. Even when a model recognizes a molecule from its SMILES, the corresponding factual knowledge often remains inaccessible, a phenomenon the authors term cross-identifier binding failure. They trace this to a missing access relation rather than missing knowledge, and propose Binding Self-Distillation to transfer lexical access directly to SMILES without retraining from scratch.

Chemical AI workflows routinely represent the same molecule through multiple co-referring identifiers, including trivial names, IUPAC names, and SMILES, implicitly assuming that these representations provide interchangeable access to an LLM's knowledge. To test this assumption, we first introduce a controlled benchmark and show that it does not hold. Across foundation models spanning 7B to 72B parameters, even chemistry-specialized models, co-referring molecular identifiers consistently expose different subsets of the model's knowledge. We then conduct a series of controlled behavioral, representational, and causal analyses to characterize this failure. We show that even when a model can identify a molecule from its SMILES and retrieve a fact through the corresponding name, the same fact can remain inaccessible directly from SMILES. We term this phenomenon \emph{cross-identifier binding failure}. Further analysis of internal representations, conflicting identifiers, and parameter editing shows that neither improved chemical representation competence nor modification of individual facts is sufficient to establish reliable access across identifiers. Together, these results indicate that the core failure lies in the binding between an identifier and knowledge already present in the model. Motivated by this diagnosis, we introduce Binding Self-Distillation, a simple mitigation that uses lexical identity during training to transfer the model's existing knowledge access to the structural route. This enables factual retrieval directly from SMILES at inference time, without requiring a name lookup or training the underlying model from scratch.
0
stat.MLcs.LG Daniele Micheletti, Federica Zoe Ricci, Erik B. Sudderth · Oct 22, 2026

xVGAE tackles graph generation for moderate-sized, potentially dense graphs where diffusion and autoregressive methods become prohibitively slow. It builds on the Aldous-Hoover representation theorem to design a hierarchical VAE with a global graph latent $z_0$ and node latents $z_i$ that are conditionally i.i.d., using a learnable neural graphon decoder for one-shot generation. The core pitch is that this structure yields sample quality competitive with state-of-the-art while sampling one to three orders of magnitude faster, and produces interpretable latent representations.

Graphs play a crucial role in many applications, ranging from drug discovery to social network modeling and astronomy. Generative models for graphs have substantially advanced in recent years, but we identify relatively simple scenarios where state-of-the-art models struggle to converge within a standard compute budget, or exhibit prohibitively slow generation times. We propose a generative architecture that achieves quality competitive with state-of-the-art models and is orders of magnitude faster at generation. Our approach is inspired by the Aldous-Hoover theorem, a classic representation theorem that characterizes any probability distribution of graphs that is invariant to permutations of node indices or exchangeable. This theorem establishes that three ingredients suffice: a graph-level latent variable, a set of exchangeable node-specific latent variables, and a so-called graphon function that maps graph- and node-level variables to the probability of an edge between any node pair. Given a training set of graphs, our exchangeable Variational Graph AutoEncoder (xVGAE) learns an approximation to their underlying graphons, as well as graph- and node-level latent variables. We show that our xVGAE encodes latent representations that correlate with graph- and node-level properties, and can (quickly, in one shot) generate new graphs that closely match key training set statistics.
0
cs.LGcs.AIstat.ML Mahdi Sabbaghi, George Pappas, Hamed Hassani et al. · Oct 22, 2026

Standard on-policy distillation forces a student to copy a teacher at every token, even when the teacher's preferred actions hurt the student's eventual success. This paper proposes Advantage-Based On-Policy Distillation (AOPD), which weights each teacher token by its counterfactual advantage under the current student policy. The key insight is that imitation should optimize for student task reward, not teacher agreement, and the authors derive an unbiased estimator that needs only standard student rollouts and terminal rewards.

Online Policy Distillation (OPD) often outperforms offline methods such as Supervised Fine-Tuning (SFT) by training on trajectories sampled directly from the student. However, standard OPD trains the student to follow the teacher at every state of the trajectory, assuming that teacher guidance is always beneficial. We instead distinguish between what the teacher prefers and what actually helps the current student succeed. We introduce Advantage-Based On-Policy Distillation (AOPD), which weights teacher actions by their counterfactual advantage under the student. Teacher actions that improve the student's expected outcome are reinforced, while those that do not are downweighted. Directly computing these advantages requires trying alternative teacher actions at each step and running new rollouts from each. Instead, we show that the AOPD objective can be estimated using only standard student rollouts and their terminal rewards. Our estimator uses teacher importance weights on the student-sampled actions to provide unbiased advantage-weighted supervision, without any additional rollouts or reward evaluations. This allows AOPD to focus teacher supervision on actions that help the current student while preserving the rollout efficiency of standard OPD. Experiments on math, coding, and Medqa show gains over distillation and RL baselines in both external-teacher and self-distillation settings.
0
cs.GTcs.LGq-fin.TR Matteo Onger, Luigi Foscari · Oct 22, 2026

Onger and Foscari analyze competitive market making as a two-sided pricing game where strategic liquidity providers face a non-strategic informed trader with inelastic demand. Because bid and ask quotes jointly set the market mid-price that determines trade direction, standard equilibrium existence theorems fail and payoffs are non-convex and discontinuous. The authors prove that pure-strategy Nash equilibria exist via a novel fixed-point argument on a midpoint operator, derive a structural linear scaling of spreads with asset volatility, and show that no-internal-regret learning on fine price grids recovers the competitive benchmark as tick size vanishes.

We propose a market-making game played among $N \ge 2$ strategic market makers and a single non-strategic representative trader. In a continuous quote space, standard finite-game arguments do not apply, while non-convex and discontinuous payoffs rule out classical continuous existence results and complicate learning. Nonetheless, we characterize pure-strategy Nash equilibria (PSNEs) and show that at least one PSNE always exists under minimal assumptions on the underlying asset value distribution, and that the equilibrium bid-ask spread widens strictly with asset value volatility. To obtain a tractable learning framework, we discretize prices and, under an additional regularity condition, show that the time-averaged play of no-internal-regret learners approaches the continuous Nash price envelope as the tick size vanishes. Finally, we empirically validate our theoretical results through numerical simulations.
0
cs.CLcs.AIcs.LG Ferdinand Kapl, Kaitlin Maile, Stefan Bauer et al. · Oct 22, 2026

Depth growth and looping reuse computation across layers to train or run Transformers more efficiently. This paper shows that both methods create an inductive bias toward learning from context over memorizing fixed associations in weights, accelerating in-context learning and propagating induction heads through depth. The evidence spans models up to 3B parameters and connects architecture design to the mechanistic origins of few-shot performance.

Looped and depth-grown language models reuse computations across depth and have attracted interest for their reasoning capabilities. Building on prior suggestive evidence of improved in-context-learning (ICL), we investigate how such reuse favors ICL, including how it shapes the acquisition, retention, and mechanisms of this ability. Our analysis spans pretrained language models up to 3B parameters and controlled tasks. The experiments provide evidence for a shared inductive bias toward learning from context: grown and looped models rely more on information in context and, compared with a full-depth dense reference, acquire ICL earlier in controlled tasks and retain it more strongly when learning fixed associations in the weights is also possible. Tracing attention heads through training reveals that depth growth propagates early induction heads across layers. Ablations show that grown and looped models rely more strongly on induction-ranked heads for both few-shot performance and later-token prediction. Together, these findings provide evidence for a shared inductive bias toward learning from context and suggest that (soft) parameter reuse shapes how this ability develops and which attention mechanisms support it.
0
cs.LG Edric Castel C. Hao, Juan Raphael S. Se\~na, Neon S. De Jesus · Oct 22, 2026

The paper tests whether matching spectral predictability $\Omega$ between synthetic pretraining data and target time series is sufficient for effective transfer learning under distribution shift. They evaluate this "predictability-aware" hypothesis using LSTM, PatchTST, and TCN across controlled synthetic conditions and the real-world ETTm1 benchmark. The core finding is a negative result: while $\Omega$-matching works under ideal conditions, it fails across different synthetic source families on real data, suggesting practitioners need more nuanced source-selection criteria.

Synthetic pretraining under distribution shift requires deciding what synthetic data to use. A natural criterion is to match the spectral predictability $\Omega$ of the source to the target, but is $\Omega$ sufficient? We test this hypothesis, which we call predictability-aware pretraining, across three architectures (LSTM, PatchTST, TCN) and three seeds. Under ideal synthetic-to-synthetic conditions, $\Omega$-matched pretraining can outperform even an oracle baseline (+46.8% MSE reduction, LSTM), though the benefit is already architecture-dependent. On the real-world ETTm1 benchmark, however, this relationship does not hold: sine-plus-noise pretraining at matched $\Omega$ yields only a marginal mean improvement +2.3% averaged over all three architectures, up to +65.5% on individual channels), whereas $\Omega$ matched chaotic ODE trajectories systematically degrade performance -13.2%). The two sources agree on the direction of transfer for only 53% of configurations across all three architectures (Pearson r=-0.02), indicating that $\Omega$ carries little information about which source will transfer beneficially. We further observe an architecture-dependent asymmetry in the response to the direction of the $\Omega$ gap. We conclude that $\Omega$ matching can help in controlled settings but is not sufficient to predict transfer across sources, and we discuss additional signal properties that a source-selection criterion may need to consider.
0
stat.MLcs.LG Ying Li, Sanyou Wu, Zi Yang et al. · Oct 22, 2026

Standard deep Gaussian processes become increasingly ill-conditioned as depth grows because discrete layer composition amplifies parameter perturbations. This paper proposes replacing the discrete stack with a latent continuous-depth SDE whose drift family carries a GP-based prior, yielding two models: CDGP with a direct separable GP prior, and FlowDGP with a flow-evolved base GP. The central claim is that depth in probabilistic regression is better modeled as continuous latent evolution than as a discrete composition, and that retaining a GP prior over the drift improves stability and competitiveness relative to both discrete DGPs and neural continuous-depth alternatives.

Deep Gaussian processes (DGPs) are appealing Bayesian regression models, but their standard discrete-depth parameterization often becomes harder to optimize as depth grows. We argue that depth is better treated as a latent continuous evolution than as a long discrete stack. We therefore propose a continuous-depth formulation in which the latent representation follows a stochastic differential equation with a depth-indexed drift family equipped with a GP-based prior. This reframes the core design choice as the prior placed on that family, rather than adopting a purely neural continuous-depth parameterization as in neural ODE or neural SDE models. We study two instantiations of this idea: CDGP, a direct GP prior over the state--depth drift, and FlowDGP, a flow-evolved prior that captures richer depth dependence at lower training cost. To motivate the redesign, we analyze how the single-sample DGP objective can become increasingly sensitive under repeated layer composition, while residual DGP is a useful first repair that still remains a finite discrete construction. We also give pathwise sensitivity analysis for the continuous-depth formulation. Experiments on synthetic, benchmark, and large-scale regression tasks show that residual DGP improves over plain DGP, while CDGP and FlowDGP provide a stronger overall story across the regimes we study.
0
cs.LG Yubo Huang, Yushe Cao, Zixi Wang et al. · Oct 22, 2026

Gradual domain adaptation (GDA) tackles large distribution shifts by splitting them into ordered intermediate steps, but existing methods often suffer from error accumulation and unstable adversarial training. This paper proposes FlowGDA, a flow-matching framework that models gradual adaptation as continuous transport on a statistical manifold in a representation space, using time-dependent velocity fields learned via a simulation-free regression objective. By coupling local left-to-right transport with a source-anchored semantic consistency loss, the method aims to avoid the error accumulation and adversarial instability of discrete stepwise GDA methods.

Large distribution shifts remain a primary obstacle for domain generalization and unsupervised adaptation. Although gradual domain adaptation alleviates this difficulty by introducing ordered intermediate domains, most existing approaches still operate in a discrete, step-wise manner, which can accumulate errors and often relies on unstable Min--Max optimization. We propose \textbf{FlowGDA}, a flow-matching framework that models gradual adaptation as \emph{continuous} transport on a statistical manifold in a representation space. FlowGDA learns time-dependent velocity fields that induce smooth domain trajectories, using a simulation-free regression objective rather than adversarial training. To prevent semantic drift, we couple left-to-right transport between consecutive domains with a source-anchored transport and a semantic consistency loss, and we further stabilize learning via a two-stage sequential optimization scheme. Extensive experiments demonstrate that our method outperforms state-of-the-art techniques, validating flow matching as an effective alternative for domain adaptation.
0
cs.LG Chenhao Zhou, Chao Zhang, Wensong Bai et al. · Oct 22, 2026

Representation learning has improved sample efficiency in unconstrained MDPs, but extending it to constrained settings with unknown dynamics remains largely open. This paper studies low-rank constrained MDPs with continuous states where latent transition features must be learned online while controlling cumulative constraint violations. The authors propose two primal-dual algorithms that combine maximum-likelihood feature learning, uncertainty bonuses, and decaying $\epsilon$-greedy auxiliary probing to obtain the first sublinear regret and violation guarantees for this setting, with an explicit tradeoff between return-policy optimality and the safety cost of exploratory execution.

Representation learning has substantially improved the efficiency of unconstrained continuous-state Markov Decision Processes (MDPs), but its extension to Constrained MDPs (CMDPs) is difficult because the transition representation must be learned while constraint violation is controlled. In this paper, we study representation learning for low-rank CMDPs with continuous state spaces, and propose REP-PD-TEG for the soft cumulative-violation setting. In the feature learning period, the algorithm interacts with the environment using a decaying-$\epsilon$-greedy mixture execution policy, and uses the collected samples to learn transition features by maximum likelihood. Based on the learned features, it constructs uncertainty bonuses and plans with an optimistic Lagrangian objective to obtain the return policy. We prove regret and soft-violation guarantees for the return policies, and quantify the influence of the decaying-$\epsilon$-greedy exploration. In particular, REP-PD-TEG achieves the optimal $\widetilde O(\sqrt K)$ return policy bound, and gives a $\widetilde O(K^{3/4})$ overall sample bound when exploratory actions are charged. For the stricter hard cumulative violation, where feasibility must be verified episode by episode, we propose REP-PD-H-TEG. It plans under a bonus-corrected lower-confidence utility certificate with the learned representation, and performs a stabilized dual search to obtain the return policy, yielding regret and hard-violation bounds. Together, these results give the first theoretically guaranteed representation-learning method for low-rank continuous-state CMDPs with both soft cumulative guarantees and certified hard-violation control.
0
cs.LGcs.AI Jo\~ao Kenji Suwa, Jo\~ao Pedro Silveira e Silva, Bruno Iochins Grisci · Oct 22, 2026

This paper adapts the Feature Selection Layer (FSL) into a post-hoc interpretability tool for pre-trained neural networks on tabular data. Instead of training an embedded feature weighting layer jointly with the network, the authors freeze the pre-trained model and insert a lightweight diagonal scaling layer that learns per-feature weights via fine-tuning. The approach aims to let practitioners retrofit already deployed models to obtain feature importance scores without retraining from scratch, bridging embedded feature selection and post-hoc attribution methods.

The interpretability of complex neural networks remains a critical challenge, especially for models already deployed in high-stakes domains. To address this, we adapted the Feature Selection Layer (FSL) to optimize feature weights post-training, a variant we term post-hoc FSL. Our approach reframes the FSL as a lightweight, trainable module that integrates with already frozen pre-trained models on tabular datasets to highlight the features the original model considers most important. This post-hoc FSL learns feature relevance by fine-tuning its weights based on the original model's learned outputs. Crucially, this process is non-invasive, operating without altering the original model's architecture or its learned parameters. We conducted our experiments using both statistical and visual metrics, including accuracy, F1 score, recall, precision, weighted t-SNE and silhouette score, and also analyzed the stability of the post-hoc FSL on high-dimensional synthetic and real-world tabular datasets. We compared the post-hoc FSL feature weighting method using these metrics against the original embedded FSL and other post-hoc interpretability methods, such as Integrated Gradients, Noise Tunnel, DeepLIFT, Gradient SHAP, and Feature Ablation. Experimental results demonstrate that the post-hoc FSL feature weighting method successfully identified relevant features across the different datasets, maintaining the predictive power of the original neural network while enhancing its interpretability.
0
cs.LGq-bio.BM Zhou Zhang, Hanqun Cao, Minghao Sun et al. · Oct 22, 2026

RiboBridge addresses the challenge of designing RNA molecules that bind to target protein structures when neither the native RNA sequence/structure nor the binding interface is known. Its core idea is to separate RNA conformation generation in a pretrained discrete structural space (RiboSphere) from protein-relative assembly via predicted cross-frame interaction geometry and rigid placement. This decomposition matters because high-quality protein–RNA complex data are scarce and existing methods entangle conformational sampling with interface discovery.

Designing RNA molecules that bind to target protein structures requires generating both an RNA conformation and its bound complex geometry, without assuming a predefined binding site. Existing approaches generally model these coupled processes within a unified representation, entangling RNA conformation generation with protein-relative placement. In this work, we introduce RiboBridge, a structure-first framework that separates RNA conformational generation from protein--RNA assembly through cross-frame interaction geometry. RiboBridge first proposes multiple candidate RNA-binding interfaces on the protein surface, generates canonical RNA conformations within a pretrained RNA structural latent space (RiboSphere), and then predicts protein--RNA interaction constraints to bridge the independently defined RNA and protein coordinate frames. The resulting interaction geometry is converted into a geometrically consistent protein-relative pose through rigid placement. We evaluate RiboBridge on a temporally split, sequence-filtered, and redundancy-controlled benchmark of 124 protein--RNA complexes. Under post-hoc interface-correspondence evaluation, where native information is used only after generation to select among already generated predicted-pocket candidates, RiboBridge achieves the highest fNAT and DockQ and the lowest interface and ligand RMSDs among compared methods. Component ablations and stage-wise diagnostics further characterize the contributions of RNA conformational generation, interaction prediction, and rigid placement, identifying the main sources of complex-recovery error.
0
cs.LGcs.AI Gabriele Dominici, Teague McMillan, Fazl Barez et al. · Oct 22, 2026

CausalCoT addresses the problem of unfaithful chain-of-thought reasoning in LLMs, where dense attention allows models to bypass their own generated rationales and exploit global context instead. It enforces procedural causal dependence by decomposing queries into a directed acyclic graph of sub-questions and evaluating each node in an isolated context containing only its direct parents. The framework promises more faithful explanations and precise test-time steerability via local interventions.

Chain-of-thought (CoT) prompting elicits step-by-step rationales that appear to explain model predictions, but there is no guarantee these steps causally drive the final answer. In standard autoregressive generation, dense attention allows each reasoning step to attend to the full context, enabling the model to derive answers through direct lookup while generating plausible-sounding but post-hoc justifications. We introduce CausalCoT, an inference framework that enforces causal transparency by decomposing problems into a directed acyclic graph of atomic sub-questions, evaluating each node in an isolated context containing only its direct causal parents. This Markovian structure removes attention pathways to non-parent content, making downstream predictions sensitive to local reasoning rather than global context leakage. Across a diverse suite of reasoning benchmarks, CausalCoT preserves competitive predictive performance while improving explanation faithfulness, increasing causal sensitivity of intermediate reasoning steps by an average of 12 and up to 21 percentage points over the strongest baseline. The structured dependency graph additionally enables test-time interventions in which local corrections propagate predictably through downstream reasoning.
0
cs.AIcs.LG Thanh Q. Tran, John Russell Himawan, Arun Verma et al. · Oct 22, 2026

DIAL tackles the challenge of fine-grained control over instruction adherence—how strongly an LLM should follow instructions like "Keep it short." The core idea is to distill classifier-free guidance (CFG) into a lightweight, text-conditioned steering adapter that edits hidden states at a single layer. This matters because it promises scalable, efficient, adjustable adherence across diverse instructions without requiring labeled responses or per-instruction fitting.

When a user says "Keep it short", how short should the LLM's response be? More generally, users and applications require different levels of instruction adherence, but prompting does not reliably provide fine-grained control over them. We therefore study "steerable language models" that provide fine-grained numerical control over the degree to which models follow general instructions specified in text. However, existing approaches do not jointly offer fine-grained control, efficiency, and scalability across diverse instructions. To address this gap, we introduce DIAL (Distilled Instruction-Adherence Levels) to achieve all three properties. For fine-grained control, we perform classifier-free guidance (CFG) with a frozen LLM to provide training signals for on-policy distillation of instruction adherence at different levels. For efficiency, we design a lightweight steering adapter that uses a classifier over the LLM's hidden states to compute a closed-form steering edit. The classifier adaptively sets the steering magnitude at each token based on the target adherence level, while accounting for the geometry of the LLM's hidden states to preserve response coherence. For scalability, the classifier is text-conditioned, allowing a shared adapter to support new instructions without per-instruction fitting, and training requires only instruction and request text. Evaluation across multiple LLM families shows that DIAL achieves a competitive balance between concept expression and response fluency, with concept scores increasing monotonically across adherence levels. We introduce SteerIF, an instruction-only dataset of 98, 625 concept, persona, verifiable, and descriptive instructions. When trained on SteerIF, DIAL provides fine-grained control over personas and, when combined with prompting, improves verifiable instruction following.
0
cs.GTcs.LG Luis F. Paul Tosta, Quinn Arnold, Gianluca Brero · Oct 22, 2026

Iterative combinatorial auctions require many costly rounds to discover clearing prices. This paper proposes FastCombo, an offline deep RL method that learns a recurrent graph policy to post sequential item prices with a single neural-network forward pass at deployment. The core insight is that maximizing immediate clearing probability can be arbitrarily suboptimal in expected rounds, so formulating the task as a POMDP and training over complete auction trajectories lets the policy acquire information that speeds up later clearing. Results show competitive clearing on standard CATS benchmarks with 300–900× lower online computation than a Bayesian baseline, though consistent round savings remain elusive outside a controlled one-item domain.

Iterative combinatorial auctions are used in spectrum allocation, transportation, and industrial procurement, but rounds are costly. We introduce FastCombo, a deep reinforcement learning approach to sequential price discovery. Bayesian pricing has sharply reduced auction rounds even against subgradient benchmarks tuned with hindsight for each instance, but relies on a one-step objective and repeated online inference and optimization. We prove that greedily maximizing immediate clearing probability can require arbitrarily more rounds in expectation than an informative policy, even with the true valuation distribution known. FastCombo learns price policies offline, assigning credit to queries for the future decisions they enable and producing each online price update with a single neural-network forward pass. We formulate the objective of minimizing expected rounds to clearing in single-minded auctions as a partially observable Markov decision process and train a recurrent bidder-item graph policy over complete auction trajectories. In a one-item experiment, all five trained policies learn an informative opening, reducing expected rounds from 1.85 to 1.65 relative to the tested Bayesian one-step rule. Across four domains from the Combinatorial Auction Test Suite, FastCombo achieves competitive clearing while reducing measured online price-selection time per auction by a factor of roughly 300-900 relative to the standard Bayesian baseline. These results demonstrate the value of learning sequential price policies for both information acquisition and online computational efficiency.
0
cs.LGcs.AI Bar{\i}\c{s} Alparslan, Sandy Tanwisuth, Caleb Petterson · Oct 22, 2026

Instrumental convergence predicts that capable agents develop power-seeking subgoals, but it is unclear whether reinforcement learning with verifiable rewards (RLVR) monotonically increases such behavior in language models. This paper evaluates OLMo-3-7B-Think across sixteen post-training checkpoints using InstrumentalEval and finds a nonmonotonic trajectory: instrumental-like outputs rise during early RLVR, peak near step 200, and then fall below the SFT baseline by the final checkpoint. The result challenges simple "more RL equals more convergence" narratives and shows that checkpoint-level monitoring can reveal dynamics hidden by endpoint comparisons.

Instrumental convergence is often invoked as a general reason to expect capable agents to acquire or express power-seeking subgoals: self-preservation, resource acquisition, deception, or resistance to oversight which poses an important threat to the society. For LLMs, reinforcement learning is the first stage of post-training that directly optimizes behavior against an objective; therefore, it is the stage where convergent instrumental behavior, on IC grounds, likely to appear. Does reinforcement learning with verifiable rewards (RLVR) make a model more likely to express instrumental-convergence behavior, or does this depend on the training regime, evaluation frame, and stage of post-training? We study this question as a checkpoint-conditioned behavioral trajectory rather than as a single before/after safety score. Using InstrumentalEval, we evaluate OLMo-3-7B-Think across SFT, DPO, 13 intermediate RLVR checkpoints, and the final RLVR model. The trajectory is nonmonotonic: instrumental rate rises from 25.0% at SFT to 46.1% near RLVR step 200, then falls to 11.8% at the final checkpoint. Paired item-level tests and step-wise regression support the final SFT-to-RLVR reduction. Prompt framing does not explain this pattern: a harmful-prompt indicator combined with other framing effects explains only 15% of within-checkpoint score variance on average, and Iterative Null-space Projection (INLP) removes a detectable framing direction without changing the SFT-to-final-RLVR gap. Together with preliminary 32B endpoint results (35.53% SFT to 22.37% RLVR final), these findings indicate that RLVR does not monotonically increase instrumental behavior in this setting: the rate rises early, then falls below the SFT baseline. The result is specific to this model family and benchmark, and judge agreement is moderate, so absolute rates should be read cautiously.
0
cs.NEcs.AIcs.LG Ze-Yu Peng, Qing-Yu Lan, Zhan-He Wang et al. · Oct 22, 2026

AgenticEvolve replaces the one-shot LLM variation operator in evolutionary program search with a persistent agent that edits code, runs self-designed experiments, and commits candidates for formal evaluation. By letting the agent test hypotheses locally between expensive evaluations, the framework aims to improve sample efficiency and final program quality on tasks ranging from online bin packing to symbolic regression. The authors report gains over a matched No-analysis ablation and over OpenEvolve, while noting that cost trade-offs depend heavily on model pricing.

Evolutionary program search with large language models keeps the structure of an evolutionary algorithm and uses the model as its variation operator. Typically, the model generates each candidate program in a single request from parent programs and their scores. We present AgenticEvolve, an evolutionary program search framework in which each island is run by a persistent large language model agent. Between evaluations, the agent designs and runs experiments on the candidate program. To measure the contribution of experimentation, we compare AgenticEvolve with No-analysis, an otherwise identical configuration with experiments disabled. On two heuristic design tasks with three large language models, AgenticEvolve produces better programs than No-analysis and OpenEvolve on both hidden and unseen instances. It reaches the baselines' final quality with far fewer evaluations and comparable cost. On twelve equation discovery problems, it recovers the ground-truth structure of more equations than No-analysis and existing language-model and genetic programming baselines.
0
cs.LG Victor Li, Owen Tucker, Michael S. Hughes et al. · Oct 22, 2026

This paper challenges how digital twins for type 1 diabetes are evaluated. Instead of the standard practice of scoring models by glucose trajectory error (RMSE), the authors propose measuring decision quality: whether a twin's simulated trajectories correctly rank candidate insulin treatments. They benchmark six methods on 30 virtual patients and show that a model can predict glucose accurately yet rank treatments no better than random, while a population-average baseline that ignores individual data ranks surprisingly well. The result is a convincing argument that clinical decision-support models need decision-aware evaluation.

A digital twin (DT) for type 1 diabetes (T1D) can predict how an individual's blood glucose will respond to different insulin treatments without actually trying them. For each treatment, downstream statistics of predicted glucose trajectories, such as glycemic risk, can be computed to guide clinical decisions. However, the quality of DTs is usually measured by the accuracy of their predicted glucose trajectories, which may not reflect the quality of the downstream treatment decisions they inform. In this work, we directly evaluate DTs by this decision quality on downstream treatment ranking, i.e., whether a DT predicts glucose trajectories that can be used to rank candidate treatments as the real patient would. We present an evaluation protocol over 30 virtual patients from the FDA-accepted UVA/Padova model, each simulated under 21 different basal-bolus treatments. For each patient, a DT is fitted under one treatment and then produces glucose trajectories for the remaining 20 treatments. Our results show that prediction accuracy and decision quality disagree. A baseline that models the average patient, never seeing the individual's glucose data, has the lowest prediction accuracy of all six methods (RMSE: 63.6 mg/dL) but ranks treatments with the second-highest mean Spearman (0.766), while a black-box neural network that predicts glucose nearly twice as accurately (RMSE: 32.9 mg/dL) ranks them no better than a random ordering of the 20 treatments (0.049 Spearman). Therefore, selecting a DT based on prediction accuracy alone can prefer one that recommends treatments at chance, and decision quality must be evaluated directly rather than assumed to follow from prediction accuracy.