Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
698 papers in cs.AI
Trending mixes fresh papers with community signal.
0
cs.AI Yixue Hao, Jiahao Zhang, Jiesong Lian et al. · Oct 14, 2026

Offline reinforcement learning from static datasets demands expressive policies that remain within data support while improving value. Drifting models train a direct generator via attraction to behavior actions and repulsion among generated particles, but standard drift policies weight repulsion solely by geometric distance and therefore cannot distinguish particles by expected return. This paper proposes Value-Guided Repulsion Q-Learning (VRQL), which modulates repulsion by combining kernel distance with a normalized Q-value bias so that lower-valued neighbors exert stronger repulsive force, while preserving the behavior anchor and a separate value-maximization objective. The authors report competitive performance across 50 OGBench tasks and 6 D4RL AntMaze environments without requiring an auxiliary behavior model.

Drifting models have emerged as a highly efficient and stable paradigm for policy design in offline reinforcement learning (RL). However, standard drift policies determine repulsion solely from geometric relationships among generated actions and therefore cannot distinguish them by expected value. To address this limitation, we introduce Value-Guided Repulsion Q-Learning (VRQL) to integrate action value estimates into the particle interaction field. For each state, VRQL combines geometric kernel distance with a normalized Q value scaling. This mechanism assigns greater repulsive influence to particles with lower values while strictly retaining attraction toward behavior action. Consequently, this value-guided interaction field aligns behavior regularization with policy improvement without adding an auxiliary behavior model stage. On 50 OGBench task configurations and 6 D4RL AntMaze configurations, VRQL demonstrates highly competitive performance against established baselines, suggesting that value-guided particle interaction is an effective method for offline RL.
0
cs.LGcs.AI Shuaijie Ma, Yongkang Hu, Yu Cheng et al. · Oct 14, 2026

Federated fine-tuning lets LLMs learn from distributed data, but malicious clients can poison the global model and their attack patterns may evolve as new tasks arrive. This paper proposes Safe-FCL, which continually adapts a risk detector using historical protective subspaces and then performs risk-aware, module-level aggregation of LoRA updates. The goal is to keep the global model safe across sequential tasks without forgetting previously learned attack signatures.

Federated fine-tuning enables large language models (LLMs) to learn collaboratively from distributed client data, but malicious client updates can compromise global model safety. As federated tasks evolve, changing malicious update patterns challenge the ability of existing defenses to maintain reliable risk detection over time. To address this challenge, we propose Safe-FCL, a framework integrating continual risk awareness with fine-grained safety aggregation for federated continual learning of LLMs. Specifically, the Continual Risk Awareness (CRA) mechanism learns emerging risk patterns across sequential tasks and constrains detector updates using a protective subspace derived from historical features, mitigating forgetting of previously learned malicious patterns while adapting to new risks. To translate risk awareness into aggregation-level safety control, the Fine-Grained Safety Aggregation (FGSA) mechanism combines client-level risk assessments from CRA with module-level deviations from historical update behavior to adaptively regulate aggregation contributions, suppressing potentially malicious updates while minimizing unnecessary restrictions on benign updates. Extensive experiments demonstrate that Safe-FCL outperforms current SOTA methods, improving global-model Rule and MD-Judge scores in federated continual learning by 0.41% and 0.64%, respectively, while increasing average risk recognition accuracy by 2.01%.
0
cs.LGcs.AI Radovan Halu\v{s}ka, Christopher Solinas, Nathan R. Sturtevant et al. · Oct 14, 2026

Neural networks require vector inputs, yet many problems involve higher-order objects like probability distributions, functions, and graphs that lack compact representations. This paper proposes a unified encoder-decoder framework that embeds families of such objects into fixed-size vectors using only finite sample sets, with a domain-specific decoder providing the training signal. The core idea is to replace per-object fitting with amortized learning: a permutation-invariant encoder compresses samples into an embedding that conditions a decoder, enabling generalization to unseen family members. The authors instantiate this on distributions, functions, and graphs, and claim it is the first framework general enough to work across object types.

Neural networks operate naturally on finite-dimensional vectors, yet many problems require reasoning about higher-order objects such as distributions, functions, and graphs. Such objects capture relationships within a ground set and rarely admit an explicit compact representation. Moreover, we typically want a compact representation not of a single higher-order object but of an entire family of such objects, including members unseen during training. While a few approaches exist for particular object types, none is designed to work across object types. We propose a unified framework that represents any higher-order object as a fixed-size embedding vector learned over a family of such objects. An encoder maps an object, seen only through a finite set of samples, to an embedding, and a domain-specific decoder supplies the training signal by modeling the object conditioned on that embedding. Since the encoder works only from samples, one architecture serves different object types. Because the decoder is a model already suited to single instances of the object type, the framework inherits that model's native operations and inductive biases. We instantiate the framework on distributions, functions, and graphs. In each case we show that a single trained model represents an entire family and generalizes to members unseen during training. Furthermore, we demonstrate the downstream utility of these embeddings: interpolating distributions in embedding space, solving differential equations in embedding space, and predicting unseen edges from a graph's embedding.
0
cs.CRcs.AIcs.SE Mohsen Iranmanesh, Sina Moradi Sabet, Sina Marefat et al. · Oct 14, 2026

Automated vulnerability repair typically validates patches against the same static alerts or proof-of-concept inputs used to generate them, risking overfitting to partial evidence. This paper introduces P2Patch, a counterexample-guided adversarial repair protocol in which an exploitation agent repeatedly tries to bypass the current patch, with each confirmed bypass becoming a permanent repair requirement. The core idea is to treat the patched program itself as a new attack target and to evaluate final patches against held-out security oracles strictly separated from construction-time evidence.

Large language models are increasingly deployed as autonomous agents for automated program repair, patching software vulnerabilities through multi-step reasoning and tool use. Yet these systems typically validate a patch against the same evidence used to construct it -- a static alert, sanitizer trace, published exploit, or test suite. A patch that blocks that one piece of evidence can therefore look successful while remaining vulnerable to the same vulnerability with some variation. We present P2Patch, a generative adversarial repair system that treats each patch as a new attack target. Starting from a normalized vulnerability finding, an exploitation agent constructs a reproducing proof of vulnerability (PoV), a patching agent repairs the program, and the exploitation agent then attacks the patched program for a distinct same-vulnerability exploit. Every successful exploit becomes a permanent repair requirement, and the final patch must block all PoVs accumulated during the patching process, with construction-time PoVs kept strictly separate from held-out evaluation oracles. Across 101 C/C++ and Java CVE subjects, this adversarial loop surfaces a distinct confirmed exploit in 41% of runs after the patch has already blocked its original construction-time PoV. Against single-pass repair from the same finding using Claude Code, P2Patch raises held-out fix-closed coverage from 78.1% to 84.7% and beyond-upstream coverage from 42.1% to 62.5%. Under the same held-out oracles, it also certifies more attack paths as blocked than recent state-of-the-art agentic repair systems on overlapping subjects. These results show that adversarial testing and independent security oracles expose repair gaps that one-shot validation misses.
0
cs.CLcs.AIcs.LG Fei Wu, Zhenrong Zhang, Jianshu Zhang et al. · Oct 14, 2026

On-policy self-distillation gives reasoning models dense token-level supervision via a teacher that sees reference solutions, but this signal can drift toward style and ignores whether the student can finish correctly on its own. VASPO repurposes the same privileged reference inside PPO to train both a prefix-value critic and a bounded self-teacher that reweights selected positive advantages. The paper reports average gains of roughly 2.6 percentage points over PPO on math benchmarks and leading accuracy on Knights and Knaves.

On-policy self-distillation provides dense supervision for reasoning models via a privileged self-teacher. However, this supervision reflects local token preferences rather than the expected return of an unguided student continuation. Recent methods combine this signal with GRPO. They use GRPO for update directions and the teacher for signal scaling. However, we demonstrate a more effective integration within PPO. Specifically, we identify complementary positional dynamics: privileged information enhances a critic's value-prediction accuracy toward the response's end, whereas self-teacher guidance is strong initially, drops mid-generation, and rebounds finally. These insights motivate Value-Augmented Self-Distillation Policy Optimization (VASPO), wherein a self-teacher and critic evaluate identical privileged information at student-generated prefixes. The critic computes token-level PPO advantages from predicted continuation returns, while the self-teacher modulates selected positive advantages via bounded probability ratios. Across six mathematical reasoning benchmarks, VASPO improves mean accuracy over PPO by 2.59 and 1.81 percentage points on Qwen3-4B and OLMo3-7B variants, respectively, and achieves the highest mean accuracy among evaluated methods on Knights and Knaves. Our code is available at https://github.com/cii030/VASPO.
0
cs.CLcs.AI Yunhao Wang, Feng Zhang, Tinghao Yu et al. · Oct 14, 2026

Most synthetic pretraining pipelines generate samples by conditioning on an entire source passage or paragraph and asking a model to rewrite or paraphrase it. The paper identifies a systematic failure mode of this approach: fine-grained facts—such as secondary entities, list and table entries, and precise temporal attributes—are frequently omitted because the generator implicitly selects which facts to preserve. Atomic-Fact-Conditioned Synthesis (AFCS) fixes this by first extracting source-supported atomic facts, then conditioning each synthetic training sample on an explicit retained fact and its local context. Continued-pretraining experiments on 7B and 32B models show consistent gains on factual QA benchmarks, especially for middle- and long-tail knowledge, and granularity ablations isolate synthesis granularity as a causal lever for factual recall beyond surface-form diversity.

Synthetic data is increasingly used in language-model pretraining. Existing knowledge-corpus synthesis pipelines, including WRAP and Nemotron-CC, usually take a source passage or document segment as input and generate rewritten or QA-style samples from that text. This can improve surface form and prompt diversity, but it does not explicitly require fine-grained source facts -- especially secondary entities, list/table entries, and precise temporal attributes -- to appear in the synthesized corpus. We propose AFCS (Atomic-Fact-Conditioned Synthesis), a pipeline that first extracts source-supported atomic facts and then uses each retained fact to drive generation. AFCS uses structure-aware extraction over the document tree, source-grounded verification, local context expansion, and multi-format generation. In continued-pretraining experiments with OLMo-3-7B and a 32B base on the same FineWiki source corpus, AFCS outperforms WRAP and Nemotron-CC on SimpleQA, SimpleQA Verified, PopQA, and HotpotQA. Granularity ablations show that fact-level synthesis improves over chunk-level, paragraph-level, and entity-level synthesis; and a 100B-token mid-training integration improves factual benchmarks and raises the 12-task general benchmark average by +1.09.
0
cs.CLcs.AIcs.LG Davide Baldelli, Robyn Kozierok, Mirko Bronzi et al. · Oct 14, 2026

Probes on hidden activations are a promising tool for detecting deception and harmful intent, but they assume models cannot volitionally alter their own representations. Baldelli et al. ask whether open-weight LLMs can control their activations through in-context neurofeedback, devising a cross-model writer-subject protocol to disentangle genuine self-access from in-context pattern matching. Across 42 semantically opaque readouts and six safety monitors, they find that free-generation effects are largely explained by sentence-selection competence, while fixed-sentence control is tiny and monitor evasion is essentially absent. The results rigorously bound the current threat but flag a capability that may grow with model scale.

Probes on activation vectors are widely used to detect misbehavior in language models, but their success relies on the assumption that models cannot control what their activations encode. Humans can learn, through neurofeedback, to control the firing of even single neurons, and recent studies investigated whether this ability extends to language models, reaching conflicting conclusions. No experimental design so far disentangles competence at the task from genuine access to one's own activations. We fill this gap with in-context neurofeedback sessions, in which a "subject" model is asked to maximize (or minimize) a score derived from its activations, shown back to it at every turn. In our first experiment, the sentences are generated either by the subject or by a second "writer" model, while the score always derives from the activations of the subject. We test ten open-weight models from five families, with sizes from 9B to 32B. Some models move their own scores considerably, but no more than a writer of comparable competence moves them. Is this because the task requires no privileged access, or because the subject controls its activations while processing the sentences, whoever wrote them? To answer this, we prefill a fixed sentence as the subject's reply at every turn and ask it to increase or decrease the score. Three out of ten models show small but consistent control effects. We further ask whether models can control their activations to the point of fooling an activation monitor. We make models repeat sentences a monitor would flag, such as a deceptive answer for a deception monitor, and ask them to raise or lower the monitor's score. No model learns to lower it, but one model can raise it. In-context control of a model's own activations might not yet be a threat to activation monitors, but it exists in a few models and needs to be tracked as models evolve.
0
cs.AI Riccardo Andreoni, Massimiliano Ronzani, Chiara Ghidini et al. · Oct 14, 2026

CGWM targets the opacity of neural world models by forcing latent states to be explicit symbolic concepts grounded from images by a neural encoder. It replaces learned transition dynamics with hand-specified LTLf rules and performs planning via gradient ascent on fuzzy temporal formulas. The key appeal is interpretability and zero-shot transfer under changing dynamics, though the evaluation is limited to small, fully observable deterministic grids.

World models aim to learn compact representations of an environment from observations, enabling agents to predict future states and plan their behaviour. However, most existing approaches learn black-box representations, with limited ability to incorporate prior knowledge about the world. We introduce Concept-Grounded World Models (CGWMs), a neurosymbolic world model design that instead learns interpretable concept representations. We learn these concepts from observations using explicit and complete knowledge, expressed in temporal logic, that specifies the valid world states and the temporal relations governing their dynamics. Furthermore, we directly use this knowledge by formulating planning as differentiable reasoning, optimising the agent's actions by gradient ascent to satisfy a goal. We experimentally compare CGWM with a purely neural baseline and a neurosymbolic baseline on two game environments. We find that CGWMs ground concepts much more accurately, even over long horizons, resulting in significantly more robust planning both in and out of distribution.
0
eess.SPcs.AI Tianyi Ding, Yang Gao, Zhuang Xiong et al. · Oct 14, 2026

Partial-volume (PV) effects blur tissue boundaries in Magnetic Resonance Fingerprinting (MRF), and conventional pipelines rely on multi-stage dictionary matching or statistical segmentation that propagate errors. DeepPV-MRF proposes an end-to-end deep network that directly maps raw, aliased MRF time-series signals to voxel-wise CSF, GM, and WM fraction maps, bypassing intermediate $T_1$/$T_2$ reconstructions. On simulated data the method reports large accuracy gains over dictionary-matching and pseudoinverse baselines, but its real-world evidence rests on synthetic training labels and a small in vivo cohort without ground truth.

Background: Estimating subvoxel tissue fractions from magnetic resonance fingerprinting (MRF) is challenging. Conventional dictionary matching and segmentation pipelines can propagate errors from intermediate parametric maps into tissue fraction estimates. Purpose: We introduce DeepPV-MRF, a deep learning framework that directly estimates voxel-wise tissue fractions from raw MRF signals. Methods: A cascaded spatial-temporal network was trained on subject-derived Bloch simulations with radial k-space undersampling. The network combines temporal encoding and spatial U-Net refinement to estimate cerebrospinal fluid (CSF), gray matter (GM), and white matter (WM) fractions without intermediate T1/T2 maps. We compared DeepPV-MRF with partial-volume dictionary matching (PV-DM) and pseudoinverse estimation (PV-Pinv) using simulated and in vivo data. Results: DeepPV-MRF outperformed both methods across acquisition settings. In single-shot simulations, CSF/WM/GM mean absolute errors were 0.0418/0.0744/0.0757, versus 0.1281/0.2443/0.2958 for PV-DM and 0.2021/0.2793/0.2630 for PV-Pinv. Corresponding structural similarity values were 0.960/0.916/0.922. In vivo results showed sharper anatomical boundaries and smoother tissue transitions, while cross-shot analysis indicated improved consistency across volunteers. Conclusions: DeepPV-MRF enables accurate and efficient direct tissue fraction estimation from MRF signals, particularly with limited shots. Further validation is needed before clinical deployment.
0
cs.LGcs.AI Christos Panourgias, Roberto Stanzione, Adrien Petralia et al. · Oct 14, 2026

Model selection for time-series anomaly detection remains a critical open problem because no single detector dominates across heterogeneous datasets. This paper proposes RAMSAD, a retrieval-based framework that replaces trainable meta-learners with non-parametric similarity search over a knowledge base of past series and their detector-performance profiles. By matching new queries to previously seen instances via time-series foundation model embeddings—optionally augmented with multimodal semantic alignment—the authors argue they can achieve stronger in-distribution accuracy and out-of-distribution robustness at a fraction of the computational cost.

Anomaly detection is a fundamental task for time-series analytics, with important implications for the downstream performance of many applications. Despite the large number of anomaly detection methods proposed in the literature, recent benchmark studies have shown that no single detector performs best across highly heterogeneous time series. Therefore, a practical and scalable solution is to develop a model-selection method that, for a given time series, selects the anomaly detector most likely to perform well. Nevertheless, the model selection approaches proposed in the literature suffer from a significant drop in accuracy when applied in Out-of-Distribution (OOD) settings. In this paper, we tackle the aforementioned limitation and propose RAMSAD, a retrieval-based framework for model selection in time-series anomaly detection. Given a new time series, our method queries a knowledge base of previously observed instances, retrieves the top-k most similar series, and transfers detector recommendations from their performance profiles. The framework can operate with standard similarity measures as well as embedding-based representations. Our results show that RAMSAD outperforms existing baselines in In-Distribution (ID) settings and is the most robust selector in OOD, where, when selecting a small subset of detectors, it matches or exceeds ensembles that run the entire detector pool, at a fraction of their cost. Overall, we demonstrate that similarity-based retrieval constitutes a strong and efficient foundation for model selection in time-series anomaly detection.
0
cs.CLcs.AIcs.LG Jia Tong, Senyou Deng, Min Peng et al. · Oct 14, 2026

Agent skills let frozen models adapt through editable external instructions, but optimizing them faces a tension: batching many changes obscures which edit mattered, while judging each edit only by its immediate score risks discarding useful stepping stones. AtomSearch proposes contrastive atomic editing—one primitive rule edit tied to execution evidence—and Skill-State Tree Search (STS), which tests short edit compositions and keeps a composed state only if it beats its primitive child. The hope is to find compact, inspectable skills without greedy myopia.

Agent skills adapt frozen models through editable external instructions. Revising several rules at once makes changes difficult to inspect, while judging each local edit only by its immediate score can discard useful intermediate states. We introduce AtomSearch, which keeps revision actions local while using subsequent skill states to guide search. Contrastive atomic editing links each primitive rule edit to failed and successful executions, a behavioral hypothesis, and an intended scope. Skill-State Tree Search (STS) evaluates short edit compositions and selectively retains them as executable states that can be revisited and extended. Outcome memory supplies later proposals with observed repair and regression statistics. We evaluate AtomSearch across four tasks and five target models. With deepseek-v4-flash, it exceeds SkillOpt on three of four tasks, including a 9.68-percentage-point gain on LiveMathematicianBench, and SkillOpt's final skills contain 2.3-19.7 times as many characters. In 67% of completed searches, the best validation state passes through an ancestor that was not highest-scoring at its depth. These results show how local rule edits can support the exploration of useful revision paths and yield compact skills, with additional offline evaluations used to explore alternative states.
0
cs.AIcs.CL Dongzhuo Li, Fangzhou Cheng, Weiwei Li et al. · Oct 14, 2026

Standard ReAct agents carry every failed attempt and off-path observation in one linear context, which eventually buries the evidence they need. TreeFlex solves this by saving intermediate states as nodes in a search tree and letting the same language model choose where to resume and what to do next, operating in two roles—Reflection for global navigation and Execution for local work—trained end-to-end with a tree-aware adaptation of GRPO. The paper shows that this design improves accuracy on deep research and software engineering benchmarks, especially on harder tasks, though it comes with higher inference costs and small-scale training.

A ReAct-style agent accumulates observations, intermediate results, and failed attempts in a single context. As this context grows, stale and off-path information consumes its limited capacity and obscures relevant evidence, making focused reasoning increasingly difficult. We introduce TreeFlex, a framework in which the agent's own policy decides where to search. The agent records each intermediate state, with a short summary, as a node in a search tree maintained by the harness. The policy is a single language model that acts in two roles. In the Reflection role, it has a global view of the tree through these summaries and picks a node to resume, together with an instruction. In the Execution role, the harness restores the path that led to that node, and the model carries out the instruction with the usual task tools until it saves a new node or proposes a solution, which Reflection then approves or sends back to another node. Through these choices, the policy decides whether to deepen the current line, branch from or revisit an earlier state, verify a proposal, or stop, without a fixed traversal order or a score for each node. We train navigation, task actions, checkpointing, and proposal review jointly with a tree-aware adaptation of GRPO, using task-level outcome rewards augmented by process rewards. After small-scale RL of a 4B model, with the same active-context limit for all methods, TreeFlex reaches 48.8% accuracy on a challenging deep-research benchmark, versus 41.5% for flat ReAct and 42.8% for FoldAgent, and its Pass@8 is about ten points higher than either. On SWE-bench Verified, with all three systems trained with RL from the same 9B model, TreeFlex resolves 54.9% of tasks, versus 43.3% for FoldAgent and 45.2% for its step-wise variant.
0
cs.LGcs.AI Sifan Yang, Hongyi Tao, Dingzhi Yu et al. · Oct 14, 2026

Training large language models is memory-intensive, and subspace projection methods like GaLore can diverge when stochastic noise dominates the selected low-rank gradient space. This paper proposes SMRC and PMRC, which keep optimizer states in a low-dimensional subspace while adding the orthogonal residual gradient back into the parameter update. The authors prove $O(T^{-1/4})$ convergence rates for momentum SGD and for Muon under a mixed stationarity measure, and demonstrate empirical gains on LLM pretraining and fine-tuning up to $1.3$B parameters.

Memory-efficient subspace optimization has emerged as a practical approach to reducing the memory cost of LLM training while preserving optimization performance. Previous algorithms typically rely on the leading singular subspace of stochastic gradients, yet the gradient noise may dominate the subspace in later training stages and can prevent convergence. To overcome this limitation, we adopt a residual correction framework, which maintains the optimizer states in the subspace and adds the orthogonal residual gradient to the parameter update. We first integrate this scheme into momentum SGD to develop SMRC, which attains an $O(T^{-1/4})$ convergence rate for a fixed orthonormal basis, matching that of full-space momentum SGD. Our analysis introduces a subspace virtual iterate to resolve the coupling between the momentum and the residual correction. Furthermore, we extend SMRC to a multi-stage variant which periodically recomputes bases to track the evolving dominant subspace and retains the same rate. Since each basis refresh breaks the consistency of the virtual iterates, we devise a boundary correction approach that aligns them across stages. Beyond momentum SGD, we incorporate our framework into Muon and propose PMRC, which applies the matrix sign to the projected momentum. Through a weighted momentum tracking analysis that accounts for the residual gradient, we establish an $O(T^{-1/4})$ convergence rate for PMRC, which matches the rate of full-space Muon. We also design a multi-stage PMRC with periodically refreshed bases, which maintains a convergence rate of the same order. Extensive experimental results confirm the effectiveness and efficiency of our algorithms.
0
cs.CLcs.AI Fiorenzo Parascandolo, Enver Sangineto, Xiaoyi Yu et al. · Oct 14, 2026

Length-Conditioned Majority Voting (LCMV) improves LLM reasoning by exploiting the empirical bias that longer chain-of-thought traces are less likely to be correct. Instead of filtering out long responses, it learns a logistic prior over correctness conditioned on CoT length and adapts it at test time using only unlabeled data and pseudo-labels from standard majority voting. The method is model-agnostic, adds negligible computational overhead, and is evaluated across 11 models and 8 benchmarks, making it a pragmatic drop-in replacement for standard MV.

Majority Voting (MV) is a simple and widely used strategy which improves the reasoning accuracy of Large Language Models (LLMs) by allocating additional inference-time computation. Specifically, in MV multiple Chain-of-Thoughts (CoTs) are independently sampled and the most frequent final answer is selected. In this work, we propose Length-Conditioned Majority Voting (LCMV), a Test-Time Training approach which improves MV leveraging an empirical observation that has recently been established in several studies: longer CoTs tend to be associated with a lower probability of correctness. We formulate this inductive bias as a length-conditioned prior probability, which is modeled by a simple logistic function. Moreover, we adapt this prior at test time using only unlabeled testing data and without fine-tuning the LLM. Finally, the adapted prior is used to weight the vote of each sampled answer. Extensive experiments across multiple LLMs and reasoning benchmarks show that LCMV consistently improves over both standard MV and existing length-based and confidence-based aggregation strategies, while retaining the simplicity and model-agnostic nature of MV. Our code is available at: https://github.com/aimagelab/LCMV.
0
cs.AI Yuanfan Li, Junyi Chen, Qi Zhou et al. · Oct 14, 2026

The paper studies Protection Mode: a tendency of frontier language models to prioritize protecting a low-risk living subject over an object facing greater immediate physical damage. The authors introduce ProtectionBench, a controlled benchmark of 285 prompts spanning 34 physical scenarios, and find that models frequently choose the subject first even when correctly assessing the object as higher-risk. This matters for understanding how safety alignment and reasoning interact in high-stakes agent decisions.

Frontier language models excel at complex tasks yet may prioritize protection over larger physical consequences in simple, urgent decisions. GPT-5.6 Sol, for example, moves a girl playing in shallow water before retrieving a submerged camera. We call this Protection Mode and study it with ProtectionBench: 285 prompts, 34 physical families, and nine models. At lowest effort, at least one of four responses prioritizes the subject on 34.74% of Sol prompts and over 83% of MiniMax M3 and Qwen3.5-27B prompts; none of four independent human raters does so. Controls show that choices usually track physical risk. We elicit both risks before requesting an action. Some models assess risk incorrectly; others state the correct ordering but still choose the subject. Qwen3.5-27B with thinking shows 100% correct risk ordering but 57.81% subject choice among eligible conversations on eight selected scenes. Attention audits find no stable reduction in attention to relevant facts; removing the stated risk direction reduces object-first choice in dots3-note-prev but not detectably in Qwen3.5-27B. Adding a general "people or animals before property" rule increases subject choice by 19-38 percentage points, whereas factual reminders favor the object by 0.7-5.2 points. Removing naturally generated versions of that rule lowers subject choice by 10-15 points. We also examine whether post-training introduces this pattern. Base models already show Protection Mode; post-training changes justifications more than choices.
0
cs.ROcs.AI Ziyan Liu, Jiting Liu, Weihong Zhong et al. · Oct 14, 2026

Existing robot policies use a single fixed parameter configuration across all interaction contexts, which forces shared weights to reconcile competing adaptation signals from diverse manipulation operations. MorphAct addresses this by introducing two coupled generators that synthesize context-dependent low-rank updates for the vision-language and action modules, where the action-side generator is conditioned on the adapted visual-language representations. This allows the effective policy weights to morph at each replanning step without test-time optimization or operation labels. Evaluations across three VLA backbones ($\pi_0$, $\pi_{0.5}$, and X-VLA), two simulation benchmarks, and four real-world tasks report closed-loop success gains of up to 16.30%, accompanied by ablations isolating the value of contextual generation and cross-module coupling.

Progress toward general intelligence in the physical world requires scaling robot learning across diverse environments and interactions. However, existing robot policies use shared parameters that remain fixed across interaction contexts. When different operations favor competing parameter adjustments, fitting their mixture can leave individual operations insufficiently adapted. Our atomic-task diagnostics reveal competing update directions in both vision-language and action parameters, with source-improving updates increasing loss on other tasks. This motivates MorphAct, a contextual parameterization framework that dynamically adjusts robot policy parameters as interaction contexts change. Two coupled generators produce context-dependent low-rank updates for the vision-language and action modules. Their coupling follows the policy's computational dependency: vision-language updates shape the representations that condition action-side parameter generation. Both generators are trained jointly through the native action objective, without operation labels or expert-adapter targets. MorphAct improves performance across three VLA backbones on LIBERO and Meta-World, with gains of up to 16.30%. In real-world evaluation, it achieves gains of up to 14% over $\pi_{0.5}$. Ablations support the benefits of contextual parameter generation and representation coupling.
0
cs.AIcs.MA Yuran Wu, Mengkang Hu, Qionglin Qiu et al. · Oct 14, 2026

Long-horizon tasks like real-world software engineering expose the brittleness of monolithic agent loops, where a single model must simultaneously decompose, execute, and verify within one trajectory. LAGO addresses this by treating specialized language agents as temporally extended options—encapsulating role specifications, intra-option policies, termination conditions, and verifiers—that a meta-agent can retrieve from a persistent library or spawn on demand. The core proposition is that this hierarchical scaffold turns task decomposition into a reusable, growing component that requires no weight updates, and the authors report 58.6% on the full 500-task SWE-bench Verified with a frozen Qwen3.5-35B-A3B.

Long-horizon tasks expose a weakness of monolithic tool-use loops: one agent must decompose, execute, and verify a task within a single trajectory. We introduce LAGO, which treats specialized language agents as reusable temporally extended options. A meta-agent retrieves options from a persistent library or spawns new ones, dispatches sub-tasks, verifies results, and admits successful novel options. The library grows across tasks without updating model weights. On 500 SWE-bench Verified tasks, frozen Qwen3.5-35B-A3B in both roles resolves 58.6% under single-attempt evaluation with the official Docker evaluator. On a fixed 150-task subset, we re-run mini-SWE-agent, Terminus 2, and LAGO with the same policy, temperature, task IDs, and evaluator; their resolve rates are 49.3%, 57.3%, and 60.3%, respectively. Cross-model experiments provide evidence consistent with a role for decomposition quality. A 50-task component ablation finds four fewer resolved tasks without decomposition, two fewer with shuffled reused content, and six fewer without the library. These results support reusable agent-options as a practical abstraction for task streams, while leaving component-level causality task- and model-dependent.
0
cs.LGcs.AIstat.ML Amartya Banerjee, Harlin Lee, Caroline Moosm\"uller · Oct 14, 2026

Population dynamics are often observed only as unpaired snapshots, leaving the evolution between measurements fundamentally underdetermined. This paper introduces Neural Wasserstein Splines (NWSP), a method that learns a continuous curve of distributions by penalizing the intrinsic Wasserstein acceleration rather than the acceleration of individual particles, which is representation-dependent. It couples a neural spline generator with a finite-dictionary projection of velocity and its time derivative, achieving competitive results on synthetic and single-cell benchmarks.

Population dynamics are often observed only as unpaired snapshots, which leave the evolution between measurements underdetermined. Second-order regularization can constrain it, but a penalty on the accelerations of sampled particles is a prior on joint particle paths, and different particle representations of the same marginal curve can have different acceleration costs. We therefore introduce Neural Wasserstein Splines (NWSP), a sample-based method that learns a continuous population curve under a Wasserstein smoothness prior. A neural network maps latent variables to the control points of a cubic spline in time, so samples at any time come from the spline basis without numerical integration. We project the generator's velocity onto gradients of a finite dictionary of scalar potentials and differentiate this measure-dependent projection in time, obtaining a finite-dimensional surrogate for the intrinsic Wasserstein acceleration, trained jointly with distributional fit losses. For a fixed dictionary and ridge parameter, we prove that the population penalty depends only on the marginal curve and bound its sensitivity to moment-estimation errors. Learned potentials (NWSP-N) sharpen acceleration estimates. On various synthetic and single-cell benchmarks, NWSP is highly competitive with transport and flow-based methods, ranking in the top two in 11 of 16 settings. The penalty improves on an unregularized spline in 13 of 16 settings and, while competitive with a particle-acceleration penalty, adds provable representation invariance.
0
cs.AI Simon Baur, Sumire Honda, Wojciech Samek et al. · Oct 14, 2026

Reliable uncertainty quantification for reasoning LLMs is expensive when it requires sampling multiple long chain-of-thought traces, and token-level signals collapse or mis-calibrate on deep reasoning. This paper introduces Argument Graph Uncertainty (AGU), a post-hoc framework for multiple-choice QA that segments a single reasoning trace into propositional nodes, scores pairwise and node-to-option relations with a small NLI model, and aggregates the resulting evidence into a Dirichlet posterior over answer options. The concentration of that posterior, expressed as normalized entropy $U_{\mathrm{AGU}}(R) = H_{\mathrm{norm}}$, yields an uncertainty estimate that is cheap to compute and structurally grounded.

Reliable uncertainty estimation is essential for deploying large language models in high-stakes reasoning tasks, yet most existing approaches rely on expensive sampling strategies or shallow token-level signals that ignore the internal logical structure of model outputs. We introduce Argument Graph Uncertainty, a post-hoc framework for multiple choice question tasks, that estimates model confidence directly from the logical structure of a single chain-of-thought reasoning trace. Our method uses either a lightweight instruction-tuned model or a simple deterministic rule to segment the reasoning chain into propositional units, then applies a NLI model to infer relational edges and construct two complementary argument graphs over these segments. The resulting edge scores are aggregated into a Dirichlet posterior over answer options, whose concentration yields calibrated uncertainty estimates reflecting both local step-to-step coherence and global logical consistency across the reasoning trace. Evaluated on GPQA, MMLU-Pro and TruthfulQA, our method consistently surpasses token-based and consistency-based uncertainty baselines across multiple reasoning models. We further demonstrate through extensive combination analyses that argument graph uncertainty captures an orthogonal signal to existing approaches, making it a complementary component in uncertainty ensembles. Crucially, our framework requires no additional calls to the evaluated model and relies entirely on small, efficient auxiliary models, producing fully interpretable, per-node uncertainty attributions at low computational cost.
0
cs.LGcs.AI Wei Chen, Yubing Wu, Zhou Xu et al. · Oct 14, 2026

Hindsight-Privileged RLVR tackles the inefficiency of group-based RLVR methods like GRPO, which require multiple rollouts per prompt and lose their learning signal when all sampled outcomes are identical. The core idea is to replace group comparisons with a single rollout per prompt, using the trajectory's own realized future as training-only privilege: a frozen snapshot of the generating policy scores each token under both causal and hindsight views, and normalized Jensen--Shannon divergence between these full-vocabulary distributions weights a historically centered reward. This yields bounded token-level credit without a learned critic or reference solution, training $1.2$--$2.3\times$ faster than GRPO on Qwen3-8B but with task-dependent accuracy tradeoffs.

Reinforcement learning with verifiable rewards (RLVR) trains language models from checked task outcomes, but assigning a terminal reward to individual reasoning tokens or actions remains difficult. Group-relative methods such as Group Relative Policy Optimization (GRPO) sample several attempts per prompt, but lose their reward-based learning signal when all attempts receive the same outcome. We propose Hindsight-Privileged RLVR (HP-RLVR), a single-rollout method that turns a completed trajectory's own future into token-level update weights. The generating policy snapshot scores each eligible token under its causal history and under a hindsight context containing the realized future and verifier feedback. A normalized Jensen--Shannon divergence between the two views weights the reward relative to a historical baseline, yielding bounded token credit for both successful and failed attempts, with no reference solution or learned critic. In paired Qwen3-8B runs over a shared $100$-step schedule, HP-RLVR trains $1.21\times$, $1.46\times$, and $2.30\times$ faster than GRPO on mathematics, code generation, and ALFWorld, using one eighth the rollouts per prompt. Accuracy is comparable overall, with HP-RLVR ahead on mathematics at all three sizes and GRPO ahead on code and ALFWorld. In ALFWorld, $43.2\%$ (4B) and $49.0\%$ (8B) of GRPO's gradient-norm records are zero, versus none for HP-RLVR.