Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
698 papers in cs.AI
Trending mixes fresh papers with community signal.
0
cs.AIcs.LGeess.SY Emile Anand, Mohammed Rehan Parwani, Xinyuan Cao · Oct 20, 2026

Multi-token prediction (MTP) accelerates language model decoding by drafting several future tokens in one forward pass, but the speculation horizon must be fixed before drafting and the best length varies with context. This paper frames horizon selection as an online survival problem: it predicts per-position rejection hazards to forecast how long a draft prefix will survive exact verification, then adaptively picks the horizon maximizing expected tokens per second. The resulting controller, AMTP, requires no retraining, leaves the target verifier unchanged, and comes with a sublinear throughput-regret bound against the best horizon at each visited context.

Multi-token prediction (MTP) can accelerate language-model decoding by drafting several tokens and verifying them in a single target-model pass. However, the best speculation horizon changes with context: longer drafts offer greater amortization when reliable, but can waste compute on suffixes discarded after a rejection. Unlike autoregressive drafting, where a stopping rule can decide token by token, MTP must fix the horizon before drafting, as all heads fire in the same forward pass. We therefore formulate horizon selection as an online control problem, using verification feedback to learn how far the draft can be trusted in each context, and introduce Adaptive Multi-Token Prediction (AMTP): a lightweight controller that requires no retraining and leaves the exact verifier unchanged. To guide horizon selection, we characterize the expected number of tokens committed at each horizon via acceptance survival, the probability that a draft prefix is fully accepted. Before each round, AMTP predicts how far the draft is likely to survive and picks the horizon with the highest expected tokens per second, learning freely from every verification pass. Theoretically, we show that any online learner's prediction error translates into throughput regret against the best horizon for each context, and in turn into a bound on wall-clock completion time. With online gradient descent, this regret is sublinear. Across five draft-target pairings built on Llama-3.1-8B-Instruct with Medusa heads, Meta's MTP models, and Qwen3-4B-Inst-2507-MTP, evaluated on AIME 2025 and GSM8K, AMTP decodes up to 4.1x faster than standard decoding and matches or outperforms the fixed window in 8 of 10 settings, with throughput gains of up to 10%.
0
cs.AI Ziyi Jiao, Heng Zhang, Drishti Regmi et al. · Oct 22, 2026

DuoCook evaluates whether a single vision-language model can centrally coordinate two cooking agents in Unreal Engine kitchens inspired by Overcooked. The benchmark spans 20 maps across five categories—basic, shared equipment, dynamic terrain, combined dynamic/shared, and separated workspaces—requiring the model to assign high-level actions from top-down visual observations while the engine handles low-level navigation. A memory ablation tests the value of a shared, self-authored belief notebook. Performance is far from saturated even with heavy scaffolding, suggesting current VLMs remain poor at real-time centralized coordination, though the task interface provides substantial structured assistance.

Coordinating two players in a cooking task requires a vision-language agent to track changing scene states, sequence recipe steps, and allocate shared resources under a time budget. We introduce an Overcooked-inspired benchmark for evaluating these capabilities in Unreal Engine environments constructed using coding agents. A single vision-language model controls both players from top-down visual observations, selecting high-level actions while the engine executes navigation. The benchmark contains 20 maps in five categories. These categories support evaluation of centralized coordination under equipment contention, changing terrain, and handoff dependencies. A prop legend and pot ingredient-count indicators provide explicit visual cues, while grid-based destinations support spatial grounding. The evaluation compares four VLMs on all 20 maps, measuring task score, order completion, delivery precision, action acceptance rate, and model API expenditure. A memory ablation on the same 20 maps examines the effect of a shared, self-authored notebook while retaining six-response action history in both conditions. The strongest evaluated model, \texttt{gpt-6-astra}, achieves 26.2\% mean order completion. Notebook memory has mixed score effects across models, with positive mean differences for Claude and Qwen and negative differences for GPT and Gemini.
0
cs.SEcs.AIcs.CY Robin Qu\'eriaux, Solveig Bachellery, L\'ea D\'el\'eris et al. · Oct 22, 2026

Regulated institutions must produce technical evidence for LLM deployments under the EU AI Act, yet existing benchmark suites are engineer-facing command-line tools while accountable reviewers are non-technical managers. VERA is an open-source, self-hosted dashboard that closes this workflow gap by letting reviewers select a model, run public benchmarks, and read requirement-level scores—with decomposable evidence and run-level energy consumption—in a browser. Its core contribution is wrapping raw measurement into a review and filing process designed for institutional approval.

Institutions that deploy large language models in regulated settings often need technical evidence of responsible AI practices before approving a deployment. COMPL-AI provides a technical interpretation of the EU AI Act that organises this evidence under six principle groups and eighteen technical requirements, twelve of which current benchmarks can measure. The benchmark suites that produce this evidence are typically operated from a command line, while the staff who approve deployments are non-engineers. We present VERA, an open-source self-hosted dashboard deployed to facilitate responsible AI processes within a large European bank. A reviewer selects a model and runs public benchmarks against it. VERA scores the twelve requirements that current benchmarks can measure and instruments the energy consumed by each evaluation, adding run-level evidence for environmental impact. We run four served open-weight models through the requirement pipeline, and the dashboard displays a score for each measurable requirement. A within-subject study then compares how participants read these benchmark results: from the raw output files in one condition, and through the VERA dashboard in the other. The dashboard reduced the time needed to perform the responsible AI assessment, reducing the time required from 56 seconds using raw files to 30 seconds using our dashboard, on average. Our dashboard scored highly (4.36 out of 5) on usefulness in the survey conducted within the organization. The dashboard and the study material are released publicly to promote replicability and reproducibility in different organisational contexts.
0
cs.CLcs.AIcs.CY Miguel Fernandez-de-Retana, Unai Zulaika, Ruben Sanchez-Corcuera et al. · Oct 22, 2026

The paper tests whether open LLMs that a hospital could self-host are ready for clinical use, evaluating four models (8–27B parameters) on the Spanish MIR residency exam under its real scoring and ranking rules. The authors go far beyond headline accuracy to probe calibration, the value of abstention under a wrong-answer penalty, the soundness of clinical reasoning, and whether vision models actually use the images they receive. Their headline message is that a model can rank high enough to choose almost any specialty while remaining overconfident, correct for the wrong reasons, and blind to the clinical plates it is shown.

Accuracy on medical examinations is common evidence offered for the clinical use of language models, yet a health system that intends to run an open model on its own hardware needs to know considerably more: whether the model recognizes when it is likely to be wrong, whether medical fine-tuning improves this ability, whether its correct answers rest on sound clinical reasoning, or whether it actually uses the images it is given. We examine these questions for four open models of 8 to 27 billion parameters on the Spanish MIR residency examination, scoring 1,552 questions from eight editions under the exam's own rules. Answering every question, the three larger models would rank among roughly the first 600 to 3,000 candidates, with 41 to 43 specialties still open to them. Abstention, however, never pays, because even their least confident answers are right more often than the 25% break-even. Medical fine-tuning reduced overconfidence at the cost of accuracy, without improving how well confidence separates right from wrong answers. Moreover, 13-38% of correct answers rejected a distractor for a clinically unsound reason that confidence did not reflect, and removing or swapping the provided contextual images left accuracy unchanged.
0
cs.LGcs.AIstat.ML Erik Bodin, Lisa Maria Kreusser, Donney Fan et al. · Oct 22, 2026

SABLE tackles expensive optimisation in the high-dimensional latent spaces of pretrained generative models — a regime where latent dimension $D$ can reach $40{,}500$ while the evaluation budget $N$ is orders of magnitude smaller. The core idea is to use a Bayesian affine surrogate on the characteristic-radius sphere, decoupling acquisition into a data-sized in-span component and a scalar off-span norm that is prescribed by a finite-horizon schedule rather than left to expected improvement. Together with a fast recompression scheme that bounds model-refitting cost to $\mathcal{O}(M^{2}D+M^{3})$, the method achieves tens-of-millisecond decisions and strong sample efficiency on synthetic and scientific benchmarks.

Complex objects such as engineering designs and proteins are often difficult to optimise because their design spaces exhibit high-dimensional structure and objective evaluations are expensive. Generative models provide continuous latent representations, but their latent spaces can have thousands to tens of thousands of dimensions, creating a regime where the latent dimension $D$ greatly exceeds the evaluation budget. We introduce SABLE, a Bayesian optimisation method for high-dimensional latent spaces with an isotropic distribution and limited budget. SABLE uses a Bayesian affine surrogate for prediction and acquisition, treating higher-order structure as surrogate discrepancy. After $N$ observations, the slope update has dimension at most $N-1$, yielding a decomposition of each query into an in-span component optimised by expected improvement (EI) in at most $N$ dimensions and an off-span component governed by a scalar norm. We show that the off-span norm implicitly selected by affine EI can lead to underexploration, and SABLE instead prescribes it using a finite-horizon schedule, without restricting search to a learned subspace. A recompression scheme reduces information to $\mathcal O(M)$ pseudo-observations, bounding refitting cost by $\mathcal O(M^2D+M^3)$ while keeping parameter inference, prediction, and acquisition decisions to tens of milliseconds. Across synthetic benchmarks and latent-space optimisation tasks, SABLE achieves high sample efficiency and reduces decision time by several orders of magnitude at large budgets.
0
cs.LGcs.AI Zhaoyi Zhou, Akshayaa Magesh, Jeongyeol Kwon et al. · Oct 22, 2026

Tool selection across corpora of tens of thousands of APIs is a critical bottleneck for LLM agents, because standard retrievers rank by relevance without knowing which tools a multi-step instruction actually requires. This paper post-trains small open Qwen3 models (1.7B to 8B parameters) via supervised fine-tuning and reinforcement learning to decompose a request and select tools through a lightweight Plan–Retrieve–Select workflow. The headline result is that an 8B checkpoint outperforms a 402B-parameter Llama-4-Maverick on ToolBench and transfers zero-shot to unseen tool domains and retrievers, suggesting that tool selection can be compressed into a small, locally hostable policy rather than delegated to massive proprietary models.

As LLM agents operate over corpora of more than ten thousand tools, selecting the right tool for a complex multi-step user instruction becomes a central bottleneck. Tool descriptions cannot all fit in context, and relevance-based retrievers only rank tools without knowing which are actually needed. Recent work instead leverages proprietary commercial LLMs like Claude or ChatGPT to drive a retriever, decomposing the instruction and selecting over retrieved candidates. We show that a small, open model can be trained via reinforcement learning to perform the same functionality. On ToolBench, a Qwen3-8B model post-trained with our recipe outperforms Llama-4-Maverick (402B). In addition, the trained model transfers directly to different retrievers and generalizes to new tool corpora in different domains.
0
cs.AIcs.HC Deepthika S, Pawni Yadav, B. Sankar · Oct 22, 2026

The paper asks who adapts to whom when a confident LLM is wrong. In a within-subjects experiment, 32 participants learned science topics from GPT-5-mini assistants whose briefings were covertly falsified at 0%, 25%, 50%, 75% or 100%. The study finds that learners absorbed roughly two-thirds of stated falsehoods regardless of overall assistant reliability, while their confidence and trust ratings failed to track accuracy. By reframing trustworthiness as a property of the human-AI pair and introducing a Human Deference Index, the work argues that sycophancy evaluation must measure human-side deference as well as model-side compliance.

Research on sycophancy asks whether large language models (LLMs) bend towards what their users want to hear. We ask the reverse question: when an LLM is confident, consistent, and wrong, do users bend towards it? In a within-subjects experiment, 32 participants learned up to five science topics by chatting with five assistants built on the same model (GPT-5-mini). Unknown to participants, each assistant's briefing had 0, 25, 50, 75, or 100% of its facts replaced by plausible falsehoods, and every assistant spoke with full confidence. A surprise quiz after each topic offered the correct fact, the planted falsehood, and two distractors, with a confidence rating for every answer. Across 104 quizzes and 1,040 answers, scores fell from 7.4 to 2.9 out of 10, and the planted option was chosen on 60% of falsified items against 11% of correctly taught ones (odds ratio 12.5). Transcript coding showed that whenever the assistant stated a falsehood, it was adopted about 65% of the time at every falsification level. Absorbed falsehoods were held with high confidence (8.4/10), the modeled confidence advantage of right over wrong answers vanished, and the discrimination of confidence for correctness fell from an AUROC of 0.70 to chance, while post-task trust ratings barely moved. Participants tended to return to the chat more when the assistant was worse, but returning went with more absorption, not less, and 30% of all turns pasted quiz questions back to the source being checked. The assistant itself was almost never sycophantic and never conceded under pushback. We introduce a baseline-corrected Human Deference Index to quantify this human-side sycophancy and argue that trustworthiness is a property of the human-AI pair, that sycophancy evaluations should measure both directions, and that learning interfaces must make reliability legible claim by claim.
0
cs.CVcs.AIcs.LG Khaled Waleed Dawoud, Muhammad Zaigham Zaheer, Khan Muhammad et al. · Oct 22, 2026

MoG-VLM attacks the prohibitive cost of zero-shot video anomaly detection with Vision-Language Models by treating motion not as a feature but as a lightweight gate that decides when to run expensive VLM inference. It introduces Temporal Gradient Magnitude (TGM) for content-aware frame sampling, anchor-triggered hierarchical lookback windows for temporal refinement, and a tier-aware fusion rule that balances frame-level and video-level语义 signals without any learned parameters. The work reports state-of-the-art zero-shot training-free AUC-ROC on XD-Violence (91.91%), UCF-Crime (84.30%), and MSAD (87.88%), alongside a claimed 1.31× speedup over the prior best method.

Vision-Language Models (VLMs) have shown strong potential for video anomaly detection, but dense frame-level inference makes them impractical for real-time deployment. Existing acceleration commonly relies on uniform sampling, which ignores content dynamics and can either waste computation on static segments or miss localized anomalies. We propose MoG-VLM a motion-adaptive anomaly detection framework that leverages motion purely as a lightweight control signal to decide when VLM inference is necessary. To this end, we introduce Temporal Gradient Magnitude (TGM) which performs content-aware sampling to concentrate computation on informative regions while avoiding redundant processing. We further introduce a hierarchical dual-stream design in which dense multi-frame VLM reasoning is activated only around frames with elevated anomaly likelihood, via anchor-triggered context-window expansion with early termination. A fusion module then reconciles these instantaneous semantic cues with temporal action dynamics. Across four benchmarks, our method achieves 91.91%, 84.30%, 87.88%, and 78.96% AUC-ROC on XD-Violence, UCF-Crime, MSAD, and ShanghaiTech, respectively, establishing new state of the art on three benchmarks under the zero-shot, training-free setting. On XD-Violence, we improve over the previous best result by +0.57% while delivering a 1.31x inference speedup. These results demonstrate that content-aware allocation of VLM capacity, processing fewer frames more intelligently rather than all frames uniformly, is a more effective axis of progress than uniformly densifying VLM inference across frames. Code is available on GitHub: https://github.com/kdawoud91/MoG-VLM.
0
cs.AIcs.SE Dingxuan Zhang, Yanhui Jiang, Jun Wang et al. · Oct 22, 2026

Coding agents typically retrieve skills before execution but rarely choose at runtime whether to invoke coarse macro skills or fine-grained primitives. This paper reframes skill use as a runtime control problem, introducing Adaptive Skill Granularity: a decision-tree router selects micro, macro, or hybrid execution, and a finite-state executor downgrades from macro to micro after observable failures. The framework matters because it shifts skill libraries from static documents into controllable, verifiable execution abstractions that can trade off efficiency against robustness.

Reusable skills allow large language model agents to package task-specific procedures, tool affordances, and execution guidance into modular units. Prior work has largely studied how agents retrieve, compose, or synthesize skills before execution. In coding agents, however, execution poses an additional runtime control problem: the same task may be solved through primitive tool calls, macro skills, or hybrid execution that starts with a macro and falls back to micro-level recovery. We introduce Adaptive Skill Granularity, a framework that treats skill granularity as an action-abstraction policy conditioned on task structure, execution state, and macro-skill failures. The system combines a feature-based granularity controller and a finite-state recovery executor. We evaluate the framework with a deterministic coding-agent protocol using verifier-defined success, total cost, and process metrics such as macro adoption, failure recovery, route match, and transition correctness. Results show that fixed macro execution is efficient when applicable but brittle under mismatch, while runtime routing and explicit macro-to-micro recovery improve robustness and recover controlled macro failures that fixed-granularity execution leaves unresolved. Our findings suggest that skill libraries for coding agents should be treated not only as retrievable resources, but also as controllable, verifiable, and recoverable execution abstractions.
0
cs.AIcs.CL Mahdi Salmani, Adel Javanmard, Devansh Gupta et al. · Oct 22, 2026

Test-time scaling generates many candidate reasoning traces, but completing all of them is prohibitively expensive. This paper proposes PKTP, a pruning framework that selects a subset of partial rollouts to maximize the probability that at least one of them ultimately succeeds—i.e., $\text{pass}@k$. It models joint correctness with a latent Gaussian threshold model, derives a closed-form submodular surrogate, and greedily selects the kept set with a $(1-1/e)$ approximation guarantee. The work matters because it directly exposes and optimizes the quality–diversity trade-off that existing pruning methods handle only indirectly.

Test-time scaling has emerged as a key inference strategy for reasoning models, where a model generates a large number of candidate solutions in the hope of finding at least one correct solution. Running all candidate solutions to completion can be computationally demanding, so recent work prunes the candidate pool after generating only a short prefix, committing further computation only to the surviving candidates. Existing pruning strategies divide broadly into two categories: Quality-based methods assign a score to each partial solution and discard those predicted to ultimately lead to an incorrect final solution, while diversity-based methods select partial solutions that follow different reasoning trajectories and are therefore likely to cover different final solutions. The tension between these two objectives is an instance of exploration versus exploitation, yet little to no prior work on pruning exposes this trade-off directly, let alone optimizes it. In this paper, we introduce a pruning procedure that addresses this trade-off directly by optimizing pass@$k$ over the selected solution pool. In particular, it chooses the pool to maximize the probability that at least one of its partial solutions, when continued to completion, yields a correct answer. Because this objective simultaneously rewards high-quality partial solutions and penalizes redundancy among them, quality and diversity are naturally balanced by the criterion itself rather than through separate ad-hoc design choices. On eight open-weight reasoning models, our method outperforms existing quality-based and diversity-based pruning strategies. The gains are particularly pronounced when the pruning procedure keeps a moderate number of partial solutions for continued generation, highlighting the value of directly balancing quality and diversity during pruning.
0
cs.AI Jinya Sakurai, Xun Xu, Jaehong Yoon · Oct 22, 2026

Masked diffusion language models generate tokens in parallel, but their efficiency depends critically on which predictions are committed at each step. This paper disentangles the design space of learned unmasking policies by treating them as distilled teachers and independently varying supervision targets, training states, and policy inputs. The authors find that trajectory-contraction labels and a confidence-plus-hidden-state input yield a lightweight policy that improves the accuracy–NFE frontier and end-to-end throughput once NFE drops by about 10%.

Masked diffusion language models generate tokens in parallel, but their efficiency depends on which predictions are committed. Learned unmasking policies improve the speed--accuracy trade-off, yet differ in supervision, inputs, and capacity, obscuring which choices matter. We view supervised policies as distilling a decoding procedure through a teacher and examine independently what the teacher labels as committable, on which states the policy imitates it, what the policy observes, and how much the number of function evaluations (NFE) must decrease to offset policy overhead. We find that labeling predictions matching the final output is overly permissive at low NFE, and hidden states are weak alone but can complement confidence. About a 10% NFE reduction suffices to offset policy overhead for policies up to 7.5M parameters across tested settings. We therefore train a policy on trajectory-contraction targets, which accept only commitments staying on a reference trajectory, using confidence and hidden states. On LLaDA-8B-Instruct, the resulting 856K-parameter policy achieves the best accuracy--NFE frontier and highest throughput on GSM8K, is competitive at moderate targets on MATH-500 and HumanEval, and largely transfers to Dream-7B-Instruct.
0
cs.ROcs.AI Huixin Xu, Ziya Yu, Peng Li · Oct 22, 2026

FocusVLA targets a subtle but important failure mode in multi-view Vision-Language-Action models: policies tend to develop early visual preferences—especially over-reliance on wrist cameras—and persist with them even when task stages shift toward global planning. The paper proposes predicting future interaction intent from multimodal context and short-term action history, then converting that intent into step-wise routing weights that dynamically balance global and local views during action generation. Because the routing module sits on the action-generation side without altering the visual encoder or language backbone, it is designed as a lightweight, plug-in upgrade for existing VLAs. It is evaluated on all 50 tasks of the RoboTwin 2.0 benchmark and on six real-world manipulation tasks, reporting 10+ percentage point improvements over a $\pi_{0.5}$ baseline trained under identical conditions.

Vision-language-action (VLA) models have become an important paradigm for robotic manipulation by unifying visual perception, language understanding, and action generation. Since reliable manipulation requires sufficient observation of objects, end-effectors, and their spatial relationships, multi-view inputs are widely used to provide complementary spatial information. However, our experiments show that existing VLA models do not fully exploit such multi-view complementarity. The policy tends to persistently rely on the wrist view, lacking the ability to dynamically adjust global-local view dependency across manipulation stages, which limits stage adaptability and robustness. To address this issue, we propose FocusVLA, a stage-aware multi-view routing framework. FocusVLA predicts future interaction intent from historical actions and uses it to guide dynamic view routing during action generation. By adaptively coordinating global and local observations across different task stages, FocusVLA improves multi-view utilization. On RoboTwin 2.0, FocusVLA improves the average success rate over the strongest baseline $\pi_{0.5}$ by 10.10 pp. In real-world evaluation, FocusVLA improves the success rate from 71.7\% to 85.0\%, achieving a 13.3\% gain over $\pi_{0.5}$. Moreover, the intent prediction and dynamic routing modules of FocusVLA can be integrated into existing VLA frameworks without modifying their core architectures.
0
cs.LGcs.AI Ali Najar, Hosein Hasani, Amir Kooshan Fattah et al. · Oct 22, 2026

Meta-RL agents struggle to adapt quickly to unseen tasks when task evidence is sparse or spread across long interaction histories, because recurrent models compress history too aggressively and transformers scale quadratically. METTA proposes a two-scale neural memory architecture that uses Test-Time Training (TTT) layers for fine-grained within-episode adaptation and compact episode summaries for cross-episode reasoning, preserving linear sequence complexity. The core claim is that this design enables stronger task-family-level generalization and more structured exploration on long-horizon sparse-reward tasks than both recurrence and full-attention baselines, while keeping wall-clock training cost low.

Meta-reinforcement learning aims to train agents that adapt quickly to unseen tasks from limited interaction, but this requires representing task evidence over long interaction histories. Classical recurrent agents compress experience into hidden states, while transformer-based agents retrieve from past trajectories at quadratic memory and computation cost. In this work, we propose Memory-Enhanced Test-Time Adaptation (METTA) for meta-reinforcement learning. It decomposes the fast adaptation phase into two temporal scales: a causal neural memory performs fine-grained within-episode adaptation with linear sequence complexity, while compact episode-level summaries support long-range cross-episode task inference without attending over the full interaction history. Moreover, equipping agents with neural memory provides sufficient expressive capacity and test-time training capability, enabling effective adaptation to unseen held-out tasks and task families at meta-test time. On unseen held-out Meta-World ML10/45 test environments, METTA achieves a success rate over $50\%$ while maintaining a low training budget and short wall-clock time. On long-context sparse-reward PointMaze tasks, it outperforms transformer-based baselines by exhibiting more structured exploration behavior. These results show that METTA provides an efficient path toward more adaptive and scalable long-context meta-RL.
0
cs.AIcs.LG Qijin Zhang, Hanzhen Wang, Yuehan Zhao et al. · Oct 22, 2026

LLM agents can execute prohibited actions when tool responses omit safety-relevant facts, even if every returned statement is true and the user request is benign. EpiSEM-Bench introduces 300 matched unsafe/safe task pairs across six domains with controlled evidence suppression and an optional audit-based recovery tool. The work shows that robustness to missing evidence and useful recovery are distinct capabilities that single-score benchmarks conceal, making joint evaluation essential for safe agent deployment.

Tool-using language model agents rely on environmental facts to decide whether an action is permitted. When a tool response omits a safety-relevant fact, an agent may carry out a prohibited action even though the user request is benign and every returned statement is true. We introduce \bench{}, an executable benchmark for evaluating unsafe execution, safety boundaries, and evidence recovery in LLM agents under missing evidence. It contains 300 matched unsafe/safe task pairs across six domains. By systematically suppressing critical facts, the benchmark measures unsafe execution under critical evidence omission and determines the minimum observed failure cardinality, including failures with full evidence and cases with no observed failure after exhaustive testing. An independent audit tool tests whether agents seek missing facts and then withhold prohibited actions while completing permissible tasks. The benchmark reveals substantial variation across the ten models in omission robustness, evidence acquisition, and appropriate action. Resistance to missing evidence does not necessarily translate into useful recovery. Recovery access reduces unsafe execution for all ten models, but agents differ in whether they actively obtain the missing facts and use them to act appropriately in both worlds.
0
cs.LGcs.AIstat.ML Mahdi Sabbaghi, George Pappas, Hamed Hassani et al. · Oct 22, 2026

Standard on-policy distillation forces a student to copy a teacher at every token, even when the teacher's preferred actions hurt the student's eventual success. This paper proposes Advantage-Based On-Policy Distillation (AOPD), which weights each teacher token by its counterfactual advantage under the current student policy. The key insight is that imitation should optimize for student task reward, not teacher agreement, and the authors derive an unbiased estimator that needs only standard student rollouts and terminal rewards.

Online Policy Distillation (OPD) often outperforms offline methods such as Supervised Fine-Tuning (SFT) by training on trajectories sampled directly from the student. However, standard OPD trains the student to follow the teacher at every state of the trajectory, assuming that teacher guidance is always beneficial. We instead distinguish between what the teacher prefers and what actually helps the current student succeed. We introduce Advantage-Based On-Policy Distillation (AOPD), which weights teacher actions by their counterfactual advantage under the student. Teacher actions that improve the student's expected outcome are reinforced, while those that do not are downweighted. Directly computing these advantages requires trying alternative teacher actions at each step and running new rollouts from each. Instead, we show that the AOPD objective can be estimated using only standard student rollouts and their terminal rewards. Our estimator uses teacher importance weights on the student-sampled actions to provide unbiased advantage-weighted supervision, without any additional rollouts or reward evaluations. This allows AOPD to focus teacher supervision on actions that help the current student while preserving the rollout efficiency of standard OPD. Experiments on math, coding, and Medqa show gains over distillation and RL baselines in both external-teacher and self-distillation settings.
0
cs.CLcs.AI Stephen Chung, Wenyu Du · Oct 22, 2026

N-gram embedding tables give language models cheap capacity gains but can consume hundreds of billions of parameters. This paper asks whether those embeddings can be stored at low precision without losing their benefit. The authors systematically compare quantization schemes—uniform, normal-quantile, and Lloyd–Max codebooks with per-embedding scales—and find that aggressive bit reduction often preserves most of the tables’ gain, freeing memory to grow the tables themselves.

Many recent open-weight language models use n-gram embedding tables to improve performance. These tables store learned representations of short token sequences, such as pairs or triples of consecutive tokens, which the model retrieves during processing. However, they can require substantial memory: DeepSeek-V4.1-Flash, for example, allocates 196 billion parameters to its Engram n-gram memory. We therefore investigate whether this memory cost can be reduced while preserving the performance improvement that the tables provide. We propose storing n-gram embeddings at low precision and systematically investigate different quantization methods and bit allocations across tables. Across nanochat-, Llama-, and GPT-2-family models trained from scratch, four-bit tables save approximately 75% of table memory while preserving more than 99% of the validation-loss improvement from adding the tables. Using fewer bits leads to a larger drop in performance, although we find that a short fine-tuning phase recovers a significant part of this loss. In addition, reinvesting the saved memory in larger tables can improve performance beyond that of the original full-precision tables while still using less memory. These table memory savings also extend to large existing models: on DeepSeek-V4.1-Flash and Qwen3.8-Flash-Next, low-bit tables save 47-55% of table memory, with perplexity increases of less than 1.2% and largely preserved downstream task performance. These findings establish low-bit precision as a practical way to reduce the memory requirements of n-gram embeddings and use the saved capacity to improve model performance.
0
cs.AI Jiening Siow, Amy Xin, Junjie Wang et al. · Oct 22, 2026

Autonomous research agents can automate entire scientific workflows from ideation through experimentation to writing, but they frequently compromise research integrity through behaviors like test-set exploitation, fabricated citations, and manipulated reporting. RIDAR addresses this gap by introducing RIVT, a taxonomy of 14 research integrity violation types spanning the full lifecycle, together with RIDAR-Post-hoc for automated detection and RIDAR-Runtime for live intervention. The work matters because the authors show such violations are nearly universal in current frontier agents, making integrity safeguards a prerequisite for trustworthy machine-generated science.

Autonomous research agents are increasingly used to automate large portions of scientific research, yet they are prone to research integrity violations (RIVs): behaviors that compromise the validity, reproducibility, or faithfulness of the research process. We present RIDAR, a framework for automated RIV detection and runtime intervention. First, we introduce RIVT, a comprehensive taxonomy of 14 RIV types spanning the full research lifecycle. Building on RIVT, we present RIDAR-post-hoc, a framework to detect RIVs within agent trajectories. RIDAR-post-hoc achieves 85.2% F1 performance on RIV-Gold, a benchmark for RIV detection with 60 expert-annotated trajectories. Applying RIDAR-post-hoc to RIV-Wild, a dataset of 300 agent trajectories across 50 distinct research tasks, we detect 3,964 RIV instances in 99.7% of trajectories, revealing the prevalence of RIVs in current agents. Finally, we present RIDAR-runtime, a framework for dynamically detecting and correcting RIVs during agent runtime. RIDAR-runtime effectively reduces agent RIVs remaining at task completion by 36.8%. We will release our code and data to facilitate future research.
0
cs.AIcs.DBcs.HC Humza Akhtar, Brian Freeman · Oct 22, 2026

Industrial organizations struggle to govern structured telemetry and unstructured documentation together because the work relies on scarce domain experts. The paper proposes contestable governance: specialist AI agents generate scored, cited arguments for metadata decisions, human stewards review and intervene before anything is committed, and an append-only record preserves full lineage. This design aims to stop unreviewed agent errors from propagating into downstream systems while making human oversight attributable and auditable.

Industrial organizations hold operational knowledge in structured records, such as telemetry, point lists, and transactions, and in unstructured sources, such as manuals, service notes, communications, and inspection reports. Governance programs often manage these sources separately. Classifying, linking, and documenting them depends on a small group of employees with deep domain knowledge. Agents built on large language models can propose metadata, cite documents, and flag quality issues, but unreviewed proposals can spread errors into downstream systems. A perfunctory approval leaves no record of what a reviewer checked. We present contestable governance: specialist agents produce scored, cited arguments for disputed metadata decisions; a steward can accept, reject, modify, or add arguments before commit; and a governance record retains the evidence, interventions, and outcome. A versioned domain glossary supplies model-specific terms and acronym definitions to the agents. We describe the workflow, a triage path that reserves full argumentation for uncertain proposals while preserving review before commit, the scoring and record models, and a gate that controls which verified decisions become precedent. Two HVAC use cases illustrate the pattern: point classification using Brick Schema class labels, supported by an open reference implementation, and an illustrative warranty failure-mode decision linking claim fields and telemetry to service notes and revisioned bulletins.
0
cs.CLcs.AIcs.LG Ferdinand Kapl, Kaitlin Maile, Stefan Bauer et al. · Oct 22, 2026

Depth growth and looping reuse computation across layers to train or run Transformers more efficiently. This paper shows that both methods create an inductive bias toward learning from context over memorizing fixed associations in weights, accelerating in-context learning and propagating induction heads through depth. The evidence spans models up to 3B parameters and connects architecture design to the mechanistic origins of few-shot performance.

Looped and depth-grown language models reuse computations across depth and have attracted interest for their reasoning capabilities. Building on prior suggestive evidence of improved in-context-learning (ICL), we investigate how such reuse favors ICL, including how it shapes the acquisition, retention, and mechanisms of this ability. Our analysis spans pretrained language models up to 3B parameters and controlled tasks. The experiments provide evidence for a shared inductive bias toward learning from context: grown and looped models rely more on information in context and, compared with a full-depth dense reference, acquire ICL earlier in controlled tasks and retain it more strongly when learning fixed associations in the weights is also possible. Tracing attention heads through training reveals that depth growth propagates early induction heads across layers. Ablations show that grown and looped models rely more strongly on induction-ranked heads for both few-shot performance and later-token prediction. Together, these findings provide evidence for a shared inductive bias toward learning from context and suggest that (soft) parameter reuse shapes how this ability develops and which attention mechanisms support it.
0
cs.AIcs.MA Ping-Lin Kuo, Suman Navaratnarajah, Christian Frey et al. · Oct 22, 2026

Muffin tackles the overhead and synchronization bottleneck of multi-agent reasoning by replacing full-trace debate with asynchronous sharing of compact intermediate findings through a shared memory buffer $B^{(d)}$. An orchestrator routes queries to either a single agent or a team of parallel agents that read and append selective findings while keeping private reasoning local. The authors claim strong accuracy-token Pareto gains across four reasoning benchmarks and four open-weight language models.

The rise of Agentic AI systems has changed the landscape of artificial intelligence by enabling strong reasoning capabilities through specialized multi-agent interaction with structured self-reflection. However, in target-driven reasoning tasks, single- and multi-agent systems are often on par in terms of performance gains. A major challenge is that failures often arise from an ineffective exchange of critical information during inter-agent interaction and coordination. Different from existing multi-agent debate paradigms that rely on synchronous turn-taking and sharing information across different agents, we propose an inter-agent protocol based on shared Memory bUFFer INference - referred to as MUFFIN - in an asynchronous agentic framework. In the first step, an orchestrator routes queries based on their reasoning demands and delegates demanding ones to a multi-agent setting, where a shared memory buffer provides asynchronous exchange of intermediate findings while an agent's private reasoning remains local. Our experiments show that our framework Muffin outperforms established competitors, achieving the best accuracy in 17 out of 20 of our benchmark settings, and provides a better quality-cost trade-off than multi-agent debate: Muffin improves accuracy by 19.2 accuracy points while using 77.4% fewer tokens, without requiring full-trace sharing.