Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
1579 papers
Trending mixes fresh papers with community signal.
0
cs.CLcs.LG Tardelli Ronan Coelho Stekel · Oct 22, 2026

Language models are increasingly used for discrete decisions like tool selection or intent classification, yet prompting LLMs for these closed-set choices is slow and sensitive to option order. This paper introduces Crivo, a family of compact encoders scaling from 17 million to 1 billion parameters, and runs a controlled study to determine whether scoring each option in a separate encoder pass outperforms reading all options jointly in a single sequence. The work matters because it tests the limits of parameter efficiency and architectural choices for high-speed decision nodes that must generalize across changing label sets.

Many language-model pipelines end in a closed-set decision, such as selecting a tool. Prompting a large language model for it is slow and order-sensitive. We ask how small an encoder for such decisions can be and whether it should read the options jointly or separately. In a three-seed study at 32 million parameters, per-option scoring beats joint scoring on a held-out sample of a 37-benchmark decision suite by 5.8 points of chance-corrected skill at matched optimizer steps and by 2.8 at approximately matched training compute; two external benchmarks agree, though not significantly on their unseen tasks. Crossing reader with initialisation shows that the advantage requires a reranker initialisation, whose query-candidate pair input matches per-option reading; from the raw encoder the two readers are indistinguishable. Per-option scoring needs 5 to 13 times more encoder passes: at most twice the median latency, but more than four times the mean. Of six released joint encoders (17 million to 1 billion parameters), the 68- and 150-million-parameter models exceed a 435-million-parameter DeBERTa-v3 zero-shot classifier by 4.9 and 5.9 accuracy points on 209 overlap-audited System1-Arena tasks and are at least on par with it on the 145 tasks unseen in training. The smallest answers a median request in 14 milliseconds on 16 processor threads, against 728 for the classifier. Reordering options changes 12 to 23% of the joint models' answers (per-option scoring: none). Up to 68 million parameters, they lead their size range on a public leaderboard's private, mainly in-distribution tests.
0
cs.CRcs.LG Tran Minh Thanh, Vo Hoai Viet · Oct 22, 2026

This paper proposes an adaptive framework for cryptographic primality testing that integrates arbitrary-precision arithmetic, hardware-aware sieving, and a machine-learning-guided Miller-Rabin witness selector anchored on quantum entropy. The core idea is to reduce expensive modular exponentiations by using lightweight structural features of a candidate integer to prioritize bases likely to expose compositeness early. It targets the key-generation bottleneck for RSA and ECC, yet the contribution is more architectural than empirically demonstrated, resting heavily on a withdrawn survey and a toy Python benchmark.

The security of modern public-key cryptographic systems, such as RSA, Diffie-Hellman, and ECC, depends entirely on the computational intractability of the integer factorization and discrete logarithm problems. For these asymmetric algorithms to operate, a core requirement is that the system must be capable of generating, testing, and simultaneously proving the primality of extraordinarily large numbers. To meet those requirements, this study proposes a comprehensive framework, bridging clas- sical number theory with modern machine learning models and optimization algorithms. Specifically, the paper delineates an adaptive, arbitrary-precision architecture dedicated exclusively to primality testing. Concurrently, the research deeply analyzes the theoretical foundations of testing methods (both deterministic and probabilistic), hardware-level optimization techniques, and the application of quantum-secured entropy sources, while providing rigorous mathematical proofs to guarantee security even when the prime distribution is biased.
0
cs.LG Haolin Liu, Chen-Yu Wei, Julian Zimmert · Oct 22, 2026

This paper initiates the statistical theory of reverse-KL policy distillation under misspecification, asking whether the teacher's full action distribution improves efficiency over action-level feedback and whether online student trajectories are necessary versus offline teacher data. The authors establish minimax-optimal rates for full-feedback settings, develop clipped importance-weighting and trajectory-truncation algorithms, and prove a striking separation: offline action feedback can match full-feedback rates, while online action feedback requires exponentially more data. The results give a first theoretical footing for empirical design choices in modern LLM distillation.

Reverse Kullback-Leibler (KL) distillation has shown empirical promise for training language models, but its statistical guarantees and limits remain poorly understood. In particular, the effects of two design choices remain unclear: Does access to the teacher's full action distribution provide an advantage over observing only the probability it assigns to the sampled action? Must training trajectories come from the student (online distillation), or can teacher-generated trajectories (offline distillation) suffice? Our work takes a first step toward understanding the theory underlying these questions. We study the sample complexity of online reverse-KL distillation under two feedback models: the teacher reveals either its full action distribution or only the probability of the student-generated action. We establish minimax bounds for the former and show that substantially more data may be required for the latter. In contrast, offline reverse-KL distillation can attain the same minimax rate whether the teacher reveals its full distribution or only its probability of the teacher-generated action. The key distinction is that teacher-generated actions themselves reveal the teacher's preferences, while queries at student-selected actions can leave those preferences unobserved. This highlights an additional statistical challenge for online distillation compared to offline distillation. These statistical guarantees do not follow simply from optimizing standard distillation objectives: our lower bounds show that common online objectives can fail when candidates are evaluated only on past student-generated trajectories. We develop trajectory-loss and importance-ratio truncation techniques together with policy-space learning to achieve optimal online distillation guarantees.
0
cs.LGcs.IR Jialin Lu, Xiaoyu Liu, Hengrui Luo et al. · Oct 22, 2026

As Mathlib grows past 400,000 theorems, effective semantic search is critical for both human formalization and automated proving, yet real-world queries are short and ambiguous while existing engines train on lengthy, context-rich informalizations. Lean Finder V2 closes this gap with an adversarial generator-retriever loop that synthesizes over 600,000 faithful, challenging short queries, then uses them for both retriever fine-tuning and GEPA-optimized input rewriting. The result is a new state of the art on human-curated and real-world benchmarks, plus measurable gains in downstream theorem-proving tasks.

We introduce Lean Finder V2, a semantic search framework for Mathlib that disambiguates user queries through complementary model-level adversarial training and input-level query rewriting. Human mathematicians and coding agents rarely search Mathlib by providing detailed context. In practice, they query short properties, notation, aliases, or hypotheses, leaving much of the intended mathematics implicit. In contrast, existing Mathlib search engines unrealistically assume context-rich queries. The scarcity of real-world short queries paired with ground-truth Mathlib statements makes this ambiguity even more intractable. We argue that this is essentially a data problem. Through adversarial training, we scale up the generation of labeled short and ambiguous queries, and learn to disambiguate user queries at both model-level fine-tuning and input-level query rewriting. On the human-curated MathlibQR benchmark, our Lean Finder V2 sets a new state of the art, with at least 11% relative improvement over the previous best Mathlib semantic search engines. On top of our state-of-the-art retriever, optimized query rewriting further improves MathlibQR retrieval. On unlabeled queries from human and coding-agent interactions, Lean Finder V2 is ranked as the strongest system. Integrated with Claude Code, Lean Finder V2 improves proof success on downstream theorem-proving task. Lean Finder V2 is available at: https://leanfinder.github.io/
0
cs.ROcs.AI Huixin Xu, Ziya Yu, Peng Li · Oct 22, 2026

FocusVLA targets a subtle but important failure mode in multi-view Vision-Language-Action models: policies tend to develop early visual preferences—especially over-reliance on wrist cameras—and persist with them even when task stages shift toward global planning. The paper proposes predicting future interaction intent from multimodal context and short-term action history, then converting that intent into step-wise routing weights that dynamically balance global and local views during action generation. Because the routing module sits on the action-generation side without altering the visual encoder or language backbone, it is designed as a lightweight, plug-in upgrade for existing VLAs. It is evaluated on all 50 tasks of the RoboTwin 2.0 benchmark and on six real-world manipulation tasks, reporting 10+ percentage point improvements over a $\pi_{0.5}$ baseline trained under identical conditions.

Vision-language-action (VLA) models have become an important paradigm for robotic manipulation by unifying visual perception, language understanding, and action generation. Since reliable manipulation requires sufficient observation of objects, end-effectors, and their spatial relationships, multi-view inputs are widely used to provide complementary spatial information. However, our experiments show that existing VLA models do not fully exploit such multi-view complementarity. The policy tends to persistently rely on the wrist view, lacking the ability to dynamically adjust global-local view dependency across manipulation stages, which limits stage adaptability and robustness. To address this issue, we propose FocusVLA, a stage-aware multi-view routing framework. FocusVLA predicts future interaction intent from historical actions and uses it to guide dynamic view routing during action generation. By adaptively coordinating global and local observations across different task stages, FocusVLA improves multi-view utilization. On RoboTwin 2.0, FocusVLA improves the average success rate over the strongest baseline $\pi_{0.5}$ by 10.10 pp. In real-world evaluation, FocusVLA improves the success rate from 71.7\% to 85.0\%, achieving a 13.3\% gain over $\pi_{0.5}$. Moreover, the intent prediction and dynamic routing modules of FocusVLA can be integrated into existing VLA frameworks without modifying their core architectures.
0
cs.LGcs.AI Ali Najar, Hosein Hasani, Amir Kooshan Fattah et al. · Oct 22, 2026

Meta-RL agents struggle to adapt quickly to unseen tasks when task evidence is sparse or spread across long interaction histories, because recurrent models compress history too aggressively and transformers scale quadratically. METTA proposes a two-scale neural memory architecture that uses Test-Time Training (TTT) layers for fine-grained within-episode adaptation and compact episode summaries for cross-episode reasoning, preserving linear sequence complexity. The core claim is that this design enables stronger task-family-level generalization and more structured exploration on long-horizon sparse-reward tasks than both recurrence and full-attention baselines, while keeping wall-clock training cost low.

Meta-reinforcement learning aims to train agents that adapt quickly to unseen tasks from limited interaction, but this requires representing task evidence over long interaction histories. Classical recurrent agents compress experience into hidden states, while transformer-based agents retrieve from past trajectories at quadratic memory and computation cost. In this work, we propose Memory-Enhanced Test-Time Adaptation (METTA) for meta-reinforcement learning. It decomposes the fast adaptation phase into two temporal scales: a causal neural memory performs fine-grained within-episode adaptation with linear sequence complexity, while compact episode-level summaries support long-range cross-episode task inference without attending over the full interaction history. Moreover, equipping agents with neural memory provides sufficient expressive capacity and test-time training capability, enabling effective adaptation to unseen held-out tasks and task families at meta-test time. On unseen held-out Meta-World ML10/45 test environments, METTA achieves a success rate over $50\%$ while maintaining a low training budget and short wall-clock time. On long-context sparse-reward PointMaze tasks, it outperforms transformer-based baselines by exhibiting more structured exploration behavior. These results show that METTA provides an efficient path toward more adaptive and scalable long-context meta-RL.
0
cs.LG Xu Wang, Shuhan Yi, Zhen Cheng · Oct 22, 2026

Wrist PPG heart rate monitoring is vulnerable to motion artifacts, and naively applying corrections can lower average error while damaging individual windows. This paper proposes a selective correction framework organized as an agent around a fixed core estimator: signal-analysis modules extract pulse and motion evidence, a temporal memory module generates candidate heart rates, and a decision module predicts each candidate's benefit and harm before a separate risk gate chooses to retain, correct, or reject the output. The authors train the auxiliary modules on PPG-DaLiA and evaluate frozen weights on three additional public datasets plus a prototype wearable stream, reporting macro-averaged MAE reductions up to 44.5%. The core idea—explicitly trading off predicted gains against harms rather than universally replacing estimates—is a clear contribution to wearable heart rate analysis, though deployment readiness is weakened by calibration transfer failures and an extremely limited prototype.

Wrist photoplethysmography (PPG) heart rate estimates are vulnerable to motion artifacts, and corrections that reduce mean error can worsen individual windows. We propose an agent architecture with tools and memory around a fixed heart rate estimator. Pulse, motion, and limited historical evidence generate candidate estimates, whose predicted benefits and harms guide selection. An independent risk gate determines whether to retain, correct, or reject each output. We trained the architecture on PPG-DaLiA and tested it on Wrist Exercise, GalaxyPPG, and WildPPG with frozen weights. Across these four public datasets, mean absolute error (MAE), macro-averaged over ten estimators, decreased by up to 44.5%, with the largest reduction on GalaxyPPG. Beneficial and harmful corrections decreased and increased absolute error by more than 1 bpm, respectively. Their ten-estimator macro-averaged proportions ranged from 16.06% to 36.64% and from 1.68% to 6.77%, respectively, across the four datasets. At 60% and 80% target coverage, numerical correction on the same accepted windows contributed more to total error reduction than window selection. We implemented real-time wearable acquisition, Bluetooth reception, and smartphone deployment of a selected estimator and the framework. In backend analysis of four prototype recordings from one participant, ten-estimator macro-averaged MAE decreased from 9.09 to 4.45 bpm without additional rejection. Under the evaluated conditions, the architecture improved average accuracy while quantifying correction benefits and harms, supporting wearable heart rate analysis that considers error, correction risk, and coverage.
0
cs.AIcs.LG Qijin Zhang, Hanzhen Wang, Yuehan Zhao et al. · Oct 22, 2026

LLM agents can execute prohibited actions when tool responses omit safety-relevant facts, even if every returned statement is true and the user request is benign. EpiSEM-Bench introduces 300 matched unsafe/safe task pairs across six domains with controlled evidence suppression and an optional audit-based recovery tool. The work shows that robustness to missing evidence and useful recovery are distinct capabilities that single-score benchmarks conceal, making joint evaluation essential for safe agent deployment.

Tool-using language model agents rely on environmental facts to decide whether an action is permitted. When a tool response omits a safety-relevant fact, an agent may carry out a prohibited action even though the user request is benign and every returned statement is true. We introduce \bench{}, an executable benchmark for evaluating unsafe execution, safety boundaries, and evidence recovery in LLM agents under missing evidence. It contains 300 matched unsafe/safe task pairs across six domains. By systematically suppressing critical facts, the benchmark measures unsafe execution under critical evidence omission and determines the minimum observed failure cardinality, including failures with full evidence and cases with no observed failure after exhaustive testing. An independent audit tool tests whether agents seek missing facts and then withhold prohibited actions while completing permissible tasks. The benchmark reveals substantial variation across the ten models in omission robustness, evidence acquisition, and appropriate action. Resistance to missing evidence does not necessarily translate into useful recovery. Recovery access reduces unsafe execution for all ten models, but agents differ in whether they actively obtain the missing facts and use them to act appropriately in both worlds.
0
cs.LG Shruti Bothe, Illyyne Saffar, Ayush K. Varshney · Oct 22, 2026

This paper studies handover prediction in cellular networks, where time-series models must meet a hard 40 ms inference deadline and a tight energy budget on user equipment. Rather than ranking by accuracy alone, the authors propose a protocol that filters models by tail latency feasibility then ranks survivors on measured per-inference energy—including feature computation. They benchmark eight architectures and find that gradient-boosted trees dominate the accuracy–energy–latency frontier, while the top accuracy-only neural model (CNN-1D, F1=0.914) costs over 3× more energy and trails in F1. The work challenges standard benchmarks by showing that duty-cycled measurement and full-pipeline accounting can invert model rankings.

AI models, and time-series models in particular are typically ranked by accuracy and deployed under constraints absent from that ranking. In this paper, we study a real setting where these constraints are explicit and measurable: handover pre- diction in cellular networks, where inference runs on the User Equipment once per 40 ms measurement period and must complete before the network acts. The timing bound is hard: a late prediction is superseded by the measurement it was predicting, while energy is a cumulative budget spent for the life of the device. Neither appears in the objective these models are selected on. We evaluate eight architectures under a protocol that screens for deadline feasibility at the tail rather than the mean, then ranks the feasible models on measured inference energy, count- ing the feature computation that precedes the forward pass and is usually omitted. Gradient-boosted trees on handcrafted temporal features are the most accurate model (F1=0.974) and among the cheapest to run, while the neural architecture an accuracy-only benchmark would rank first (CNN-1D, F1=0.914) costs over 3 times more energy per inference under a realistic duty-cycled deployment pattern. We give three conditions under which this outcome should be expected, so the finding applies beyond telecommunications. Accuracy-only benchmarking does not merely under-report deployment cost. It can rank first a model that cannot be deployed.
0
cs.LG Khouloud Saadi, Di Wang · Oct 22, 2026

This paper shows that large language models fail to treat co-referring molecular identifiers—such as trivial names, IUPAC names, and SMILES strings—as interchangeable routes to the same knowledge. The authors introduce ChemIDBench, a controlled benchmark of 896 approved drugs, and demonstrate a striking double dissociation: lexical names unlock entity-associated facts like therapeutic indications, while structural identifiers unlock structure-computable properties like benzene-ring presence. Even when a model recognizes a molecule from its SMILES, the corresponding factual knowledge often remains inaccessible, a phenomenon the authors term cross-identifier binding failure. They trace this to a missing access relation rather than missing knowledge, and propose Binding Self-Distillation to transfer lexical access directly to SMILES without retraining from scratch.

Chemical AI workflows routinely represent the same molecule through multiple co-referring identifiers, including trivial names, IUPAC names, and SMILES, implicitly assuming that these representations provide interchangeable access to an LLM's knowledge. To test this assumption, we first introduce a controlled benchmark and show that it does not hold. Across foundation models spanning 7B to 72B parameters, even chemistry-specialized models, co-referring molecular identifiers consistently expose different subsets of the model's knowledge. We then conduct a series of controlled behavioral, representational, and causal analyses to characterize this failure. We show that even when a model can identify a molecule from its SMILES and retrieve a fact through the corresponding name, the same fact can remain inaccessible directly from SMILES. We term this phenomenon \emph{cross-identifier binding failure}. Further analysis of internal representations, conflicting identifiers, and parameter editing shows that neither improved chemical representation competence nor modification of individual facts is sufficient to establish reliable access across identifiers. Together, these results indicate that the core failure lies in the binding between an identifier and knowledge already present in the model. Motivated by this diagnosis, we introduce Binding Self-Distillation, a simple mitigation that uses lexical identity during training to transfer the model's existing knowledge access to the structural route. This enables factual retrieval directly from SMILES at inference time, without requiring a name lookup or training the underlying model from scratch.
0
stat.MLcs.LG Daniele Micheletti, Federica Zoe Ricci, Erik B. Sudderth · Oct 22, 2026

xVGAE tackles graph generation for moderate-sized, potentially dense graphs where diffusion and autoregressive methods become prohibitively slow. It builds on the Aldous-Hoover representation theorem to design a hierarchical VAE with a global graph latent $z_0$ and node latents $z_i$ that are conditionally i.i.d., using a learnable neural graphon decoder for one-shot generation. The core pitch is that this structure yields sample quality competitive with state-of-the-art while sampling one to three orders of magnitude faster, and produces interpretable latent representations.

Graphs play a crucial role in many applications, ranging from drug discovery to social network modeling and astronomy. Generative models for graphs have substantially advanced in recent years, but we identify relatively simple scenarios where state-of-the-art models struggle to converge within a standard compute budget, or exhibit prohibitively slow generation times. We propose a generative architecture that achieves quality competitive with state-of-the-art models and is orders of magnitude faster at generation. Our approach is inspired by the Aldous-Hoover theorem, a classic representation theorem that characterizes any probability distribution of graphs that is invariant to permutations of node indices or exchangeable. This theorem establishes that three ingredients suffice: a graph-level latent variable, a set of exchangeable node-specific latent variables, and a so-called graphon function that maps graph- and node-level variables to the probability of an edge between any node pair. Given a training set of graphs, our exchangeable Variational Graph AutoEncoder (xVGAE) learns an approximation to their underlying graphons, as well as graph- and node-level latent variables. We show that our xVGAE encodes latent representations that correlate with graph- and node-level properties, and can (quickly, in one shot) generate new graphs that closely match key training set statistics.
0
cs.LGcs.AIstat.ML Mahdi Sabbaghi, George Pappas, Hamed Hassani et al. · Oct 22, 2026

Standard on-policy distillation forces a student to copy a teacher at every token, even when the teacher's preferred actions hurt the student's eventual success. This paper proposes Advantage-Based On-Policy Distillation (AOPD), which weights each teacher token by its counterfactual advantage under the current student policy. The key insight is that imitation should optimize for student task reward, not teacher agreement, and the authors derive an unbiased estimator that needs only standard student rollouts and terminal rewards.

Online Policy Distillation (OPD) often outperforms offline methods such as Supervised Fine-Tuning (SFT) by training on trajectories sampled directly from the student. However, standard OPD trains the student to follow the teacher at every state of the trajectory, assuming that teacher guidance is always beneficial. We instead distinguish between what the teacher prefers and what actually helps the current student succeed. We introduce Advantage-Based On-Policy Distillation (AOPD), which weights teacher actions by their counterfactual advantage under the student. Teacher actions that improve the student's expected outcome are reinforced, while those that do not are downweighted. Directly computing these advantages requires trying alternative teacher actions at each step and running new rollouts from each. Instead, we show that the AOPD objective can be estimated using only standard student rollouts and their terminal rewards. Our estimator uses teacher importance weights on the student-sampled actions to provide unbiased advantage-weighted supervision, without any additional rollouts or reward evaluations. This allows AOPD to focus teacher supervision on actions that help the current student while preserving the rollout efficiency of standard OPD. Experiments on math, coding, and Medqa show gains over distillation and RL baselines in both external-teacher and self-distillation settings.
0
cs.GTcs.LGq-fin.TR Matteo Onger, Luigi Foscari · Oct 22, 2026

Onger and Foscari analyze competitive market making as a two-sided pricing game where strategic liquidity providers face a non-strategic informed trader with inelastic demand. Because bid and ask quotes jointly set the market mid-price that determines trade direction, standard equilibrium existence theorems fail and payoffs are non-convex and discontinuous. The authors prove that pure-strategy Nash equilibria exist via a novel fixed-point argument on a midpoint operator, derive a structural linear scaling of spreads with asset volatility, and show that no-internal-regret learning on fine price grids recovers the competitive benchmark as tick size vanishes.

We propose a market-making game played among $N \ge 2$ strategic market makers and a single non-strategic representative trader. In a continuous quote space, standard finite-game arguments do not apply, while non-convex and discontinuous payoffs rule out classical continuous existence results and complicate learning. Nonetheless, we characterize pure-strategy Nash equilibria (PSNEs) and show that at least one PSNE always exists under minimal assumptions on the underlying asset value distribution, and that the equilibrium bid-ask spread widens strictly with asset value volatility. To obtain a tractable learning framework, we discretize prices and, under an additional regularity condition, show that the time-averaged play of no-internal-regret learners approaches the continuous Nash price envelope as the tick size vanishes. Finally, we empirically validate our theoretical results through numerical simulations.
0
cs.CLcs.AI Stephen Chung, Wenyu Du · Oct 22, 2026

N-gram embedding tables give language models cheap capacity gains but can consume hundreds of billions of parameters. This paper asks whether those embeddings can be stored at low precision without losing their benefit. The authors systematically compare quantization schemes—uniform, normal-quantile, and Lloyd–Max codebooks with per-embedding scales—and find that aggressive bit reduction often preserves most of the tables’ gain, freeing memory to grow the tables themselves.

Many recent open-weight language models use n-gram embedding tables to improve performance. These tables store learned representations of short token sequences, such as pairs or triples of consecutive tokens, which the model retrieves during processing. However, they can require substantial memory: DeepSeek-V4.1-Flash, for example, allocates 196 billion parameters to its Engram n-gram memory. We therefore investigate whether this memory cost can be reduced while preserving the performance improvement that the tables provide. We propose storing n-gram embeddings at low precision and systematically investigate different quantization methods and bit allocations across tables. Across nanochat-, Llama-, and GPT-2-family models trained from scratch, four-bit tables save approximately 75% of table memory while preserving more than 99% of the validation-loss improvement from adding the tables. Using fewer bits leads to a larger drop in performance, although we find that a short fine-tuning phase recovers a significant part of this loss. In addition, reinvesting the saved memory in larger tables can improve performance beyond that of the original full-precision tables while still using less memory. These table memory savings also extend to large existing models: on DeepSeek-V4.1-Flash and Qwen3.8-Flash-Next, low-bit tables save 47-55% of table memory, with perplexity increases of less than 1.2% and largely preserved downstream task performance. These findings establish low-bit precision as a practical way to reduce the memory requirements of n-gram embeddings and use the saved capacity to improve model performance.
0
cs.AI Jiening Siow, Amy Xin, Junjie Wang et al. · Oct 22, 2026

Autonomous research agents can automate entire scientific workflows from ideation through experimentation to writing, but they frequently compromise research integrity through behaviors like test-set exploitation, fabricated citations, and manipulated reporting. RIDAR addresses this gap by introducing RIVT, a taxonomy of 14 research integrity violation types spanning the full lifecycle, together with RIDAR-Post-hoc for automated detection and RIDAR-Runtime for live intervention. The work matters because the authors show such violations are nearly universal in current frontier agents, making integrity safeguards a prerequisite for trustworthy machine-generated science.

Autonomous research agents are increasingly used to automate large portions of scientific research, yet they are prone to research integrity violations (RIVs): behaviors that compromise the validity, reproducibility, or faithfulness of the research process. We present RIDAR, a framework for automated RIV detection and runtime intervention. First, we introduce RIVT, a comprehensive taxonomy of 14 RIV types spanning the full research lifecycle. Building on RIVT, we present RIDAR-post-hoc, a framework to detect RIVs within agent trajectories. RIDAR-post-hoc achieves 85.2% F1 performance on RIV-Gold, a benchmark for RIV detection with 60 expert-annotated trajectories. Applying RIDAR-post-hoc to RIV-Wild, a dataset of 300 agent trajectories across 50 distinct research tasks, we detect 3,964 RIV instances in 99.7% of trajectories, revealing the prevalence of RIVs in current agents. Finally, we present RIDAR-runtime, a framework for dynamically detecting and correcting RIVs during agent runtime. RIDAR-runtime effectively reduces agent RIVs remaining at task completion by 36.8%. We will release our code and data to facilitate future research.
0
cs.AIcs.DBcs.HC Humza Akhtar, Brian Freeman · Oct 22, 2026

Industrial organizations struggle to govern structured telemetry and unstructured documentation together because the work relies on scarce domain experts. The paper proposes contestable governance: specialist AI agents generate scored, cited arguments for metadata decisions, human stewards review and intervene before anything is committed, and an append-only record preserves full lineage. This design aims to stop unreviewed agent errors from propagating into downstream systems while making human oversight attributable and auditable.

Industrial organizations hold operational knowledge in structured records, such as telemetry, point lists, and transactions, and in unstructured sources, such as manuals, service notes, communications, and inspection reports. Governance programs often manage these sources separately. Classifying, linking, and documenting them depends on a small group of employees with deep domain knowledge. Agents built on large language models can propose metadata, cite documents, and flag quality issues, but unreviewed proposals can spread errors into downstream systems. A perfunctory approval leaves no record of what a reviewer checked. We present contestable governance: specialist agents produce scored, cited arguments for disputed metadata decisions; a steward can accept, reject, modify, or add arguments before commit; and a governance record retains the evidence, interventions, and outcome. A versioned domain glossary supplies model-specific terms and acronym definitions to the agents. We describe the workflow, a triage path that reserves full argumentation for uncertain proposals while preserving review before commit, the scoring and record models, and a gate that controls which verified decisions become precedent. Two HVAC use cases illustrate the pattern: point classification using Brick Schema class labels, supported by an open reference implementation, and an illustrative warranty failure-mode decision linking claim fields and telemetry to service notes and revisioned bulletins.
0
cs.CLcs.AIcs.LG Ferdinand Kapl, Kaitlin Maile, Stefan Bauer et al. · Oct 22, 2026

Depth growth and looping reuse computation across layers to train or run Transformers more efficiently. This paper shows that both methods create an inductive bias toward learning from context over memorizing fixed associations in weights, accelerating in-context learning and propagating induction heads through depth. The evidence spans models up to 3B parameters and connects architecture design to the mechanistic origins of few-shot performance.

Looped and depth-grown language models reuse computations across depth and have attracted interest for their reasoning capabilities. Building on prior suggestive evidence of improved in-context-learning (ICL), we investigate how such reuse favors ICL, including how it shapes the acquisition, retention, and mechanisms of this ability. Our analysis spans pretrained language models up to 3B parameters and controlled tasks. The experiments provide evidence for a shared inductive bias toward learning from context: grown and looped models rely more on information in context and, compared with a full-depth dense reference, acquire ICL earlier in controlled tasks and retain it more strongly when learning fixed associations in the weights is also possible. Tracing attention heads through training reveals that depth growth propagates early induction heads across layers. Ablations show that grown and looped models rely more strongly on induction-ranked heads for both few-shot performance and later-token prediction. Together, these findings provide evidence for a shared inductive bias toward learning from context and suggest that (soft) parameter reuse shapes how this ability develops and which attention mechanisms support it.
0
cs.AIcs.MA Ping-Lin Kuo, Suman Navaratnarajah, Christian Frey et al. · Oct 22, 2026

Muffin tackles the overhead and synchronization bottleneck of multi-agent reasoning by replacing full-trace debate with asynchronous sharing of compact intermediate findings through a shared memory buffer $B^{(d)}$. An orchestrator routes queries to either a single agent or a team of parallel agents that read and append selective findings while keeping private reasoning local. The authors claim strong accuracy-token Pareto gains across four reasoning benchmarks and four open-weight language models.

The rise of Agentic AI systems has changed the landscape of artificial intelligence by enabling strong reasoning capabilities through specialized multi-agent interaction with structured self-reflection. However, in target-driven reasoning tasks, single- and multi-agent systems are often on par in terms of performance gains. A major challenge is that failures often arise from an ineffective exchange of critical information during inter-agent interaction and coordination. Different from existing multi-agent debate paradigms that rely on synchronous turn-taking and sharing information across different agents, we propose an inter-agent protocol based on shared Memory bUFFer INference - referred to as MUFFIN - in an asynchronous agentic framework. In the first step, an orchestrator routes queries based on their reasoning demands and delegates demanding ones to a multi-agent setting, where a shared memory buffer provides asynchronous exchange of intermediate findings while an agent's private reasoning remains local. Our experiments show that our framework Muffin outperforms established competitors, achieving the best accuracy in 17 out of 20 of our benchmark settings, and provides a better quality-cost trade-off than multi-agent debate: Muffin improves accuracy by 19.2 accuracy points while using 77.4% fewer tokens, without requiring full-trace sharing.
0
cs.LG Edric Castel C. Hao, Juan Raphael S. Se\~na, Neon S. De Jesus · Oct 22, 2026

The paper tests whether matching spectral predictability $\Omega$ between synthetic pretraining data and target time series is sufficient for effective transfer learning under distribution shift. They evaluate this "predictability-aware" hypothesis using LSTM, PatchTST, and TCN across controlled synthetic conditions and the real-world ETTm1 benchmark. The core finding is a negative result: while $\Omega$-matching works under ideal conditions, it fails across different synthetic source families on real data, suggesting practitioners need more nuanced source-selection criteria.

Synthetic pretraining under distribution shift requires deciding what synthetic data to use. A natural criterion is to match the spectral predictability $\Omega$ of the source to the target, but is $\Omega$ sufficient? We test this hypothesis, which we call predictability-aware pretraining, across three architectures (LSTM, PatchTST, TCN) and three seeds. Under ideal synthetic-to-synthetic conditions, $\Omega$-matched pretraining can outperform even an oracle baseline (+46.8% MSE reduction, LSTM), though the benefit is already architecture-dependent. On the real-world ETTm1 benchmark, however, this relationship does not hold: sine-plus-noise pretraining at matched $\Omega$ yields only a marginal mean improvement +2.3% averaged over all three architectures, up to +65.5% on individual channels), whereas $\Omega$ matched chaotic ODE trajectories systematically degrade performance -13.2%). The two sources agree on the direction of transfer for only 53% of configurations across all three architectures (Pearson r=-0.02), indicating that $\Omega$ carries little information about which source will transfer beneficially. We further observe an architecture-dependent asymmetry in the response to the direction of the $\Omega$ gap. We conclude that $\Omega$ matching can help in controlled settings but is not sufficient to predict transfer across sources, and we discuss additional signal properties that a source-selection criterion may need to consider.
0
stat.MLcs.LG Ying Li, Sanyou Wu, Zi Yang et al. · Oct 22, 2026

Standard deep Gaussian processes become increasingly ill-conditioned as depth grows because discrete layer composition amplifies parameter perturbations. This paper proposes replacing the discrete stack with a latent continuous-depth SDE whose drift family carries a GP-based prior, yielding two models: CDGP with a direct separable GP prior, and FlowDGP with a flow-evolved base GP. The central claim is that depth in probabilistic regression is better modeled as continuous latent evolution than as a discrete composition, and that retaining a GP prior over the drift improves stability and competitiveness relative to both discrete DGPs and neural continuous-depth alternatives.

Deep Gaussian processes (DGPs) are appealing Bayesian regression models, but their standard discrete-depth parameterization often becomes harder to optimize as depth grows. We argue that depth is better treated as a latent continuous evolution than as a long discrete stack. We therefore propose a continuous-depth formulation in which the latent representation follows a stochastic differential equation with a depth-indexed drift family equipped with a GP-based prior. This reframes the core design choice as the prior placed on that family, rather than adopting a purely neural continuous-depth parameterization as in neural ODE or neural SDE models. We study two instantiations of this idea: CDGP, a direct GP prior over the state--depth drift, and FlowDGP, a flow-evolved prior that captures richer depth dependence at lower training cost. To motivate the redesign, we analyze how the single-sample DGP objective can become increasingly sensitive under repeated layer composition, while residual DGP is a useful first repair that still remains a finite discrete construction. We also give pathwise sensitivity analysis for the continuous-depth formulation. Experiments on synthetic, benchmark, and large-scale regression tasks show that residual DGP improves over plain DGP, while CDGP and FlowDGP provide a stronger overall story across the regimes we study.