Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
698 papers in cs.AI
Trending mixes fresh papers with community signal.
0
cs.AI Yifan Zhang, Liang Zheng · Oct 1, 2026

Model-based reinforcement learning can leverage simulators to avoid risky target interactions, but dynamics shifts create a dilemma: should one correct the simulator or fit the target directly from limited data? This paper introduces MC-WM, which trains both a residual-corrected simulator and a direct target world model, then selects between them using a held-out calibration-risk score. The core value is a disciplined experimental protocol—including exact routing counterfactuals and careful access accounting—that tests whether calibrated model-family selection outperforms fixed strategies.

Model-based reinforcement learning (MBRL) can exploit simulated experience, but a simulator-to-target shift creates a model-selection problem: correcting the simulator and fitting the target directly can each fail under limited target data. We introduce the Model-Corrected World Model (MC-WM), which separates initial target data into disjoint fit, selection, and calibration partitions and deploys the family with lower standardized calibration risk. A learned confidence signal and deterministic validity predicates weight one-step imagined policy updates without rewriting physical rewards. We evaluate 540 unique reported run cells across three controlled Multi-Joint dynamics with Contact (MuJoCo) shifts; one exact-routing cell was repeated after a pre-deployment artifact gate, giving 541 completed executions.
0
cs.AI Yoonkyu Woo, Woojin Lee, Jin-Xia Huang · Oct 1, 2026

YouRA tackles a structural reliability problem in end-to-end research agents: manuscript claims drift away from executed experiments because hypotheses, failure histories, and evidence pointers are buried in transient dialogue context rather than kept as persistent, verifiable state. The architecture introduces a YAML-based Verification State Architecture (VSA), an Independent Controller that separates control from execution (using GPT-5.2), and Stateful Reflection with three-level failure routing (bounded repair, redesign, or reset). Evaluation on MLR-Bench's 10-task end-to-end subset reports the highest Overall scores across matched backbones, complemented by hallucination and data-provenance diagnostics, though non-significant differences on the latter versus the strongest baseline temper the reliability claims.

End-to-end research agents can now produce complete scientific papers, yet manuscript claims often diverge from executed experiments. This gap is structural: research state, failure histories, and claim-evidence alignment are not maintained as persistent, verifiable state across long-horizon pipelines. We present YouRA (Your Research Agent), an architecture for stateful, evidence-traceable autonomous research. YouRA preserves research state, execution evidence, and failure history across the research trajectory by integrating three components: a Verification State Architecture (VSA) that tracks hypotheses, gates, and evidence pointers; an Independent Controller that turns state and reflection records into lifecycle, recovery, and debate/review control while separating control from execution; and Stateful Reflection that logs failures as structured lessons and routes recovery through bounded repair, redesign, or reset. On MLR-Bench's predefined ten-task end-to-end subset, YouRA improves over both MLR-Agent and AI Scientist V2 on scalar Overall across all three matched backbones. An automated diagnostic using MLR-Bench's hallucination taxonomy reports intersection/union counts for four fact-based failure types, and data-provenance diagnostic shows more real-data-based outputs. Ablating each of the four components (the VSA, the Independent Controller, MCP tool access, and reflection-guided recovery) supports their separable contributions. Removing either core-state component drops YouRA below the full system. Code: https://github.com/PrayPrey/Your-Research-Agent.
0
cs.LGcs.AI Seonghwi Kim, Sung Ho Jo, Minwoo Chae · Oct 1, 2026

Tabular foundation models like TabPFN achieve strong average accuracy but crash on minority groups when subpopulation proportions shift between training and deployment. DR-TFM addresses this by training only a tiny query-scaling network—updating as little as 0.016% of TabPFN-3’s parameters—using distributionally robust objectives on *estimated* groups, with no true group labels needed. Across tabular benchmarks and multiple TFMs, it delivers large worst-group accuracy gains while staying computationally cheap.

Despite strong mean accuracy, tabular foundation models (TFMs) can perform poorly on underrepresented groups under subpopulation shift, where group proportions change between training and deployment. We propose DR-TFM, a parameter-efficient distributionally robust adaptation framework that requires no true group annotations. DR-TFM adjusts attention to labeled context examples by fine-tuning an existing query scaling network or adding and training one, while keeping all other parameters fixed. We instantiate the framework with two robust objectives using estimated groups or source conditional distributions derived from training data. For TabPFN-3, adaptation updates only 0.016% of the pretrained model's parameters. Across five tabular benchmarks, DR-TFM achieves substantially higher average worst-group accuracy than pretrained TFMs and the compared robust baselines without true group annotations, while maintaining competitive mean group accuracy. DR-TFM also improves average worst-group accuracy on ACS Income and across four additional TFMs.
0
cs.LGcs.AI Sung Ho Jo, Seonghwi Kim, Wonsang Yun et al. · Oct 1, 2026

Machine learning models often fail under subpopulation shift when spurious correlations mislead them into relying on shortcut features. This paper introduces POTER, a method that derives per-sample importance weights from optimal-transport (OT) dual potentials between the training distribution and a small validation-based reference distribution. By avoiding loss-based proxy selection entirely, POTER aims to remain robust under label noise while requiring only a single standard ERM training stage. The authors report state-of-the-art worst-group accuracy on several benchmarks and identify a previously overlooked failure mode: subgroup-concentrated label noise.

Machine learning models often suffer performance degradation under subpopulation shift, particularly when spurious correlations cause models to rely on shortcut features that fail to generalize across subgroups. A recent line of work mitigates this issue by using loss-based signals to identify informative samples, but these signals can become severely distorted under label noise: mislabeled samples may also incur large losses and contaminate subsequent reweighting or retraining. Despite its practical importance, this intersection remains largely underexplored. We propose POTER, a reweighting framework based on optimal transport that derives sample importance from the transport geometry between the training distribution and a reference distribution constructed from limited validation group annotations. By measuring alignment at the individual-sample level rather than relying on loss, POTER downweights mislabeled or strongly bias-aligned samples while assigning higher importance to samples better aligned with the reference distribution. In addition, POTER requires only a single ERM training stage, moving beyond the retraining paradigm common in recent work. Across standard benchmarks and noisy-label settings, POTER achieves state-of-the-art worst-group accuracy, including cases where label corruption is concentrated within minority subgroups.
0
cs.AI Fan Huang, Minsuk Kim, C. Tyler Diggans et al. · Oct 1, 2026

This paper asks whether Large Language Models can serve as stable, implicit world priors for simulation and decision support when real-world data are unavailable. The authors introduce a framework to evaluate full LLM-generated probability distributions over discrete choice sets—airports, restaurants, and consumer products—across nine open-weight models, three families, and repeated sampling with controlled prompt perturbations. Their central finding is that model scale and family introduce far larger distributional shifts than prompt wording, with modes stabilizing rapidly but encoding structurally different priors across models. This directly challenges the assumptions underlying recent silicon-sampling work that treats LLMs as interchangeable stand-ins for human respondents.

Large Language Models (LLMs) are increasingly used as probabilistic generators for simulation, synthetic data generation, and decision support in settings where real-world data are unavailable. Yet, the structure and reliability of the distributions they produce remain understudied. Here, we systematically analyze LLM-generated distributions of preferences for air travel, restaurants, and consumer products. Encouragingly, all models considered in our analysis exhibit self-coherence, with the most probable outcomes stabilizing rapidly under repeated sampling. At the same time, we observe substantial discordance across both model families and scales, with little consensus even among their most probable outcomes. These patterns hold across nine open-weight models, three choice domains, and show robustness under temperature changes, greedy decoding, and perturbations of prompt and ordering. Our findings indicate that outcomes are influenced more by the choice of model than by the wording of the prompt, challenging the common assumption that sufficiently capable LLMs produce similar preference distributions when used as stand-ins for survey respondents.
0
cs.AI Bangji Yang, Jiajun Fan, Hongba Ma et al. · Oct 1, 2026

The paper tackles the waste of intermediate reasoning in multi-sample LLM math inference, where self-consistency discards unfinished arguments and only votes on final answers. ReSolve proposes a training-free selective moderation loop: after sampling four candidates, a controller invokes the same 4B model to read existing derivations when answers disagree or are missing, then generates a repaired or completed solution within a bounded budget. The idea matters because it reframes already-generated reasoning as reusable evidence, potentially replacing independent resampling with cheaper evidence-conditioned refinement.

Sampling multiple solutions spends computation on intermediate deductions and unfinished arguments as well as final answers. We introduce ReSolve, a training-free inference procedure that reuses this candidate reasoning through selective generative moderation. An answer-distribution controller invokes a model to examine existing derivations when candidates disagree or lack a parseable answer, then incorporates the generated solution into a bounded loop. Under Hybrid scoring on 130 competition-mathematics problems evaluated with two independently sampled candidate pools, ReSolve obtains 100 and 99 correct answers, compared with 91 and 92 for voting over the same four candidates, with no correct-to-incorrect changes relative to that vote in either pool. Eight-sample self-consistency obtains 94 and 96 correct answers while consuming substantially more tokens; ReSolve uses 46.3% and 47.2% fewer tokens in the two evaluations. A controlled ablation removes visible derivations while retaining answer keys, vote counts, and the per-state output-cap rule, reducing accuracy from 100 to 93 correct despite increasing computation. Selective and always-on Uniform moderation both solve 97 problems, while selectivity reduces moderation tokens by approximately 54% and total pipeline tokens by 6.2%. These results support candidate reasoning as reusable inference computation. They do not establish an accuracy advantage over additional sampling or a distinct benefit from specialized route instructions.
0
cs.ROcs.AImath.OC Yuji Takubo, Daniele Gammelli, Marco Pavone et al. · Oct 1, 2026

Spacecraft rendezvous and proximity operations currently require specialized engineers to translate high-level mission intent into dynamically feasible trajectories, creating a scalability bottleneck for distributed space systems. This paper introduces OrbitTAMP, a hierarchical task-and-motion planning framework that leverages pretrained LLMs to map natural-language commands into a partial mission specification, then systematically completes unspecified behavior, timing, and waypoint decisions via a domain-specific behavior graph and planning modules. Final trajectory optimization ensures dynamical feasibility and safety, aiming to provide an auditable, scalable language interface for spacecraft operations.

Spacecraft rendezvous and proximity operations (RPO) are currently planned through an expertise-intensive process in which engineers translate high-level operational intent into safe, dynamically feasible trajectories, creating a bottleneck to scalable operations. Large language model (LLM)-based agents could offer an intuitive interface for this process, although their outputs are not inherently grounded in orbital dynamics, operational constraints, or the structure of admissible spacecraft maneuvers. To exploit their semantic reasoning while ensuring the generated plan's physical validity, this paper presents a hierarchical framework for spacecraft task-and-motion planning (TAMP) that grounds LLM reasoning in a graph of reusable behaviors and domain-specific planning modules. Within this framework, a pretrained LLM maps a natural-language command to a partial mission specification. The associated planners then resolve unspecified decisions within the admissible operational space. Finally, trajectory optimization converts the completed mission specification into a dynamically feasible trajectory. Numerical experiments demonstrate that this architecture substantially improves intent recovery over direct LLM generation, achieving 98% exact recovery of partial mission specifications across all evaluated splits when backed by frontier LLMs. Additional test-time-compute experiments show that, for a compact 9B model, verifier-guided revision increases exact recovery from 75% to 88%, while broader behavior-plan search independently improves selection among admissible trajectory realizations. Overall, these results establish a scalable and auditable foundation for language-driven agentic planning of spacecraft RPO.
0
cs.CLcs.AI Xuehang Guo, Haoyu Wang, Haifeng Chen et al. · Oct 1, 2026

Multi-agent workflows can solve complex tasks that stump a single LLM, but current methods typically train only the workflow generator while leaving execution agents frozen despite their shared influence on outcomes. This paper proposes FloWright, a paradigm that treats the workflow itself as a shared harness to optimize any role—generator, executor, or skill—using a hierarchical, structure-aware reward derived from execution traces, without extra models or labels. It also introduces DataWright, a rule-based data hardening procedure that converts single-agent datasets into workflow-level benchmarks. On 44 evaluation arms across documents, slides, charts, code, math, and finance, the authors show that co-evolving multiple roles yields larger gains than evolving one alone.

Tackling complex real-world tasks can exceed the capabilities of a single large language model (LLM), motivating the use of multi-agent workflows that coordinate specialized agents to work together on these tasks. Recent methods train LLMs to construct better workflows from execution outcomes, but they optimize only the workflow generator, while the other agents that build or execute each workflow remain fixed even though every outcome depends on all of them. However, extending training beyond the generator is challenging: the agents are coupled, and a workflow's outcome is a single sparse score that cannot tell which agent causes a failure. We propose FloWright, which leverages the workflow as a harness to optimize workflows. By introducing a hierarchical, structure-aware reward paradigm, FloWright enables one role to self-evolve and two or more roles to co-evolve, with no additional models, labels, or executions. Considering the limitation that workflows are commonly trained and evaluated on data that a single agent can already handle, we further propose DataWright, an adaptive data hardening approach that converts existing datasets into workflow-level tasks with increased difficulty. Across document, slide, chart, code, math, and finance tasks, small open models trained with FloWright achieve improved performance by up to $+7.41\%$, with co-evolving ($+5.03\%$) more roles gaining more than optimizing one of them alone ($+2.83\%$). Our project page: https://xhguo7.github.io/FloWright/.
0
cs.AI Haotian Chen, Bowen Ye, Yuning Zhang et al. · Oct 1, 2026

Concurrent actions in LLM agent environments can be individually valid yet jointly infeasible. This paper audits settlement semantics through a typed snapshot–settlement contract, testing five arbitration policies for order sensitivity, useful progress, and replay consistency. The core finding is that joint order invariance does not guarantee useful execution: in a six-agent doorway task, priority arbitration raises completion from 31.25% to over 90%, yet still misses the feasibility oracle optimum. The work matters because settlement mechanics directly shape measured agent capabilities but are often left implicit in multi-agent frameworks.

Concurrent actions in large language model (LLM) agent environments require arbitration even when each proposal is individually valid. We implement a typed snapshot-settlement contract and audit three distinct properties: order sensitivity, useful progress, and replay consistency. Five settlement policies are tested in 28,800 exhaustive permutation trials and 2,160 scripted multistep episodes. Joint policies are spatially order-invariant conditional on fixed priorities, yet conservative rejection completes only 31.25% of agents in a six-agent doorway task versus 90.28% for random tickets; the paired improvement is 59.03 percentage points (95% bootstrap interval: 50.00-68.06). All policies preserve the tested spatial constraints, and priority arbitration still misses the independent small-instance optimum. A separate full-state journal audit exactly replays 156 checkpoints and rejects 1,332 constructed corruptions with a retained terminal anchor. The evidence concerns execution semantics, not human realism or long-run fairness.
0
cs.AI Shaohuai Liu, Yuning Wu, Haoran Liu et al. · Oct 1, 2026

APIVIS addresses the vanishing-learning-signal problem in RLVR mathematical reasoning by mixing direct and Gumbel-searched completions within each rollout group. The core idea is to treat chunk-level search as a policy-improvement operator with a provable monotonicity guarantee, while a selective InfoSFT auxiliary loss preserves training signal when all group returns are identical. Empirical gains on Qwen3-1.7B and Qwen3-4B are consistent but rest on single-seed runs and roughly 3× the compute of direct RLVR.

Reinforcement learning with verifiable rewards (RLVR) has substantially improved the mathematical reasoning capabilities of large language models. Recent work introduces search into RLVR rollouts to increase trajectory diversity, but diversity alone does not ensure that the search-induced rollout policy improves upon the current policy. To address this gap, we propose APIVIS, a training-time framework that adapts finite-budget Gumbel search to chunk-level mathematical reasoning. APIVIS combines direct and searched responses within each rollout group, allowing improvements found by search to produce informative relative rewards. It further applies selective supervision to search-improved tokens, preserving a learning signal when uniform group rewards render GRPO ineffective. We show that exact value-guided selection improves the expected verifier reward at each searched state and that this guarantee extends to the complete rollout policy, with a corresponding approximate guarantee under bounded value-estimation error. Experiments on widely recognized mathematical reasoning benchmarks and different model scales demonstrate substantial improvements over competitive search-based methods, validating the effectiveness of APIVIS.
0
cs.LGcs.AI Bangji Yang, Jiajun Fan, Hongba Ma et al. · Oct 1, 2026

This paper asks whether the best policy from an RL training run is necessarily one of its visited checkpoints. It introduces policy-space scaling—the idea that completed RL histories contain stronger, constructible policies—and proposes SURGE, which fuses two checkpoints via delta-first spectral decomposition without additional training or per-query inference cost. Across two 1.5B math trajectories and one 7B code trajectory, SURGE exceeds the best native measured checkpoint while using fewer reasoning tokens.

Scaling reasoning typically spends more compute on reinforcement learning (RL) or on inference. We show that a completed RL training history can yield policies stronger than the checkpoints visited by its optimizer. We call this policy-space scaling: expanding the deployable policy set accessible from a fixed RL history, without extending training or increasing per-query inference computation. We instantiate it with SURGE (Scaling Up RL Gradient-free via Eigenspace fusion). SURGE combines two checkpoints from the same RL run: a high-accuracy anchor and a competitive donor that generates shorter responses. It expresses both checkpoints as changes from their shared initialization, then spectrally decomposes the anchor's update to retain its dominant component and incorporate the donor's complementary component. With a fixed target for how much of the anchor update to retain, SURGE determines the block size from the weights without testing candidate policies. We evaluate two 1.5B mathematical-reasoning histories, DeepSeek and Nemotron, and one 7B coding history, OLMo. SURGE improves benchmark-average accuracy over both input checkpoints while using fewer reasoning tokens than the anchor. It reaches 54.17% on DeepSeek AIME24 against a measured native maximum of 50.83%, and 83.7% on OLMo HumanEval+ against 82.8%. These gains exceed the observed training curves. Geometric controls support the importance of RL-update structure beyond weight displacement or token reduction alone. Each constructed model runs as a single policy. Our findings identify stored RL history as a reusable scaling resource: the capability available from a training run need not end at its best checkpoint.
0
cs.CLcs.AIcs.LG Jungseob Lee, Sugyeong Eo, Seongtae Hong et al. · Oct 1, 2026

Knowledge distillation risks propagating the reversal curse when a teacher can recall a relation forward but not backward. This paper proposes directional label distillation: frozen teachers score candidate answers in the direction they know, and the highest-scoring candidate becomes the student's training target. On parent-child facts from Wikidata, this yields 13-15 point gains in student open-ended accuracy and shows that verification can provide accurate supervision where generation fails.

Knowledge distillation aims to transfer the factual knowledge of large language models to smaller models for efficient deployment. Yet a teacher may recall a relation in one direction while failing to generate the answer in the reverse direction. Distillation from its generated answers can therefore propagate this directional limitation to the student. The same teacher can nevertheless recognize such an answer by scoring the relation in the direction it knows. We introduce directional label distillation, in which frozen teachers score candidate answers in that known direction and the best-scoring candidate becomes the student's training target. On facts about parents and their children, known-direction scoring yields more accurate labels than scoring the requested direction, even after tuned corrections for name priors. With prior-corrected scores, the better direction depends on the facts rather than the template, and reverses on mined facts whose notable entity is the parent rather than the child. With the evaluated children's forward facts withheld, students trained on known-direction labels improve open-ended accuracy on their trained queries by 13 to 15 points over students trained on prior-corrected reverse labels. After generated answers are matched to a fixed name list by lexical similarity, students reproduce nearly all selected labels. Their accuracy largely follows label quality. The label advantage holds on unscreened queries and when candidates are retrieved without inserting correct answers. Our findings show that directional verification mitigates the transfer of errors from teacher-generated answers to students by providing more accurate training targets. Code is available at https://github.com/js-lee-AI/directional-verification.
0
cs.CRcs.AI Paulo Severo, Silvio E. Quincozes, Amanda Dias · Oct 1, 2026

Jev-IDS explores whether a System One Model (SOM)—the typed, probabilistic decision model Jev—can serve as a lightweight few-shot classifier for network intrusion detection. Instead of generating free-form text, Jev answers bounded noul and choice questions that return structured attack probabilities and traffic categories, promising lower latency and cost than autoregressive LLMs under label scarcity. This matters because operational NIDS deployments are constrained by per-flow inference overhead, monetary cost, and false-alarm rates, and conventional supervised detectors fail when labeled attack examples are scarce or entirely unseen.

Machine-learning Network Intrusion Detection Systems (IDS) depend on substantial labeled datasets and task-specific training, whereas Large Language Models (LLMs) detection can analyze flow records directly but incurs higher inference cost and latency, with less constrained outputs. This paper presents JEV-IDS, an open experimental general NIDS based on the Jev System One Model (SOM) to detect zero day intrusions Under label scarcity. JEV-IDS serializes one flow per request and asks JEV two questions: a binary attack probability and a finite-choice traffic category. Our results show that, at k=1, JEV was 4.8 times faster and 3.8 times cheaper than GPT-5.6 Luna, with 1.5 times higher novel-attack recall; it also produced 15 times fewer false alarms than a low-data Random Forest. Across 5,400 decisions on a 300-flow NSL-KDD pilot split, JEV achieved F1-Score 0.859, precision 0.941, recall 0.790, and novel-attack recall 0.838. Increasing k to 2 reduced its F1-Score to 0.839.
0
cs.SEcs.AIcs.CL Junyu Guo, Shangding Gu, Ming Jin et al. · Oct 1, 2026

The paper asks when a nominally weaker LLM can reliably audit patches produced by a stronger coding agent. Its central claim is that groundability—the property that evidence exposes an independently checkable claim about missing behavior—matters more than reviewer scale. On a benchmark of 411 real execution-labeled traces and 101 controlled cases, the authors show that weak reviewers given official execution evidence can achieve near-perfect catch and near-zero over-rejection, while a deployable cascade of static checks and generated tests recovers only part of that upper bound. The finding that parameter count is not a monotonic predictor of review quality reframes the oversight problem from building bigger judges to building better checks.

Coding agents can return plausible patches that omit required behavior. These failures are hard to review because long traces and confident summaries often hide what was missed. We ask when a nominally weaker reviewer can reliably decide whether a patch solves its issue. We study 411 execution-labeled traces from three agents and 101 controlled cases. On 154 GPT-5.4 traces, structured but unchecked evidence raises both defect catch and over-rejection. We then provide official execution evidence as an upper-bound diagnostic. After choosing and freezing one of two formats per reviewer, five of six reviewers improve both rates on 122 held-out traces; two classify every trace correctly. Reviewer size is not a consistent predictor of quality. Because official tests are unavailable in deployment, we also evaluate a frozen cascade with patch-caused static errors and generated tests that first fail on the unpatched repository. On 121 scored held-out GPT-5.4 traces and 59 Gemini traces, its coverage is 0.89 and 0.86, risk is 0.33 and 0.26, catch is 0.76 and 0.80, and over-rejection is 0.66 and 0.67. Most false rejections occur when unresolved cases reach the reviewer. Official execution evidence shows the potential of weak review when decisive checks are available. Producing equally reliable checks without official tests remains the main bottleneck.
0
cs.CLcs.AI Chao Li, Shigeng Wang, Anbang Yao · Oct 1, 2026

Post-training quantization (PTQ) for LLMs is typically performed sequentially, block by block, by minimizing a reconstruction loss. The authors show that the standard MSE loss creates an Optimization Imbalance: because gradient magnitude scales with the square root of loss, early stages receive much weaker updates than later ones. Replacing MSE with RMSE implicitly normalizes gradients across stages, improving quantization accuracy—especially at aggressive bit widths like W2A16 and W4A4—with no extra parameters or meaningful compute overhead.

Post-training quantization (PTQ) methods typically use sequential quantization that partitions a pre-trained LLM into a series of units (e.g., transformer blocks), with one unit quantized at each stage. State-of-the-art PTQ methods are predominantly learning-based, optimizing auxiliary quantization parameters (e.g., scaling factors, rotation matrices, clipping thresholds, and adapters) via gradient descent to minimize a reconstruction loss. A common practice is to use mean squared error (MSE) as the reconstruction loss function, yet its induced optimization behavior remains largely unexplored. In this work, we take a holistic view of sequential quantization and systematically investigate how optimization evolves from the first quantization stage to the last, aiming for a deep understanding of optimization in learning-based PTQ schemes. Through extensive empirical studies spanning representative learning-based PTQ methods, LLM families, model scales, architectures, quantization settings and various tasks, we consistently uncover Optimization Imbalance: reconstruction loss magnitudes vary dramatically across stages, accompanied by highly uneven gradient magnitudes and parameter updates under MSE. We term the cross-stage range of loss magnitudes the reconstruction loss scale, and reveal that MSE translates the unexpectedly large reconstruction loss scale into highly uneven gradient magnitudes, which in turn lead to uneven optimization strength across quantization stages. This finding suggests a general principle for improving learning-based PTQ: optimization strength across stages should be decoupled from the reconstruction loss scale. Theoretically, we show that root mean squared error (RMSE) variants defined at the sample, channel, token, and element levels naturally realize this principle through implicit gradient normalization, outperforming MSE significantly as a drop-in replacement.
0
cs.CLcs.AIcs.DB Sandipan De, Abhijit Chakraborty, Sambaran Bandyopadhyay et al. · Oct 1, 2026

JoinGR attacks a real bottleneck in Text-to-SQL pipelines: dense retrievers rank tables independently and miss ones only identifiable through multi-hop join relationships. The method builds a column-level join graph with typed intra-table and foreign-key edges, selects semantic anchor tables via dense similarity, then propagates query-conditioned relevance deposits along edges using a lightweight learned scorer. Final table scores aggregate these deposits, making schema structure a first-class retrieval signal rather than an afterthought, which matters most for enterprise settings with cryptic table names and implicit relational dependencies.

Retrieving the right tables is a prerequisite for Text-to-SQL over realistic databases. Dense table retrievers rank schema elements independently, but this ignores a key source of evidence: some required tables are not mentioned in the question and become identifiable only through their join relationships to already relevant tables. We introduce JOINGR, a join-aware table retrieval method that treats the database join graph as the retrieval space. Columns are represented as graph nodes, while intra-table and foreign-key relationships are represented as typed edges. Given a question, JOINGR selects semantically similar anchor tables, traverses join edges with a query-conditioned scorer, and aggregates the resulting edge deposits into table scores. The scorer is a lightweight MLP on top of frozen query, node, and edge embeddings, trained with a pairwise margin loss over gold tables. On BIRD and Spider datasets, JOINGR is competitive with the strongest retrieval baselines. On BEAVER, a challenging enterprise benchmark with multi-hop table requirements, JOINGR substantially improves recall over dense retrieval and re-ranking baselines. Cross-domain experiments show that the learned scorer transfers across benchmarks, indicating that the method captures reusable joingraph traversal behavior.
0
cs.ROcs.AI Xuehui Yu, Eason Yu, Meiyi Wang et al. · Oct 1, 2026

Vision-language-action policies often fail on partially observable, long-horizon manipulation because the current image alone does not determine the correct action. This paper reformulates robotic memory as an optimisation problem: the optimal memory should maximise the conditional mutual information $I(a_t; m_t \mid o_t)$ between action and memory given the current observation. To realise this, the authors propose Divide-and-Remember (D&R), a recursive lightweight selector that retains the top-$K$ most action-relevant tokens from an unbounded history while staying in the pretrained VLA token space. On the RoboMME benchmark and in real-robot experiments, D&R achieves strong gains with budgets as small as 64 tokens, offering both theoretical clarity and empirical progress on memory-augmented visuomotor control.

Vision-language-action (VLA) models struggle on history-dependent manipulation tasks, where the current observation alone does not determine the action, and the policy needs a memory of the history. Existing memory methods decide what to remember by design, for example, keeping frames with large pixel changes, and show inconsistent gains across tasks. We view what to remember as an optimisation problem. From the POMDP formulation of imitation learning, we show that the optimal memory maximises the conditional mutual information $I(a_t; m_t \mid o_t)$ between the action and the memory given the current observation. Intuitively, this means preserving the action-relevant information in the history that is not already contained in the current observation. Based on our analysis, we propose Divide-and-Remember (D&R), a recursive memory method that learns a memory function $m_t = M(h_t)$ and scales to long contexts while staying compute-light. It involves two strategies: (1) the selection over the full history is divided recursively into subproblems of top-$K$ selection over $2K$ tokens, so that fixed-size, lightweight selectors learned end-to-end support an unbounded history; (2) all recursion blocks share one selector, which captures the selection rule common to every block and keeps the method efficient. On RoboMME, a benchmark of 16 long-horizon manipulation tasks that require remembering when, where, what, and how to act, D&R achieves a state-of-the-art average success rate with consistent gains across all four suites under a budget of only 64 tokens; real-robot experiments show the same gain. Code, checkpoints and more results are at https://dnr-memory.github.io/
0
cs.AIcs.CL Xuehang Guo, Haoyu Wang, Shengyu Chen et al. · Oct 1, 2026

InFlowOp attacks the costly cycle of building and fixing multi-agent LLM workflows by pricing every decision in a single label-free cost. The framework first constructs a workflow at the right granularity via bidirectional cost-driven coalescing, then detects and repairs faults locally during execution without reference answers. The authors also introduce Braid, a benchmark designed to demand multi-agent coordination, and report accuracy gains up to +11.97% over a single agent across eight domains and six backbones.

Large language models (LLMs) increasingly construct multi-agent workflows that decompose a complex task and assign specialist agents from a pool. However, building such a workflow well remains challenging: how finely to divide the task, which agent to trust with each subtask, and when to create a new specialist are all critical decisions a workflow constructor needs to settle up front. Thus, whether each subtask succeeds remains unknown until the workflow runs. Yet, improving a workflow is costly. Locating a fault usually requires a reference answer, a graded outcome, or a trained assessor, and the fix is applied to the whole workflow through re-execution, re-search, or retraining. We propose InFlowOp, which prices every decision in one label-free cost that weighs how well an agent's competence meets what a subtask demands against how much that agent takes to run. Before execution, InFlowOp bidirectionally determines the granularity of task decomposition and agent assignment following from the cost rather than from a fixed template. During execution, InFlowOp corrects a fault with the cheapest move via the same cost that serves the workflow both as it is built and as it runs. Facing the workflow-level evaluation challenge, we introduce Braid, a benchmark whose tasks require multi-agent coordination beyond single-agent capability. Across various domains and backbones, InFlowOp outperforms single agent baselines by up to $+11.97\%$, achieving $+9.64\%$ with in-flow optimization. Our project page: https://xhguo7.github.io/InFlowOp/.
0
cs.AIcs.HC Shawn Bowers, Martin Caminada, Haoyang Liu et al. · Oct 1, 2026

Structured argumentation frameworks such as ASPIC- compute whether claims are accepted under grounded semantics by chaining strict rules ($p_1,\ldots,p_n \rightarrow c$) and defeasible rules ($p_1,\ldots,p_n \Rightarrow c$), but interacting with them has traditionally required writing symbolic literals and move primitives. ABDA-NL solves this usability barrier by wrapping the ABDA engine in a natural-language web interface that renders arguments, attacks, and discussion-game explanations in plain English, and by using a large language model strictly as a translator and research assistant rather than a reasoner. Because the deterministic engine alone constructs arguments and assigns acceptance labels, users can explore and extend formal scenarios without losing logical guarantees.

ABDA-NL adds a natural-language interface to ABDA, a system for argument-based discussion using ASPIC- knowledge bases under grounded semantics. Users see which conclusions are accepted, rejected, or undecided, open an interactive rendering of the grounded discussion game to learn why, explore what-if alternatives by suspending assumptions and rules or changing preferences, ask questions that are answered from a scenario's reference documents, and author new facts, assumptions, and rules in plain English. A large language model provides the bridge between language and formalism: it answers questions from the documents and the current state of the scenario, and it translates plain-English edits into candidate formal statements. The deterministic ABDA engine remains the sole source of arguments, attacks, and acceptance labels, and every proposal of the model is validated and confirmed by the user before it takes effect.
0
cs.MAcs.AI Zijian Liu, Yangzhixin Luo, Junyu Lu et al. · Oct 1, 2026

Current multi-agent AI scientists rely on fixed, design-time workflows, yet human scientists adapt their division of labor dynamically. This paper proposes Runtime Agent Coordination (RAC), which lets agents select the next capability at runtime based on research state, scoped work contracts, and artifact-grounded verification. Evaluated across three existing hosts on ResearchClawBench, the key finding is that runtime selection alone improves mean scores, but adding contracts and verification often hurts performance under tight budgets. The work is conceptually sound but empirically thin, resting on a single seed and tiny task samples.

Multi-agent AI scientists have shown improving performance across a diverse range of tasks. Yet a common approach is design-time agentic orchestration, which typically relies on fixed workflows. In contrast, human scientists coordinate and adjust their division of labor at runtime. We therefore ask: can AI scientists also coordinate at runtime? To this end, we introduce Runtime Agent Coordination (RAC), which selects agents from existing AI-scientist hosts during execution, assigns scoped work contracts, and provides artifact-grounded verification. Verification informs subsequent agents without blocking transitions or discarding artifacts. We conduct a single-seed exploratory evaluation across Agent Laboratory, EvoScientist, and ARK on ResearchClawBench, preserving host models, tools, and permissions under host-calibrated budgets. Four cumulative conditions separate native execution, runtime communication, runtime selection, and the combined addition of contracts and verification. Runtime selection yields the highest observed mean score for each host; adding contracts and verification reduces these means, with host-dependent outcomes relative to native execution. These results motivate runtime coordination while exposing the limits of additional coordination mechanisms under constrained budgets. Code is available at https://github.com/systemind-team/Runtime-AI-Scientist.