Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
698 papers in cs.AI
Trending mixes fresh papers with community signal.
0
cs.AI Dingyi Rong, Yue Shi, Chaofan Ma et al. · Oct 14, 2026

SERO attacks a core problem in long-horizon agentic RL: outcome-based credit assignment cannot teach behaviors that never appear in the policy's own rollouts. The idea is to restore snapshots of states actually reached by the current policy, let a training-only oracle continue interacting with the real environment, and distill the resulting executable multi-step trajectories into the learner via an auxiliary reachability-weighted loss. This extends the supervision horizon as the policy improves and remains compatible with existing group-based RL algorithms, providing dense grounded guidance without touching the base estimator.

Long-horizon agentic RL is constrained by the futures visited by the current policy. When rollouts fail to reach useful behaviors, improved credit assignment cannot provide supervision for states and actions that were never encountered. On-policy distillation (OPD) introduces teacher guidance on policy-induced states, and recent multi-turn variants improve how this guidance is scheduled, replayed, refined, or validated. However, they do not directly use the oracle-controlled future itself as the training trajectory. We introduce \textbf{State-Rooted Executable Rollout Optimization (SERO)}, which augments on-policy agentic RL with executable oracle continuations. SERO restores a state actually reached by the current policy and lets a training-only oracle continue interacting with the real environment, making the downstream observations and oracle actions themselves available for learning. It then applies \textbf{policy-reachability weighting}, which weights each oracle step by the frozen behavior policy's compatibility with the preceding oracle actions. This allows deeper supervision to become effective as the policy becomes more compatible with the oracle branch. The oracle loss is optimized separately from the base RL estimator and no oracle is used at inference time. We evaluate SERO on two challenging interactive-agent benchmarks, ALFWorld and WebShop, using Qwen2.5-1.5B-Instruct and Qwen2.5-7B-Instruct. On ALFWorld, learning the full executable continuation is substantially more effective than supervising only the root oracle action, while policy-reachability weighting further improves out-of-distribution performance.
0
cs.AI Sarthak Gupta, Priyanka Tembey · Oct 14, 2026

The paper tackles the ambiguity in prompt-injection detection: internal-state probes may detect injection presence rather than actual behavioral compromise. It evaluates five adapted methods on the same structured prompts for two models, stratifying by attack success, and finds that attention- and role-based signals correlate more strongly with successful attacks than presence- or recognition-based probes.

Several recent studies propose detecting prompt injections from a language model's internal state. However, these methods do not measure a single security property. Residual-stream probes, attention scores, role projections, exposure probes, and concept readouts may capture injection presence, recognition, information routing, or behavioral influence. It is therefore unclear what differences in prompt-injection detection performance reveal about the internal signals these methods read. We study how five representation-reading methods vary under a common structured indirect prompt-injection setup on Qwen3.6-35B-A3B and Gemma-4-26B-A4B-it. We evaluate each method by how well it distinguishes injected prompts from benign controls. We then further analyze each detection method's ability to detect attacks in cases where they are successful and in cases where they are not. This helps us better assess what properties each detection method might rely on. Methods trained to detect injection presence or attack-related concepts generally separate unsuccessful injections more strongly from benign inputs, whereas attention diversion, exposure, and role-confusion-based methods separate successful injections more strongly on both models. Attention Tracker provides the strongest consistent successful injection separation, reaching 0.949 AUROC on Qwen and 0.887 on Gemma. These results suggest that signals closer to response formation may better encode information about an attack's success, and that detection performance can depend strongly on the prompt template. We share the data associated with this study at https://anonymous.4open.science/r/paper-evaluation-data-7877
0
cs.AI Tonglong Wei, Zheng Yuan, Lingshuai Lin et al. · Oct 14, 2026

Infectious disease surveillance is hampered by fragmented data sources, uneven evidence availability across regions, and manual processing delays. EpiGuard proposes an autonomous LLM agent that proactively monitors surveillance feeds, dynamically selects forecasting strategies across absent, sparse, and abundant evidence regimes, and accumulates reusable standard operating procedures from successful warnings. The platform promises faster, more reliable early warning for over 50 diseases, but its experimental validation covers only 15 time series and never tests the absent or sparse branches it advertises.

Infectious disease outbreaks often spread rapidly before signs of widespread transmission become apparent, leaving a big challenge for rapid response and effective intervention. However, current infectious-disease early-warning systems face three major challenges: fragmented epidemiological evidence across diverse surveillance sources, highly uneven data availability across diseases and geographic regions, and delayed warning procedure caused by manual data collection, analysis, and reporting. To address these challenges, we present EpiGuard, an autonomous, continually self-improving agentic platform for timely and reliable early warning of more than 50 infectious diseases across different regions. EpiGuard proactively monitors and captures newly released official surveillance records, using the latest available evidence for risk assessments. It dynamically adjusts its analytical strategy across three evidence availability regimes, enabling reliable risk assessment under diverse data conditions, ranging from the absence of historical observations to sparse and abundant evidence. Moreover, EpiGuard learns from the successful execution process by preserving effective data-acquisition and analytical procedures as reusable standard operating procedures, enabling it to progressively generalize to previously unseen diseases and regions. We use officially released infectious-disease surveillance data from the China CDC and the United States CDC to evaluate EpiGuard's effectiveness. Experimental results demonstrate that EpiGuard outperforms state-of-the-art forecasting systems, improving forecasting performance by 9.68% and 14.04% on the China CDC and U.S. CDC datasets, respectively.
0
cs.AI Calder Johnson, Robin Cohen · Oct 14, 2026

Recommendation systems are opaque black boxes that curate feeds for billions of users, raising serious assurance risks. xLightGCN targets the popular LightGCN architecture and turns its linear graph propagation into an exact accounting of which user and item neighbors most influence a prediction. The result is a compact, inspectable subgraph plus a quantitative fidelity score that tells auditors how much of the score that subgraph actually explains—an idea that matters because interpretability alone does not guarantee the explanation covers the model’s reasoning.

Recommendation systems, systems that predict a user's preference for items in order to curate that user's feed, are a ubiquitous and central feature in online social networks. While they are a central piece of our modern digital infrastructure, many modern approaches are opaque black boxes, making them difficult to audit, understand, and assess the trustworthiness of. In this paper we present an exact, graph-based approach for generating explanations for decisions made by recommendation systems. We argue that in the risk-sensitive sociotechnical context of user-facing AI such as recommendation systems, explainability is a key pillar for establishing the trustworthiness of models and validating their effectiveness. We propose a technique built on LightGCN like architectures, an influential and popular class of recommendation models. We describe our approach and argue that it provides an appropriate assurance mechanism for these AI systems leading to specific advantages, including interpretable explanations and a theoretically guaranteed measure of explanation fidelity. We conclude by discussing limitations and directions for future research.
0
cs.AI YingQiao Wang, Eric Bigelow, Tomer Ullman et al. · Oct 14, 2026

This paper tackles physical reasoning in multimodal language models by asking when chain-of-thought (CoT) suffices and when physics-grounded video simulation is necessary. The authors propose Hybrid Simulation and Reasoning (HSR), a small MLP-based router that dynamically assigns questions to either CoT or a video diffusion simulator, aiming to balance accuracy against computational cost. The core claim is that this resource-rational tradeoff improves performance while allowing a 4B-parameter model to control routing for much larger base models like Gemini 3 Pro.

Multimodal language models often need to reason about the physical dynamics of the world in order to answer questions appropriately. Various methods have emerged for solving physical reasoning tasks, and in particular, two leading approaches are Chain-of-Thought reasoning and physics-grounded simulation. However, relatively little is known about which particular problems can be solved by each approach. Some tasks may benefit from computationally expensive generative video simulations, whereas others may be solved equally well (or even better) with language-based reasoning. Our work addresses this by systematically comparing simulation and language reasoning across a variety of multimodal tasks involving physical reasoning, such as answering questions about fluid dynamics and elasticity. We draw a parallel with this to resource-rational theories of human cognition, which propose that people optimally trade off simulation and reasoning depending on task demands. We present a novel cognitively-inspired hybrid model which optimally trades off simulation and reasoning to improve model performance and computational efficiency. Our model is able to decide the appropriate method to solve a physical reasoning problem at test time, and finds an optimal balance between accuracy and cost. Further, our model can be trained on a smaller vision-language model that is only 4B parameters and deployed to improve performance on much bigger base models with $>$3T parameters like Gemini 3 Pro.
0
cs.AI Qianhong Guo, Wei Xie, Xiaofang Cai et al. · Oct 14, 2026

Static benchmarks for LLM agents saturate and face contamination, making it hard to measure true progress over time. EvoProbe tackles this by evolving cybersecurity CTF tasks in a closed loop: generate executable tasks, diagnose solver trajectories with multi-judge scoring and phase-level subtask outcomes, and feed distilled bottlenecks back into task regeneration. Its core premise is that fine-grained diagnostics—not just aggregate pass rates—should dictate what the next benchmark probes.

Static benchmarks for large language model (LLM) agents face saturation and data contamination risks, motivating continual updates to evaluation tasks. However, aggregate scores and success rates offer limited insight into specific problem-solving bottlenecks and provide limited guidance for subsequent task design. We propose EvoProbe, an evaluation-driven benchmark evolution framework that integrates task generation, diagnostic evaluation, and feedback-driven regeneration into a closed loop. It combines verifiable subtask outcome scoring with evidence-supported multi-judge trajectory evaluation and distills phase-level bottlenecks, success patterns, and failure patterns into diagnostic feedback for generating new executable tasks. Across two rounds of cybersecurity experiments, evaluations of eight models on 66 tasks reveal phase-level performance differences and common failure patterns beyond aggregate scores. In a cross-round comparison with the Examiner model set and solver configuration held fixed, all eight models achieve lower Outcome scores on the updated tasks, with relative decreases of 11.8\% in mean Outcome and 40.0\% in mean Pass\textasciicircum{}3. These results support using fine-grained diagnostics to guide iterative task updates and probe agents' current capabilities and limitations.
0
cs.AIcs.CE Lingfei Qian, Yan Wang, Xueqing Peng et al. · Oct 14, 2026

Cross-lingual financial analysis requires models to both recognize shared accounting concepts across languages and exhaustively recover all corresponding numerical facts. This paper introduces MultiFinGround, a benchmark built from real FY2025 ESEF reports in English, French, and Greek, aligned through the IFRS Accounting Taxonomy. The core finding is that strong concept recognition does not imply complete evidence grounding: even top models reach near-perfect recognition accuracy while missing target facts in over a quarter of correctly recognized cases. This matters because benchmarks that only test recognition can obscure critical failures in numerical evidence completeness.

Comparing financial disclosures across languages requires identifying shared accounting concepts and recovering all numerical facts that express them. Existing benchmarks evaluate aspects of these capabilities, but provide limited insight into whether both succeed on the same multilingual evidence. In particular, it remains unclear whether language models can recognize these concepts across languages and exhaustively recover their corresponding numerical evidence from the same contexts. We introduce MULTIFINGROUND, a benchmark designed to investigate this recognition-grounding gap in multilingual financial reports. Constructed from FY2025 disclosures of 90 issuers in English, French, and Greek, MULTIFINGROUND aligns independently authored reports through a shared accounting taxonomy and provides traceable fact-level annotations. The benchmark evaluates financial fact identification, concept recognition, exhaustive fact selection, and concept discrimination without candidate labels. Across 15 evaluated models, eight API and open-weight reference models achieve 97.3-99.4\% concept recognition accuracy, yet miss at least one target fact in 26.6-41.9\% of correctly recognized groups. Further analyses reveal substantial variation in concept discrimination and limited gains from the evaluated finance-specialized models. Our findings demonstrate that strong concept recognition can coexist with incomplete evidence recovery, highlighting the importance of evaluating semantic recognition and evidence completeness together.
0
cs.CLcs.AI Shuyuan Zheng, Yun-seo Lee, Xing Gao et al. · Oct 14, 2026

Legal reasoning is not merely the mechanical application of rules to facts; it is shaped by a judge's underlying legal philosophy. This paper introduces LePhilBench, the first benchmark to test whether LLMs can both understand jurisprudential tendencies and apply them to predict judicial outcomes. It pairs jurisprudential profiling with philosophy-aware judgment prediction and grounds the tasks in a dataset of 220 annotated U.S. Supreme Court opinions, offering a rigorous new lens on models' legal reasoning capabilities.

Legal reasoning is a fundamental capability for large language models (LLMs) to complete legal AI tasks such as legal judgment prediction. In legal practice, this reasoning is shaped by legal philosophy: a judge's view of the nature and sources of law guides how legal materials are interpreted and applied, so judges working from the same statutes and precedents can reach different judgments. Existing research has largely overlooked whether LLMs can understand legal philosophy and apply it in legal reasoning, an ability we call \textit{legal-philosophical reasoning}. To fill this gap, we introduce LePhilBench, a benchmark for evaluating the legal-philosophical reasoning of LLMs that comprises two benchmarking tasks and a dataset. The two tasks evaluate how well LLMs understand legal philosophy and how well they apply it in legal reasoning, respectively. The dataset is manually and meticulously constructed. Its test set contains 220 U.S. Supreme Court opinions. A law professor designed fourteen annotation questions on legal philosophy, and three law-trained annotators with formal training in jurisprudence answered all fourteen questions for every opinion, yielding 9,240 legal-philosophical labels. LePhilBench takes the first step toward exploring legal-philosophical reasoning in LLMs.
0
cs.CLcs.AIcs.SD Sangmin Lee, Yejin Jeon, David Ifeoluwa Adelani · Oct 14, 2026

Multilingual speech technologies still fail to reach most of the world's languages because existing corpora are limited to a few hundred well-resourced languages and narrow domains like parliamentary proceedings or Bible readings. ELARSpeech addresses this gap by curating 30,202 hours of speech across 675 underrepresented languages from the Endangered Languages Archive, yielding both labeled and unlabeled subsets with rich acoustic and communicative diversity. It matters because it provides a large-scale, publicly available testbed that reveals existing self-supervised speech models struggle on the true linguistic long tail despite massive pretraining.

Massively multilingual speech modeling has made remarkable progress in recent years, yet existing training resources and benchmarks still underrepresent much of the linguistic long tail. To address this gap, we introduce ELARSpeech, a large-scale multilingual speech resource comprising 30,202 hours of speech across 675 underrepresented languages, curated from the Endangered Languages Archive. Combining human-annotated and unlabeled recordings, the corpus spans diverse recording conditions, domains, and language families. Beyond corpus construction, our experiments show how ELARSpeech supports extending ASR and TTS capabilities to diverse underrepresented languages, with further benefits from pseudo-labeling unlabeled data. At the same time, our speech representation analysis reveals remaining limitations in transferring existing multilingual models to the linguistic long tail. Together, ELARSpeech provides both a resource and a testbed for extending multilingual speech technology further into the linguistic long tail. We publicly release the dataset, all trained ASR and TTS models, and the complete data construction pipeline to facilitate research on long-tail multilingual speech technologies.
0
cs.AI Jiarui Qin, Junjie Huang, Yunjia Xi et al. · Oct 14, 2026

Base models are hard to evaluate on agentic tasks because standard benchmarks assume instruction-following chat interfaces. ASAP adapts existing agent scaffolds to pretrained base models by treating execution as text continuation, using a Markdown+XML format, a short reference trajectory prefix, and minimal failure recovery. The framework yields discriminative end-to-end scores across models and checkpoints, and exposes execution trajectories that enable fine-grained behavioral diagnosis before post-training.

Agentic capabilities are increasingly important for modern LLMs, yet remain difficult to evaluate during pretraining. Existing approaches typically rely on static trajectory-derived tasks or likelihood-based proxies, which are lightweight but provide limited visibility into how base models behave in interactive environments. We introduce ASAP (Agent Scaffold Adaptation for Pretraining Evaluation), a lightweight framework for eliciting and evaluating agentic behavior from pretrained base models on end-to-end tasks. Rather than converting base models into chat-style agents, ASAP preserves the completion interface and adapts existing agent scaffolds through structured trajectory continuation, short reference prefixes, and minimal recovery mechanisms. Across software-engineering and deep-research benchmarks, ASAP yields discriminative end-to-end performance across base models and pretraining checkpoints. Beyond aggregate scores, ASAP exposes model-generated execution trajectories, enabling analysis of exploration, editing, testing, recovery, and task completion across training stages. These trajectories provide a behavioral view of how agent-relevant capabilities change during pretraining and how execution patterns differ after post-training. Our results suggest that end-to-end agent evaluation can complement conventional pretraining benchmarks by providing a practical diagnostic of interactive model behavior.
0
cs.AI Guanhua Zhu, Hanwen Li, Zhi Wei et al. · Oct 14, 2026

STRATA tackles the problem of scalable, self-maintaining memory for test-time self-evolving LLM agents. Instead of a flat, monotonic pool of episode summaries, it organizes experience as a typed three-layer directed graph of atomic skills, task workflows, and meta-frameworks, maintained by five mechanisms including multi-dimensional similarity, adaptive reflection thresholds, community detection, pressure-triggered garbage collection with articulation-point protection, and contrast edges that warn against directionally opposite experiences. The authors show that this structured memory attains the best average accuracy across four interactive benchmarks while simultaneously using the lowest latency, fewest environment steps, and fewer injected memory lines than seven memory-augmented baselines.

Large language model (LLM) agents can self-evolve at test time by accumulating experience: retrieving relevant memories before acting and writing new lessons back afterwards. Yet most are single-level: trajectories, distilled workflows and reasoning items all land in one undifferentiated pool indexed by embedding similarity, with no typed abstraction hierarchy. They never forget or deduplicate, and are prone to negative transfer, where a superficially similar but directionally opposite experience is recalled and its concrete steps are copied verbatim, actively harming the agent. We introduce STRATA, a structured, outcome-grounded, self-maintaining memory that organizes experience into a three-layer graph of atomic skills and code snippets, task workflows and generalized meta-frameworks, connected by typed edges. STRATA maintains itself through five mechanisms sharing one similarity geometry: a multi-dimensional similarity that scores retrieval by operation and target; a typed reflector crystallizing procedures from successes and pitfalls from failures; community detection that induces meta-frameworks; pressure-triggered garbage collection with articulation-point protection; and contrast edges that flag confusable, direction-opposite experiences. Across four interactive benchmarks (AppWorld, WebArena, ALFWorld, ScienceWorld), two frozen backbones and seven baselines, STRATA attains the best average score while simultaneously using the lowest latency and fewest environment steps of any memory-augmented method, and 44% fewer lines of injected memory than the most context-hungry baseline. We isolate two failure modes of prior memories: single-level memory degrades sharply as the task set grows, and single-level concrete memories suffer catastrophic negative transfer, which contrast edges repair, lifting ScienceWorld from 78.7 to 96.7 within the same system.
0
cs.AIcs.DC Anshu Raina, Peyman Razaghi, Yuankai Chen et al. · Oct 14, 2026

Configuring distributed LLM training over hundreds of GPUs involves a combinatorial explosion over tensor, pipeline, expert, context, and data parallelism plus micro-batch size, recomputation, and sharding, where a single byte of activation accounting can separate a legal run from an OOM crash. This paper proposes Primus Projection, a hybrid engine that benchmarks compute kernels on as few as one GPU and analytically reconstructs out-of-scope communication and pipeline schedules at the target scale, coupled with an LLM-driven tuning agent that searches the space in minutes instead of days. The authors validate across dense and MoE models on two AMD GPU generations, reporting projection errors around $5\%$ at up to 1,024 GPUs and a $+27\%$ throughput gain discovered in under 30 minutes of single-node exploration.

Configuring distributed LLM training across hundreds of GPUs requires jointly optimizing tensor, pipeline, expert, context, and data parallelism alongside micro-batch size, recomputation, sharding, and overlap, a combinatorial space where memory legality can hinge on a single byte of activation accounting. Today, teams navigate it through expensive multi-node trial and error, burning GPU-hours on crashes and suboptimal recipes. We present Primus Projection, which closes this loop with two coupled components. First, a hybrid projection engine that measures what it can and simulates what it cannot: GPU microbenchmarks on as few as a single device capture compute kernels and any in-scope communication; a sub-node downscale-measure-upscale workflow analytically restores out-of-scope collectives, FSDP overlap, and the full pipeline schedule at the multi-node target. A pure simulation mode runs entirely on CPU, enabling pre-silicon planning without any GPU. Second, the Primus Tuning Agent treats the projection engine as a fast scoring oracle (seconds per candidate instead of tens of minutes) and uses it to drive an intelligent search over the configuration space. A deterministic seed planner sweeps single axes; an LLM investigation loop proposes cross-axis combinations the planner cannot reach, with an analytic memory pre-filter that rejects infeasible candidates before any GPU time is spent. Validated on Llama 3.1 (dense) and Mixtral 8x22B (MoE) across two GPU generations, all projections stay within ~10% of measured multi-node throughput, and fidelity holds at production scale: 4.7% error on DeepSeek V3 671B at 1,024 GPUs and 1.9% on Qwen3-235B-A22B at 256 GPUs. In a Mixtral 8x22B case study, the Primus Tuning Agent discovers a configuration delivering +27% throughput over the published 4-node BF16 reference at the same scale, in under 30 minutes of single-node exploration.
0
cs.AI Han-Sang Lee, Kyuho Lee, Juneyoung Park et al. · Oct 14, 2026

ixi-sLM tackles the problem of running an AI call agent entirely on a mobile device under constraints that cloud deployments never face: roughly 1 GiB of memory, in-call thermal limits, static-integer NPU execution, Korean STT input riddled with disfluencies, and user expectations set by cloud LLMs. The core idea is to take a 1.2B-parameter Korean sLM and apply two service-specific optimizations—domain-adaptive vocabulary trimming and tokenizer merging to shrink footprint and token counts, followed by task-aware mixed-precision quantization calibrated on real calls—to squeeze the model onto Qualcomm and Apple NPUs. It matters because the authors claim a live production deployment serving several million subscribers at 94% of an unnamed cloud LLM's quality, cutting per-call energy to 23% of a CPU baseline.

Running an AI call agent on-device makes it private, network-independent, and free of per-query cloud cost, but shipping one as a real-world service imposes constraints a cloud deployment never faces: ~1GiB memory budget, in-call latency and thermal limits, static-integer NPU execution, Korean STT input far from sLM pretraining, and cloud-level quality expectations. We bring ixi-sLM, a 1.2B Korean sLM, to mobile NPUs through ON-DEVICE MODELING: domain-adaptive modeling trims the vocabulary by call frequency to shrink the embedding and LM head that take nearly half the model under INT4 transformer weights and refits the tokenizer to call speech (18% fewer tokens on call traffic), while task-aware quantization calibrates on real calls and assigns per-module mixed precision by activation sensitivity. A single domain-adapted model runs ixi-O's two production services, AI Call Summary and AI Call Answering, at 94% of a state-of-the-art cloud LLM's task-weighted quality; our on-device modeling carries that quality onto the NPU with only a marginal drop in overall score, in an 803MiB model (28% of FP16) at 23% of the CPU's per-call energy. The same recipe deploys across Qualcomm and Apple NPUs and serves several million ixi-O subscribers in production.
0
cs.AI Chenxu Wang, Xiaoyu Wen, Han Qi et al. · Oct 14, 2026

LLM agents face an expanded attack surface because malicious content can hide in user queries, tool descriptions, and environment observations. AgentSafeEvo casts agent safety as an attacker-defender co-evolutionary game over multi-turn tool interactions, where the attacker constructs full adversarial tasks and the defender learns to execute tasks safely. A novel learnability-guided task weighting mechanism uses within-task reward variance to shape updates for both players. Experiments on Qwen3-8B show strong safety gains and broad preservation of general capabilities.

Large language model (LLM) agents accomplish complex tasks through multi-turn interactions with external tools. However, malicious content embedded in user queries, tool descriptions, or environment observations can manipulate their decisions and induce unsafe actions. Adversarial co-evolution has emerged as an effective approach to strengthening LLM safety, but existing work primarily focuses on language-level safety or indirect prompt injection in web tasks. In this paper, we introduce AgentSafeEvo, a co-evolutionary reinforcement learning framework for agent safety built on an attacker-defender game spanning diverse tasks and attack types. The attacker learns to construct adversarial agent tasks that expose weaknesses in the defender's tool use, while the defender learns to complete tasks safely under these attacks. We further introduce learnability-guided task weighting, which uses within-task defender-reward variability to adjust each task's contribution to attacker and defender updates. Extensive experiments on agent safety and general capability benchmarks demonstrate that our method improves adversarial robustness while maintaining general agent capabilities.
0
cs.AI Guanhua Zhu, Bo Shen, Lei Zhang et al. · Oct 14, 2026

EvoWeave addresses how interactive agents can reuse past experience without importing entire workflows or discarding step dependencies. It proposes a graph memory where nodes are abstract states and edges are reusable operations annotated with contracts, provenance, and capability references; a task planner guides retrieval and bounded graph search to assemble experience fragments. Experiments across four benchmarks and three LLM backbones show heterogeneous gains and highlight tradeoffs between retrieval precision and runtime overhead.

Different tasks often require interactive agents to perform similar operations at intermediate steps. Retrieving an entire past workflow can introduce irrelevant steps, whereas retrieving isolated operations can discard the dependencies needed to reuse them. We introduce EvoWeave, a framework for experience memory that represents abstract states as nodes and reusable operations as directed edges with input and output contracts, provenance, and capability references. A planner decomposes the current task into a dependency graph; operation retrieval and bounded directed search then assemble relevant experience fragments. An execution agent can inspect these fragments and their referenced capabilities, while reflection separates concrete execution evidence from reusable abstractions. We study the framework across four benchmarks, five evaluation settings, and three language model backbones. Across backbones, AppWorld Normal and Challenge task goal completion average 51.91 and 27.99, respectively, exceeding the baseline without memory by 6.99 and 4.99 percentage points. An AppWorld ablation associates directed connections with an additional improvement of 2.08 points over independent operation cards. The results motivate composition of reusable operations while exposing tradeoffs in retrieval overhead and conditions for valid reuse.
0
cs.PLcs.AI Hang Lin · Oct 14, 2026

Program synthesis and library learning generate useful operations, but the resulting artifacts are often treated merely as derivations or search traces rather than reusable operational objects. This paper introduces FormCraft, a framework that represents both primitive and composed operations as first-class capabilities in a uniform well-formed space $\mathfrak{F}$, separating instance-independent formation and public callability from optional persistence through a verification gate. By retaining formation provenance while exposing composites through the same public interface as primitives, the framework aims to make persistent library growth possible and to eliminate the need to reconstruct historical derivation chains at reuse time, a claim backed by a paired experiment showing orders-of-magnitude reductions in search work.

We introduce FormCraft, a framework for representing acquired operations as first-class capabilities that can be recursively composed, directly invoked, and selectively retained in a persistent library through domain-specific verification. The framework separates capability well-formedness and public callability from later admission to persistent storage while preserving formation provenance and operational identity. We formalize recursive compositional closure over a uniform capability space and show that formed composites can be reused through the same public interface without re-forming their historical derivation. Experiments across continuous, discrete, propositional, and sequence domains demonstrate instance-independent reuse, independent checking, persistent acquisition, and reduced reuse-time search work under first-class exposure.
0
cs.DCcs.AIcs.LG Javad Mirzaei, Jeebak Mitra · Oct 14, 2026

Choosing a parallelism configuration for distributed LLM inference is challenging because the prefill and decode phases impose conflicting demands on time-to-first-token (TTFT) and inter-token latency (ITL). This paper develops a systematic framework that defines parallelism operating regions via TTFT-ITL Pareto frontiers and formulates SLO-aware selection using goodput $G_p(w,T_s)=\lambda_p(w)F_p(T_s|w)$. The core finding is a workload-dependent transition: tensor-parallel (TP) configurations excel for decode-heavy workloads and relaxed latency requirements, while pipeline-parallel (PP) configurations dominate for prefill-heavy workloads, stringent TTFT targets, and long contexts. The work matters because it moves parallelism selection from a static deployment choice to a workload- and SLO-dependent operating decision.

Large Language Model (LLM) serving systems must balance latency and throughput while efficiently utilizing distributed GPU resources. This challenge arises because inference consists of two fundamentally different phases: prefill, which determines time-to-first-token (TTFT), and decode, which determines inter-token latency (ITL). The use of tensor parallelism (TP), pipeline parallelism (PP), and hybrid configurations exposes different trade-offs between these latency dimensions, making the optimal parallelism configuration highly dependent on workload characteristics, latency requirements, and context length. Moreover, despite the widespread adoption of distributed inference, there is still limited understanding of how parallelism configurations should be selected under varying workload conditions and service-level objectives (SLO). In this paper, we develop a systematic framework for characterizing LLM inference parallelism via throughput-latency trade-offs, SLO-aware serving, and long-context scalability. We introduce the notion of parallelism operating regions by constructing TTFT-ITL feasible sets and Pareto frontiers across different workload compositions, thereby revealing a systematic transition from TP-dominant to PP-dominant configurations as workloads become increasingly prefill-heavy. We further formulate SLO-aware parallelism selection using goodput, showing that stringent TTFT requirements favor PP-dominated configurations, whereas relaxed latency constraints progressively shift the optimality toward TP-dominated configurations with higher serving capacity. Finally, we demonstrate that increasing context length fundamentally changes the relative advantages of parallelism configurations, with PP-dominant configurations exhibiting more favorable scalability and SLO attainment in the long-context regime.
0
cs.AI Tianle Chen, Pushkar Singh, Ketan Todi et al. · Oct 14, 2026

Long-horizon language agents frequently re-issue identical tool calls and receive redundant observations, a failure mode the authors call a loop. The paper shows that compressing the agent's history to fit a context window dramatically increases these loops, which in turn strongly predict task failure. DeLoop solves this by mining preference pairs directly from the agent's own rollouts—treating the looping action as a rejected example and the first later non-looping action as a chosen one—and training with direct preference optimization without any external rewards, gold answers, or LLM judges.

Language-model agents that run long tasks often redo work they have already done: they re-issue a tool call they made earlier and get back exactly the same observation, a step that adds no new information. We identify this failure as a loop. Loops appear natively in Qwen, Llama, and Gemini agents and become far more common once the agent's history is compressed to fit its context window. To reduce these loops, we propose DeLoop, a self-supervised training method. DeLoop builds on a simple observation: the agent's own rollout can provide the supervision needed to learn from its loops. We use a looping action as a negative example and the first later non-looping action in the same rollout as a positive example. DeLoop learns from these pairs through direct preference optimization and does not require task rewards, gold answers, or LLM judges. On CodeGym under compression, DeLoop reduces the share of Qwen3-8B tasks containing loops from 57.3% to 6.1%. It also uses about one third as many steps per task, with similar task success. On Qwen3-32B, DeLoop reduces loops and steps while raising task success from 37.7% to 44.8%.
0
cs.CLcs.AI SungHo Kim, Eojin Jeon, SangKeun Lee · Oct 14, 2026

KoAGE investigates whether large language models can know, learn from context, and coin Korean neologisms. The authors introduce NeoTrace, an automated pipeline that collects and dates 4,271 neologisms across six genres, and propose a cutoff-aware benchmark that separates lexical recall from contextual inference and generation. By comparing model outputs with attested human coinages under original materials and simulated community settings, the paper offers a temporally grounded view of how models adapt to evolving vocabulary.

Korean neologisms arise through diverse mechanisms, a demanding test of language models beyond lexical memorization. To enable systematic evaluation, we introduce NeoTrace, an automated, rerunnable framework that collects and dates neologisms across genres. Its 4,271 entries support KoAGE, a cutoff-aware benchmark with three acquisition and two generation tasks---the latter, to our knowledge, the first to compare model coinages with attested neologisms under their original materials and community context. Across 21 models, lexical recall diverges from contextual inference: in a five-model temporal analysis, models define only 13-30% of cutoff-year words, yet can infer meaning from one usage. However, structural understanding remains limited: even correct definitions barely improve formation analysis of pre-cutoff neologisms. Given word-building materials, single models often follow human formation mechanisms, whereas multi-agent coinage favors abbreviation and depends on interaction framing. KoAGE thus separates what models know, learn from use, and coin.
0
cs.CLcs.AI Minsu Oh, Seunghui Jwa, Chanjun Park et al. · Oct 14, 2026

This paper exposes a critical flaw in how compressed memory is evaluated for large language models: standard ablation tests like zeroing memory vectors do not prove that stored document content improves predictions. The authors distinguish three empirically separable questions—whether a model depends on memory after training, whether training with memory outperforms training without it, and whether gains actually require document content—and argue that evaluation claims must be matched to specific controlled comparisons. Across nine memory systems and multiple QA benchmarks, they show these comparisons frequently lead to different conclusions, calling for stricter evidentiary standards in context-compression research.

Does a language model answer better because its compressed memory contains useful document information? Replacing memory vectors with zeros can lower a trained model's score without showing that it outperforms a model trained without memory. We combine zeroing with separately trained models that cannot access stored text or receive the same constant input for every document. Across nine systems, some models rely on memory yet perform worse than the trained alternative. For example, in experiments that predict states in generated stories, zeroing memory worsens a model's prediction loss, yet a model trained without memory achieves lower loss than the original model with intact memory. On TriviaQA, giving xRAG memory from another question's passage raises F1, which measures word overlap with accepted answers, from 19.38 without a document to 24.78. Its effect on how often outputs contain an accepted answer is statistically uncertain. The question's retrieved passage scores higher still (29.88 F1). Thus a gain over no document alone does not establish that the gain requires the question's passage. Evaluations must therefore specify the comparison model, absolute performance, and generation and scoring conditions.