Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
297 papers in cs.CL
Trending mixes fresh papers with community signal.
0
cs.CLcs.AI Fiorenzo Parascandolo, Enver Sangineto, Xiaoyi Yu et al. · Oct 14, 2026

Length-Conditioned Majority Voting (LCMV) improves LLM reasoning by exploiting the empirical bias that longer chain-of-thought traces are less likely to be correct. Instead of filtering out long responses, it learns a logistic prior over correctness conditioned on CoT length and adapts it at test time using only unlabeled data and pseudo-labels from standard majority voting. The method is model-agnostic, adds negligible computational overhead, and is evaluated across 11 models and 8 benchmarks, making it a pragmatic drop-in replacement for standard MV.

Majority Voting (MV) is a simple and widely used strategy which improves the reasoning accuracy of Large Language Models (LLMs) by allocating additional inference-time computation. Specifically, in MV multiple Chain-of-Thoughts (CoTs) are independently sampled and the most frequent final answer is selected. In this work, we propose Length-Conditioned Majority Voting (LCMV), a Test-Time Training approach which improves MV leveraging an empirical observation that has recently been established in several studies: longer CoTs tend to be associated with a lower probability of correctness. We formulate this inductive bias as a length-conditioned prior probability, which is modeled by a simple logistic function. Moreover, we adapt this prior at test time using only unlabeled testing data and without fine-tuning the LLM. Finally, the adapted prior is used to weight the vote of each sampled answer. Extensive experiments across multiple LLMs and reasoning benchmarks show that LCMV consistently improves over both standard MV and existing length-based and confidence-based aggregation strategies, while retaining the simplicity and model-agnostic nature of MV. Our code is available at: https://github.com/aimagelab/LCMV.
0
cs.SDcs.AIcs.CL Puneet Mathur, Dinesh Manocha · Oct 14, 2026

Multi-party floor control is the next bottleneck for full-duplex voice agents: systems must decide not just when speech ends, but whether overlapping listeners are backchanneling or genuinely taking the floor. MultiPartyTurnBench introduces 240 synthetically generated, channel-separated conversations spanning two to five speakers and six interaction types, evaluating End-of-Turn (EOT) and Interruption (INT) detection with exact causal annotations. The results reveal a stark capability asymmetry: turn completion is largely tractable, while selective interruption handling remains near chance even for state-of-the-art commercial agents.

Full-duplex speech systems must decide when to enter, hold, or relinquish the conversational floor, even as multiple speakers overlap or backchannel without taking it. Existing evaluations study dyadic turn-taking or end-to-end agent behavior, but lack a unified, controlled evaluation of genuine floor transitions against confusable non-events in multi-party settings. We introduce MultiPartyTurnBench (MPTB), a benchmark of 240 synthetically generated, channel-separated conversations spanning two to five speakers and six interaction types. MPTB evaluates two complementary tasks: End-of-Turn (EOT) detection distinguishes genuine turn completion from temporary holds, while Interruption (INT) detection distinguishes successful floor takeovers from non-floor-taking speech. Exact event-conditioned annotations enable causal evaluation using false-positive-constrained recall and signed latency. Across acoustic, semantic, and turn-projection baselines, we find a stark asymmetry: learned systems achieve 82.5-92.6% EOT recall at 4.3-11.8% false-positive rates, while INT detection suffers from missed takeovers or excessive false activations. This asymmetry extends to five full-duplex agents which achieve 86.1-95.8% balanced accuracy on turn entry, yet perform near chance (46.9-54.7%) on selective interruption handling. Gemini-3.8-Live yields to 97.7% of backchannels, whereas MiniCPM-o-4.5 yields to only 1.4% of genuine interruptions. These findings establish selective floor control as a distinct, unresolved challenge for reliable multi-party voice interaction.
0
cs.AIcs.CL Soyoung Oh, Nursulu Sagimbayeva, Nicholas Jennings et al. · Oct 14, 2026

Theory-of-Mind reasoning requires connecting an agent's perception to their belief and then to their action, yet large language models often fail to compose these inferences even when each part is known. This paper proposes rule-based reinforcement learning: using Group Relative Policy Optimization to train models to emit concise if–then rules that bridge perception, belief, and action before answering. The authors show that this approach outperforms free-form chain-of-thought reasoning and supervised fine-tuning across four ToM benchmarks, while using roughly half the tokens, and that rules from larger models improve downstream GPT-4o-mini accuracy.

In Theory-of-Mind (ToM) reasoning, large language models may correctly infer the agent's mental state but fail to use that inference when predicting or judging the agent's subsequent actions. In this work, we investigate whether explicitly connecting perception, belief, and action with rules improves ToM reasoning. We generate concise \textit{if--then} rules that express relations between perception to action and use Group Relative Policy Optimization (GRPO) to train Qwen2.5 and Llama3 models across four ToM benchmarks. GRPO with rule generation outperforms prompting, supervised fine-tuning, and think reasoning. Moreover, rules generated by larger models ($\geq$3B) provide transferable knowledge that improves downstream performance of GPT-4o-mini. These findings suggest that explicit rules help models bridge the reasoning gap in ToM and support knowledge transfer across models.
0
cs.AIcs.CLcs.LG Maolin Ran, Minda Chen, Di Huang et al. · Oct 14, 2026

Reinforcement learning for language agents suffers from sparse trajectory-level rewards that do not directly supervise environment dynamics. DGS-WM addresses this by introducing Decision-Guided Selective World Modeling: instead of forcing the policy to predict entire environment observations as auxiliary targets, it selects only observation units that support the subsequent policy response and discounts already-mastered targets via confidence-adaptive weighting. This selective co-training yields consistent gains over full-observation counterparts across QA and web-shopping benchmarks.

Reinforcement learning provides a direct mechanism for optimizing task objectives in large language model-driven agents, but task rewards are typically sparse trajectory-level signals that only evaluate task success, without directly supervising action-conditioned environment transitions, leaving the model with limited explicit understanding of action consequences and environment dynamics. Recent work introduces auxiliary supervision through policy and world modeling co-training, yet typically treats complete environmental observations uniformly as world modeling targets, overlooking the varying decision relevance of observation content. We propose DGS-WM (Decision-Guided Selective World Modeling), a decision-guided policy-world modeling co-training approach for language agents. DGS-WM employs a Decision-Guided Observation Selection component that filters observation units with decision value as world modeling targets based on their support for subsequent policy responses, and a Confidence-Adaptive Weighting component that adaptively adjusts supervision strength according to the model's prediction confidence on selected targets. Together, these components form a decision-aware auxiliary world modeling loss, jointly optimized with the RL loss on the same policy model. Across multiple benchmarks covering single-hop/multi-hop question answering and interactive web tasks, DGS-WM achieves consistent improvements under different model scales and RL algorithms, demonstrating more stable and effective performance compared to full-observation world modeling methods.
0
cs.AIcs.CLcs.LG Alexander Spangher, Daniel E. Ho, Diyi Yang et al. · Oct 14, 2026

The paper asks how much meaning language models can actually share through language alone. To measure this, the authors introduce two tools — an epsilon-estimation algorithm that finds near-optimal prompts and estimates how much performance is left on the table, and a reconstruction bottleneck that scores how well a receiver model recovers a sender model's concept from labeled examples alone. They then apply observational scaling laws across 1.2k qualitative concepts in eight domains, classifying each as already articulable ('reaches'), potentially articulable with stronger models ('rising'), or permanently tacit ('bounded').

Language captures only a subset of the perceptions, intuitions and intents that form meaning between speakers. What, then, are the limits of language? We take steps towards measuring this in LLMs as follows: for a set of concepts, we measure how well each concept can be transmitted between two LLMs as their capabilities scale. This requires novel measurement tools: (1) optimal messages: we introduce a prompt optimization algorithm that beats existing algorithms by up to 14% on benchmarks and accurately estimates prompt upper bounds. (2) A transmission measure: the sender is asked to label text; the receiver then tries to recover the sender's prompt, and recovery is measured; we find this correlates strongly with human label error. With these measures, we use observational scaling laws to study how transmissibility of a concept, conveyed with optimal messages, increases as transmitter and receiver capacity grows: does it asymptote below or above a threshold? Measuring 1.2k concepts in eight domains, we find concepts that (a) can be fully articulated; these concepts usually depend on local patterns, e.g. "joke ends with surprise"; (b) might be articulated by future, stronger models; these rely on whole-text structural patterns, e.g. "story's worldbuilding coherence"; (c) concepts that face articulability limits; these concepts' meaning, we find, is tied to identity and social-group awareness, e.g. "comic voice". Interesting, these same concepts are not all challenging for humans: humans have moderate-to-high levels of agreement in 76% of concepts that LLMs struggle with; articulation limits, we find, are executor relative. Finally, we characterize the nature of improvement in each case: while recoverable concepts can be articulated through definitions and explanations, irrecoverable concepts cannot be transmitted, even with examples, and might require novel learning mechanisms.
0
cs.CLcs.AI Ziyang Ling, Shuyu Lu, Ziyi Chen · Oct 14, 2026

Multimorbid prescribing is a high-stakes coordination problem: patients with multiple chronic conditions receive fragmented, single-disease treatment plans that frequently trigger adverse drug events. PRISMATIC addresses this by treating prescription generation as a multi-agent synthesis task rather than monolithic text generation. The system deploys six specialized agents—ranging from information extraction to safety and rationality critics—on a shared blackboard, coordinated by an inner iterative-refinement loop (DFPC) and an outer long-term weight-adaptation loop (DSWA). The work matters because it reframes clinical AI safety as an explicit multi-objective coordination problem, moving beyond end-to-end LLM output toward modular, auditable reasoning.

Medical prescribing errors for multimorbid patients, who require complex drug regimens, are a major patient safety concern. These errors often stem from fragmented decision-making across medical specialties, a critical coordination failure that leads to adverse drug events and rehospitalizations. To address this coordination challenge, we introduce PRISMATIC, a multi-agent architecture where specialized agents, each representing a workflow role, collaboratively generate and refine treatment plans. Operating on a blackboard architecture, the system first structures patient information from clinical notes, then iteratively develops safe, rational, and interpretable drug regimens. The agents' collaboration is governed by two novel adaptive coordination mechanisms: (1) Dynamic Self-Updating Weight Adjustment (DSWA), a long-term mechanism that adjusts the influence weights of agents based on historical case outcomes, enabling the system to adapt and trust more reliable specialists over time. (2) Discrepancy Feedback Precise Calibration (DFPC), a short-term mechanism where agents provide iterative feedback to resolve disagreements and eliminate prescription conflicts for the current patient. Experiments on patient records from the MIMIC-IV database show that PRISMATIC significantly reduces drug conflicts, improves prescription coverage, and enhances treatment consistency compared to strong LLM baselines. Our work demonstrates that structuring clinical co-treatment as a multi-agent coordination problem offers a promising path toward safer and more coherent multidisease management.
0
cs.CLcs.AI Minghan Li, Guodong Zhou · Oct 14, 2026

The paper tackles the token inefficiency of visible reasoning traces in Chinese LLMs, which are typically generated in modern vernacular Chinese. It proposes Wenyan Thinking, a method that rewrites intermediate reasoning into Classical Chinese (wenyanwen) to produce more compact traces while keeping final answers short and benchmark-compatible. The work matters because it treats linguistic register itself as a controllable compression axis for reasoning, offering a practical way to improve accuracy under tight generation budgets without architectural changes.

Visible reasoning traces of Chinese reasoning-oriented LLMs are typically written in modern vernacular Chinese, which may be verbose under limited decoding budgets. We ask whether the linguistic register of reasoning can be used to improve efficiency. We propose Wenyan Thinking, which emits intermediate reasoning in Classical Chinese (wenyanwen) while retaining a short direct-answer output. Starting from modern-Chinese reasoning traces, we rewrite only the reasoning field into wenyan and fine-tune Qwen3-4B-Thinking-2507 on the rewritten supervision. To distinguish register shift from generic compression, we construct a compact modern-Chinese control using the same source data, teacher family, base model, and SFT recipe. Across budget-sensitive evaluations on MMLU-ProX-Lite-ZH, CEVAL, and AGIEval-CN, Wenyan Thinking substantially reduces reasoning length and missing-answer rates under constrained decoding. Compact rewriting explains much of the efficiency gain, while wenyan consistently outperforms the compact modern-Chinese control on the primary benchmark and remains competitive across the additional benchmarks. These results identify linguistic register as a practical design axis for efficient visible reasoning in Chinese LLMs.
0
cs.LGcs.AIcs.CL Aryan Das, Arnab Bhattacharya, Vinay Kumar Verma · Oct 14, 2026

Reinforcement learning with verifiable rewards suffers from coarse scalar supervision and moving-target instability in self-distillation. FSPO eliminates the persistent teacher model by storing sparse historical next-token distributions as fixed function-space targets, combining them with privileged disagreement correction and reliability-adaptive grounding. Across scientific reasoning and tool-use benchmarks, it achieves roughly 4% higher average accuracy than SDPO under a 5-hour budget while cutting peak memory from about 70 GB to 56 GB on Olmo3-7B-Instruct.

Reinforcement Learning with Verifiable Rewards (RLVR) improves reasoning in language models, but scalar outcomes provide coarse supervision over response trajectories. Self-distillation offers denser token-level guidance by comparing an unassisted policy with a feedback-informed self-teacher, yet the teacher evolves with the student, creating unstable targets and motivating additional regularization. We introduce Function-Space Policy Optimization (FSPO), a single-policy framework that combines current privileged adaptation with function-space temporal consolidation. FSPO stores sparse historical next-token distributions as fixed temporal targets, providing temporal separation without maintaining a persistent teacher model. It further introduces privileged disagreement correction to explicitly suppress locally overvalued actions, reliability-adaptive grounding that strengthens reference supervision when self-generated evidence repeatedly fails, and quality and coverage-aware temporal memory that retains verified behaviors and improves privileged demonstrations. Across reasoning and tool-use benchmarks, FSPO achieves the highest average accuracy under a 5-hour training budget, improving over the strongest baseline by approximately 4% points on average while reducing peak memory from about 70 GB to 56 GB on Olmo3-7B-Instruct.
0
cs.AIcs.CLcs.LG Minseok Ko, Hyunseok Lee, Woomin Song et al. · Oct 14, 2026

As large language models proliferate, identifying which model family generated a given text must remain reliable even when the domain or model version changes at test time. This paper proposes ATLAS, a generative framework that learns source-conditioned text distributions through lightweight adapter tuning and attributes text by comparing clipped token-level likelihoods. A new benchmark, MAABench, demonstrates that this likelihood-based approach outperforms direct discriminative classifiers under distribution shifts, while also enabling identification of distillation teachers.

As large language models (LLMs) are increasingly used to generate text, their misuse has become a growing societal problem, with implications for academic misconduct, model distillation, and cyberattacks. For these reasons, Model Authorship Attribution (MAA), which identifies the source model of a given text, is important for promoting the responsible use of LLMs and improving AI safety. In practice, attribution systems must remain reliable beyond the distributions observed during training. They may encounter texts from unseen domains and writing settings, as well as generations from future versions of model families that were not available when the system was trained. However, existing MAA methods often exhibit substantial performance degradation under such distribution shifts. To address this challenge, we propose Authorship Tracing via Likelihood-based Attribution of Sources (ATLAS), which formulates MAA through source-conditioned text modeling rather than direct source prediction. ATLAS learns how text from each source family is generated and attributes a given text by comparing its likelihood under each learned source condition. We aggregate this likelihood evidence at the token level with clipping so that no single token dominates the decision. We further introduce MAABench, a broad MAA benchmark for evaluating practical OOD settings such as domain and version. Our experiments show that ATLAS consistently outperforms existing baselines across MAABench and OpenTuringBench. In particular, when both the generation domain and the model version change on MAABench, ATLAS achieves 74.27% accuracy, 9.00pp higher than the strongest baseline. Beyond MAA, ATLAS can also help identify distillation source models by measuring which source model a target LLM most closely resembles. Our extended experiments show that ATLAS recovers the known teacher of every distilled model we evaluate.
0
cs.CLcs.AIcs.LG Raavi Gupta, Ziqing Yang, Karli R. Hochstatter et al. · Oct 14, 2026

The paper tackles the months-long lag in confirming US overdose deaths by predicting suspected overdoses directly from death investigation reports available days after a fatality. Its core idea is an expert-guided pipeline that extracts verbatim evidence spans—feature-guided rationales—to support classification, comparing them against templated verbalizations and against joint self-rationalizing models. The best configuration improves over a deployed rule-based system by roughly 15% relative macro-F1 while preserving expert oversight, offering a plausible path to faster public-health surveillance.

Confirmation of overdose deaths in the United States is often delayed due to the complexities of certifying drug-involved deaths. Death investigation reports represent a rich but underutilized data source that could be used to predict whether a death is a suspected overdose (i.e., a death preliminarily identified as an overdose prior to the final cause and manner of death determination). We present an automated framework that classifies suspected overdoses from death investigation reports, while producing supporting explanations guided by expert knowledge. Through an expert-guided design process, we investigate 1) what type of explanations are best for model prediction performance, and 2) which architecture is better suited for this task: pipeline models that rationalize first and then predict, or self-rationalizing models that jointly predict and rationalize? Our experiments show that a pipeline model with explanations grounded in the input death investigation reports outperforms the other settings. Our best model also outperforms a rule-based system currently in deployment by 15%, while allowing expert interventions for final decisions.
0
cs.CLcs.AIcs.HC Yilin Jiang, Fei Tan, Xuanyu Yin et al. · Oct 14, 2026

This paper tackles the problem that LLM agents often return replies which a human requester cannot interpret because they rely on private working context unseen by the user. The authors define reply usability as the ability of a requester to understand and act on a reply from only what they have seen ($R$), and measure it with an LLM-based reader model that flags information gaps. Across eight current models, 54% of 480 replies fail, with even the best model failing 30% of the time. They show that appending explicit requirements or rewriting with a secondary model substantially lowers failures, making usability an actionable target for agent design.

People delegate multi-step work to LLM agents and read only the reply that the agent hands back. Current evaluation scores task completion and the faithfulness of reports, and it leaves open whether the requester can understand and use the reply. We call this property reply usability and measure it with a reader model that takes the requester's position and tests whether the reply can be interpreted from what the requester has seen, is in the requester's language and answers the request. Its agreement with the majority of five annotators lies within the range of the individual annotators. Across eight models from seven families, 54% of 480 replies fail, and the best model still fails on 30%. Failed replies mostly point to material the requester has not seen or use labels that the agent coined during its work. Stating explicit requirements for the reply reduces the failure rate from 0.52 to 0.43 together with errors and omissions, and a secondary model that rewrites the reply reduces it to 0.36, which human annotators confirm in a blind comparison. Reply usability can thus be scored alongside task success and improved with one appended message or one call to a secondary model.
0
cs.CLcs.AIcs.LG Baowen Zhang, Hangting Ye, Hongyuan Zha · Oct 14, 2026

Typed decision models return probabilities over fixed answer choices instead of generating free text, making them a natural fit for tabular prediction tasks. This paper evaluates four such models against three large language models on row classification, fact verification, and anomaly detection, subjecting every request to 21 content-preserving rewrites. The authors find that decision models match LLM accuracy at far lower cost and are far more robust to how questions are phrased, yet no model escapes fragility when the table layout is altered.

Typed decision models are language models that answer a question with a fixed set of possible answers by returning a probability for each answer instead of generating text. We study them on tabular data and compare four decision models with three large language models (LLMs) on row classification, fact verification and anomaly detection. Every request is sent in its original form and under 21 types of rewrite that keep its content, such as renaming the options or writing the table in another format. The decision models perform as well as the LLMs at a lower cost. Three of them are also far more robust to how the question is formulated. No model we test is robust to how the table is organized. For every model, at least a third of the row decisions change under some rewrite of the table or the question. The decisions to which a decision model gives low probability are the ones most likely to change. Decision models are a practical choice for tabular decisions, but their robustness remains an open problem.
0
cs.CLcs.AIcs.CY Yilin Jiang, Fei Tan, Xuanyu Yin et al. · Oct 14, 2026

Simulated students let developers test tutoring systems before real learners are available, but LLM role-play suffers from competence leakage because the model substitutes its own knowledge for the learner's. HACHIMI-II counters this by recasting simulation as third-person prediction: it builds a student model, infers a fine-grained learner state for each step, and compiles that state into a deterministic behavior harness that constrains generation. On five datasets, this cuts the ability-distribution gap by 2.4–8.4× and more than doubles error-structure fidelity over the strongest baseline.

Simulated students let researchers test tutoring systems and teaching strategies before real learners are available, but only if the simulation reproduces where a particular learner succeeds and fails. The common approach asks a large language model to role-play a student, but a role does not model what this learner knows or will do next, so the model's own competence fills the gap. Simulated students perform at a level set by the model, differ little from one another, and seldom make the real learners' errors. We model the learner's behavior and recast student simulation as third-person prediction of the learner's next action. HACHIMI-II builds a student model from the learner's history, infers the learner's state for the current item or tutor turn, and compiles it into a behavior harness that constrains the next action. On three item-response datasets, the Wasserstein-1 distance between simulated and real student ability is 2.4--8.4$\times$ smaller than that of the strongest baseline. On two dialogue datasets, HACHIMI-II reproduces real student errors with the same knowledge type, locus, and mechanism 1.8--5.1$\times$ more often than the strongest baseline, and ablations trace the gains mainly to the explicit learner state. Predicting the learner makes capable models usable as simulated students.
0
cs.CLcs.AIcs.IR Shijun Li, Yang Liu, Najmeh Sadoughi et al. · Oct 14, 2026

Existing retrieval-augmented MT applies retrieval uniformly, yet LLM parametric knowledge suffices for many inputs and external evidence is only conditionally useful. This paper proposes SRAT, an agentic RL framework that treats reasoning, retrieval, and translation as learnable actions optimized via GRPO for final translation quality. It learns when to retrieve, what to query, and how to integrate evidence, supported by two retriever-alignment strategies and evaluated across idiom, knowledge-intensive, and document-level settings. The work is important because it challenges the default assumption that retrieval is always beneficial and shows that adaptive, quality-aligned evidence acquisition consistently outperforms fixed pipelines.

Retrieving external knowledge can improve large language model (LLM) translation by providing supplementary information such as idiom interpretations and terminology. However, existing retrieval-augmented machine translation systems typically apply predefined retrieval strategies uniformly across all inputs. We argue that translation operates in a partial-evidence regime: LLM's parametric knowledge suffices for many inputs, while external evidence benefits a subset and usually supports rather than directly provides the desired translation. This creates two challenges: deciding when to retrieve and what evidence to acquire. We introduce Selective Retrieval-Augmented Translation (SRAT), an agentic reinforcement learning framework that learns when to translate directly or retrieve, what to retrieve, and how to integrate these decisions by optimizing final translation quality. To align evidence retrieval with downstream translation quality rather than simple semantic similarity, we further develop joint Plackett--Luce optimization and translation-quality contrastive training for retriever-training. Experiments on idiom, knowledge-intensive, and document-level translation with offline or online retrieval show that SRAT consistently outperforms never- and always-retrieve baselines, and quality-aligned retriever training provides further gains when similarity-based retrieval is insufficient. The results demonstrate the benefit of treating retrieval as a learnable translation action rather than fixed preprocessing.
0
cs.CLcs.AI Ruilin Shang, Shilong Hou, Zi Long et al. · Oct 14, 2026

Data augmentation for document-level NLP risks breaking inter-sentential coherence and invalidating sentence-aligned labels. This paper proposes an LLM-driven discourse parsing framework that preserves sentence order, count, and rhetorical relations $R_{i,j}$ while replacing key phrases $\mathbf{K}_i$ to generate augmented documents $\mathbf{D}'$. By keeping the $n$-sentence structure fixed, labels such as summary indices or QA spans can be transferred without expensive LLM relabeling.

Data augmentation (DA) plays a vital role in improving model performance in low-resource or limited-supervision scenarios within Natural Language Processing (NLP). Existing DA methods, such as synonym replacement and back-translation, have demonstrated effectiveness on the word or sentence level; however, they frequently neglect discourse-level coherence and logical flow, which are essential for complex tasks dependent on inter-sentential relationships. In this paper, we propose a structure-preserving document-level data augmentation framework based on large language models (LLMs) and document-level discourse structure parsing. Our approach identifies rhetorical relations between sentence pairs and extracts key phrases, which are then replaced with semantically coherent but topically shifted content while preserving the original discourse structure. Experimental results on text summarization and question answering show that the proposed augmented data provides complementary supervision and improves combined-data training across the evaluated tasks. Comparisons with a standard RST parser and controlled ablations further support the proposed discourse representation.
0
cs.CLcs.AI Yi Ding, Mengyu Wang, Min Zhou et al. · Oct 14, 2026

Language models frequently derail on multi-step reasoning because a single early error propagates through the rest of the generation. REWIND attacks this by treating token-level entropy as a diagnostic: it traces backward from high-entropy peaks to the sharpest local gradient jumps, uses those positions as cut points for suffix regeneration, and filters proposals with a likelihood-based acceptance rule. The result is a targeted, test-time repair loop that requires no fine-tuning or external verifier and that the authors show improves accuracy across multiple model families and reasoning benchmarks.

An early mistake in the generated reasoning can constrain all subsequent reasoning. Repeated-generation methods, like MCMC-based approaches, attempt to improve output quality by sampling multiple generations, but their effectiveness can be limited by randomly selecting where to regenerate. On MATH500 with Qwen2.5-Math-7B, we find that incorrect responses have substantially higher mean token entropy than correct responses, with an average within-question relative increase of approximately 112%, suggesting that entropy can signal reasoning errors. Motivated by this finding, we introduce REWIND, a training-free controller that uses entropy dynamics to propose targeted suffix regenerations. Across three model families and five benchmarks, REWIND outperforms all baselines, with gains of 0.51-10.00 percentage points over the strongest baseline. These results demonstrate the effectiveness of targeted, uncertainty-guided trajectory repair across models and tasks. Our code is available at https://anonymous.4open.science/r/rewind-D310.
0
cs.AIcs.CL Rishitosh Kumar Singh, Amir Saeidi, Shamanthak Hegde et al. · Oct 14, 2026

Existing agent benchmarks generally assume cooperative, emotionally stable users, overlooking a major source of real-world failure. This paper introduces τ-Emotion-Bench, a ten-domain benchmark that evaluates tool-calling agents under controlled emotion-conditioned user interactions, together with Tracer, a pipeline that collects training trajectories through an interaction-aware harness where dissatisfied users can terminate inefficient exchanges. It matters because it reveals large reliability gaps in frontier models and shows that small models can be trained to substantially improve interaction consistency with far less data than prior methods.

In long-horizon tool-calling tasks, LLM agents can fail not only because of tool-use errors, but also because of ineffective interaction with users. Yet existing benchmarks largely assume cooperative and behaviorally stable users, leaving the effect of emotional variation on agent reliability underexplored. We introduce $\tau$-Emotion-Bench, a ten-domain benchmark for evaluating tool-calling agents under controlled emotion-conditioned user interactions while preserving the underlying task objective. To scale both benchmark construction and agent training, we introduce Tracer, a scalable agentic data-generation pipeline that constructs grounded, policy-valid tasks and collects trajectories through an interactive agent--user--environment harness. By allowing dissatisfied users to terminate inefficient interactions, the harness provides an interaction-aware signal that filters trajectories with excessive user dependence and favors effective tool use. Experiments with two user simulators show that frontier agents remain unreliable, with substantial gaps between average task success and consistent task completion. Tracer-generated supervision consistently improves Qwen3 models across scales, generalizes to unseen domains, and transfers to $\tau$-Bench and $\tau$-Trait. Behavioral analyses further show that higher task success is associated with a better balance between tool execution and necessary user follow-up. Overall, $\tau$-Emotion-Bench and Tracer provide a scalable framework for evaluating agent reliability under diverse user behaviors and improving tool-calling agents through interaction-aware supervision.
0
cs.CLcs.AI Shuyuan Zheng, Yun-seo Lee, Xing Gao et al. · Oct 14, 2026

Legal reasoning is not merely the mechanical application of rules to facts; it is shaped by a judge's underlying legal philosophy. This paper introduces LePhilBench, the first benchmark to test whether LLMs can both understand jurisprudential tendencies and apply them to predict judicial outcomes. It pairs jurisprudential profiling with philosophy-aware judgment prediction and grounds the tasks in a dataset of 220 annotated U.S. Supreme Court opinions, offering a rigorous new lens on models' legal reasoning capabilities.

Legal reasoning is a fundamental capability for large language models (LLMs) to complete legal AI tasks such as legal judgment prediction. In legal practice, this reasoning is shaped by legal philosophy: a judge's view of the nature and sources of law guides how legal materials are interpreted and applied, so judges working from the same statutes and precedents can reach different judgments. Existing research has largely overlooked whether LLMs can understand legal philosophy and apply it in legal reasoning, an ability we call \textit{legal-philosophical reasoning}. To fill this gap, we introduce LePhilBench, a benchmark for evaluating the legal-philosophical reasoning of LLMs that comprises two benchmarking tasks and a dataset. The two tasks evaluate how well LLMs understand legal philosophy and how well they apply it in legal reasoning, respectively. The dataset is manually and meticulously constructed. Its test set contains 220 U.S. Supreme Court opinions. A law professor designed fourteen annotation questions on legal philosophy, and three law-trained annotators with formal training in jurisprudence answered all fourteen questions for every opinion, yielding 9,240 legal-philosophical labels. LePhilBench takes the first step toward exploring legal-philosophical reasoning in LLMs.
0
cs.CLcs.AIcs.SD Sangmin Lee, Yejin Jeon, David Ifeoluwa Adelani · Oct 14, 2026

Multilingual speech technologies still fail to reach most of the world's languages because existing corpora are limited to a few hundred well-resourced languages and narrow domains like parliamentary proceedings or Bible readings. ELARSpeech addresses this gap by curating 30,202 hours of speech across 675 underrepresented languages from the Endangered Languages Archive, yielding both labeled and unlabeled subsets with rich acoustic and communicative diversity. It matters because it provides a large-scale, publicly available testbed that reveals existing self-supervised speech models struggle on the true linguistic long tail despite massive pretraining.

Massively multilingual speech modeling has made remarkable progress in recent years, yet existing training resources and benchmarks still underrepresent much of the linguistic long tail. To address this gap, we introduce ELARSpeech, a large-scale multilingual speech resource comprising 30,202 hours of speech across 675 underrepresented languages, curated from the Endangered Languages Archive. Combining human-annotated and unlabeled recordings, the corpus spans diverse recording conditions, domains, and language families. Beyond corpus construction, our experiments show how ELARSpeech supports extending ASR and TTS capabilities to diverse underrepresented languages, with further benefits from pseudo-labeling unlabeled data. At the same time, our speech representation analysis reveals remaining limitations in transferring existing multilingual models to the linguistic long tail. Together, ELARSpeech provides both a resource and a testbed for extending multilingual speech technology further into the linguistic long tail. We publicly release the dataset, all trained ASR and TTS models, and the complete data construction pipeline to facilitate research on long-tail multilingual speech technologies.
0
cs.CLcs.AI SungHo Kim, Eojin Jeon, SangKeun Lee · Oct 14, 2026

KoAGE investigates whether large language models can know, learn from context, and coin Korean neologisms. The authors introduce NeoTrace, an automated pipeline that collects and dates 4,271 neologisms across six genres, and propose a cutoff-aware benchmark that separates lexical recall from contextual inference and generation. By comparing model outputs with attested human coinages under original materials and simulated community settings, the paper offers a temporally grounded view of how models adapt to evolving vocabulary.

Korean neologisms arise through diverse mechanisms, a demanding test of language models beyond lexical memorization. To enable systematic evaluation, we introduce NeoTrace, an automated, rerunnable framework that collects and dates neologisms across genres. Its 4,271 entries support KoAGE, a cutoff-aware benchmark with three acquisition and two generation tasks---the latter, to our knowledge, the first to compare model coinages with attested neologisms under their original materials and community context. Across 21 models, lexical recall diverges from contextual inference: in a five-model temporal analysis, models define only 13-30% of cutoff-year words, yet can infer meaning from one usage. However, structural understanding remains limited: even correct definitions barely improve formation analysis of pre-cutoff neologisms. Given word-building materials, single models often follow human formation mechanisms, whereas multi-agent coinage favors abbreviation and depends on interaction framing. KoAGE thus separates what models know, learn from use, and coin.