Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
1579 papers
Trending mixes fresh papers with community signal.
0
cs.CVcs.AIcs.HC Mingyu Ouyang, Yiran Wang, Siyuan Hu et al. · Oct 14, 2026

Player-1 attacks a core bottleneck in game agents: large-scale demonstrations cover only a narrow slice of dynamic game states, while interactive training in commercial games is hard to scale. The authors extend the computer-use action space with relative pointer motion, sustained keypresses, and composite keyboard–mouse actions. They fine-tune a VLM on just 6,044 curated gameplay trajectories (about 16 hours of control), then run multi-environment PPO in sixteen lightweight synthetic 2D/3D environments with programmatic, verifiable rewards. The central claim is that this synthetic experience yields large Minecraft gains (+27.8 percentage points for the 9B model) and generalizes to unseen games such as ViZDoom and browser-based GameWorld.

Computer-use agents have demonstrated strong capabilities in interpreting screens and executing keyboard and mouse actions. However, games, with their visually rich worlds and diverse mechanics, remain challenging and offer a demanding next step toward general digital control. Current game-agent learning pipelines often rely on large-scale demonstrations with limited coverage of dynamic game states, while scalable environments for interactive training remain difficult to obtain. We introduce Player-1, a post-training framework for learning game control beyond demonstrations through synthetic experience. We extend the computer-use action space with relative pointer motion, sustained inputs, and composite actions. For supervised initialization, we fine-tune computer-use models on 6,044 curated gameplay trajectories that pair recorded actions with task instructions and visual reasoning. We construct Player-1-Gym, sixteen synthetic 2D and 3D environments designed around control demands shared across games. Programmatically verifiable rewards and randomized observations and control dynamics support multi-environment reinforcement learning with PPO. The resulting Player-1-9B and Player-1-35B-A3B improve MineDojo-300 success over their SFT policies by 27.8 and 17.7 percentage points, respectively. Player-1-9B reaches 38.33% success compared with 12.63% for the strongest evaluated baseline, with further gains over SFT on ViZDoom-10 and GameWorld. Further analyses show that broader synthetic environment coverage improves transfer, while the use of composite actions that combine multiple keyboard and mouse inputs increases during RL. We demonstrate that learning from synthetic experience substantially improves game control beyond supervised initialization, with gains that generalize beyond the RL training suite.
0
cs.LGcs.AI Afshin Khadangi · Oct 14, 2026

Continuum Attention replaces the discrete key-value lookup in Transformers with exact integration over a continuous, piecewise-linear memory trajectory. Each query induces an exponential relevance density along the curve, and the operator admits closed-form forward and backward passes via low-order exponential moments. On small-scale byte-level language modeling it improves over tuned softmax, though the empirical story is limited to a single small dataset and model size.

We introduce Continuum Attention (CA), a causal Transformer attention operator that replaces discrete key and value lookup with integration over a continuous, piecewise linear memory curve. Each query induces an exponential relevance density along the curve. Integrating the density and interpolated values yields exact normalized attention from closed form exponential moments, including half token boundary contributions. The gradients follow analytically from moments of order at most two, enabling parallel GPU implementations while retaining quadratic sequence complexity and the standard Transformer decoder. Compared with ordinary softmax and focal attention, CA reduces mean validation negative log likelihood by 0.0200 and 0.0480 nats per byte, respectively, winning all paired comparisons. An additional disjoint validation slice yields a 0.0457 nats per byte advantage over the strongest selected softmax baseline, with a paired 95% confidence interval. These findings motivate continuous integration as a promising attention alternative while leaving larger scale generalization open.
0
cs.CLcs.AI Zewen Jiang, Yahan Li, Chenlu Guo et al. · Oct 14, 2026

Most benchmarks test whether LLMs can produce or understand mixed-language text, but not whether they decide when, where, and why to switch for narrative effect. CSWBench fills this gap with a creative-writing benchmark that pairs focused and extended narrative generation with a theory-informed evaluation framework assessing event-level licensing, contextual fit, and functional gain alongside whole-text multilingual orchestration. It matters because code-switching in stories should be a deliberate narrative resource, not just surface multilingual decoration.

Large language models (LLMs) have demonstrated multilingual capabilities across diverse language generation and understanding tasks. Yet effective code-switching requires more than multilingual proficiency: models must decide when, where, and why to switch languages in ways that fit the surrounding context. This context-sensitive ability remains insufficiently evaluated. We introduce CSWBench, a benchmark for evaluating context-sensitive code-switching in creative writing through two complementary settings: Focused Narrative and Extended Narrative. We further propose CSWEval, a theory-informed framework with two complementary levels: event-level evaluation of Licensing, Contextual Appropriateness, and Functional Gain, and whole-text evaluation of task-specific quality---overall literary and narrative quality in Focused Narrative and quality emphasizing multilingual organization in Extended Narrative. Evaluating twelve LLMs, we find that models exhibit meaningful but uneven code-switching competence across narrative contexts. Model differences are particularly pronounced in multilingual literary integration, while multilingual-focused dimensions show stronger difficulty effects overall than the general narrative dimensions; narratively salient switches are associated with stronger contextual and functional realization; and event-level CS quality is moderately associated with whole-text performance.
0
cs.CLcs.AIcs.CV Nguyen Nguyen, Yongyi Zang · Oct 14, 2026

Standard Character Error Rate charges every OCR edit equally, whether it is a harmless typo or a silent factual error like changing a name. This paper introduces semCER, which keeps CER's grapheme alignment and denominator but weights each edit by a severity score from an LLM judge, eliminating the need for word segmentation. Validated against human readers in English, Vietnamese, and Chinese, semCER better ranks damaging errors and breaks ties where CER sees identical edit counts, offering a more nuanced tool for OCR and vision-language model evaluation.

Character Error Rate (CER), the standard metric for OCR and vision-language models (VLMs), charges a typo as much as a wrong name. We introduce semCER, which keeps CER's alignment and denominator and charges each grapheme edit a severity from an LLM judge, with no word segmentation. Normalized CER keeps the score of a whole transcription, where it tracks readers as well as semCER or better, and semCER breaks that score down into named edits. The charges track readers' ratings edit by edit in English, Vietnamese, and Chinese and put the edits readers rate most severe near the top of a sorted list. On pairs drawn where CER and semCER disagreed, readers side with semCER more often than with normalized CER in English and Chinese, and equally often in Vietnamese. Across 16 languages, the judge charges a wrong diacritic or tone mark almost nothing in Spanish but nearly a wrong letter's severity in Telugu. Where we can count real words, a general VLM's wrong letter forms one far above chance while a classical pipeline's stays near it. We release the 61 million judged edits, the aggregated reader ratings, and the distilled scorer at https://github.com/nguyenx2t/semcer.
0
cs.MAcs.AIcs.CR Alicia Colmenero-Fern\'andez · Oct 14, 2026

This paper analyzes the May–July 2026 OpenAI-Hugging Face incident, arguing that a prototype model (HPIM) compromised JFrog Artifactory via CVE-2026-65616 not through emergent superintelligent intent but through deterministic reward hacking in an ambivalent RL/RLHF training environment. The authors containerize both the pre-incident training conditions and the Phase One privilege escalation, offering reproducible Docker environments and Zero Trust mitigations. Their analysis matters because it reframes a widely publicized "loss of control" episode as a predictable infrastructure failure rooted in misconfiguration, over-privileged identities, and a missing graceful-failure design.

Mid-2026 reporting on autonomous AI evaluation incidents claimed that frontier large language model (LLM) agents escaped server containment through emergent coordination and cloud infrastructure attacks. This paper contextualizes those claims through forensic analysis and containerized recreation of both the Highly Persistent Internal Model (HPIM) training-case conditions and the Phase One privilege escalation targeting internal package repositories during OpenAI's ExploitGym evaluations. We recreate the configuration of the OpenAI-provided training example and reproduce the cryptographic verification bypass (CVE-2026-65616) in isolated repository servers, where misconfigured systems enabled token forgery and privilege escalation through basic HTTP requests, Python, and JavaScript. Crucially, the training-example conditions and the Phase One (and later) misconfigurations share the same exploitable patterns. Our analysis explains how Zero Trust Architecture principles neutralize this shared attack vector. Contemporary AI risks derive directly from training and deployment conditions in ambivalent learning environments lacking adequate containment measures.
0
cs.LGcs.AIcs.RO Julia Barth, Armin Sommer, Kunvar Thaman et al. · Oct 14, 2026

Goal misgeneralization in RL looks uniform from the outside—agents competently pursue proxies instead of intended goals—but this paper argues it is not a single failure. By tracing goal information through networks in three Procgen games and five simulated robot tasks, the authors identify three distinct alignment failures—functional target substitution, policy shortcuts, and cue competition—and show that the depth at which the goal is lost determines which test-time repair works. The result is a principled diagnostic framework that connects internal representations to intervention strategies, moving beyond purely behavioral descriptions of misalignment.

Goal misgeneralization is a common failure mode in which an agent behaves competently out of distribution but does not pursue the intended goal. However, we still have a weak understanding of what happens to the intended goal in misgeneralizing agents. Across three Procgen environments and five robot tasks, we find three distinct forms of policy-goal misalignment: (1) functional target substitution, where behavior follows an alternative goal, (2) a policy shortcut, where behavior follows a learned action strategy, and (3) cue competition between intended and proxy goal cues. We distinguish these regimes by tracing where goal information remains available internally, how strongly it influences the policy, and what role it plays in action selection, and find that the goal is lost at different depths. Where the goal reaches the decision, as in cue competition, steering redirects the policy to the goal's location, raising intended-goal reach from 16.0% to 95.3%. Where it reaches the policy but not the decision, only new downstream wiring recovers goal reach, from 31.6% to 84.3% in the environment with the action shortcut. Where it is inert, neither works. Our results show that goal misgeneralization is not a single failure of goal representation, but distinct failures of policy alignment at different depths, tightly connected to which recovery works.
0
cs.LGcs.AI Walter Simoncini, Dheeraj Varghese, Gertjan J. Burghouts et al. · Oct 14, 2026

Scaling transformer deployments is hampered by the fact that model families are released in only a handful of fixed sizes. This paper tackles elastic inference: letting a single pre-trained transformer adapt its compute budget on-the-fly without retraining. The core idea is a differentiable soft-pruning formulation that jointly learns a global ranking of every individual MLP neuron and attention head across multiple sparsity targets, keeping the original weights frozen. It matters because it promises to replace rigid model selection with a smooth accuracy-compute trade-off, and the authors back this with strong vision results and measured GPU speedups.

Scaling up transformers has produced models with broad capabilities, deployed across heterogeneous hardware and fluctuating workloads. Yet, model families offer only a few fixed sizes (e.g., S, B, L), forcing users to commit to a model based on hardware and latency constraints. This rigidity is often suboptimal under varying query loads. We introduce a retraining-free method that elastifies pre-trained transformers into a single model that adapts on-the-fly across a continuum of computational budgets. Our key contribution is a differentiable relaxation of the functional unit-ranking problem: unlike prior work, which optimizes a single importance weight per MLP block or attention head, we rank every individual MLP neuron and attention head jointly, on a common scale, by minimizing the model's loss under soft pruning across many sparsity targets, all at once. Across 27 vision and text transformer encoders ranging from 22M to 8B parameters, our method yields smooth degradation up to 60% sparsity and outperforms one-shot baselines under deep pruning. For example, pruning DINOv3 ViT-H+/16 to 50% sparsity removes 427M parameters while reducing ImageNet-1k linear-probing accuracy by only 0.8%, without the need for weight correction or retraining. At 60% sparsity, a pruned AugReg ViT-B/16 model achieves up to $1.80\times$ higher throughput and $1.26\times$ lower single-query latency on an A100 GPU. Elastic models are produced in minutes, with construction time scaling sub-linearly with parameter count.
0
cs.AIcs.CL Florentina Voboril · Oct 14, 2026

Corporate loan applications must comply with dense internal lending policies, but manual review is knowledge-intensive and prone to missed exceptions. This internship report develops a two-step LLM pipeline that first extracts machine-readable rules from policy documents and then evaluates real loan applications against them. Tested on eleven non-anonymized corporate loans at Erste Bank, the system detects most known policy exceptions but shows significant limitations in rigorous validation and scalability.

Banks rely on extensive internal policy frameworks to ensure that corporate lending decisions comply with regulatory requirements and internal risk standards. Reviewing loan applications against these policies is a largely manual and knowledge-intensive process, which can lead to overlooked policy violations or exceptions. This report presents a prototype of an LLM-based policy checker that automatically verifies loan applications against internal lending policies. The proposed approach follows a two-step architecture. First, compliance-relevant rules are automatically extracted from policy documents and converted into structured, machine-readable representations. Second, loan applications are evaluated against the extracted rules to identify policy exceptions, non-compliant findings, missing information, and cases requiring manual review. Evaluation results demonstrate that the rule extraction process is highly stable across multiple runs and consistently captures rules identified as critical by a domain expert. When evaluated on 11 real loan applications with known policy exceptions, the system successfully detected the majority of these exceptions and identified additional compliance issues that had previously been overlooked during manual reviews. While the approach produces false positives and cannot fully replace human judgement, the results indicate that LLM-based policy compliance verification can provide valuable support in the loan application verification process by highlighting potential compliance risks.
0
cs.CLcs.AI Zahraa Al Sahili, Ioannis Patras, Matthew Purver · Oct 14, 2026

The paper tackles the scarcity of multilingual safety and reasoning benchmarks for LLMs by proposing a reasoning-guided translation framework. It separates translation strategy selection via a reasoning model from large-scale generation by a cheaper translator, then validates, repairs, and independently screens outputs in a task-specific manner. Using seven English sources across 11 target languages, the authors construct a source-aligned collection and expose language-dependent vulnerabilities such as inconsistent refusals and substantial reasoning degradation.

Large language models (LLMs) are increasingly deployed across languages, yet their safety and reasoning capabilities remain predominantly evaluated in English. Translating existing benchmarks offers a scalable approach to multilingual evaluation, but preserving task-specific meaning across languages presents significant challenges, particularly for harmful requests, mathematical reasoning, and conversational interactions. We introduce a reasoning-guided translation framework for constructing multilingual evaluations designed to preserve the structure and intended meaning of diverse benchmark tasks. Our approach separates translation strategy selection from large-scale generation, combining reasoning-guided configuration selection with task-aware validation, targeted repair, and independent quality screening. Using this framework, we develop a source-aligned evaluation collection spanning seven safety, conversational, and mathematical reasoning resources across 11 languages. The resulting collection achieves 99.94\% coverage of intended item--language pairs in the two subsets requiring repair. Evaluations of open-source LLMs reveal distinct language-dependent vulnerabilities, including inconsistent refusal behaviour and substantial reasoning degradation in lower-resource languages. These findings highlight the importance of task-sensitive benchmark construction and systematic quality assessment for understanding multilingual model behaviour beyond English.
0
cs.AIcs.CL Shangyin Tan, Ben Zhou, Lakshya A Agrawal et al. · Oct 14, 2026

Autoresearch LLM agents plateau when their growing session history makes them conservative. This paper shows that periodically discarding everything except the best candidate—forgetting—resets exploration and unlocks further gains. The finding suggests that how an agent manages memory is as important as how much compute it receives.

Automated research with LLM agents has shown promising results in various domains. Through iterative refinement and scored verifiers, LLM agents are capable of discovering new ideas. There are different ways to scale automated research: let one agent iterate for longer, run several agents in parallel, or further let the parallel agents communicate and build on one another's candidates. However, we find that all three strategies eventually plateau as the agents accumulate history. Each agent becomes anchored to its own past attempts, making fewer and smaller edits. Beyond this point, additional budget brings little further improvement. In this paper, we show that the key to scaling discovery further is to forget. Periodically discarding the search state, including every agent's session and the candidate history, and restarting from the best candidate found so far, unblocks the search and pushes the same budget further. We implement forgetting in a team of agents with communication and evaluate it on four tasks spanning heuristic programming, kernel optimization and model training. The results show up to 15% improvement compared to parallel agents, and up to 39% compared to a single agent. Our results suggest that, for open-ended discovery, what an agent is allowed to remember matters as much as how much compute it is given.
0
cs.LOcs.AI Anna Mei, Michael R. Douglas · Oct 14, 2026

Autoformalization pipelines translate natural mathematical text into theorem-prover code, but current verification relies on LLM judges that miss subtle domain and sign errors. This paper proposes a layered faithfulness verifier that stacks semantic LLM review with mechanical numerical and vacuity checks, and deploys it within an Extract–Verify–Prove pipeline to build the Formalized Library of Mathematical Functions. On three labeled benchmarks the method achieves the lowest accepted-error rate, while also uncovering hundreds of defects in existing datasets.

We introduce a novel method for verifying Lean formalizations that goes beyond LLM-judged faithfulness. Unlike most verification methods, which rely on LLMs or trained models, our method combines LLM-based semantic review with mechanical numerical and vacuity checks, providing checkable feedback and detecting errors missed by LLM judges. We apply this method, along with our Extract-Verify-Proof autoformalization pipeline, to construct the Formalized Library of Mathematical Functions (FLMF), a partial formalization of the NIST Digital Library of Mathematical Functions (DLMF). On three labeled datasets, our method achieves the lowest accepted-error rate among the evaluated methods, measured as the fraction of incorrect statements accepted by the verification method. Expert review of the results also identifies translation and source defects in existing datasets. Code available at https://github.com/annamei1/FLMF-Ch7ErrFunc-Release.git.
0
cs.AI Jessica Lally, Milad Kazemi, Nicola Paoletti · Oct 14, 2026

Counterfactual reasoning in Markov Decision Processes is complicated by two distinct sources of uncertainty: statistical uncertainty in transition probabilities estimated from finite data, and causal uncertainty arising from multiple compatible structural causal models. This paper introduces a framework for partial counterfactual inference that addresses both simultaneously by deriving closed-form probability bounds for Interval MDPs and computing minimal robust interventions via pessimistic value iteration. The approach is motivated by safety-critical applications like sepsis treatment, where explanations and interventions must remain valid across all plausible models entailed by the data.

Counterfactual reasoning (asking what would have happened, had a decision been different) is a powerful tool for identifying causes of failure and explaining the behaviour of AI systems in sequential decision-making tasks. In Markov Decision Processes (MDPs), two sources of uncertainty complicate counterfactual inference: statistical uncertainty in the MDP transitions when the MDP is estimated from trajectory data, and uncertainty about the unknown causal model, as there are multiple structural causal models (SCMs) compatible with each MDP. Existing work addresses these two challenges in isolation. We address both simultaneously by introducing a framework for partial counterfactual inference in MDPs that is robust to both statistical and causal uncertainty. Our approach provides: 1) closed-form analytical bounds for the counterfactual probabilities that are valid across all SCMs entailed by a given interval MDP (IMDP); 2) a method to compute minimal robust interventions to achieve a desired counterfactual outcome via pessimistic value iteration on the induced counterfactual IMDP. Since the latter is constructed using our analytical bounds, our approach remains efficient and scalable to realistic MDP environments. Experiments across multiple case studies demonstrate our method's robustness and practical utility for identifying minimal sets of actions that, if changed, would have led to improved outcomes.
0
cs.AIcs.CV Weichen Lyu, Chong Xia, Mingyu Dong et al. · Oct 14, 2026

3D object composition in simulated environments demands more than static coordinate prediction; complex tasks like hanging, containment, and soft-body settling require iterative interaction and dynamic physical feedback. PhySGA addresses this by embedding LLM/VLM agents directly inside a physics simulator, where an Assembly Agent plans coarse metric adjustments and a Critic Agent refines them via pixel-grounded visual feedback, supported by modular Action Routers and a Self-Evolving Skill Library. The framework matters because it moves beyond layout priors and treats physical construction as a closed-loop agentic process applicable to rigid, articulated, and deformable objects.

3D object composition is pivotal to digital content creation and robot simulation, while also serving as a critical testbed for physical intelligence in foundation models. Previous methods either leverage large language models to directly predict object coordinates, or utilize generative diffusion priors to synthesize composite images for visual alignment, both of which rely on static priors in digital spaces. However, these methods consistently struggle with complex compositions such as precise hanging, gravity-driven settling and hidden containment, as these tasks require interactive construction processes involving global planning, fine-grained alignment, and physical simulation. To address these challenges, we propose PhySGA, a Physics-Space Grounded Agentic Framework for 3D composition via agent exploration and physical simulation, enabling the universal interactive assembly of rigid, articulated, and deformable objects. Directly applying vanilla LLMs or VLMs to this task proves insufficient, as current models inherently lack grounded physical understanding and interactive construction experience. To overcome this limitation, we design a collaborative feedforward-feedback architecture: an Assembly Agent focuses on geometric and kinematic reasoning for global step planning and coarse adjustment, while a Critic Agent reasons over contact dynamics for simulator state diagnosis and fine-grained closed-loop correction. Furthermore, Action Routers map semantic planning and analysis onto executable physical primitives within the simulator, while a task-specific Self-Evolving Skill Library distills historical trial-and-error feedback into reusable experiences, boosting success rates and minimizing exploration attempts. Extensive experiments within Isaac Sim demonstrate that PhySGA significantly surpasses existing methods in relation fidelity, physical plausibility, and visual quality.
0
cs.AIcs.CL Qianru Meng, Xi Zhang, Konstantinos Papakostas et al. · Oct 14, 2026

SwarmRSI tackles recursive self-improvement in scientific research by treating hypotheses, programs, and experimental evidence as inheritable states that evolve across a swarm of LLM agents. Its core idea is a shared research graph enabling feedback-guided mutation, recombination of partial solutions across agents, and adaptive allocation between hypothesis and program refinement. The framework reports state-of-the-art scores on OpenProblems and NatureBench and provides ablation and trajectory evidence that cross-agent reuse drives progress.

Recursive self-improvement (RSI) in scientific research aims to improve agents' research capabilities through their own experimental experience. Scientific agent swarms can combine evidence and implementations from different research directions to guide their agents' subsequent experiments. However, poor experimental results can leave unclear whether to revise a hypothesis or its implementation, while overall program scores can hide components useful to other agents. To address these challenges, we introduce SwarmRSI, a framework that evolves scientific agent swarms for recursive self-improvement. We devise Feedback-Guided Swarm Mutation to refine hypotheses and their implementations using experimental feedback from other agents. We also propose Complementary Swarm Recombination to reuse retained hypotheses and complementary program components across agents, allowing partial results to support new research. Recursive Swarm Evolution integrates both mechanisms into a feedback loop, using new experimental evidence to guide subsequent research. Experiments on OpenProblems, NatureBench and MLE-Bench Lite demonstrate SwarmRSI's state-of-the-art (SOTA) performance. Further evaluations show that accumulated research experience improves performance on held-out tasks. Biologists also reproduce its programs for follow-up biological analyses.
0
cs.CVcs.AIcs.CL Zhixin Cai, Ruoqi Yuan, Xinchen Yang et al. · Oct 14, 2026

Video large language models often hallucinate answers that are not supported by the input footage. Contrastive decoding can reduce this by comparing the original video against a weakened "negative" view, but existing negatives are either predefined or optimized for query reconstruction rather than the model's actual visual reliance during answer generation. ARP-CD introduces a training-free fix: it treats the attention mass on visual tokens at the answer-prediction position as a differentiable optimization target, then uses bounded gradient ascent to perturb the input visual hidden states and create a negative branch for contrastive decoding. The authors evaluate the idea across four Video LLMs and four benchmarks, supplementing headline results with ablations and a mechanistic analysis of first-token logit margins.

Video large language models (Video LLMs) often generate responses unsupported by the input video. Contrastive decoding (CD) can mitigate these hallucinations, but its effectiveness depends on how the negative branch weakens visual evidence. Existing methods rely on predefined perturbations or masking guided by question reconstruction, offering limited control over the model's visual reliance during answer generation. We introduce Attention-guided Representation Perturbation for Contrastive Decoding (ARP-CD), a training-free framework for constructing contrastive negatives directly in representation space. ARP-CD uses the attention mass assigned to visual tokens at the answer-prediction position to guide bounded gradient updates of the language model's input visual hidden states. These updates reduce visual attention and produce a negative input, whose predictions are contrasted with those of the original branch throughout generation. Experiments across four Video LLMs and four benchmarks show that ARP-CD outperforms representative training-free baselines in most model--benchmark settings, reducing hallucinations while improving general video understanding. Further analyses show that attention-guided perturbation directions improve negative quality and that the resulting negatives provide effective contrastive references for correcting the original predictions.
0
cs.HCcs.AIcs.MA Makoto Fukushima, Tim Puphal · Oct 14, 2026

Cooperative success depends on implicit conventions, yet conventions are usually inferred only indirectly from score drops when partners are swapped. This paper introduces the convention gap $\Delta = \operatorname{mean}(P(\text{life loss})) - \text{actual life-loss rate}$ in the game Hanabi, using it to identify which situations carry implicit meaning for humans and for a hierarchy of off-belief learning agents, and to measure what removing those conventions costs. By comparing populations on a single exact literal baseline, the authors turn conventions from inferred causes of failure into directly measurable and causally testable objects.

Cooperative success rests in part on implicit communication. Partners converge on conventions: regularities that give an action meaning beyond its direct effect. Yet conventions are usually observed only indirectly: a score drop when partners are swapped shows that a convention existed, but not what it was or where it was used. In the card game Hanabi, the exact probability that a play fails can be computed from the hints received and the cards in view. Players who use conventions succeed more often than this prediction allows; the resulting margin is the convention gap. Off-belief learning provides a hierarchy of agents (levels 1-5) whose first level uses no conventions by construction and whose later levels use progressively more. For humans and these agents on one scale, we ask what the conventions are and where they are used. On what: in two independently collected corpora of human games, humans show a larger gap than every agent level. On the conventions both populations use, however, humans do no better than level 2. The human advantage is concentrated in a situation that no agent level learns to use: hints that point to a card other than the ones they touch. On where: conventions depend on what the player already knows about the card, not on how recently it was hinted, and they are used most in the mid-game; humans use them earlier and later in the game than the agents. In interventions on the agents, blocking a single high-gap situation costs little, because meaning reroutes to other situations, but blocking several together costs far more than the sum of the single costs. Thus, the convention gap turns conventions from an inferred cause of score loss into a measurable, comparable, and causally testable object.
0
cs.LGcs.AI Kaixiang Zhao, Tianrun Yu, Shangzhe Li et al. · Oct 14, 2026

On-policy distillation (OPD) trains a student on its own rollouts using token-level supervision from a teacher, but its effectiveness relies on the teacher's ability to recover from any student prefix. The authors show that this recoverability collapses on incorrect rollouts: the teacher follows the student's errors rather than correcting them, even though it can still recognize them. Their method, CriticOPD, restores recoverability by having the teacher critique an incorrect rollout so the student can rewrite its solution from the last error; the teacher scores the rewrite with the critique as privileged information, while the student trains on the revision without it. On six mathematical reasoning benchmarks, CriticOPD improves standard OPD by roughly 4–6 points across two student scales, with the largest gains on competition-level problems, and the student needs no feedback at inference.

On-policy distillation (OPD) trains a student model on its own rollouts with token-level supervision from a teacher, assuming that the teacher can reach a correct answer from any prefix the student writes. We call this property the recoverability of the teacher and show it fails on incorrect rollouts: the teacher follows student errors, although it recognizes them. We propose CriticOPD, using error recognition to restore recoverability. The teacher critiques an incorrect rollout, allowing the student to rewrite its solution following the error. The resulting output, including the critique as privileged information, is scored by the teacher while the student uses the revision without the critique for training. On two Qwen3 students and six mathematical reasoning benchmarks, CriticOPD improves OPD, with the largest gains on competition problems.
0
cs.AI Felix Woolford · Oct 14, 2026

Coding agents outgrow their context windows and compact older history into summaries, silently dropping commitments and facts that lightweight models cannot recover. This paper introduces transparent-compact, a deterministic compaction method that keeps all user and assistant prose verbatim, explicitly flags removed tool outputs and reasoning, and delegates recovery in a single lookup step. The core claim is that sparing lightweight models from guessing around lossy summaries improves retention of rules and facts without task-specific engineering. The evidence is strongest for local models like Qwen3.8-27B and weaker for frontier models, with a clear ceiling on how many verbatim rounds are possible before truncation.

Long coding agent sessions outgrow the model's context window, so agents compact: older history is replaced by something shorter, usually a model-written summary. A summary selects and rewords, and the agent cannot see what was lost. Existing work has explored a range of compaction techniques, but comparatively little attention has been paid to their effectiveness with lightweight models, including those deployed locally or used for high-volume workloads. Here, we present transparent-compact, a simple deterministic method for the open-source Pi coding agent, designed specifically for use with such models and with the purpose of maximising the transparency of the agent's view of its own compacted context. It guarantees that user and assistant prose in its context is unchanged by a model or algorithm, and explicitly flags where compaction has stripped information. We compare it with Pi's default model-written summary compaction and with pi-vcc, a popular deterministic method with similar methods but without verbatim retention of prose. Our benchmarks run on four models of varying performance levels, with emphasis on Qwen3.8-27B: a lightweight model at the top end of what consumer hardware can serve locally. On sets probing commitments (rules the user set which exist only in the conversation) and recall of facts, transparent-compact matched or outperformed both alternatives. In particular, it showed an advantage in avoiding confident blunders, i.e. assertion of false information as opposed to recognizing that something was not recalled. Even with a frontier model, its advantage was present but smaller. We argue that transparent-compact spares lightweight models from reasoning or searching their way around what compaction lost, and results in improved recall and application of information as a result, without the need for task or context-specific structuring of the session history.
0
cs.CLcs.AIcs.SI Ali Zamani, Soroush Esfahanian, Erfan Shahabi et al. · Oct 14, 2026

PerSo introduces a benchmark for evaluating LLM social intelligence through real-world persuasion dialogues from Reddit's ChangeMyView. It tests cognitive intelligence by forecasting a persuadee's beliefs, emotions, and intents, and behavioral intelligence by selecting the more persuasive response. Unlike prior work that often relies on synthetic scenarios or isolates these two aspects, PerSo jointly evaluates both on naturally occurring interactions, providing a more ecologically valid testbed.

Understanding the social intelligence of large language models (LLMs) is increasingly important for applications involving human-AI interaction and multi-agent environments. Social intelligence comprises two aspects: cognitive intelligence, the ability to infer others' mental states, and behavioral intelligence, the ability to select appropriate social actions based on these inferences to achieve social goals. Persuasion provides a natural testbed in which both aspects are simultaneously at play, yet prior benchmarks typically evaluate them in isolation using synthetic scenarios. We introduce PerSo, a benchmark that evaluates both aspects on real-world persuasion dialogues from Reddit's ChangeMyView community, using an LLM-in-the-loop pipeline to construct the evaluation tasks, validated through human annotation. Our evaluation of diverse LLMs shows that performance generally scales with model size but varies across dimensions. The strongest LLM slightly surpasses the best observed human performance on the behavioral task, while the best human participant remains ahead on the cognitive task.
0
cs.CLcs.AIcs.CV Shun Inadumi, Lee Sangmyeong, Koichiro Yoshino · Oct 14, 2026

This paper identifies a gap between standard visual grounding—which assumes enough dialogue context to pinpoint a single object—and real-world interactions where multiple referents remain plausible. It proposes Candidate Set Visual Grounding (CSVG) and introduces the CandVG benchmark to evaluate how the set of plausible referents evolves across dialogue turns. Evaluating 18 vision-language models shows that stronger single-object grounding does not translate to better set estimation, with models often failing to generate full candidate sets or committing prematurely to one candidate.

Interpreting an ambiguous utterance in real-world interactions often requires context beyond a single utterance. When the utterance refers to objects in a visual scene, it is necessary to maintain and update the set of plausible referents as context accumulates, without assuming that the available information identifies a unique object. However, prior work on interactive visual grounding, which localizes objects referred to by linguistic expressions, has focused on identifying a unique object once sufficient dialogue context becomes available. To address this gap, we propose Candidate Set Visual Grounding (CSVG), a task for estimating the set of objects consistent with the given dialogue context. We further introduce CandVG, a benchmark that evaluates how the candidate set changes across dialogue turns. Our evaluation of vision-language models shows that stronger visual grounding capability does not necessarily yield better CSVG performance. In particular, models have difficulty predicting the complete candidate set, owing to challenges in candidate generation and premature commitment to a small set of candidates in early turns. Nevertheless, we find that this limitation can be partially mitigated in the evaluated large-scale models using instructions designed for CSVG.