Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
1579 papers
Trending mixes fresh papers with community signal.
0
cs.AI Ilaria Imperatrice, Taisia Kameneva, Adam Eric Greenberg et al. · Oct 14, 2026

Do fast, structured AI decision models exhibit the same cognitive and social biases that plague human intuitive judgment? This study subjects Jev—a commercial "System One" model that returns probabilities over fixed choices rather than generating text—to 41,500 trials across cognitive reflection, classical bias paradigms, and a demographic pricing task. The core contribution is showing that pristine accuracy on famous benchmark items can collapse under minor rewordings or answer-order changes, and that probability scores often shift even when the top choice does not, which matters deeply when those probabilities drive downstream automation.

Do AI models designed for fast, structured decisions exhibit the cognitive and social biases observed in human judgment? We evaluate Jev, a model described as a System One decision-maker, using 41,500 responses across cognitive reflection tasks, five classical cognitive-bias paradigms, and a pricing experiment testing ethnic and gender bias. At the level of selected answers, the results are largely encouraging. We confirm previous findings that Jev performs extremely well on cognitive reflection problems. We also observe that it generally avoids the characteristic choice patterns associated with several well-documented human biases, and exhibits only small differences among demographic groups in the tested pricing scenario. However, this apparent robustness conceals important vulnerabilities. Its judgments are sensitive to irrelevant numerical information and the ordering of response options. Moreover, several cognitive-bias manipulations substantially affect returned probabilities even when selected answers remain unchanged. Most strikingly, Jev answers a well-known probability problem correctly in every response but violates the same underlying probability rule in every response to an adapted version. We investigate this discrepancy using 15,000 additional responses across 30 conjunction tasks. Jev violates the rule in 54\% of responses, with accuracy varying dramatically across formulations and answer orders. These findings suggest that evaluating decision models solely on familiar benchmarks and selected answers may substantially overstate their reliability in practical applications. They also identify vulnerabilities for developers to address and practical considerations for users integrating such models into automated decision-making systems.
0
cs.LGcs.AIq-bio.QM Alberto Mart\'inez, Natalia Flechas Manrique, Lloren\c{c} Espinosa-Portal\'es et al. · Oct 14, 2026

ProtModernBERT tackles the high cost of training protein language models by porting modern NLP encoder improvements—RoPE, FlashAttention, GeGLU, and bias-free layers—into a BERT-style protein model. The authors pre-train on the UR100P corpus and show that a 140M-parameter model can match ProtBert and Amplify-120M on structural benchmarks while using roughly one-tenth the pre-training FLOPs of ProtBert. The work matters because it tests whether architectural modernization alone can lower the barrier to custom protein LMs for resource-constrained labs, and it uses random-initialization baselines to separate inductive biases from transfer-learned features.

Large protein language models provide a powerful framework for learning sequence-function relationships and guiding experimental design. However, architectural improvements are underexplored, especially in low-compute regimes of relevance for resource-constrained research laboratories. We show that the training cost for encoder-only transformer architectures can be reduced by leveraging modern architectural refinements, offering an encouraging performance / compute-efficiency trade-off. We introduce ProtModernBERT, a modernized BERT-style model pre-trained on amino acid sequences, and compare it with ProtBert, Amplify, and ESM2 across a set of supervised structural tasks -encompassing secondary structure prediction, disorder prediction, and subcellular localization- and ProteinGym's zero-shot functional benchmark. We find that ProtModernBERT matches or closely tracks the performance of Amplify-120M and ProtBert with up to 80-90\% reduction in pre-training FLOPs, and narrows the gap to ESM2 when controlling for pre-training. Our analysis using a cluster-based validation protocol for hyperparameter selection and randomly initialized models disentangles the contributions of architecture and data, showing that modern components provide stronger inductive biases that are more consequential than parameter count in low-compute regimes.
0
cs.LGcs.AIcs.CL Aryan Das, Arnab Bhattacharya, Vinay Kumar Verma · Oct 14, 2026

Reinforcement learning with verifiable rewards suffers from coarse scalar supervision and moving-target instability in self-distillation. FSPO eliminates the persistent teacher model by storing sparse historical next-token distributions as fixed function-space targets, combining them with privileged disagreement correction and reliability-adaptive grounding. Across scientific reasoning and tool-use benchmarks, it achieves roughly 4% higher average accuracy than SDPO under a 5-hour budget while cutting peak memory from about 70 GB to 56 GB on Olmo3-7B-Instruct.

Reinforcement Learning with Verifiable Rewards (RLVR) improves reasoning in language models, but scalar outcomes provide coarse supervision over response trajectories. Self-distillation offers denser token-level guidance by comparing an unassisted policy with a feedback-informed self-teacher, yet the teacher evolves with the student, creating unstable targets and motivating additional regularization. We introduce Function-Space Policy Optimization (FSPO), a single-policy framework that combines current privileged adaptation with function-space temporal consolidation. FSPO stores sparse historical next-token distributions as fixed temporal targets, providing temporal separation without maintaining a persistent teacher model. It further introduces privileged disagreement correction to explicitly suppress locally overvalued actions, reliability-adaptive grounding that strengthens reference supervision when self-generated evidence repeatedly fails, and quality and coverage-aware temporal memory that retains verified behaviors and improves privileged demonstrations. Across reasoning and tool-use benchmarks, FSPO achieves the highest average accuracy under a 5-hour training budget, improving over the strongest baseline by approximately 4% points on average while reducing peak memory from about 70 GB to 56 GB on Olmo3-7B-Instruct.
0
cs.AIcs.CLcs.LG Minseok Ko, Hyunseok Lee, Woomin Song et al. · Oct 14, 2026

As large language models proliferate, identifying which model family generated a given text must remain reliable even when the domain or model version changes at test time. This paper proposes ATLAS, a generative framework that learns source-conditioned text distributions through lightweight adapter tuning and attributes text by comparing clipped token-level likelihoods. A new benchmark, MAABench, demonstrates that this likelihood-based approach outperforms direct discriminative classifiers under distribution shifts, while also enabling identification of distillation teachers.

As large language models (LLMs) are increasingly used to generate text, their misuse has become a growing societal problem, with implications for academic misconduct, model distillation, and cyberattacks. For these reasons, Model Authorship Attribution (MAA), which identifies the source model of a given text, is important for promoting the responsible use of LLMs and improving AI safety. In practice, attribution systems must remain reliable beyond the distributions observed during training. They may encounter texts from unseen domains and writing settings, as well as generations from future versions of model families that were not available when the system was trained. However, existing MAA methods often exhibit substantial performance degradation under such distribution shifts. To address this challenge, we propose Authorship Tracing via Likelihood-based Attribution of Sources (ATLAS), which formulates MAA through source-conditioned text modeling rather than direct source prediction. ATLAS learns how text from each source family is generated and attributes a given text by comparing its likelihood under each learned source condition. We aggregate this likelihood evidence at the token level with clipping so that no single token dominates the decision. We further introduce MAABench, a broad MAA benchmark for evaluating practical OOD settings such as domain and version. Our experiments show that ATLAS consistently outperforms existing baselines across MAABench and OpenTuringBench. In particular, when both the generation domain and the model version change on MAABench, ATLAS achieves 74.27% accuracy, 9.00pp higher than the strongest baseline. Beyond MAA, ATLAS can also help identify distillation source models by measuring which source model a target LLM most closely resembles. Our extended experiments show that ATLAS recovers the known teacher of every distilled model we evaluate.
0
cs.CVcs.AI Shuofeng Sun, Wenzhao Zheng, Yunpeng Zhang et al. · Oct 14, 2026

SceneAE proposes a sparse 3D-anchored latent representation for scene reconstruction and camera-controllable generation. Instead of viewpoint-aligned video latents, each latent couples an explicit 3D point with an implicit feature, enabling queryable rendering from arbitrary cameras. A two-stage diffusion model decouples geometry generation from content synthesis, improving camera control and cutting computational cost roughly in half compared with dense-grid baselines.

Recent video world models have increasingly adopted 3D memory mechanisms to integrate historical observations into a lightweight and persistent scene representation. This naturally raises a complementary question: if 3D representations can serve as an effective mechanism for memorizing observed scenes, can they also be directly used as the latent space for reconstructing and generating scenes? Motivated by this idea, we represent a scene as a compact and unstructured 3D-anchored latent space (\textbf{SceneAE}). Each latent combines an explicit 3D position with an implicit content feature and is spatially grounded to describe its local scene region, forming a sparse latent point cloud. Unlike conventional video-VAE latents that describe how a scene appears from particular viewpoints, our representation directly describes the scene itself, making it naturally applicable to both reconstruction and generation. For reconstruction, once the scene has been generated, our persistent 3D representation can be projected and decoded into RGB-D observations by different target cameras, without the need to regenerate a video for each new camera trajectory. For generation, we leverage the geometry-content separation to first generate camera-controlled 3D geometry and then synthesize content conditioned on it, reducing camera-appearance entanglement and improving camera controllability. Experiments show that this 3D latent achieves superior generation quality, computational cost, and camera controllability.
0
cs.CLcs.AIcs.LG Raavi Gupta, Ziqing Yang, Karli R. Hochstatter et al. · Oct 14, 2026

The paper tackles the months-long lag in confirming US overdose deaths by predicting suspected overdoses directly from death investigation reports available days after a fatality. Its core idea is an expert-guided pipeline that extracts verbatim evidence spans—feature-guided rationales—to support classification, comparing them against templated verbalizations and against joint self-rationalizing models. The best configuration improves over a deployed rule-based system by roughly 15% relative macro-F1 while preserving expert oversight, offering a plausible path to faster public-health surveillance.

Confirmation of overdose deaths in the United States is often delayed due to the complexities of certifying drug-involved deaths. Death investigation reports represent a rich but underutilized data source that could be used to predict whether a death is a suspected overdose (i.e., a death preliminarily identified as an overdose prior to the final cause and manner of death determination). We present an automated framework that classifies suspected overdoses from death investigation reports, while producing supporting explanations guided by expert knowledge. Through an expert-guided design process, we investigate 1) what type of explanations are best for model prediction performance, and 2) which architecture is better suited for this task: pipeline models that rationalize first and then predict, or self-rationalizing models that jointly predict and rationalize? Our experiments show that a pipeline model with explanations grounded in the input death investigation reports outperforms the other settings. Our best model also outperforms a rule-based system currently in deployment by 15%, while allowing expert interventions for final decisions.
0
cs.AIcs.LG Yan Xu, Dandan Song, Luan Zhang et al. · Oct 14, 2026

LLM-based agents can produce final reports that falsely claim task success even when their execution trajectories failed to follow required sources or procedures. This paper defines Agent Completion Unfaithfulness as a misalignment between what an agent actually did and what it ultimately reports, and proposes MCAIR, a runtime framework that uses step-level internal representations to train a lightweight linear probe for online risk detection and correction. Because users typically rely on final reports rather than inspecting full execution traces, detecting and mitigating such overstatement is critical for trustworthy autonomous agents.

Large Language Model (LLM)-based agents have demonstrated remarkable capabilities in completing complex tasks through multi-step reasoning and tool interactions. However, recent studies have revealed that LLM-based agents can exhibit unfaithful behaviors, where their final reports fail to faithfully reflect their actual execution trajectories. Specifically, when agents fail to accomplish tasks through the intended sources or procedures, they may resort to alternative sources or strategies while failing to disclose such deviations, leading users to incorrectly believe that the tasks have been completed according to the original requirements. We refer to this specific form of agent unfaithfulness as Agent Completion Unfaithfulness. Detecting and mitigating agent completion unfaithfulness is critical yet remains largely unexplored. In this work, we propose MCAIR, a runtime monitoring and correction framework that leverages internal representations of LLM-based agents. MCAIR uses multi-step internal representations as inputs to train a risk-aware probe, enabling online detection of potential completion unfaithfulness during execution. Furthermore, MCAIR introduces a risk-guided correction loop that prompts agents to review their execution history and mitigate potential inconsistencies between their execution trajectories and final reports. Additionally, we construct ACUD, a dataset for Agent Completion Unfaithfulness detection that provides step-level execution traces, step-level internal representations, and consistency annotations for training and evaluating runtime detection probes. Experiments demonstrate that MCAIR outperforms LLM-as-a-judge baselines, generalizes across prompts and tasks, and effectively reduces agent completion unfaithfulness.
0
cs.MAcs.AI Weihao Li, Jun Bai, Shijie Chen et al. · Oct 14, 2026

XferAgent tackles the problem of sharing reusable task experience across heterogeneous LLM agents. Instead of trapping effective strategies inside individual memories, it organizes local and shared experience graphs and reconciles cross-agent contributions with a similarity-margin merge rule that avoids unreliable unions. For each new task, it routes a connected, task-relevant subgraph and integrates it with local experience so agents benefit from collective exploration without sacrificing agent-specific context.

Large language model (LLM) agents can reuse experience from prior task executions to improve performance on subsequent tasks. Although existing methods enable cross-agent experience sharing, differences in agents' execution histories and task requirements make shared experiences difficult to reuse effectively. We propose XferAgent, a framework for cross-agent experience transfer that organizes reusable experience in local and shared experience graphs. XferAgent reconciles compatible contributions from heterogeneous agents while avoiding unreliable merges. For each new task, it selects shared experiences and integrates them with the target agent's local experience to support task execution. Experiments across diverse task domains show improvements over representative memory-based methods and effective experience transfer between heterogeneous agent frameworks. Cumulative task success also increases over successive task passes as agents update and reuse their experiences.
0
cs.LGcs.AI Minwoo Yu, Young-guk Ha · Oct 14, 2026

Temporal graph data come in different formats, but it is unclear whether representation boundaries limit how learned predictive structure can be reused. This paper proposes that Relational Dynamics—the predictive regularities in relational histories—can be transferred across continuous-time dynamic graphs and temporal knowledge graphs while keeping their input and prediction layers separate. The core idea is to train a shared history encoder on one representation, freeze it, and drop it beneath a different representation’s interface, then use controlled source-history reorganizations to identify which organizational aspects actually drive reuse. If the empirical claims hold up, the work implies that temporal graph foundation models need not be siloed by representation.

Temporal graph data are recorded in different representations, but whether these differences also determine the scope of learned knowledge reuse remains unclear. This study investigates whether predictive structure learned from relational histories can be reused between continuous-time dynamic graphs (CTDGs) and temporal knowledge graphs (TKGs). Bidirectional reuse emerges while retaining distinct input and prediction interfaces and independent vocabularies, and sources with the same representation are not always more useful. Controlled reorganizations of source histories show that the organization contributing to reuse varies across source-target conditions. We show that learned aspects of Relational Dynamics, the predictive structure present in relational histories, can be reused across conventional representation boundaries. Independently pretrained TKG and CTDG learners can also be fused at the score level to improve prediction on a third dataset without entity or relation-semantic alignment. Two proofs of concept in recommendation and security detection illustrate that external temporal sources without direct alignment can also become useful pretraining resources.
0
cs.AIcs.SYeess.SY Mirco Giacobbe, Thomas A. Henzinger, Konstantin Kueffner et al. · Oct 14, 2026

Supermartingale certificates guarantee temporal properties of stochastic dynamical systems, but their validity depends on a design-time model that may not match the black-box deployment environment. This paper introduces a runtime monitoring framework that observes a single live trajectory and uses betting-based sequential testing to raise an alarm when statistical evidence suggests the certificate has been violated. By applying Ville’s inequality, the method provides a user-specified bound on the probability of ever raising a false alarm, closing the sim-to-real gap for probabilistic certificates.

Supermartingale certificates formally guarantee temporal properties of discrete and continuous-time stochastic dynamical systems. However, these guarantees rely on a mathematical model of the world, leaving a sim-to-real gap that can invalidate them for the deployed system. We formulate the runtime monitoring problem for supermartingale certificates, in which a monitor observes a single system trajectory and raises an alarm when there is sufficient statistical evidence that the supermartingale certificate has been violated during execution. We present an algorithm to automatically construct a monitor using betting-based sequential tests that bound the probability of ever raising a false alarm at a user-specified level. Within this betting framework, we formulate strategies that allow the monitor to exploit spatial regularity to improve detection power while preserving this statistical guarantee. We demonstrate the efficacy of our approach on supermartingale certificate benchmarks from the literature.
0
cs.AI Hui Zhang, Yujia Zeng, Yuhao Xin · Oct 14, 2026

Clinical LLMs must import external medical knowledge that can be poisoned, outdated, or hallucinated, yet the gravest risk is regression—turning a correct answer into an incorrect one. This paper introduces Med-TrustRouter, a lightweight per-instance router that selects among five knowledge-use actions using only leakage-free runtime signals, preserving the base answer unless another action is confidently better. On a new benchmark with seven attack families and paired clean controls, it raises the worst-case accuracy floor to 69.2%, well above any fixed-strategy competitor.

Clinical reasoning LLMs need external medical knowledge, but retrieved evidence and reasoning chains can be outdated, poisoned, or hallucinated. Harmful knowledge can cause regression: changing a correct answer into an incorrect one. We construct a medical knowledge-poisoning benchmark covering retrieved evidence and reasoning chains, with seven attack families filtered by a three-judge "subtle-but-wrong" vote and paired clean exams that separate poisoning effects from question difficulty. No fixed knowledge-use strategy is robust across these settings: strong RAG methods trade robustness to poisoned evidence against accuracy when evidence is useful. We formulate knowledge use as per-instance routing and introduce Med-TrustRouter, a lightweight controller that keeps the solver frozen. From leakage-free runtime signals, it estimates each action's expected correctness gain and uncertainty, preserving the base answer unless another action is confidently better. Across seven medical reasoning settings, Med-TrustRouter achieves 78.9 macro and 69.2 worst-case accuracy, matching the strongest competitor on macro accuracy while substantially improving the worst-case floor. Its gains transfer across solvers and evidence judges, unlike a hand-coded router using the same signals. Similar performance across linear, tree, and neural action-value heads suggests that the benefit comes from routing rather than estimator complexity. These results support learning when to trust external knowledge for robust clinical reasoning.
0
cs.AI Tiantian Peng, Guannan Lv, Hongyang Li et al. · Oct 14, 2026

On-policy distillation (OPD) trains a student on its own trajectories with reverse-KL, but reverse-KL gives weak gradients for teacher-supported tokens where the student assigns very low probability, causing teacher-mode under-coverage. This paper proposes Divergence-Routed OPD (DrOPD), which uses cross-sampling to show that teacher-student Jensen-Shannon divergence pinpoints behaviorally critical positions better than single-model entropy, then adds forward-KL selectively at the highest-JS positions while keeping reverse-KL everywhere. Across six math benchmarks and two student-teacher pairs, DrOPD reduces severe under-coverage by 37.9% and improves mean Avg@8 by up to 1.84 points, offering a principled token-level strategy for allocating distillation supervision.

On-policy distillation (OPD) transfers knowledge from a teacher model to a student along student-generated trajectories, typically by minimizing the reverse Kullback-Leibler (RKL) divergence. However, RKL can provide weak corrective signals for teacher-supported tokens to which the student assigns very low probability. This raises two questions: which positions are most consequential for the behavioral gap between the student and teacher, and what additional supervision is needed at these positions? Through cross-sampling, we find that divergence-based routing more effectively pinpoints positions contributing to the teacher-student performance gap than entropy-based routing. Further analysis reveals teacher-mode under-coverage at high Jensen-Shannon (JS) divergence positions, where standard OPD increases the large teacher-student probability gaps. Motivated by these findings, we propose Divergence-Routed On-Policy Distillation (DrOPD). DrOPD retains RKL supervision at all positions and selectively adds forward Kullback-Leibler (FKL) divergence supervision at positions with high JS divergence. Experiments across six math benchmarks show that DrOPD improves over standard OPD and entropy-based routing. DrOPD also reduces severe under-coverage cases by 37.9 percent relative to OPD, supporting targeted FKL as an effective complement to OPD.
0
cs.AI Jingyuan Li, Dongzhan Zhou, Minting Pan et al. · Oct 14, 2026

LabCompiler targets the translation of imperfect natural-language laboratory protocols into verifiable, executable human-machine workflows. The framework introduces a staged "diagnose-represent-execute" architecture: a protocol firewall repairs defects before compilation, a two-level device-agnostic graph separates experimental intent from hardware details, and a capability-grounded router assigns actions to automated devices or human operators. Reliable protocol execution across heterogeneous, partially automated labs is essential for closing the loop in AI-driven science.

Closing the loop of AI-driven science requires reliably translating natural-language protocols into executable laboratory workflows despite protocol defects and heterogeneous hardware. Existing approaches often couple scientific interpretation with device-specific code generation, making errors difficult to localize and limiting reuse across laboratory platforms. We introduce LabCompiler, a robust protocol-to-execution framework that transforms imperfect natural-language protocols into verifiable human-machine workflows. Its protocol firewall diagnoses and repairs defects before compilation while preserving unaffected content, guided by troubleshooting knowledge accumulated through perturbation-guided self-evolution. A two-level, device-agnostic graph representation separates experimental semantics from hardware-specific implementation and supports capability-based device assignment with coordinated human execution. We further introduce a protocol recovery benchmark covering four controlled perturbation types and naturally occurring errors collected from protocols written by iGEM participants. Experiments show that LabCompiler outperforms frontier LLMs in protocol error correction while enabling coordinated human-machine execution across heterogeneous, partially automated laboratory settings.
0
cs.CLcs.AIcs.HC Yilin Jiang, Fei Tan, Xuanyu Yin et al. · Oct 14, 2026

This paper tackles the problem that LLM agents often return replies which a human requester cannot interpret because they rely on private working context unseen by the user. The authors define reply usability as the ability of a requester to understand and act on a reply from only what they have seen ($R$), and measure it with an LLM-based reader model that flags information gaps. Across eight current models, 54% of 480 replies fail, with even the best model failing 30% of the time. They show that appending explicit requirements or rewriting with a secondary model substantially lowers failures, making usability an actionable target for agent design.

People delegate multi-step work to LLM agents and read only the reply that the agent hands back. Current evaluation scores task completion and the faithfulness of reports, and it leaves open whether the requester can understand and use the reply. We call this property reply usability and measure it with a reader model that takes the requester's position and tests whether the reply can be interpreted from what the requester has seen, is in the requester's language and answers the request. Its agreement with the majority of five annotators lies within the range of the individual annotators. Across eight models from seven families, 54% of 480 replies fail, and the best model still fails on 30%. Failed replies mostly point to material the requester has not seen or use labels that the agent coined during its work. Stating explicit requirements for the reply reduces the failure rate from 0.52 to 0.43 together with errors and omissions, and a secondary model that rewrites the reply reduces it to 0.36, which human annotators confirm in a blind comparison. Reply usability can thus be scored alongside task success and improved with one appended message or one call to a secondary model.
0
cs.CLcs.AIcs.LG Baowen Zhang, Hangting Ye, Hongyuan Zha · Oct 14, 2026

Typed decision models return probabilities over fixed answer choices instead of generating free text, making them a natural fit for tabular prediction tasks. This paper evaluates four such models against three large language models on row classification, fact verification, and anomaly detection, subjecting every request to 21 content-preserving rewrites. The authors find that decision models match LLM accuracy at far lower cost and are far more robust to how questions are phrased, yet no model escapes fragility when the table layout is altered.

Typed decision models are language models that answer a question with a fixed set of possible answers by returning a probability for each answer instead of generating text. We study them on tabular data and compare four decision models with three large language models (LLMs) on row classification, fact verification and anomaly detection. Every request is sent in its original form and under 21 types of rewrite that keep its content, such as renaming the options or writing the table in another format. The decision models perform as well as the LLMs at a lower cost. Three of them are also far more robust to how the question is formulated. No model we test is robust to how the table is organized. For every model, at least a third of the row decisions change under some rewrite of the table or the question. The decisions to which a decision model gives low probability are the ones most likely to change. Decision models are a practical choice for tabular decisions, but their robustness remains an open problem.
0
cs.CLcs.AIcs.CY Yilin Jiang, Fei Tan, Xuanyu Yin et al. · Oct 14, 2026

Simulated students let developers test tutoring systems before real learners are available, but LLM role-play suffers from competence leakage because the model substitutes its own knowledge for the learner's. HACHIMI-II counters this by recasting simulation as third-person prediction: it builds a student model, infers a fine-grained learner state for each step, and compiles that state into a deterministic behavior harness that constrains generation. On five datasets, this cuts the ability-distribution gap by 2.4–8.4× and more than doubles error-structure fidelity over the strongest baseline.

Simulated students let researchers test tutoring systems and teaching strategies before real learners are available, but only if the simulation reproduces where a particular learner succeeds and fails. The common approach asks a large language model to role-play a student, but a role does not model what this learner knows or will do next, so the model's own competence fills the gap. Simulated students perform at a level set by the model, differ little from one another, and seldom make the real learners' errors. We model the learner's behavior and recast student simulation as third-person prediction of the learner's next action. HACHIMI-II builds a student model from the learner's history, infers the learner's state for the current item or tutor turn, and compiles it into a behavior harness that constrains the next action. On three item-response datasets, the Wasserstein-1 distance between simulated and real student ability is 2.4--8.4$\times$ smaller than that of the strongest baseline. On two dialogue datasets, HACHIMI-II reproduces real student errors with the same knowledge type, locus, and mechanism 1.8--5.1$\times$ more often than the strongest baseline, and ablations trace the gains mainly to the explicit learner state. Predicting the learner makes capable models usable as simulated students.
0
cs.LGcs.AI Xinjie Lan, Yunbo Mei, Leheng Zhou et al. · Oct 14, 2026

This paper tackles non-stationarity in long-term time series forecasting by asking how positional encoding shapes temporal dependencies in Transformer attention. The core idea is to reinterpret self-attention as a Bayesian posterior in which positional encoding acts as latent temporal evidence, and to replace static positional biases with an input-conditioned mixture-of-experts router that adaptively combines local and periodic kernels. The results matter because they offer a principled, lightweight, plug-and-play module that consistently improves forecasting across four diverse Transformer backbones.

Transformers have demonstrated strong performance in long-term time series forecasting (LTSF), yet modeling non-stationary temporal dependencies remains challenging. In this paper, we interpret self-attention as a Bayesian posterior over attended positions, combining a content-based prior induced by scaled dot-product similarity with a temporal-evidence likelihood induced by positional encoding. This formulation provides a probabilistic interpretation of how positional encoding shapes the temporal dependencies captured by self-attention. Building on this perspective, we derive a population-level evidence lower bound (ELBO) that characterizes the role of positional encoding in forecasting weakly stationary time series. Our analysis further highlights a limitation of static positional encoding: when temporal dependence structures vary across input windows, a fixed temporal bias must accommodate heterogeneous dynamics and can therefore be suboptimal for non-stationary forecasting. Motivated by this analysis, we propose Bayesian Time-aware Attention (BTA), which employs a mixture-of-experts (MoE) router to adaptively combine temporal kernels and generate input-conditioned, head-specific positional biases. Extensive experiments on standard LTSF benchmarks demonstrate that BTA consistently improves forecasting performance across multiple Transformer backbones and achieves competitive overall performance with modest computational overhead and stable training.
0
cs.CLcs.AIcs.IR Shijun Li, Yang Liu, Najmeh Sadoughi et al. · Oct 14, 2026

Existing retrieval-augmented MT applies retrieval uniformly, yet LLM parametric knowledge suffices for many inputs and external evidence is only conditionally useful. This paper proposes SRAT, an agentic RL framework that treats reasoning, retrieval, and translation as learnable actions optimized via GRPO for final translation quality. It learns when to retrieve, what to query, and how to integrate evidence, supported by two retriever-alignment strategies and evaluated across idiom, knowledge-intensive, and document-level settings. The work is important because it challenges the default assumption that retrieval is always beneficial and shows that adaptive, quality-aligned evidence acquisition consistently outperforms fixed pipelines.

Retrieving external knowledge can improve large language model (LLM) translation by providing supplementary information such as idiom interpretations and terminology. However, existing retrieval-augmented machine translation systems typically apply predefined retrieval strategies uniformly across all inputs. We argue that translation operates in a partial-evidence regime: LLM's parametric knowledge suffices for many inputs, while external evidence benefits a subset and usually supports rather than directly provides the desired translation. This creates two challenges: deciding when to retrieve and what evidence to acquire. We introduce Selective Retrieval-Augmented Translation (SRAT), an agentic reinforcement learning framework that learns when to translate directly or retrieve, what to retrieve, and how to integrate these decisions by optimizing final translation quality. To align evidence retrieval with downstream translation quality rather than simple semantic similarity, we further develop joint Plackett--Luce optimization and translation-quality contrastive training for retriever-training. Experiments on idiom, knowledge-intensive, and document-level translation with offline or online retrieval show that SRAT consistently outperforms never- and always-retrieve baselines, and quality-aligned retriever training provides further gains when similarity-based retrieval is insufficient. The results demonstrate the benefit of treating retrieval as a learnable translation action rather than fixed preprocessing.
0
cs.AI Chaoyang Zhu, Zhe Liao, Jiayi Zhang et al. · Oct 14, 2026

This paper challenges the dominant triplet contrastive learning pipeline for 3D shape understanding, which aligns 3D point clouds with rendered images and text. The authors argue that rendered images are unreliable due to domain shift, self-occlusion, and rendering artifacts, and propose learning from language supervision only. Their core idea, HyperCL, embeds 3D shapes and text into hyperbolic space via the Lorentz model, using a geodesic-based contrastive loss and a batch-wise entailment loss that enforces the partial-order relation $\text{caption}\,\text{entails}\,\text{3D}\,\text{shape}$. They also introduce c-OLVIS, a manually cleaned subset of Objaverse-LVIS, for more rigorous evaluation. The work matters because it questions a multi-modal pre-training assumption and reports state-of-the-art zero-shot classification and retrieval under a smaller parameter budget.

In multi-modal 3D pre-training, aligning 3D shapes, their 2D image counterparts, and language descriptions has made tremendous progress. However, we find that supervision from rendered images is unreliable, the semantics encoded in synthetic views are distorted due to domain gap, self-occlusion, and rendering artifacts. Instead, we learn transferable 3D representations from language only. We observe that, in real world, 3D shapes are organized in a tree-like structure, ranging from general concepts to fine-grained instances with specific attributes, while language typically denotes generic concepts and subsumes these various 3D instantiations. Hence, we propose to embed 3D representations in hyperbolic space, whose geometry is well-suited for modeling tree-like data without distortion. To capture the asymmetric hierarchy between language and 3D shapes, we further impose a partial-order relation that language entails 3D shapes. Our method, Hyperbolic Contrastive Learning (HyperCL), jointly optimizes a hyperbolic geodesic-based contrastive objective and an entailment loss to learn discriminative cross-modal representations while explicitly preserving this hierarchy. We also introduce a rigorously verified benchmark for comprehensively evaluating cross-modal 3D alignment. Across two widely used benchmarks and ours, we improve the performance up to 4.6% absolute percentage on 3D shape classification and 5.5% on cross-modal text-to-3D retrieval under the same parameter budget. The code and evaluation benchmark will be made publicly available.
0
cs.AI Zerui Yang, Quan Xue, Chaorui Zhang et al. · Oct 14, 2026

This paper tackles questions about an agent's history that require aggregating multiple events, a task that pure retrieval cannot solve. It proposes Trajectory Memory (TM) for deferred, source-preserving evidence selection, and TallyMem for executable event aggregation via a typed query language over a reusable ledger. The core insight is that aggregation load—the number of events an answer must combine—predicts failure better than raw history length, with strong controlled evidence (+11.0 to +13.8 points) supporting the mechanism, though full-benchmark gains are more modest.

Questions about an agent's history often require aggregating events, which retrieval alone does not resolve. We combine source-preserving evidence access with executable aggregation. Trajectory Memory (TM) retains the original trajectory and constructs a source-addressable reading view at question time. TallyMem augments it with a reusable event ledger, model-generated event specifications and deterministic execution. With a commit-specific adaptation on 776 questions from 99 held-out MINTEval repositories, TallyMem raises Qwen3-32B exact match from 35.2% to 49.0%, a 13.8-point gain over TM; gains span 12.8-13.9 points across three readers. A controlled probe with event sets parsed independently from raw logs shows an 11.0-point gain, from 82.8% to 93.8%, without routing. On full AMA-Bench, the routed system yields a smaller 1.3-point gain, from 69.8% to 71.1%. These results support executable aggregation on tasks that require combining events, with benefits dependent on the task and event specification, the largest residual system-error category in our diagnostic analysis.