Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
1579 papers
Trending mixes fresh papers with community signal.
0
cs.SDcs.AIeess.SP Zhe Cao, Jichao Zhang, Xiao-Lei Zhang · Oct 14, 2026

Underwater vessel recognition is limited by scarce training data and small public benchmarks. This paper introduces ONCship, a 4521-hour corpus curated from Ocean Networks Canada hydrophones and Automatic Identification System vessel metadata. It evaluates domain-specific self-supervised pre-training, supplementary supervised fine-tuning, and MMSI-Level individual vessel classification, showing that scale and metadata can improve representations even though downstream gains are architecture-dependent and uneven.

Recent advances in deep learning have significantly improved underwater acoustic vessel recognition. However, existing publicly available datasets are typically limited in scale, hindering large-scale representation learning and downstream task evaluation. To address this limitation, we introduce ONCship, a large-scale underwater acoustic dataset comprising 4521 hours of curated recordings from Ocean Networks Canada (ONC) hydrophones and Automatic Identification System (AIS) data. We evaluate the proposed dataset across three tasks: self-supervised representation learning, vessel-type classification, and MMSI-Level Vessel Classification. Experiments on DeepShip and ShipsEar demonstrate the effectiveness of ONCship for acoustic representation learning, with joint pre-training on ONCship and AudioSet achieving a classification accuracy of 62.45% on DeepShip through linear probing. Furthermore, incorporating ONCship as auxiliary training data improves downstream vessel-type classification performance. Beyond conventional vessel-type classification, we further investigate MMSI-Level Vessel Classification, treating each vessel as a distinct identity. Experimental results show that models fine-tuned with different loss functions achieve Top-1 accuracies exceeding 53% and Top-5 accuracies approaching 69%, demonstrating the feasibility of distinguishing individual vessels through MMSI-Level Vessel Classification. Overall, ONCship provides a valuable resource for underwater acoustic representation learning and vessel recognition, while its rich vessel-level metadata enables further exploration of MMSI-Level Vessel Classification.
0
cs.LGcs.AI Haimanot Bitew Alemayehu, Simachew Melaku Ayalew, Chilotie Desalew Mengesha et al. · Oct 14, 2026

Potato leaf diseases such as early and late blight reduce yields in Ethiopia, where farmers often lack access to laboratory diagnosis. This study develops a lightweight convolutional neural network to classify healthy, early-blight, and late-blight leaves, training on 2,215 PlantVillage images and testing on 247 smartphone photos collected from local farms. The central claim is that a 1.70 MB model can achieve high accuracy while remaining efficient enough for deployment on low-resource hardware.

Potato is an important food-security crop in Ethiopia, but its production is affected by foliar diseases, particularly early blight and late blight. This study develops a lightweight convolutional neural network (CNN) to classify potato leaves into three categories: healthy, early blight, and late blight. The proposed model was trained using 2,215 images from the PlantVillage dataset and evaluated on an independent field dataset containing 247 images collected from potato farms in Banja, Awi Zone, Ethiopia. On PlantVillage, the model achieved 99.04% training accuracy, 98.21% validation accuracy, and 98.66% test accuracy. On the field dataset, it achieved 90.28% accuracy. The study also compares the proposed CNN with VGG16 and MobileNetV2 in terms of classification performance and computational efficiency. The proposed model contains 446,787 trainable parameters, occupies approximately 1.70 MB, and requires an average of 5.58 seconds per training epoch in the reported experimental setup, compared with 9.96 seconds for VGG16 and 7.68 seconds for MobileNetV2. The results demonstrate the potential of a compact CNN for potato leaf disease classification and highlight the importance of independent field evaluation, where image conditions are more variable than in controlled benchmark datasets. The proposed approach may support preliminary disease identification for smallholder farmers in Ethiopia and similar agricultural settings.
0
cs.ROcs.AI Bingao Chen, Lihan Zha, C. Karen Liu et al. · Oct 14, 2026

Most robot VLAs rely on wrist cameras for manipulation detail, which narrows scene coverage and adds hardware complexity. FoveaVLA removes that dependency by teaching a π0.5-based policy to predict future interaction regions, cropping high-resolution 'foveal' patches from external stereo views to recover fine gripper-and-object detail. Post-trained on DROID with RoboInter annotations, the model achieves 77.1% overall real-world success with two external RGB-D views versus 52.1% for the wrist-equipped baseline. The idea is biologically grounded and architecturally clean, though the evaluation scale and claims about learning from human videos remain tentative.

We present FoveaVLA, a Vision-Language-Action (VLA) model that replaces the wrist camera with learned foveation actions. Wrist cameras provide close-up detail but restrict the view to the end-effector's surroundings. External cameras see the whole scene, but the policy receives them at low resolution, so the fine detail needed for manipulation is lost. FoveaVLA recovers this detail by predicting, alongside each action chunk, the interaction region to observe at the next policy query. The policy then receives crops of these regions, taken from the original-resolution images, together with the full views. We build FoveaVLA on $\pi_{0.5}$ in two configurations, Single and Dual, using one or two external stereo cameras with full and foveal RGB and depth inputs, and post-train both on DROID with RoboInter interaction annotations. Across four real-world task suites, FoveaVLA-Single achieves 70.8% success with one external RGB-D view, and FoveaVLA-Dual achieves 77.1%, versus 52.1% for the wrist-equipped $\pi_{0.5}$. Both match the baseline on plain pick-and-place and improve success with distractors, cloth manipulation, and far-away objects.
0
cs.LGcs.AI Tiantong Sun, Jinlin Liu, Xingru Wei et al. · Oct 14, 2026

Fairness-weighted federated learning deliberately inflates updates from high-loss clients, but under an update-only interface a server cannot tell legitimate amplification from adversarial scaling. This paper identifies that $q$-fair loss scaling preserves the class-mixture structure of honest updates while warping their coefficient constraint from a unit-sum simplex to a radial nonnegative cone. Building on this geometry, FUSE uses a small trusted labeled set to recover latent coefficients, screens submissions jointly for radial scale and cone consistency, and renormalizes the aggregate to protect both robustness and fairness.

Client-level fair federated learning, in the form of $q$-fair federated learning ($q$-FFL), agnostic federated learning, or tilted empirical risk minimization, has emerged as an attractive solution to equalize utility across heterogeneous clients. This paradigm grants high-loss clients greater relative influence, while a central server aggregates their loss-weighted updates into a single shared model. Yet, the Byzantine robustness of $q$-fair federated learning has been largely neglected, leaving the server unable to tell legitimate fairness-induced amplification from malicious update scaling. To address this critical gap, we formalize the problem of Byzantine-robust $q$-fair federated learning under an \emph{update-only interface}, in which the server observes nothing but the fairness-scaled client updates. Our analysis under shared class-conditional label skew shows that fairness scaling preserves the nonnegative class-mixture structure of honest updates, while replacing their unit-sum constraint by a client-dependent radial scale. Moving beyond magnitude-based screening, we show that this warped geometry supplies two complementary tests, one radial and one structural, that a single norm cannot provide. We then introduce FUSE, a structure-aware robust aggregator that uses a small trusted labeled dataset for coefficient recovery, scale and cone-consistency screening, and post-screening step-size control. Across four benchmarks and seven Byzantine attacks, FUSE improves seed-wise worst-attack accuracy over the strongest baseline on each benchmark by 3.9--30.1 percentage points, while largely preserving the influence of the high-loss honest clients that fairness is meant to protect.
0
cs.AI Liang He, Xiangyu Li, Yuxin Wang et al. · Oct 14, 2026

Most research on test-time compute treats the model as fixed and asks how to allocate extra inference tokens. This paper instead asks whether a model can be post-trained to use a given compute budget more effectively. The authors identify compute-responsive (CR) problems—those that flip from complete failure to success under additional blind re-solving or audit-based revision—and show that supervised fine-tuning on these examples shifts the compute–accuracy frontier across budgets from 512 to 4,096 tokens and generalizes across model families.

Reasoning language models increasingly rely on test-time compute scaling, yet most existing work studies how to allocate inference computation while treating the model itself as fixed. We ask a complementary question: can reasoning models be post-trained to make better use of a given amount of test-time compute, and which examples are most useful for this goal? Our key observation is that reasoning problems differ substantially in their response to additional computation. Some are already solved under limited compute, others remain unresolved even after further reasoning, while a distinct subset changes from complete initial failure to success when additional reasoning is provided. We call these compute-responsive (CR) examples and introduce Compute-Responsive Data Selection (CRDS), a post-training data-selection principle that prioritizes examples with empirically demonstrated marginal utility from additional reasoning. On Qwen3-8B, SFT on CR examples recovers 45.3\% of held-out low-compute failures, compared with 40.6\% when training on already-solved examples. The advantage extends beyond the selected CR split: SFT-CR reaches 51.8\% overall accuracy on an independently sampled test distribution, with the gain concentrated on compute-responsive problems. CR training also shifts the compute--accuracy frontier across inference budgets from 512 to 4,096 tokens, outperforming matched non-CR training throughout and reaching 48.1\% recovery at the largest budget. The same pattern is supported across multiple data sources, remains visible under on-policy distillation, and extends to Llama-3.1-8B-Instruct when CR sets are reconstructed separately for that model. Better test-time compute utilization can therefore be learned through post-training, with recoverable responses to additional reasoning providing a particularly informative signal for selecting training examples.
0
cs.LGcs.AI Xiuyi Yang · Oct 14, 2026

Training deep networks without normalization remains difficult, and relating their trainability to the exact geometry of the loss surface is rarely attempted. This paper proposes a projective polynomial activation $f(z)=z+\lambda z^3$ paired with either an $\ell_2$ projection onto the unit sphere or an unnormalized identity path, and studies it at two scales: networks that train to depth $100$--$300$ on MNIST, and tiny algebraic versions whose square-loss critical points are solved exactly via Gröbner bases and numerical irreducible decomposition. The point is to derive concrete design, initialization, and diagnostic rules from the small model's geometry and validate them at depth.

What makes a deep network train, and what shape is its loss surface? We answer both with one construction at two scales: a polynomial activation f (z) = z + {\lambda}z 3 , clamped and projected onto the unit sphere, plus an unnormalized identity path. As a deep stack it trains to one hundred layers on MNIST with no normalization machinery; as a small model its square loss is a polynomial system we solve exactly. The small scale explains the large one: it prescribes how to design, initialize and train the stack.
0
cs.CLcs.AIcs.CV Qiushi Sun, Jingyang Gong, Yang Liu et al. · Oct 14, 2026

Multimodal code intelligence demands programs that are correct, well-structured, and visually faithful, yet existing training signals are either too coarse or confined to single tasks. This paper introduces PrismaForge, which synthesizes per-instruction evaluation rubrics that separately assess code-level and visual-level criteria, then uses them to filter training data and reward reinforcement learning. The resulting dataset, PrismaCoder-2M, and the trained 9B and 35B models advance the open state of the art and compete with proprietary systems on charts, webpages, and scientific graphics.

Multimodal code intelligence connects the symbolic world of programs with the visual world their execution creates. Interest in this capability is burgeoning, as models are increasingly asked to produce charts, webpages, animations, and semi-structured documents. Recently, proprietary models have pushed far ahead, producing interactive artifacts even from a text description or a screenshot alone. Yet their data and training remain closed, and open progress is held back by the quantity and quality of available data and by the pipelines and methods for producing it. Quality is the harder of the two, since a sample must be correct as a program, well built, and above all visually right once rendered. No existing signal covers all three. Execution often returns just a pass or fail, code similarity does not map to the visual output, and task-specific verifiers do not generalize. To push open progress further, we start from the data side with PrismaForge, a hierarchical data pipeline centered on a synthesized rubric that decomposes these factors into checkable criteria. The same rubric serves as both filter and reward: it curates the supervised corpus, then drives reinforcement learning on visual-coding tasks. Leveraging PrismaForge for data synthesis and filtering, we build PrismaCoder-2M, the most diverse open dataset for multimodal code intelligence and the largest to date. On the model side, we train PrismaCoder-9B and PrismaCoder-35B on this data and release both. They lead the open state of the art by a wide margin and rival leading proprietary systems. Our analyses further show that the proposed rubric-based pipeline improves multimodal coding performance across model backbones. We release our code and data at https://qiushisun.github.io/PrismaCoder-Home/.
0
cs.LGcs.AI Junze Zhu, Weihao Chen, Zhiyang Zhou et al. · Oct 14, 2026

Deploying LLMs as agents requires respecting runtime-specific execution contracts, yet standard training leaves harness semantics implicit in action trajectories. This paper introduces Harness Policy Distillation (HPD), which replays reference trajectories through the target harness to compile control-state documents, uses harness verification to filter teacher actions, and jointly trains a shared model on native action prediction, document-conditioned action prediction, and document reconstruction. On TRAJECT-Bench with the Pi harness, HPD lifts Qwen3-8B task success from 3.09% to 22.98% and substantially outperforms supervised, RL, and standard distillation baselines.

Deploying a general-purpose model as an agent means running it inside a product-specific runtime harness that decides which actions are executable, how state advances, and when the loop may terminate. Ordinary trajectory supervision shows which action was taken but leaves the runtime semantics behind that action implicit. We introduce Harness Policy Distillation (HPD), which makes these runtime control semantics an explicit training target alongside actions to align the harness policy. HPD replays reference trajectories through the harness to recover the runtime semantics that are implicit in ordinary trajectory data, and represents them as control documents at each model-call boundary. These documents provide privileged information for a teacher to generate actions, while harness verification ensures that the resulting targets are executable under the runtime contract. We jointly train a shared model on the runtime semantics recovered from control-state privileged information and native history, thereby internalizing these semantics into the model policy. At deployment, the trained model uses the original harness interface without requiring the control document or any additional supplement. On TRAJECT-Bench with the Pi harness, Qwen3-8B trained with HPD reaches 22.98% autonomous task success and 49.23% runtime compliance, against 3.09% and 19.90% for the unadapted model. Harness-verified teacher actions substantially improve the native deployment policy, while joint control-state supervision provides further gains in task completion and runtime compliance. HPD turns executable runtime semantics into dense supervision for learning harness-compatible actions at each decision boundary.
0
cs.LGcs.AI Kintan Saha, Ahana Deb, Anders Jonsson et al. · Oct 14, 2026

Average-reward reinforcement learning with options models continuing hierarchical tasks, but before this paper there were no finite-time convergence guarantees for option-based Q-learning in that setting. The authors prove that multi-step (J-step) inter- and intra-option Bellman operators contract in the span seminorm, design corrected synchronous multi-step estimators, and derive the first $\widetilde{\mathcal{O}}(1/k)$ mean-square convergence rates for average-reward option Q-learning. The results extend to hierarchical reward machines and are supported by small-scale tabular experiments.

We study the finite-sample convergence of Q-learning algorithms for the average-reward formulation of Reinforcement Learning (RL) with options. While options allow temporarily extended and hierarchical actions, the average-reward formulation incorporates continual tasks beyond discounted and episodic RL. We establish the first $\tilde{O}(1/\text{iterations})$ convergence guarantees, in the mean-square sense, for average-reward option Q-learning algorithms in both the inter- and intra-option settings. First, we prove that both inter- and intra-option Bellman operators satisfy multi-step span contractions under unichain assumptions. Then, we propose synchronous estimators of these multi-step option Bellman operators leading to two variants of option Q-learning. Finally, we extend the stochastic approximation framework to prove convergence rates of these two algorithms under the minimal assumptions used in the literature.
0
cs.SDcs.AI Mengke Zhang, Yanda Shao, Tianhe Wu et al. · Oct 14, 2026

Speech Emotion Recognition (SER) models and Audio LLMs often suppress vocal emotion when it contradicts transcribed text—a bias the authors label Semantic Dominance. To probe this, they introduce ASPIRE, a fully synthetic benchmark of adversarial audio-text pairs generated via EmotiVoice, and propose ACR-Net, a dual-stream Whisper-based architecture that uses a Contrastive Decoupling Loss to push conflicting acoustic and semantic representations toward orthogonality. The work claims state-of-the-art Acoustic Accuracy on both adversarial and standard congruent datasets.

Speech Emotion Recognition (SER) models and Audio LLMs fail when vocal tone contradicts textual semantics. Extensive training on congruent data engenders a rigid semantic prior, causing "Semantic Dominance", a severe text bias during cross-modal conflicts. We introduce the ASPIRE benchmark of adversarial audio-text pairs across four conflict types, alongside two metrics: Semantic Overconfidence Penalty (SOP) and Latent Decoupling Degree (LDD). Unlike fusion methods that merely re-weight collapsed features, our Acoustic Conflict Resolution Network (ACR-Net) uses Cross-Modal Attention and Contrastive Decoupling Loss to disentangle contradictory representations into orthogonal latent spaces. Experiments show existing models fail under polarity conflicts due to extreme semantic overconfidence. Conversely, ACR-Net preserves acoustic fidelity, maintaining high LDD to drive SOP near zero, achieving superior Acoustic Accuracy (ACC) in both adversarial and standard scenarios.
0
cs.AIcs.MA Isabel Jones, Matthew Edwards, Janina A. Hoffmann · Oct 14, 2026

Consensus research has expanded from human social networks to multi-agent LLM systems, yet it remains unclear how language models coordinate when their preferences conflict. This paper adapts the Network Consensus game—where agents must agree on one of two colours despite receiving different payoffs for the agreed colour—to evaluate seven LLMs under varying network topologies and communication regimes. The authors find that open-source models reach consensus far less often than humans and usually require global messaging to do so, whereas ChatGPT 5.6-sol succeeds even with restricted communication through lower stubbornness and stronger majority-following. The work matters because it directly challenges the assumption that LLMs can serve as drop-in proxies for humans in social simulations or collective decision-making architectures.

Large Language Models (LLMs) are increasingly deployed in multi-agent environments that produce unanimous agreement, both in intended interactions that need coordination and in unintended emergent interactions. Consequently, understanding how LLMs with competing incentives reach consensus is crucial to better interpret and design LLM collectives. We introduce an evaluation, based on the Network Consensus game, to assess the mechanisms driving this process. Here, a network of agents must agree on one of two colours to receive a payoff, but agents are offered different payoffs for the agreed colour. We vary components such as communication access and network structure and assess six open-source models and one closed model (ChatGPT 5.6-sol). We find that open-source LLMs reach consensus less often than humans in comparable experiments and only if messages are communicated across the global network. ChatGPT 5.6-sol, however, is able to reach consensus with communication limited to its neighbours and with no communication ability. This is achieved through lower stubbornness and higher majority-following tendencies, and by providing more information about its neighbours' states in messages. However, situating agents in a highly clustered graph reduces consensus, regardless of these traits, demonstrating that both system design and individual model traits drive collective outcomes.
0
cs.CLcs.AI Fazle Mohammed Tasfiq, Sabab Attin, Sheikh Md. Tahmid Hossain et al. · Oct 14, 2026

This paper investigates how Retrieval-Augmented Generation affects question answering across five South Asian languages. The authors construct a Wikipedia-based multilingual dataset, generate questions with Qwen 3 32B, and compare non-contexted, contexted, and RAG-based answering using four LLMs. They find that RAG improves QA unevenly—substantially aiding non-popular cultural questions in Bangla and Tamil while underperforming direct contexted answering in Hindi and Nepali—suggesting that retrieval quality and language-specific data alignment matter more than the choice of RAG framework.

Retrieval-Augmented Generation (RAG) models have become almost a cornerstone of open-domain question answering tasks; in which the quality of answers generated in the process, greatly relies on the effectiveness of retrieval mechanisms. In the realm of LLM, the last two years have seen tremendous progress in RAG architectures, with many models reporting to have improved performance through various design innovations. The cultural question and answering systems of South Asia, in particular, present a specific challenge since the region is home to the vast number of languages and traditions, which are closely interrelated. Along with these deeply intertwined historical narratives increase the need for culturally grounded and context-aware interpretation. Despite major architectural advances in LLMs, claiming significant improvements, challenges remain when answering these region specific questions in native languages. In this study, we aim to extract high-performing factors to guide the development of optimized hybrid RAG systems. We further explore whether the integration of RAG changes performance differently for culturally grounded and non-cultural questions in a South Asian multilingual setup, and whether RAG produces a higher overall percentage of correct answers than contexted answering. We also examine how LLM performance changes when RAG methods are integrated into the question-answering pipeline in comparison with non-contexted and contexted answering and, evaluate whether the introduction of RAG benefits popular or non-popular culturally grounded questions more. Not only does our work evaluate the current methods but also carves a path for future designs of more accurate and efficient question-answering pipelines.
0
cs.LGcs.AI Kai Ruan, Jinghao Lin, Tao Chen et al. · Oct 14, 2026

This paper studies policy optimization for long-horizon software-engineering agents that learn from sparse binary test outcomes. The core idea is a training recipe—dubbed SPO++—that combines the Muon optimizer with single-rollout asynchronous updates, truncated importance sampling (TIS), token-averaged loss, and auxiliary length/tool-error penalties. The authors claim this combination achieves higher training success than SPO baselines on repository-level issue resolution for two model families, suggesting Muon is critical for long-horizon RL.

Long-horizon agents must coordinate reasoning, tool use, and environment feedback over extended interactions. Learning from sparse outcome rewards requires weighting trajectories of different lengths and updating the policy while rollouts are still being collected. We examine a single-rollout asynchronous recipe combining Muon, token-averaged loss, truncated importance sampling, and auxiliary length and tool-error penalties. Single-rollout sampling allows asynchronous learning without waiting for multiple trajectories for the same issue. We study optimizer choices and recipe components for repository-level issue resolution across two model families. The evaluated training runs show higher training success with the full recipe than with the baselines.
0
cs.SEcs.AI Yuyao Ge, Shenghua Liu, Peizhong Gao et al. · Oct 14, 2026

Doc2Harness evaluates whether frontier LLMs can engineer a coding-agent harness from scratch, a capability that existing SWE benchmarks ignore by holding the harness fixed. The benchmark asks a build model to generate a complete harness from a development document and an interface-only skeleton, then evaluates it deterministically with a scripted mock model across $328$ black-box test cases. The results reveal a $26$-point performance gap between the best and worst models, with even the strongest scoring only $53.05\%$, suggesting substantial room for improvement in long-horizon infrastructure construction.

Agents driven by large language models are increasingly deployed on long-horizon tasks, where they use tools and modify real workspaces. How well they perform depends as much on the harness around the model as on the model itself. Existing benchmarks measure downstream task success under a fixed harness, leaving harness engineering itself unexplored. We propose Doc2Harness, a two-stage benchmark that evaluates long-horizon harness engineering directly. In Stage 1, a build model operating inside a fixed builder harness receives an interface-only contract skeleton and a development document that consolidates behavior across twelve frontier harnesses, and then constructs a complete candidate harness in an isolated container. In Stage 2, the frozen candidate harness runs in containers separate from the construction environment, one per test case, and is driven end to end by a scripted mock model. We score each test case using four observable channels, namely the requests sent to the model, the files on disk, the process exit code, and the command output; positive controls rule out vacuous passes. Across nineteen frontier models, each evaluated with three independent builds on 328 test cases, GPT-6 Astra achieves the highest pass rate at 53.05%, while the weakest model reaches 27.44%, a gap of roughly twenty-six percentage points. Even the strongest model fails nearly half of the test cases, and failures cluster around how cross-cutting functionality is split across modules. To our knowledge, Doc2Harness provides the first deterministic benchmark for measuring long-horizon harness engineering.
0
cs.CVcs.AI Yuheng Chen, Yufan Chen, Zhuojun Cai et al. · Oct 14, 2026

Document understanding has been evaluated through isolated silos—layout detection, OCR, reading order, and image captioning—making it impossible to audit whether a single coherent page parse exists. This paper proposes Read-Parse-Describe, a unified benchmark built from 2,402 ACM scientific documents that forces models to jointly output bounding boxes, semantic labels, reading order, recognized text, caption links, and alternative-text descriptions for visual elements. To combat spatial drift in compressed vision-language tokens, the authors introduce SARA, a lightweight residual adapter that re-injects crop-aligned multi-layer visual features into frozen VLMs.

Document understanding systems are typically evaluated as separate components via layout analysis, optical text recognition, reading-order prediction, and image captioning. This separation leaves scientific figures, captions, and visual semantics weakly connected, and fails to measure whether a model can produce a single page-level parse that is both structurally faithful and semantically accessible. We introduce Read-Parse-Describe, a unified dataset for document parsing with visual element description generation. Given a page image, models are required to output an ordered list of layout elements containing bounding boxes, semantic labels, reading-order indices, recognized textual content, and alternative text descriptions for visual elements. The benchmark is built from 2,402 documents, comprising 18,163 continuous pages, 125,218 layout elements, and 11,338 visual instances. Besides, we further propose a plug-and-play space-awareness enhancer that reuses multi-layer visual features and injects grid-aware spatial guidance into vision-language tokens for layout-aware generation. Experiments across end-to-end VLMs and pipeline parsers show that existing systems still struggle to jointly recover reading order and visual semantics, while our enhanced model achieves strong joint performance. These results highlight the need to move beyond isolated document parsing modules toward unified models that jointly read, parse, and describe complex documents. The new dataset and code will be made publicly available at https://github.com/yufanchen96/RPD
0
cs.CLcs.AIcs.SI Caixin Kang, Ke Wang, Yuchuan Wu et al. · Oct 14, 2026

Current social agent benchmarks reward fluent conversation but ignore whether agents actually reach valid plans that respect hidden constraints. This paper introduces HICO-Bench, a benchmark where two agents with private information must coordinate verifiable outcomes, and PaCPO, a reinforcement learning method that redistributes terminal rewards across turns by checking tentative plans against paired worlds. The work matters because it reveals that high LLM-judged conversation ratings frequently mask infeasible or unsupported agreements, and provides a concrete credit-assignment mechanism to train agents on verified social outcomes rather than just dialogue style.

Effective social interaction requires more than fluent responses: agents must reach plans that fit the participants' needs and circumstances. Existing evaluations of social agents mainly rely on LLM judges that rate the conversation, without checking the resulting plan. We introduce HICO-Bench, a benchmark of 180 everyday coordination scenarios, such as resource allocation, scheduling, and authorization, in which two agents with private information converse and then independently record the plan they agreed on. A program checks Feasibility (the two records match and satisfy both participants' private conditions), and an LLM judge checks Integrity (the conversation supports the recorded plan); passing both is a Verified Success. Each scenario has two versions that share the same public context but differ in one private condition, so the correct plan differs between them. Across thirteen LLMs, 36% of conversations rated highly for goal completion fail Verified Success. To learn from outcomes that arrive only at the end of a conversation, we propose Paired-Credit Policy Optimization (PaCPO). After each turn, PaCPO asks the agent for a tentative plan, checks it in both versions of the scenario, and rewards the turns after which the tentative plans fit their respective versions. PaCPO raises Qwen3-8B's Verified Success from 20.4% to 28.3%.
0
cs.LGcs.AI Mohamed Bouadi, Nassim Bouarour, Aditya Tanna et al. · Oct 14, 2026

Tabular foundation models learn to predict from in-context examples without task-specific fine-tuning, but dense architectures apply the same computation to every feature regardless of statistical context. OrionMoE-Small attacks this limitation by inserting a dataset-conditioned mixture-of-experts layer along the feature axis of a dual-axis Transformer, allowing the model to route different features to different expert networks based on both local token content and a global dataset register. If the sparse design truly helps, it could offer a principled way to scale tabular models by allocating computation heterogeneously; however, the paper never proves the MoE itself is responsible for the gains.

Tabular foundation models enable in-context learning by predicting unseen observations from a labeled support table without task-specific parameter updates. Despite recent advances, most existing approaches rely on dense architectures that apply the same transformations across features and datasets. We introduce OrionMoE-Small, a compact tabular foundation model that combines distribution-aware representations with dataset-conditioned sparse mixture-of-experts computation. Built on a dual-axis Transformer architecture, OrionMoE-Small selectively activates experts along the feature axis, with routing decisions informed by both individual feature representations and the broader dataset context. This design enables adaptive allocation of computation across heterogeneous tabular problems while retaining a shared computational pathway across tasks. OrionMoE-Small is pretrained entirely on synthetic classification tasks generated from a structured causal prior and performs downstream prediction without gradient-based adaptation. Experiments across multiple tabular benchmarks demonstrate competitive performance against substantially larger foundation models, with particularly strong results on small-context and high-dimensional datasets. Further analysis reveals favorable relative performance under class imbalance and highlights the importance of feature composition.
0
cs.LGcs.AI Yajie Zhao, Yingjun Mo, Zhiyong Wang et al. · Oct 14, 2026

The paper studies how much context a Transformer must retain to perform in-context temporal-difference (TD) policy evaluation without parameter updates. Existing theoretical constructions store the full trajectory, costing Θ(Nd) memory. The authors prove the intrinsic limit is the Krylov dimension k_L, construct a fixed-parameter attention network that compresses raw transitions to Θ(nk_L) registers, and give tight worst-case approximation error Θ(γ^m max{1,1/(m(1−γ))}) when the context falls below k_L.

Transformers can perform in-context reinforcement learning without parameter updates. However, existing theoretical constructions often require context sizes that grow with the number of sampled transitions, leading to increasing memory costs in large-scale problems. This raises a fundamental scalability question: how much context is intrinsically necessary to carry out such learning? We answer this question for fixed-policy TD evaluation. We show that, with a shared linear decoder, the minimum context dimension required to exactly reproduce the first $L$ TD iterates is the Krylov dimension induced by the sampled transitions. When the available context dimension $m$ falls below this threshold, exact reproduction is no longer possible. In this regime, we characterize the optimal approximation error and show that it decays as $\Theta(\gamma^m\max\{1,1/(m(1-\gamma))\})$ where $\gamma$ is the discounting factor. Moving from representation complexity to actual memory cost, we characterize the optimal retained memory for exact continuous representations as $\Theta(nk_L)$ and show experimentally that on a sampled task whose exact rank is full but whose numerical rank is small, a context accurate to $10^{-2}$ is $88.7\%$ smaller than the sparse sufficient statistics of TD. Finally, we establish the learnability of the shared executor through pretraining by proving global convergence of an auxiliary objective over effective attention parameters under suitable task diversity. Experiments across diverse TD evaluation problems validate parameter recovery and the predicted context--accuracy tradeoff.
0
cs.CLcs.AI Jiahong Qian · Oct 14, 2026

LLM entity extraction from full-length documents is widely deployed but its failures are poorly diagnosed. This paper runs a preregistered audit of two low-cost LLMs and a flagship control on 315 real-world cyber-threat-intelligence reports, finding that most false positives are background mentions rather than hallucinations, and that confidence signals can rank outputs for human review but cannot verify truth against relation-level counterfactuals. The results set a concrete deployment boundary for any high-stakes pipeline that triages extraction by confidence.

Audits of large language model (LLM) extraction from full-length documents report severe unreliability, leaving two questions open: what the failures actually consist of, and whether confidence signals can turn unreliable output into usable output. We run a preregistered, fully frozen evaluation of two new-generation low-cost LLMs (DeepSeek-V4-Flash, GLM-5.3-Flash) with a flagship-tier control (GPT-6.1-Sol) on a public corpus of 354 incident campaigns (315 unique reports, 630 model-report evaluations), scoring extraction quality against gold, confidence calibration, and robustness to single-sentence perturbations. Three findings emerge. (1) Unreliability persists across tiers: micro precision is 0.03-0.34 and verbalized calibration error (ECE) 0.53-0.94 across both splits; the gap does not close at the flagship tier. (2) The dominant failure is not hallucination: a full mention census plus a three-tier annotation of 360 sampled candidates (two independent LLM annotators from vendors outside the evaluated set, Cohen's kappa = 0.79 on the preregistered acceptance line, fully disclosed) back-projects to 65.6% background mentions and 19.9% gold-scope gaps, with only 1.2% unsupported candidates. (3) Confidence ranks but does not verify: zero-cost self-consistency-frequency tiering passes a preregistered top-30% precision-gain bar in all six test-split model-type cells (4/6 on train), the zero-cost text-frequency x SC frequency combination wins 3, ties 2, loses 1 across cells, yet relation-level counterfactuals on all 45 targets show that a single misattribution sentence flips high-confidence judgments in 95.6-100% of cases, and even a background sentence explicitly marked as unrelated still binds a fake vulnerability in up to 26.7% of them. We conclude with a deployment boundary: confidence tiering may set review priorities, never truth.
0
cs.ROcs.AI Xiangyi Wei, Hanzhe Yao, Jingwen Shang et al. · Oct 14, 2026

MUCO proposes manipulation units (MUs) to decompose long-horizon robot manipulation into reusable, verifiable sub-operations. Each MU carries a local goal, an initiation condition, and observable success/failure criteria; the MUCO framework matches MUs to specialist policy executors from a frozen capability registry, enables local retry and fallback, and avoids replaying already-verified prefixes. The conceptual goal is to reduce data-collection costs, enable cross-task reuse, and contain failures without joint training or shared backbones. The critical caveat is that the submitted preprint contains almost no quantitative results.

Learning and executing long-horizon robot manipulation as complete task trajectories raises data-collection costs, lim?its capability reuse, and causes local failures to cascade into later task stages. We introduce manipulation units (MUs) as reusable operations, each defined by a local goal, an initi?ation condition, and observable success and failure criteria. MUs are learned and verified individually. During execution, consecutive MUs remain coupled through shared environ?ment dynamics. We formulate MU-Structured Manipulation (MUSM) and realize it through MU-Centric Orchestration (MUCO). Given language and vision, MUCO constructs an MU sequence, matches each MU to compatible policy models in a frozen capability registry, and dispatches the model with the highest calibrated success rate. Visual verification checks MU outcomes against success and failure criteria and governs transitions, enabling retry or fallback to another model from the current state without re-executing verified MUs. Canonical keys enable checkpoint reuse for equivalent MUs across tasks without new demonstrations or updates. We evaluate MUCO on RLBench, RoboTwin 2.0, and five real-world tasks. MUCO achieves higher complete-task success and verified progress, stronger failure containment, and lower error propagation than baselines. Results demonstrate cross-task MU reuse and het?erogeneous policy composition without joint training, shared backbones, or common action representations.