Nothing here yet
Large language models rely on just-in-time compilers like Triton to generate optimized GPU kernels, caching the results for reuse. This paper asks whether a Rowhammer-induced bit-flip can silently degrade inference efficiency without harming output correctness, and answers affirmatively with LLVMhammer. By corrupting a target-independent optimization pass in Triton, the attack forces emission of a suboptimal kernel that raises latency by 4–16%, while the on-disk cache makes the slowdown persist across restarts.
Learning discrete distributions from batched user data under person-level privacy is a fundamental problem in federated analytics. This paper develops the first polynomial-time pure-DP algorithm that matches the information-theoretic sample complexity up to logarithmic factors, via a new degree-6 sum-of-squares certificate based on a trace-bounded diagonal majorizer for multinomial covariance. It also proves a statistical-query lower bound suggesting the gap between efficient and optimal robust rates may be inherent.
KV cache compression for multimodal LLMs usually evicts visual tokens once at prefill, but this one-shot selection breaks down during long-form generation because the model's attention drifts as the description unfolds. The paper proposes Rate-Controlled Refresh (RCR), which uses a low-rank drift detector to decide when and where to refresh the cached tokens, while a per-sample rate controller decides how often, ensuring low-drift samples are not starved of refreshes. The core claim is that a single configuration transfers across models and tasks, outperforming per-step retrieval baselines at comparable CPU-GPU traffic.
Privacy auditing without retraining is essential for auditing deployed or third-party models, but available non-members often come from a different distribution than the training data, causing standard membership-inference attacks to conflate membership with domain shift and severely overestimate leakage. This paper proposes shift-aware score transport: the auditor learns how membership-inference scores depend on pretrained data representations from the available out-of-distribution non-members, transports that conditional relationship to the in-distribution covariate space implied by known members, and then corrects the estimate via controlled internal calibration tasks. The core contribution is a practical way to recover stable, relatively tight empirical lower bounds on $\mu$-GDP when the auditor cannot retrain, insert canaries, or control data inclusion.
Conformal prediction for non-Euclidean responses is underdeveloped because conventional scores require residuals or densities that assume a vector-space structure. This paper introduces the conditional expected local radius, $R_\beta(\omega|x)=\frac{1}{\beta}\int_0^\beta Q_x(\omega,\tau)\,d\tau$, as a nonconformity measure in general metric spaces, and estimates the conditional distance profile, the CELR, and its conditional distribution from a single metric distributional random forest. The result is a computationally cheaper alternative to the conditional profile score method of Zhou and Müller (2025) with uniform consistency and asymptotic conditional validity guarantees.
Diffusion large language models introduce a bidirectional infilling mechanism that poses a distinct jailbreak surface compared to autoregressive generation. This paper proposes RMT-Jailbreak, which first elicits a harmful response from a source autoregressive model using existing jailbreak methods, then converts that response into a sparsely masked template and feeds it to a target diffusion model to reconstruct the harmful content. The key finding is that query-specific harmful responses provide more effective reconstruction cues than generic attack scaffolds, yielding strong cross-paradigm transferability.
The paper tests whether open LLMs that a hospital could self-host are ready for clinical use, evaluating four models (8–27B parameters) on the Spanish MIR residency exam under its real scoring and ranking rules. The authors go far beyond headline accuracy to probe calibration, the value of abstention under a wrong-answer penalty, the soundness of clinical reasoning, and whether vision models actually use the images they receive. Their headline message is that a model can rank high enough to choose almost any specialty while remaining overconfident, correct for the wrong reasons, and blind to the clinical plates it is shown.
QuaNAS tackles query-efficient neural architecture search by treating a library of earlier searches as explicit but uncertain knowledge. Its core idea is to encode design decisions as additive main-effect priors that seed a Gaussian process, letting every new evaluation re-weight trust in transferred knowledge and fall back on zero-cost proxies when the library is uninformative. The paper tests this under a frozen, self-preregistered protocol on 12 held-out datasets spanning images, time series, text, and tabular data.
Complex reasoning training hinges on two supervision modes—sparse RL rewards and dense distillation—but combining them naively causes optimization conflicts.
GIFT introduces a token-level geometric filter that decomposes the teacher gradient into a conflict-measuring parallel component ($a_i$) and a novel-guidance orthogonal component ($b_i$), then progressively anneals which tokens receive distillation.
This yields consistent improvements on hard math and logic benchmarks, with relative gains reaching 9.5% on the most difficult tasks.
SABLE tackles expensive optimisation in the high-dimensional latent spaces of pretrained generative models — a regime where latent dimension $D$ can reach $40{,}500$ while the evaluation budget $N$ is orders of magnitude smaller. The core idea is to use a Bayesian affine surrogate on the characteristic-radius sphere, decoupling acquisition into a data-sized in-span component and a scalar off-span norm that is prescribed by a finite-horizon schedule rather than left to expected improvement. Together with a fast recompression scheme that bounds model-refitting cost to $\mathcal{O}(M^{2}D+M^{3})$, the method achieves tens-of-millisecond decisions and strong sample efficiency on synthetic and scientific benchmarks.
This paper studies how to handle aging textual signals in weekly portfolio allocation: keep stale news with explicit timing information, or filter out reports older than a fixed threshold. A frozen LLM extracts ternary $z_{i,t} \in \{-1,0,1\}$ signals from SEC disclosures, then either a Double DQN RL policy or the same LLM selects portfolios for a ten-stock US universe. The core finding is that filtering old signals outperforms retaining them with age metadata for the LLM agent, yet nearly none of the return differences are statistically significant. The work matters because trading costs make signal timeliness practically relevant, but its claims of superiority rest on noisy, short-sample evidence.
Existing AI evaluations treat economic value and energy consumption separately, leaving a critical gap in understanding whether more capable systems actually deliver better returns per watt. This paper formalizes Net Value per Joule ($NVJ$) and Time Saving per Joule ($TSJ$), pairing judged professional output quality with end-to-end energy measurement across 220 real-world tasks. The work matters because it shows rankings of occupations and models shift dramatically once energy is accounted for, challenging the assumption that raw capability or dollar cost alone guide efficient deployment.
Different XAI methods frequently contradict one another, yet most tools show only one explanation at a time. XALIGN is a visual analytics workflow that places rule-based explanations and three feature attribution methods side by side for a single Random Forest model. Its goal is to let domain experts spot agreements and contradictions, calibrating trust rather than accepting a single explainer's story.
Tool selection across corpora of tens of thousands of APIs is a critical bottleneck for LLM agents, because standard retrievers rank by relevance without knowing which tools a multi-step instruction actually requires. This paper post-trains small open Qwen3 models (1.7B to 8B parameters) via supervised fine-tuning and reinforcement learning to decompose a request and select tools through a lightweight Plan–Retrieve–Select workflow. The headline result is that an 8B checkpoint outperforms a 402B-parameter Llama-4-Maverick on ToolBench and transfers zero-shot to unseen tool domains and retrievers, suggesting that tool selection can be compressed into a small, locally hostable policy rather than delegated to massive proprietary models.
Formal verification of neural networks usually requires expensive set propagation whose error accumulates with depth and input size. This work introduces a mixed-monotone architecture built as the difference of two monotone subnetworks, reducing tight output enclosure to just two forward passes at opposite interval corners. Because the enclosure size is a closed-form differentiable function of the weights, it can be minimized directly during training, yielding orders-of-magnitude speedups and near-optimal tightness without sacrificing predictive accuracy.
This paper tackles the underexplored problem of token sparsification in audio transformers, where self-attention cost grows quadratically with input length. The authors systematically compare pruning and merging strategies across model sizes and datasets, and propose frequency-aware heuristics—Spectral Flatness (SF) and Low-Frequency Energy (LFE)—to score token importance. Their core finding is that audio-specific spectral cues consistently outperform generic attention-only methods in post-training settings, offering a practical path to faster inference on spectrogram-based models.
This paper studies whether width and depth limits commute not just at initialization, but during training, for linear residual networks with $1/\sqrt{L}$ branch scaling and $\mu$P width scaling. Its core result is that under clipped gradient descent, the trained output converges in $\mathbb{L}_2$ as $\min\{n,L\}\to\infty$ for any fixed number of steps, proving the order of limits does not matter. Without clipping, commutativity holds only in probability, because the second moment can diverge with depth even after a single gradient step. The finding matters because it rigorously characterizes joint scaling limits in a tractable deep-learning model and isolates gradient clipping as a key enabler of stable infinite-depth training.
GraphRAG usually assumes a centralized knowledge graph, which clashes with real-world settings where sensitive data is siloed across organizations that cannot share raw graphs due to privacy or ownership constraints. This paper proposes FedGRAG, a federated framework that routes queries to relevant clients using lightweight semantic prototypes and then reconstructs abstracted evidence subgraphs on a central server to enable cross-client reasoning. The problem is practically important because legal and competitive barriers prevent the global construction and indexing required by standard GraphRAG pipelines.
MoG-VLM attacks the prohibitive cost of zero-shot video anomaly detection with Vision-Language Models by treating motion not as a feature but as a lightweight gate that decides when to run expensive VLM inference. It introduces Temporal Gradient Magnitude (TGM) for content-aware frame sampling, anchor-triggered hierarchical lookback windows for temporal refinement, and a tier-aware fusion rule that balances frame-level and video-level语义 signals without any learned parameters. The work reports state-of-the-art zero-shot training-free AUC-ROC on XD-Violence (91.91%), UCF-Crime (84.30%), and MSAD (87.88%), alongside a claimed 1.31× speedup over the prior best method.
Trace2World tackles the bottleneck of building faithful GUI training environments from sparse real-app traces. It separates global semantic reconstruction—resolving page identities, state fields, and conditional effects across traces—from browser implementation, then validates by independently replaying every source workflow. On 200 workflows across ten apps, this contract reaches 91.1% end-to-end fidelity versus 59.8% for the strongest task-local baseline and retains 94.0% of simulated training gains when transferred to real devices.