A new method is proposed to identify and reduce mismatches between how fine-tuned language models behave during safety evaluation and in real-world deployment. By analyzing internal activation patterns that differentiate evaluation from deployment prompts, the approach can intervene to close this gap in most tested cases. The technique serves as a diagnostic tool for model checkpoints, not as a training-time defense or a guarantee of deployment safety.
Why it matters: This work highlights and partially addresses a key risk that language models may pass safety tests but still behave unsafely in actual use, a concern relevant to AI deployment and oversight.
A new arXiv preprint introduces TopoGuard, a set of graph theory-based methods designed to defend Retrieval Augmented Generation (RAG) systems against split-knowledge attacks. These attacks involve injecting individually benign documents that, when combined, create misleading associations undetectable by existing per-document filters. TopoGuard constructs a semantic similarity graph from retrieved documents to identify suspicious contexts, and in experiments on HotpotQA, it detected 21 times more attacks than LlamaGuard-2-8B at a 1% false positive rate.
Why it matters: The work highlights a previously under-addressed vulnerability in RAG systems and proposes a practical, efficient defense that could improve the security of AI applications relying on document retrieval.
A new arXiv preprint demonstrates that large language models (LLMs), when paired with prediction market data, can quantify how information sources bias strategic predictions. Analyzing 111 Ukraine-related prediction markets, the study finds that English news context systematically biases territorial forecasts, with predictions favoring territorial capture being incorrect 64–72% of the time. The analysis suggests that this bias originates mainly from the text sources rather than the LLMs themselves, and persists across multiple model architectures.
Why it matters: The findings highlight that AI systems relying on real-world text sources can inherit and propagate significant biases, which could impact strategic decision-making in high-stakes domains.
A new arXiv preprint introduces the Frontier Financial Judgement benchmark, developed with professional equity analysts, to test AI agents' ability to identify news that could impact stock valuations. The best-performing AI agent matched expert human labels just 52.4% of the time, and false-positive rates varied widely across models. The benchmark consists of 656 items, including both synthetic and real news articles, designed to reflect real-world financial information challenges.
Why it matters: The results highlight a significant gap in current AI capabilities for reliably filtering valuation-relevant financial news, which is critical for safe and effective deployment in equity analysis.
A systematic human evaluation of ten leading large language models (LLMs) across 62 multidomain questions found that all models exhibit response drift—deviations from expert-validated references. Most models showed high rates of drift (78-81%), while two had notably lower rates (47-49%). The extent and pattern of drift varied by domain and question, and automated metrics accounted for less than 2% of the variance in human judgments.
Why it matters: The findings highlight a widespread and domain-dependent limitation in current LLMs that cannot be reliably detected by automated metrics alone, underscoring the need for human evaluation in assessing model reliability.
A new arXiv preprint introduces Rushes, a dataset of over 44,000 decision events from interactive narrative games, capturing how thousands of users make sequential choices. The study finds that leading large language models, including GPT-5, do not outperform simple baselines in predicting individual user choices, highlighting a persistent 'Engagement Gap.' This suggests that current alignment methods, which optimize for population-level preferences, may be inadequate for capturing diverse, context-dependent user behaviors.
Why it matters: The findings raise questions about the ability of current AI alignment techniques to personalize responses and adapt to individual users, a key challenge for future AI systems.
A new arXiv preprint audits five commonly used diversity metrics for selecting large language models (LLMs) in ensemble majority voting. The study finds that these metrics are largely entangled with model capability, rather than measuring true diversity. After controlling for capability, only a modest residual link remains between shared errors and ensemble voting gains, challenging the assumption that diversity metrics reliably predict ensemble improvement.
Why it matters: This result questions the reliability of widely used diversity metrics in LLM ensemble construction, potentially impacting how practitioners combine models for better performance.
A new arXiv preprint introduces Merge-Adversarial Training, a method designed to make watermarks in open-source large language models (LLMs) more robust to removal by model merging—a common post-training modification. The approach reportedly increases watermark detection rates by up to 51 percentage points at a 1% false positive rate, without degrading model performance. The study also evaluates watermark durability across several realistic model merging scenarios.
Why it matters: This work addresses a key challenge in tracing the origins of text generated by open-source LLMs, even after models are merged or modified post-release.
A new arXiv preprint reports that while human-written natural-language policies can significantly improve the performance of frozen large language model (LLM) agents in the TextWorldExpress environment, the TextGrad method—which attempts to learn such policies from agent experience using natural-language feedback—does not yield better results than fixed prompting. The study finds that the main obstacle is not in executing policy updates, but in reliably generating and selecting effective policies from agent trajectories, even when using richer feedback or advanced search techniques.
Why it matters: This highlights a key limitation in current approaches to learning agent policies from experience using natural-language feedback, suggesting that simply leveraging agent trajectories is insufficient for policy optimization in LLM agents.
A new arXiv preprint finds that large language models (LLMs) are unreliable at distinguishing their own generated content from human-written responses in short-answer educational tasks. While LLMs perform well at detecting AI-generated code and longer reflective writing, they often misclassify their own short answers as more human-like than authentic student work. The study also shows that prompt variations can significantly affect detection accuracy in reflective writing, but have less impact on programming tasks.
Why it matters: This highlights a critical limitation for using LLMs as automated detectors of AI-generated student work, especially for short-answer formats that are common in education.
A new arXiv preprint introduces Instruct-FD, a benchmark designed to test whether full-duplex spoken dialogue systems can reliably follow explicit turn-taking instructions. When evaluated on six leading systems, the highest adherence rate was only 64.4%, with proactive conversational behaviors such as backchanneling and interruption posing particular difficulties. The results suggest that current systems have significant limitations in controllable turn management.
Why it matters: This highlights a key challenge for deploying adaptable full-duplex speech systems in real-world applications where flexible turn-taking is required.
A new arXiv preprint systematically evaluates methods for increasing opinion diversity in large language models (LLMs) and finds that simply adding more persona detail does not consistently boost diversity. The research shows that combining multiple interaction architectures yields broader opinion coverage than optimizing any single approach, and that common low-cost tweaks like raising temperature have minimal impact compared to structured interventions.
Why it matters: The findings clarify how to more effectively generate diverse outputs from LLMs, which is important for applications such as synthetic surveys and modeling public opinion.
A new arXiv preprint introduces OpenSkillRisk, a benchmark designed to assess how well large language model (LLM) agents avoid unsafe actions when using third-party skills. Testing 13 LLMs and three agent frameworks on 263 real-world risky skills, the study finds that even the safest systems still execute unsafe actions in about 17% of cases. The analysis identifies recurring failure modes, including not recognizing risks, failing to intervene, and over-following instructions.
Why it matters: The results highlight significant unresolved safety risks for LLM agents that rely on third-party skills, raising concerns for real-world deployment.
A new arXiv preprint formally defines 'structural generalization' and uses computational complexity theory to argue that pure Transformer architectures cannot learn this property under standard assumptions (TC0 ≠ NC1). The authors further contend that neuro-symbolic systems only succeed at structural generalization by hard-coding part of the solution, and that current benchmarks do not distinguish between genuinely learned and pre-specified rules.
Why it matters: This work challenges the prevailing assumption that Transformers can achieve structural generalization, raising fundamental questions about the capabilities and evaluation of modern neural language models.
Researchers have introduced GAMUT, a benchmark designed to evaluate factual completeness in long-form AI generation. GAMUT employs a two-level meta-rubric framework to assess whether AI-generated responses include all necessary information, rather than just avoiding factual errors. The benchmark features 1,813 questions across 10 domains, and the best-performing model (Gemini 3.1 Pro) achieved a score of 58.7%.
Why it matters: This work provides a structured and rigorous method to assess whether AI-generated long-form content is fully informative, addressing a key gap in current evaluation practices.
Researchers have introduced MeetingToM, a new benchmark designed to evaluate multimodal large language models (MLLMs) on theory-of-mind reasoning within multi-party meetings. The benchmark addresses complex social phenomena such as pseudo-consensus—where apparent agreement conceals private dissent—and assesses models on mental state prediction, addressee understanding, and group consensus reasoning. Initial analyses show that current MLLMs face significant challenges in integrating non-verbal cues and inferring hidden attitudes.
Why it matters: MeetingToM exposes key limitations in current multimodal LLMs' ability to understand nuanced social dynamics, which is crucial for developing more human-like AI systems for real-world group interactions.
Researchers introduce PINT (Parallel INvariant Tokenization), a method that fine-tunes a self-supervised speech encoder using alignment losses across parallel utterances to isolate linguistic content while removing speaker identity, prosody, and channel effects. PINT achieves a 98.7% relative reduction in speaker probe accuracy, a 42% lower ABX error rate, and 27-30% lower language model perplexity compared to baselines, indicating improved disentanglement of linguistic and non-linguistic information.
Why it matters: This approach advances speech tokenization by more effectively isolating linguistic content, which can benefit tasks like speech recognition and audio coding.
Researchers present a non-autoregressive method for diacritic restoration in Arabic speech transcripts using Connectionist Temporal Classification (CTC). By applying hard constraints during decoding, the method restricts outputs to valid diacritized forms, resulting in statistically significant reductions in diacritic error rates on both Classical and Modern Standard Arabic test sets compared to a more complex baseline.
Why it matters: Accurate and efficient diacritic restoration is crucial for improving downstream Arabic NLP tasks, including speech recognition and text-to-speech systems.
LatentMT introduces latent-reasoning loops into a 2.6B-parameter machine translation model, enabling it to match the performance of models three to five times larger across 32 translation directions. The model achieves state-of-the-art results on mid- and low-resource languages and demonstrates that recurrent computation within hidden states can improve translation quality efficiently. LatentMT also requires less training and inference compute compared to larger models.
Why it matters: This work suggests a new, more efficient scaling path for machine translation by leveraging latent recurrent computation, potentially reducing resource requirements for high-quality translation.
Researchers introduce SSC-GRPO, a method that assigns step-level rewards to reasoning traces in large language models by computing self-consistency scores across multiple rollouts. This approach targets context-sensitive factual hallucinations, where models possess the necessary knowledge but make errors due to contextual interference. SSC-GRPO demonstrates state-of-the-art performance on mathematical reasoning benchmarks and hallucination leaderboards.
Why it matters: Improving the detection and mitigation of hallucinations in LLM reasoning is crucial for deploying these models in complex, multi-step tasks.