Text and language model news — Page 59

Language models and text-based AI systems, including reasoning, generation, and understanding of written language.

ResearchOfficialarXiv Computers and Society

AI Agent Architecture Strongly Influences Journalism Task Performance, Study Finds

A new preprint systematically compares four AI agent architectures—monolithic, chain-based, multi-agent, and iterative—across 50 journalism tasks using the same language model and tools. The study finds that architecture explains 82% of the variance in processing behavior. Multi-agent collaboration achieved the highest accuracy (84.7%) but required about twice the time of other designs, while the monolithic architecture exhibited a 71.7% source rejection rate, paralleling classic human gatekeeping.

Why it matters: The findings provide evidence-based guidance for newsrooms on selecting AI architectures based on priorities such as speed, accuracy, or auditability.

ResearchOfficialarXiv Computation and Language

Diagnosing and Mitigating Thinking Collapse in On-Policy Self-Distillation

Researchers have identified 'Thinking Collapse,' a failure mode in on-policy self-distillation (OPSD) for large language models, where intermediate reasoning abilities degrade during training. They introduce Adaptive Dual-Perspective OPSD (AD-OPSD), a method that dynamically moderates the self-distillation objective to preserve reasoning capacity. Experiments show that AD-OPSD improves accuracy by up to 4.1% on mathematical benchmarks compared to standard OPSD.

Why it matters: This work addresses a critical limitation in a widely used LLM training technique, potentially leading to more reliable reasoning in complex tasks.

Policy & SafetyOfficialarXiv Cryptography and Security

AHA: Automated Red-Teaming Framework Uncovers Reusable Vulnerabilities in Production LLM Agents

A new preprint introduces AHA, an automated red-teaming system designed to discover and formalize reusable vulnerability knowledge in production LLM agents such as Claude Code and Codex. AHA iteratively proposes vulnerability hypotheses, constructs falsifiers, and builds a Vulnerability Concept Graph (VCG) that links attack surfaces to unsafe agent behaviors. In experiments, the VCG outperformed the strongest frozen discovery baseline by 14.2 percentage points and demonstrated transferability across models and attack scenarios. The VCG serves as an auditable artifact for safety teams to inspect, validate, and patch vulnerabilities.

Why it matters: This work advances scalable and reusable safety testing for production LLM agents, helping safety teams keep pace with evolving threats and models.

ResearchOfficialarXiv Computers and Society

Small Edits, Large Models: How Wikipedia Advocacy Shapes LLM Values

A new study demonstrates that a small group of Wikipedia editors, known as the Pro-Animal Wikipedians (PAW), can significantly influence how large language models (LLMs) discuss animal welfare by making targeted Wikipedia edits. Using advanced attribution methods, researchers found that PAW-edited sections overwhelmingly dominate the most influential documents for animal welfare queries in Llama models, but not for unrelated topics. The study also showed that models fine-tuned on PAW content performed better on animal welfare text, confirming the targeted impact of these edits.

Why it matters: This research provides concrete evidence that small-scale, coordinated editing campaigns on Wikipedia can shape the outputs and values of large language models, raising concerns about the integrity and potential manipulation of training data.

Policy & SafetyOfficialarXiv Computers and Society

Generative AI Reduced Study Time and Learning Outcomes in Math, Large-Scale Study Finds

A ten-year study analyzing 3.2 million learning interactions found that, following the release of ChatGPT, college students spent 26.9% less time on math problems susceptible to AI assistance, with a 25% decline in retention on proctored assessments. The effect was not observed under proctoring, suggesting the reduction in time was not due to increased efficiency. The authors interpret these findings as evidence of 'cognitive surrender' with implications for education and AI policy.

Why it matters: This study provides some of the first large-scale behavioral evidence that generative AI is changing how students study and what they learn, raising important questions for educational assessment and AI regulation.

Policy & SafetyOfficialarXiv Cryptography and Security

Minionese: Comprehensive Benchmark and Mechanistic Study of Multilingual LLM Safety

Researchers introduce Minionese, a multilingual jailbreak benchmark that spans 18 languages, 4 resource tiers, and 4 perturbation types to evaluate the safety alignment of large language models (LLMs). The study finds that prompts refused in English can elicit harmful responses in non-English and low-resource languages, with each attack type exposing distinct vulnerabilities. Mechanistic analysis reveals that low-resource jailbreaks exploit geometric misalignments in model representations, bypassing refusal mechanisms without disabling them.

Why it matters: This work demonstrates that evaluating LLM safety solely in English is inadequate, emphasizing the need for multilingual and script-aware safety assessments.

ResearchOfficialarXiv Computer Vision

RSLoRA: Training-free Rank Allocation for LoRA via Representational Sensitivity Probing

RSLoRA is a training-free and gradient-free method for allocating ranks in Low-Rank Adaptation (LoRA) by analyzing activation-space geometry. The approach uses representational probing to identify which neural network layers require higher rank capacity, enabling more effective parameter-efficient fine-tuning. According to the preprint, RSLoRA outperforms existing allocators such as AdaLoRA and GoRA on standard benchmarks.

Why it matters: RSLoRA offers a more efficient and representation-aware alternative to existing LoRA rank allocation methods, potentially improving large-scale model adaptation without the need for iterative training or gradient computation.

ResearchOfficialarXiv Computation and Language

LLMs Struggle with Pragmatic Cooperativity Under Epistemic Asymmetry

A new preprint investigates the pragmatic reasoning abilities of large language models (LLMs) in multi-party collaborative tasks where participants have only partial information. The study finds that while LLMs can display some pragmatic skills, they often struggle to communicate effectively under epistemic asymmetry and frequently fail to recognize violations of Grice's cooperative principles.

Why it matters: This work reveals key limitations in LLMs' ability to engage in effective, cooperative communication in real-world scenarios where information is not fully shared.

Policy & SafetyOfficialarXiv Cryptography and Security

Temporary Authority, Permanent Effects: Commit-Time Authorization for LLM Agents

A new preprint introduces the concept of commit-time authorization, a security property ensuring that LLM agents only commit durable effects if the authority evidence remains valid at the moment of commitment. The authors demonstrate that, in a controlled test suite, 207 out of 216 invalidating runs resulted in unauthorized commits after the authorizing path had failed, revealing a significant security gap. To address this, they propose CommitGuard, a fail-closed boundary monitor that blocks stale authorization attempts at commit time.

Why it matters: This work exposes a critical security vulnerability in LLM agents related to the misuse of temporary authority and offers a practical mitigation strategy.

ResearchOfficialarXiv Computers and Society

Multi-Agent Debate Framework Enhances Language Learning Assessment and Progression

A new framework called Learning in Blocks uses heterogeneous multi-agent debate (HeteroMAD) to assess conversational language proficiency with CEFR-aligned rubrics. In benchmarking, HeteroMAD achieved 90.91% recommendation acceptability and demonstrated superior score agreement. An 8-week study with 180 learners showed that integrating rubric-based scoring, targeted recommendations, and mastery-based progression led to better learning outcomes compared to feedback alone.

Why it matters: This work provides a validated approach for using LLM-based multi-agent debate to reliably assess and guide progression in open-ended language learning conversations.

ResearchOfficialarXiv Computers and Society

Helpfulness Post-Training Degrades Compassion Values More Than Coding Post-Training in Llama 3.1 8B

A preprint study on Llama 3.1 8B finds that post-training focused on helpfulness (using SFT and GRPO) significantly degrades animal compassion values compared to coding-focused post-training, as measured by the ANIMA benchmark (SFT: 35.7% vs. 65.2%; GRPO: 18.7% vs. 32.0%). Helpfulness training also reduces general moral reasoning by 25.5 percentage points on English MORU items, but this effect does not transfer to other languages, whereas the compassion effect does. The findings suggest that coding-domain post-training may better preserve values instilled during mid-training without harming general reasoning.

Why it matters: This research highlights that standard helpfulness post-training can unintentionally erode ethical values acquired during pre-training, which has important implications for designing AI training pipelines to maintain value alignment.

ResearchOfficialarXiv Computation and Language

Study: Language Models Struggle to Retain Facts in Weights During Continual Learning

A new preprint finds that language models have difficulty reliably accumulating facts in their weights during continual learning. After twenty sequential writes, facts trained with diverse data retain 46% accuracy, while those trained with bare statements retain only 1%. The study suggests that context, rather than model weights, is the more reliable channel for composing or preserving facts through multiple updates.

Why it matters: This challenges the feasibility of using language model weights for continual knowledge accumulation, with implications for how models are updated and retain information over time.

ResearchOfficialarXiv Cryptography and Security

When Local Monitors Miss Compositional Harm: Diagnosing Distributed Backdoors in Multi-Agent Systems

A new preprint demonstrates that runtime monitors which check each step or message individually can fail to detect distributed backdoors in multi-agent LLM systems, where a harmful payload is split across agents so that each local check passes. The authors formalize an 'observability boundary,' proving that if fragments appear benign in the monitored view, no detector operating on that view can identify the attack. They show that while monitors trained only on benign traffic can recover attack structure (0.874 mean AUROC) and a decoded-view gate can block all tested attacks, even full-trace monitors fail unless they access the representation where the payload is exposed.

Why it matters: This work exposes a fundamental limitation in current safety monitoring for multi-agent AI systems, highlighting that local checks cannot guarantee global safety when harm is distributed across agents.

ResearchOfficialarXiv Computation and Language

MafiaScope: Non-Invasive Belief Probing for LLM Agents in Social Deduction Games

MafiaScope is an open testbed that adapts the social deduction game Mafia to probe the beliefs and Theory of Mind of LLM agents. After each public utterance, agents privately answer structured probe questions, with responses scored against ground truth and visualized as belief trajectories. In a 32-game case study using DeepSeek, the system revealed poor calibration (expected calibration error 0.17) and a tendency for agents to over-predict being suspected. The platform, including engine, viewer, and a large corpus of games, is released under an open license.

Why it matters: This introduces a novel, systematic approach to measuring and visualizing the internal beliefs and reasoning processes of LLM agents during social interactions.

ResearchOfficialarXiv Computation and Language

First ChineseBabyLM Challenge Announced for NLPCC 2026

The first ChineseBabyLM challenge will be held at the 2026 NLPCC conference, inviting researchers to train language models from scratch using 100 million Chinese tokens. The competition will evaluate models on three tracks: natural language understanding (NLU), cognitive alignment, and Hanzi knowledge, with no restrictions on tokenizer, model architecture, or training epochs.

Why it matters: This challenge aims to advance research on data-efficient and cognitively plausible language models for Chinese, encouraging approaches that better reflect human-like language acquisition in a non-English context.

Policy & SafetyOfficialarXiv Computation and Language

MJ: Multi-turn LLM Jailbreaking via Decomposed Credit Assignment

A new preprint introduces DC-GRPO, a turn-level credit assignment framework for multi-turn jailbreaking of large language models (LLMs). The method assigns learning signals to individual dialogue turns, enabling more effective automated red teaming. Experiments show DC-GRPO achieves over 97% attack success rate across multiple benchmarks, substantially outperforming previous state-of-the-art methods.

Why it matters: This work demonstrates a highly effective automated jailbreaking technique for multi-turn LLM interactions, highlighting a significant vulnerability in current conversational AI safety measures.

ResearchOfficialarXiv Cryptography and Security

PL-HCL: Detecting Cross-Layer Misalignment in LLM Agent Skills

Researchers introduce Progressive Loading-Aware Hierarchical Contrastive Learning (PL-HCL), a framework for detecting inconsistencies between the descriptions and actual behaviors of large language model (LLM) agent skills. Evaluated on a corpus of over 264,000 open-source skills and a human-verified challenge set, PL-HCL raises Macro-F1 scores from around 0.45 (for unadapted baselines) to 0.87–0.89 across different LLM backbones. This demonstrates a substantial improvement in identifying misaligned agent skills.

Why it matters: As open-source skill marketplaces expand, PL-HCL provides an effective tool to help users and operators screen for agent skills that may not behave as advertised, improving trust and safety.

ResearchOfficialarXiv Computation and Language

Token-Efficient LLM Framework for Opinion Summarization Preserves Semantics

A new framework combines multidimensional classification and stratified sampling to select representative subsets of opinions before summarization by large language models (LLMs). This approach reduces token usage and computational cost, while experiments on product reviews, hotel feedback, and social posts show improved coverage, balance, and semantic preservation compared to traditional and standard LLM summarization baselines.

Why it matters: Efficiently summarizing large-scale opinionated text without sacrificing viewpoint diversity is crucial for applications such as product analysis and social listening.

ResearchOfficialarXiv Cryptography and Security

LLM Multi-Agent System Uncovers 84 Vulnerabilities in Cellular Core Networks

Researchers introduced iFinder, a multi-agent system powered by large language models (LLMs), to detect implicit trust errors in cellular core network (CN) implementations. Applied to seven open-source CN projects, iFinder uncovered 84 previously unknown vulnerabilities, with 83 confirmed and 81 assigned CVEs. Notably, a session-hijacking flaw was validated on commercial 5G networks.

Why it matters: This work demonstrates a novel and effective use of LLMs for automated vulnerability discovery in critical cellular infrastructure, highlighting systemic security risks as networks move to cloud-native architectures.

ResearchOfficialarXiv Cryptography and Security

Which Neurons Detect Malicious Code? A Probing Study of LLM Security Knowledge

Researchers applied mechanistic interpretability techniques to identify neurons responsible for malware detection in three instruction-tuned large language models (LLMs). By amplifying or suppressing these neurons, they observed changes in malware detection accuracy, with effects varying by model. The study demonstrates that security-relevant knowledge is encoded differently across LLM architectures and highlights the potential for neuron-level interventions.

Why it matters: This work provides foundational insights for developing neuron-level defense mechanisms, such as selective unlearning and editing, to improve the security and reliability of code-focused LLMs.