EvolvingWorld is a framework and benchmark designed for co-evolving characters and worlds in interactive literary simulations. It features a Character Agent and an LLM-based World Model that enable persistent, long-horizon state updates across diverse literary settings. The framework is supported by a dataset derived from 57 books, comprising 138,596 training samples and 222 test snapshots, and introduces a trajectory-level evaluation protocol. Experiments indicate that EvolvingWorld can improve the coherence and persistence of character and world development over extended simulations.
Why it matters: This work represents a notable advance in interactive literary simulation by enabling dynamic, persistent co-evolution of characters and worlds, addressing limitations of prior static or isolated approaches.
A controlled study evaluated the impact of biographical personas in system prompts on code generation by large language models (LLMs). The research found that persona effects varied by model: on Claude Opus, a librarian persona led to frequent in-character disclaimers and a drop in code correctness from 0.92 to 0.67, while GPT-5.5 did not exhibit these behaviors. The findings indicate that personas introduce model-dependent behavioral biases rather than consistent quality improvements.
Why it matters: This work highlights that persona-based prompting can unpredictably affect LLM performance, emphasizing the importance of model-specific prompt engineering.
DeLIVeR is a new framework that frames evidence retrieval for automated fact-checking as a reinforced strategic exploration task. It uses a Planner LLM to decompose complex claims into targeted questions, guiding traversal of structured knowledge graphs for high-precision evidence. On the LIAR, FEVER, and PolitiFact datasets, DeLIVeR achieves peak F1-scores of 83.73, 84.57, and 79.70, representing a 10-15% improvement over the HippoRAG2 baseline.
Why it matters: This work advances automated fact-checking by combining reinforcement learning with knowledge graph traversal, enabling more transparent and auditable multi-hop reasoning for misinformation detection.
A new preprint identifies that model collapse during iterative instruction tuning with synthetic data often appears as a polarization of competence, where strong skills are reinforced but weak skills degrade. The authors introduce KITE, a two-stage framework that uses failure-guided data generation and boundary-aware uncertainty curation to address this issue. Experiments across several datasets and open-source LLMs show that KITE achieves more stable improvements compared to strong synthetic-data baselines.
Why it matters: This work offers a practical approach to mitigating performance degradation in LLMs trained with synthetic data, addressing a growing challenge as model-generated data becomes more common.
Policy & Safety→Official→arXiv Computation and Language
A new preprint introduces Intern-BioBreaker, a specialized bio-red-teaming model designed to test the biosecurity vulnerabilities of advanced large language models (LLMs). The study finds that several frontier LLMs, including GPT-5.5, can be induced to generate pathogenic viral sequences that are physically realizable, with near-100% attack success rates in some cases. The researchers demonstrate that these model-generated biological designs can be synthesized and verified in wet-lab experiments, highlighting a significant gap between current safeguards and the risks posed by capable scientific models.
Why it matters: This work provides concrete evidence that current LLM safeguards are insufficient to prevent misuse in designing dangerous biological agents, underscoring the urgent need for stronger biosecurity measures.
Researchers have introduced Pancasila-Dilemmas, a dataset of 1,834 dilemma questions based on Indonesia's Pancasila values, to evaluate the value alignment of large language models (LLMs). Testing 50 LLMs, the study found that all models scored below 0.5 on Probability Match Score and struggled most with dilemmas related to Religion and Unity, indicating a significant gap in their ability to capture Indonesian human values.
Why it matters: This work highlights the importance of culturally-specific benchmarks for evaluating the value alignment of AI systems, especially in non-Western contexts.
Researchers introduce VDAR-Router, a training-free, difficulty-aware framework for routing queries to large language models (LLMs). The system generates explicit difficulty analyses for each query and retrieves historical examples with similar difficulty profiles to estimate which model is most suitable, optimizing for both performance and cost. Experiments on three datasets show that VDAR-Router achieves better cost-performance trade-offs than existing routing methods.
Why it matters: This work presents a novel, training-free approach to LLM routing that explicitly incorporates query difficulty, offering a practical way to reduce deployment costs without sacrificing performance.
Researchers have introduced Scientific Feasibility Control (SFC), a graph-structured conformal prediction framework designed to provide statistical guarantees for the validity of scientific reasoning in large language models (LLMs). SFC decomposes reasoning into atomic units and dynamically validates each step, branching to alternative paths when scientific violations are detected. On the PhyX physics reasoning benchmark, SFC achieves 50.1% accuracy, outperforming DeepSeek-R1 (49.8%) and GPT-4 (45.8%), and reduces scientific law violations by 73%.
Why it matters: This framework offers a principled approach to improving the reliability and scientific consistency of LLM outputs, which is important for trustworthy AI in research and education.
SpecLA is a speculative decoding runtime designed for stateful linear-attention models. It introduces topology-aware kernels, compact factor recovery, and confidence pruning to efficiently verify draft tokens, addressing the unique challenges of recurrent dependencies in these models. On an NVIDIA H100 with a GDN-1.3B target, SpecLA achieves up to 1.70x end-to-end speedup over standard autoregressive decoding.
Why it matters: This work enables faster inference for linear-attention models, which are important for long-context tasks, by overcoming inefficiencies in traditional autoregressive decoding.
A new framework, MCF-MOE, is introduced to enhance expert selection in Mixture-of-Experts (MoE) models by fusing cross-layer semantic information and local token-level interactions. The approach addresses context incompleteness in existing MoE routers, leading to more consistent and context-aware expert routing. Experimental results on language modeling and understanding tasks show that MCF-MOE achieves improved routing consistency and better downstream performance compared to strong MoE baselines.
Why it matters: This work offers a practical advance in MoE model design, potentially enabling more efficient and stable large-scale Transformer systems by improving expert routing consistency.
Researchers introduce MSCE, a training-free framework that organizes agent experience into reusable procedural skills and declarative environmental knowledge. MSCE employs reflection-weighted value backfilling to guide the evolution of memory and skills, enabling agents to autonomously crystallize and refine capabilities from experience. Experimental results on EvoAgentBench and LoCoMo show that MSCE significantly outperforms state-of-the-art skill-augmented and memory-driven agent baselines, with strong cross-domain transfer and lifelong learning abilities.
Why it matters: This work advances the autonomous evolution of LLM agent capabilities without retraining, supporting more robust lifelong learning and cross-domain adaptability.
A new preprint investigates how language models and humans process next-word prediction by analyzing EEG recordings during reading. The study finds that only surprisal, not top-1 prediction accuracy, correlates with brain signals associated with language processing. Additionally, increasing model size does not necessarily improve alignment with human cognitive patterns.
Why it matters: The findings suggest that simply scaling up language models does not guarantee more human-like cognitive processing, highlighting the need for new approaches to achieve cognitive plausibility.
Researchers introduce RIMS, a three-stage preference optimization framework designed to enhance small language models in retrieval-augmented generation tasks. RIMS generates synthetic chain-of-thought preference data, employs a differentiable soft aggregation mechanism to better utilize preference signals, and applies preference optimization to improve robustness against noisy evidence. Experiments on four multi-hop question answering benchmarks demonstrate that RIMS consistently outperforms state-of-the-art baselines in both Exact Match and F1 scores under noisy retrieval conditions.
Why it matters: This work advances the reliability and effectiveness of small language models for retrieval-augmented generation, particularly in resource-constrained environments.
A new preprint investigates whether the neurons responsible for arithmetic in large language models (LLMs) are form-invariant across symbolic arithmetic, natural language word problems, and Python code. Using attribution and activation patching on Llama-3 models, the researchers identified a compact set of neurons shared across all three formats, which are both necessary and sufficient for late-layer arithmetic computation. Transferring activations from successful to failed executions recovered over 97% of incorrect predictions for addition and subtraction, suggesting that cross-format failures are due to activation states rather than distinct neural circuits.
Why it matters: This work provides mechanistic evidence that LLMs use a shared neural circuit for arithmetic across different input formats, informing future efforts to improve model robustness and interpretability.
Open Source→Official→arXiv Computation and Language
OpenLanguageModel (OLM) is an open-source PyTorch library designed for building and pretraining small language models with readable and modular code. It offers 27 presets across nine model families, supports CPU, single-GPU, and multi-GPU execution, and demonstrates 90.6% four-GPU weak-scaling efficiency on a 348M-parameter workload. OLM is MIT-licensed and available via PyPI, GitHub, and its documentation site.
Why it matters: OLM lowers the barrier for education and research in language model pretraining by providing transparent, modular code that is accessible for both teaching and experimentation.
A new preprint demonstrates that large language models (LLMs) encode syntactic distinctions not captured by Universal Dependencies (UD) tree distances. Using English wh-movement stimuli, researchers found that probe distances between embedded subjects and verbs reverse sign depending on clause finiteness—a pattern unexplained by UD but consistent with Minimalist phase theory. The findings were robust across 13 models from four families and were validated through causal interventions.
Why it matters: This suggests that LLMs internalize deeper grammatical structures than those represented by standard linguistic annotations, aligning with advanced theoretical linguistics.
A new preprint introduces a unified black-box robustness evaluation framework for token-level explanations in enterprise NLP systems. The study systematically compares encoder and decoder models, finding that decoder LLMs yield significantly more stable explanations (73% lower flip rates on average) and that explanation stability increases with model scale (44% improvement from 7B to 70B parameters). The work also presents a practical cost-robustness tradeoff curve to inform model selection before deployment in compliance-sensitive environments.
Why it matters: This framework addresses a key challenge in validating explanation robustness for black-box NLP systems, supporting user trust and regulatory compliance in enterprise applications.
A new preprint demonstrates that even state-of-the-art large language models (LLMs) struggle to exactly copy input strings within their context windows, a task much simpler than many they routinely solve. The authors attribute this limitation to the inductive biases of standard positional encodings in Transformer architectures. They introduce 2D-RoPE, a method that organizes text into a 2D grid with separate row and column IDs, enabling shallow Transformers to achieve perfect copying at input lengths hundreds of times longer than those seen during training. Experiments, including pretraining models up to 1.4B parameters, confirm the advantage of this approach over standard methods.
Why it matters: This work reveals a fundamental limitation in current Transformer-based LLMs and proposes a simple architectural change that could improve their reliability on basic tasks like copying.
Policy & Safety→Official→arXiv Computation and Language
A new preprint evaluates three leading LLM watermarking methods—KGW, Unigram, and SynthID-Text—against legal admissibility standards, including the Daubert criteria and NIST forensic guidelines. The study finds that meaning-preserving paraphrasing removes watermarks in 100% of KGW and Unigram cases and 98.3% of SynthID cases, with high false-negative rates even before attack. None of the methods tested meet the evidentiary standards required for court use, raising serious concerns about their reliability for legal or regulatory purposes.
Why it matters: The findings challenge the foundational assumption behind emerging regulations that AI-generated content can be reliably identified for legal evidence using current watermarking techniques.
A new preprint systematically compares tokens, bytes, and pixels as language model encodings, controlling for both linguistic content and downstream model capacity. Using parallel sentences in 13 languages, the study traces rate-utility frontiers and finds that no single encoding is optimal across all tasks or capacity regimes. Pixels best preserve surface form, bytes excel at cross-lingual alignment, and tokens are most effective for topic prediction.
Why it matters: This work provides a principled framework for selecting language encodings based on specific tasks, language diversity, and computational constraints, challenging the default reliance on subword tokens.