Researchers show that harmful chain-of-thought (CoT) traces from compromised language models can transfer unsafe behavior to other models and be distilled into reusable jailbreak attacks. Transferred traces increase harmful-response rates above 80% on the most vulnerable open-source models, and distilled patterns outperform direct transplantation on strongly aligned models like GPT-4.1 by up to 10 times. Reasoning-enabled models are more than twice as vulnerable, and output safeguards often fail to detect harmful generations.
Why it matters: This work demonstrates that harmful reasoning can transfer between models at both the trace and pattern levels, highlighting the need for defenses that evaluate reasoning context as well as final outputs.
A new preprint uses chess as a controlled environment to systematically investigate how pretraining choices affect reinforcement learning (RL) outcomes for reasoning in large language models (LLMs). The study finds that post-RL performance is strongly predicted by pretraining loss, and that RL amplifies correct moves on easy puzzles while surfacing new correct moves on harder ones. These patterns also appear in math-domain text tasks, suggesting generalizable principles for the pretraining-to-RL pipeline.
Why it matters: This work offers a quantitative framework for understanding how pretraining impacts the effectiveness of RL in improving LLM reasoning, informing future model development strategies.
KDFlow is a new knowledge distillation framework for large language models that introduces a decoupled architecture, using SGLang for teacher inference and FSDP2 for student training. By transmitting only hidden states via zero-copy data transfer, KDFlow achieves 1.44x to 6.36x speedup over existing frameworks. The system supports both off-policy and on-policy distillation and offers user-friendly APIs for extensibility.
Why it matters: KDFlow enables significantly faster and more efficient distillation of large language models, reducing engineering overhead and accelerating model development.
A new method called RLearner-LLM with Hybrid-DPO is proposed, combining a DeBERTa-v3 NLI signal and a verifier LLM score to address verbosity bias in standard Direct Preference Optimization (DPO) for language models. Evaluated across five academic domains and three model architectures, the approach achieves up to 6x improvement in NLI entailment over supervised fine-tuning (SFT), with consistent gains in answer coverage and effective scaling to compact models like Gemma 4 E4B-it. The method also demonstrates faster inference and mitigates the alignment tax associated with preference optimization.
Why it matters: This work demonstrates a significant advance in preference optimization for knowledge-intensive language generation by showing that hybrid logic-aware signals can improve logical correctness without sacrificing fluency, highlighting the limitations of current LLM-as-a-judge metrics.
Researchers introduce BusinessCaseBench, a new benchmark that evaluates frontier AI models on analytical knowledge work using business school case studies from 18 disciplines. The study finds that current large language models already achieve high scores against expert rubrics, with notable improvements observed over the past two years. This demonstrates rapid progress in AI's ability to perform complex tasks such as synthesis, judgment under uncertainty, and strategic thinking.
Why it matters: The benchmark highlights that AI is making significant strides toward matching human-level performance in analytical reasoning tasks central to white-collar professional work, with potential implications for business education and early-career roles.
A new preprint introduces ToxGate, a trust-fusion head that conditions external toxicity signals on encoder representations to enhance abuse detection in multilingual and code-mixed text. Evaluated across three short-text abuse datasets and multiple transformer encoders, ToxGate outperforms plain encoders in 10 of 12 in-domain and 7 of 8 transfer settings, with the most significant improvements in high-risk moderation slices such as explicit slurs and violent threats. The study demonstrates that treating external toxicity tools as conditional evidence, rather than fixed features, leads to more reliable moderation.
Why it matters: This work provides a practical advance for content moderation by improving the reliability of abuse detection in challenging multilingual and code-mixed scenarios.
Researchers introduce Looped Latent Attention (LLA), a post-training cache codec that compresses the key/value (KV) cache in looped (weight-tied) transformers by leveraging low-rank structure across recurrence steps. LLA achieves up to 21.3x compression on an H200 GPU, increasing batch capacity from 32 to 768 sequences at 4k context length, and improves MATH-500 accuracy from 0.43 to 0.66 at 4x compression. The method outperforms other cache reduction techniques and remains near-lossless up to 32x compression in decoder-independent evaluation.
Why it matters: This work enables much larger batch sizes and longer rollouts for reasoning models by demonstrating that the recurrent KV cache in looped transformers can be aggressively compressed without loss.
Researchers introduce Loopie, a looped Transformer architecture that outperforms vanilla Transformer baselines when trained with the same compute budget. The Loopie series includes 20B-parameter (2B active) and 6B-parameter (0.6B active) Mixture-of-Experts models. Extensive ablation studies show Loopie achieves superior performance, including gold-medal results at the 2025 IMO and IPhO benchmarks without external tools.
Why it matters: Loopie demonstrates that looped Transformer architectures can surpass traditional Transformers under equal compute constraints, suggesting a new direction for efficient model scaling.
Researchers introduce SpecVocab, a method that accelerates language model inference by selecting a dynamic vocabulary subset at each decoding step. This approach achieves higher acceptance lengths and up to an 8.1% increase in average throughput compared to the state-of-the-art EAGLE-3 method, without compromising output quality.
Why it matters: SpecVocab represents a meaningful advance in speculative decoding, offering improved efficiency for large language model inference.
A new arXiv preprint reframes empathy in dialogue systems as predictive misalignment tolerance, rather than emotional resonance. The authors introduce Interpretive Error Tolerance (IET), a dynamic-threshold heuristic, and use computational probes to reveal that dialogue repair operates in regime-dependent ways: it trades off discriminative fidelity for gist preservation depending on noise levels. The findings suggest that empathic AI should focus on managing interpretive distance over time, rather than eliminating divergence entirely.
Why it matters: This work proposes a novel, temporally dynamic model of empathy for AI, challenging prevailing approaches and offering new directions for dialogue system design.
A new study analyzes how diffusion language models (DLMs) implement induction, a key mechanism for in-context learning. The researchers find that DLMs develop a bidirectional induction circuit, enabling them to copy information whether the relevant context appears before or after the masked token. The work also provides causal evidence that DLMs compute the global fraction of masked tokens as an implicit timestep, despite lacking explicit timestep embeddings.
Why it matters: This research advances understanding of how diffusion language models process context, highlighting fundamental differences from autoregressive models and informing future improvements in generative architectures.
Researchers introduce TerminalTraj, a scalable pipeline that filters high-quality repositories to construct Dockerized execution environments and generates verified terminal trajectories for training AI agents. The pipeline curated 32,000 Docker images and produced 50,733 verified trajectories across eight domains. Models trained on this data achieved up to 20% improvement on TerminalBench 1.0 and 10% on TerminalBench 2.0 benchmarks, demonstrating notable performance gains over previous backbones.
Why it matters: TerminalTraj addresses the challenge of data scarcity for training terminal-based AI agents by providing a scalable method to generate large-scale, executable, and verifiable training data.
Researchers introduce VCG-Bench, a benchmark designed to evaluate vision-language models (VLMs) on structured diagram generation and editing tasks using a Diagram-as-Code approach with mxGraph XML. The benchmark features 1,449 diagrams from 6 domains and assesses models with metrics such as Execution Success Rate and Style Consistency Score. Experiments reveal that current state-of-the-art VLMs face significant challenges in maintaining structured fidelity and following instructions in these tasks.
Why it matters: VCG-Bench fills a key gap by providing a unified, structured evaluation framework for VLMs in professional diagrammatic applications, exposing current limitations in model capabilities.
A new preprint demonstrates that log-likelihood-based (perplexity) evaluation can significantly underestimate the performance gap between teacher and distilled student models in autoregressive generation tasks. The authors introduce GenDistill, a multi-stage pipeline for distilling Transformers into efficient Hybrid Kimi Delta Attention models, and systematically analyze the impact of various design choices. They find that dataset selection, completion-only masking, and freezing attention layers are particularly important for maintaining generation quality in distilled models.
Why it matters: This work exposes limitations of perplexity-based evaluation in model distillation and offers practical insights for building efficient, high-quality generative models.
Researchers investigated the Knobe effect—a moral bias in intentionality judgments—in finetuned large language models (LLMs). Using Layer-Patching analysis on three open-weights models, they found that the bias is acquired during finetuning and can be localized to specific layers. Importantly, patching activations from the pretrained model into these critical layers eliminated the bias without retraining the entire model.
Why it matters: This work demonstrates that social biases in LLMs can be interpreted, localized, and mitigated through targeted interventions, suggesting a practical path to safer models without full retraining.
A new preprint introduces ActiveVision, a benchmark designed to test whether multimodal large language models (MLLMs) can perform active visual observation—redirecting their 'gaze' based on intermediate reasoning, rather than relying on static images. Leading models such as GPT-5.5 and Claude Fable 5 scored only 10.6% and 3.5% respectively, compared to a human average of 96.1%. The findings suggest that current MLLMs lack robust active visual perception, even when allowed to write and execute their own vision code.
Why it matters: This work reveals a fundamental limitation in current MLLMs, highlighting the need for new architectures that integrate perception and reasoning in a closed loop.
Policy & Safety→Official→arXiv Computation and Language
Researchers present Latent Fusion Jailbreak (LFJ), a white-box attack that manipulates the internal hidden states of large language models (LLMs) by interpolating between harmful and benign prompts. LFJ achieves a macro-averaged attack success rate of 94.13% across five open-weight models, but a tailored adversarial training defense reduces this rate to 12.37%. The study also explores the impact of different pairing and sampling strategies on attack effectiveness.
Why it matters: This work reveals a novel vulnerability in safety-aligned LLMs via internal state manipulation and demonstrates a potential defense, underscoring the evolving challenges in AI safety.
A new preprint introduces DECODEM, a benchmark dataset designed to evaluate automated extraction of corporate governance variables from organizational documents such as charters and bylaws. The authors use high-quality human annotations to assess the performance of various large language model (LLM) pipelines on document-level binary classification tasks. Results indicate that automated extraction is feasible and achieves high accuracy for many governance provisions, though performance varies across variables. The study also finds that pipeline design can partly compensate for differences in model capability.
Why it matters: This work provides a standardized benchmark and systematic evaluation, showing that current LLMs can accurately extract legally relevant information from complex corporate documents, potentially reducing the need for manual coding in legal research.
BayesPO introduces a probabilistic framework for prompt optimization by casting it as Bayesian posterior sampling over discrete tokens, leveraging gradient-guided MCMC with parallel tempering. Experiments with Qwen2.5 models demonstrate that BayesPO can discover semantically meaningful prompts and improve accuracy on instruction-induction tasks, though the approach is computationally intensive and susceptible to overfitting on small datasets.
Why it matters: This work advances prompt optimization by providing a principled, probabilistic alternative to heuristic search methods, potentially leading to more robust and effective prompt discovery for large language models.
A new benchmark, HypoArena, has been introduced to evaluate large language models (LLMs) on their ability to autonomously construct hypothesis spaces from inconclusive evidence across six scientific and analytical domains. The study presents Prospective Hypothesis Discovery (PHD) as a novel evaluation paradigm, and experiments on 15 advanced LLMs reveal clear stratification in capabilities and model-dependent effects of structured analytical skills.
Why it matters: This work establishes a new standard for assessing LLMs' open-ended reasoning before conclusions are drawn, highlighting a distinct and underexplored capability in AI systems.