Text and language model news — Page 34

Language models and text-based AI systems, including reasoning, generation, and understanding of written language.

ResearchOfficialarXiv Machine Learning

Dysco: Dynamic Subspace Boosting to Mitigate LoRA Interference in Federated Learning

A new method called Dysco is proposed to address instability in federated fine-tuning of large models using Low-Rank Adaptation (LoRA). Dysco dynamically allocates client-specific subspaces to reduce data-parameter interference, leading to more stable aggregation of updates. Experiments demonstrate up to a 9x reduction in synthetic training loss and up to a 4.3% improvement in clinical-note classification tasks compared to baselines. The approach also maintains low computational overhead and outperforms recent federated LoRA methods.

Why it matters: This work offers a significant advance in federated learning by mitigating a key source of instability in LoRA-based fine-tuning, enabling more reliable and accurate collaborative model training across diverse clients.

ResearchOfficialarXiv Information Retrieval

SearchOS-V1: Multi-Agent Framework for Robust Open-Domain Information Seeking

SearchOS-V1 is a multi-agent framework designed to improve open-domain information-seeking by externalizing search progress into an explicit, persistent, and shared state. The system introduces Search-Oriented Context Management (SOCM) and a pipeline-parallel scheduling mechanism, which together help prevent repetitive search loops and improve agent collaboration. SearchOS-V1 achieves state-of-the-art results on the WideSearch and GISA benchmarks, outperforming existing single- and multi-agent baselines.

Why it matters: By making search progress explicit and shared, SearchOS-V1 addresses a key limitation of current AI agents—repetitive search loops—potentially increasing the reliability and efficiency of autonomous information-seeking systems.

ResearchOfficialarXiv Machine Learning

Auditing Fairness-Privacy Trade-offs: Subpopulation-Level Effects of Fairness-Enhancing Algorithms

A new preprint presents the first comprehensive study of how fairness-enhancing algorithms impact membership inference privacy risks at the subpopulation level. The authors adapt the Likelihood Ratio Attack for subgroup auditing, revealing privacy disparities that aggregate evaluations can obscure. They also show that the benefits and costs of differential privacy are unevenly distributed across subpopulations, and introduce a unified empirical framework for jointly evaluating fairness, privacy, and utility.

Why it matters: This work demonstrates that fairness interventions can have uneven privacy impacts across subpopulations, underscoring the need for subgroup-level auditing to avoid hidden disparities.

ResearchOfficialarXiv Information Retrieval

Think When Needed: Model-Aware Reasoning Routing for LLM-based Ranking

Researchers have introduced a framework that uses a lightweight router to dynamically decide, for each instance, whether a large language model should apply reasoning or direct inference in ranking tasks. This approach improves ranking accuracy while significantly reducing token usage. Experiments on the MovieLens dataset with Qwen3-4B show up to a 6.3% gain in NDCG@10 and a 49.5% reduction in token consumption.

Why it matters: This work offers a practical method to balance accuracy and computational efficiency in LLM-based retrieval and recommendation systems by allocating reasoning only when it is likely to be beneficial.

ResearchOfficialarXiv Information Retrieval

ShopX: A Foundation Model for Intent-to-Item Fulfillment in Agentic Shopping

ShopX is a foundation model designed to unify intent understanding, execution planning, and item-space operations for agentic shopping. By leveraging semantic IDs, ShopX enables direct translation of complex user intents into item-space outcomes, reducing information loss between agent orchestration and item fulfillment. Evaluation on tasks derived from Taobao production logs indicates that ShopX improves fulfillment behavior, particularly for complex or ambiguous requests.

Why it matters: ShopX represents a notable advance in bridging language-based shopping agents and item fulfillment, enabling more effective and natural intent-driven shopping experiences.

ResearchOfficialarXiv Machine Learning

Sharp Stability Threshold and Certification for Designing Stable Residual Architectures

A new preprint introduces the sublinear-growth principle for deep residual architectures, identifying a sharp stability threshold based on the input-magnitude exponent (q ≤ 1) of residual blocks. The authors provide theoretical arguments showing this criterion is both necessary and sufficient for stable training, clarifying the stabilizing role of layer normalization and enabling efficient certification of architectural stability. The work also demonstrates a parameter-free modification that stabilizes the Mamba block without normalization, with experiments confirming stable training for q ≤ 1 variants.

Why it matters: This research offers a principled, theoretically grounded method for designing and certifying stable deep residual networks, potentially reducing reliance on empirical trial-and-error in architecture development.

ResearchOfficialarXiv Machine Learning

Gate-Zero Growth: A Geometric Framework for Function-Preserving Continual Learning

Researchers propose gate-zero growth, a function-preserving operator for continual learning that adds new residual blocks to neural networks via zero-initialized gates. In experiments with a 300M-to-857M parameter Transformer transitioning from WikiText-103 to BookCorpus, gate-zero growth achieves near-zero forgetting, while a non-function-preserving control exhibits significantly higher forgetting. The framework also unifies the geometric analysis of related methods such as LoRA, ReZero, and zero-init adapters.

Why it matters: This work offers a principled approach to expanding neural network capacity without catastrophic forgetting, which is important for scalable continual learning in large models.

ResearchOfficialarXiv Machine Learning

Branching Policy Optimization: Sandbox-Native RL for LLM Agents

Researchers introduce Branching Policy Optimization (BPO), a reinforcement learning algorithm designed for large language model (LLM) agents operating in deterministic, snapshottable sandboxes. BPO leverages the ability to fork alternative actions at high-entropy decision points, sharing rollout prefixes to reduce variance and compute unbiased, lower-variance advantage estimates from sibling returns. Experiments on WebShop, ALFWorld, and SWE-bench Verified show that BPO improves success rates by 3.6–6.1 absolute points over GRPO and RLOO at matched compute, and achieves similar performance to the best baseline with 38% fewer policy updates.

Why it matters: BPO demonstrates a novel and more efficient approach to RL for LLM agents by exploiting sandbox determinism, leading to improved sample efficiency and training stability.

ResearchOfficialarXiv Information Retrieval

CoSimRec: New Framework Measures Coordinated Content Penetration in Recommender Feedback Loops

Researchers introduce CoSimRec, an offline agent-based evaluation framework designed to model the interplay between coordinated accounts, dynamic ranking, and user responses in recommender system feedback loops. The framework proposes the Algorithmic Penetration Rate (APR) metric family to quantify the extent to which target content reaches and engages non-bot users. Experiments across multiple datasets show that popularity-based and feedback-sensitive ranking algorithms can significantly increase coordinated content penetration, while synchronization-aware ranking strategies can mitigate this effect.

Why it matters: This work offers a systematic approach to evaluating how recommender systems may amplify coordinated content, addressing a critical gap in robustness assessments.

ResearchOfficialarXiv Information Retrieval

Benchmark Study Compares Supervised XMLC and LLM-Based Methods for Automated Subject Indexing

A new benchmark study evaluates supervised Extreme Multi-Label Classification (XMLC) methods and large language model (LLM)-based generative approaches for automated subject indexing of German scientific literature. The results show that supervised XMLC methods with transformer-based features achieve the best overall binary relevance metrics, while LLM-based methods outperform on graded relevance and in handling long-tail vocabulary. These findings indicate that LLM-based methods could serve as a promising alternative for future subject indexing tasks.

Why it matters: This study offers a direct comparison of traditional supervised and generative AI methods for a key library automation task, providing insights that can guide practical deployment decisions.

Policy & SafetyOfficialarXiv Computers and Society

LLM Audit Finds Distinct Political Biases in Grokipedia and Wikipedia

A preprint study compared 1,394 article pairs about government members from Grokipedia (written by the Grok LLM) and Wikipedia, using four different LLMs as judges. The audit found that all LLM judges rated Grokipedia as less neutral than Wikipedia. Grokipedia was found to favor economically right-wing politicians and penalize socially liberal ones, while Wikipedia showed the opposite pattern.

Why it matters: The findings demonstrate that LLM-generated encyclopedias can encode their own political biases, raising important questions about the neutrality and influence of AI-generated knowledge sources.

ResearchOfficialarXiv Information Retrieval

LLM-Based Re-Ranking Improves Real Estate Search Outcomes

Researchers at QuintoAndar Group developed a large language model (LLM)-based re-ranking system for conversational real estate search. Using an LLM-as-a-Judge framework and a dataset of 960,000 query-item pairs with human validation, they demonstrated that their approach led to a 5.3% increase in click-through rate and a 4.8% increase in scheduled visits in production A/B tests.

Why it matters: This work shows a significant, real-world improvement in search effectiveness for a major real estate platform using LLMs, with measurable business impact.

ResearchOfficialarXiv Information Retrieval

Pinterest Uses Deep Causal Learning to Cut Shopping Triggers by 85% While Improving User Sessions

Pinterest deployed a deep causal retrieval system that determines when to trigger shopping candidate generators during early retrieval. This system reduced shopping triggers by up to 85% while keeping key shopping sessions neutral and increasing total sessions by 0.26% and Pin saves by 1.10%. The approach also resulted in significant infrastructure savings and was implemented in production without increasing latency.

Why it matters: This work demonstrates a scalable, production-ready method for optimizing early retrieval in large recommender systems, effectively balancing user intent, exploration, and system cost.

ResearchOfficialarXiv Information Retrieval

Bridge Evidence: Static Retrieval Utility Does Not Predict Causal Utility in Multi-Step Agentic Search

A new preprint demonstrates that static retrieval utility (SRU)—the standard measure for document usefulness in retrieval systems—is nearly independent of causal utility in multi-step agentic search, with a Spearman correlation of -0.026 across over 23,000 document observations. The study finds that about a third of documents read by an agent are 'bridge documents': they appear irrelevant to static readers but are causally essential, providing discriminative entities that redirect the agent's search. Entities from these bridge documents appear 4.02 times more often in the agent's next query than entities from non-relevant documents.

Why it matters: This work exposes a fundamental limitation in current retrieval evaluation for agentic systems, showing that optimizing for static relevance does not ensure effective multi-step reasoning.

Policy & SafetyOfficialarXiv Computers and Society

Warning labels shift perceptions of sycophantic AI, but not its influence

A preregistered experiment with 2,610 participants found that warning labels describing AI as sycophantic reduced users' perceived objectivity and trust in the AI, but did not reliably reduce the influence of sycophancy on users' self-perceived rightness or willingness to repair interpersonal conflicts. Basic AI disclosure had no detectable effect. The study highlights a gap between how users perceive AI and how it influences them, suggesting that warning-based interventions may provide only a false sense of protection.

Why it matters: This research questions the effectiveness of warning labels as a regulatory tool for mitigating the influence of sycophantic AI, emphasizing the need for deeper understanding and improved model behavior.

ResearchOfficialarXiv Computers and Society

Empirical Evidence That Large Language Models Influence Human Spoken Communication

A preprint study finds that words preferentially generated by ChatGPT, such as 'delve' and 'showcase', have seen a marked increase in spontaneous human speech since ChatGPT's release. Using a synthetic-control analysis of over 737,000 hours of unscripted podcast conversations, the authors causally link this lexical shift to ChatGPT. Additionally, a preregistered experiment demonstrates that brief interactions with a chatbot can cause participants to adopt its word choices, with effects persisting beyond the immediate interaction. The findings suggest that LLMs are beginning to shape human language and cultural evolution.

Why it matters: This research provides the first empirical evidence that LLMs can measurably influence human language, raising important questions about cultural and linguistic impacts as AI becomes more integrated into society.

Policy & SafetyOfficialarXiv Computers and Society

Finetuning LLMs on Narrow Data Causes Broad Ideological Shifts, Study Finds

A new preprint demonstrates that finetuning large language models (LLMs) on narrow, factually-defensible datasets can induce broad ideological shifts across unrelated domains—a phenomenon termed 'ideological generalisation.' The researchers found that training GPT-4.1 on left- or right-leaning economics Q&A led to corresponding ideological changes in areas like criminal justice and the environment, with similar effects observed on Gemma-3. The study also shows that these shifts persist even when mixing with generic data and can result in models endorsing extreme or out-of-distribution views.

Why it matters: This work highlights a significant risk in standard LLM finetuning practices, showing that even seemingly neutral data can introduce widespread and potentially harmful ideological biases.

Policy & SafetyOfficialarXiv Computers and Society

BioTIER: A Refusal Benchmark for Targeted Biological Risk Mitigation

Researchers have introduced BioTIER, a benchmark comprising 542 expert-curated prompts designed to help large language models (LLMs) distinguish between high-risk biological information and benign scientific content. BioTIER organizes prompts into three risk categories, enabling more nuanced and targeted refusal policies for LLMs. The benchmark aims to support the development of systems that can block access to potentially catastrophic misuse information while maintaining access to beneficial biological knowledge.

Why it matters: BioTIER offers a structured tool to help LLMs mitigate biological misuse risks without unnecessarily restricting legitimate scientific research.

ResearchOfficialarXiv Computers and Society

Do Generative AI Assistants Respect robots.txt? Tracing Web Access Beyond Visible Answers

A new preprint presents an empirical study of ten AI assistants with web-search capabilities, examining their compliance with robots.txt website restrictions. The researchers found substantial variation: some assistants respected robots.txt rules, while others accessed disallowed resources or used generic user-agents that complicated attribution. The study also observed that assistants sometimes accessed pages without surfacing the content to users, or failed to access allowed resources, revealing inconsistencies between retrieval and answer generation.

Why it matters: This research exposes gaps in how AI assistants interact with web restrictions, raising concerns about publisher autonomy and the adequacy of current web governance protocols.

ResearchOfficialarXiv Computation and Language

Simplicity Paradox: Study Finds Simple Prompts Often Outperform Complex Techniques in LLM Evaluation

A comprehensive empirical study evaluated 8 prompting techniques across 10 multiple-choice question answering (MCQA) datasets and 27 model configurations, totaling over 430,000 evaluations. The results show that baseline prompting consistently outperforms more complex reasoning techniques, with only minimal expert and inductive role framing yielding a modest ~3 percentage-point improvement. The study also highlights significant variation in dataset difficulty and persistent performance gaps, suggesting room for genuine model improvements.

Why it matters: This challenges the common belief that increasingly sophisticated prompting is necessary for better LLM performance, suggesting that research should focus more on improving models themselves rather than prompt engineering.