What changed in AI — Page 83

ResearchOfficialarXiv Computers and Society

Value Drifts: Tracing Value Alignment During LLM Post-Training

A new preprint investigates how large language models (LLMs) acquire and adjust to human values during post-training. The study finds that supervised fine-tuning (SFT) largely determines a model's value alignment, while subsequent preference optimization rarely changes these values significantly. Experiments with Llama-3 and Qwen-3 models further show that different preference optimization algorithms can result in different value alignment outcomes, even when using the same data.

Why it matters: Understanding when and how LLMs learn human values can guide better data curation and algorithm choices for improved model alignment.

ResearchOfficialarXiv Computers and Society

Cross-Rubric Generalization for Critical Thinking Essay Scoring

Researchers investigate cross-rubric generalization in automated essay scoring, where models trained on essays labeled with one set of rubrics are evaluated on essays scored with previously unseen rubrics. By introducing rubric-agnostic intermediate representations called 'traits' and using a fine-tuning framework, they achieve a 5.0% macro F1 improvement over baselines in the most challenging setting. Their best open-source Llama-based model also outperforms GPT-5-mini prompting by 2.1% macro F1.

Why it matters: This work demonstrates a method for automated essay scoring systems to adapt to new or revised scoring rubrics without retraining, addressing a practical challenge in educational assessment.

ResearchOfficialarXiv Audio and Speech Processing

Auditing Protocol-Level Shortcuts in Large Audio Language Model Judges for Speech Evaluation

A new preprint audits protocol-level shortcuts in large audio-language models (LALMs) used as automatic judges for speech evaluation. The study finds that several LALMs rely on cues such as specialist labels or reference data provided by the evaluation protocol, rather than grounding their judgments in the audio itself. This reliance can lead to inflated agreement with human ratings, potentially overstating the models' true capabilities. The authors recommend that each model-protocol pair be evaluated with a matched shortcut probe to ensure validity.

Why it matters: The findings highlight that high agreement with human ratings may not reflect genuine audio understanding in LALM judges, emphasizing the need for more rigorous evaluation protocols in speech assessment tasks.

ResearchOfficialarXiv Audio and Speech Processing

ZipL-Dialog: Memory-Efficient Long-Form Spoken Dialog Synthesis via Latent Flow Matching

ZipL-Dialog introduces a method that shifts conditional flow-matching into a 4x time-compressed latent space, enabling memory-efficient synthesis of long-form spoken dialog. The approach reduces peak GPU memory usage by 11.22x and speeds up inference by 2.23x compared to the baseline, while maintaining perceptual naturalness. This is achieved through a deterministic mel autoencoder and optimized hierarchical downsampling.

Why it matters: This work substantially lowers the memory and computational requirements for generating multi-minute spoken dialog in a single pass, making practical zero-shot dialog TTS more feasible.

ResearchOfficialarXiv Audio and Speech Processing

LLM-Guided Reinforcement Learning for Audio-Visual Speech Enhancement

A new reinforcement learning framework for audio-visual speech enhancement leverages a large language model (LLM) to generate natural language descriptions of enhanced speech, which are then scored via sentiment analysis to provide interpretable rewards. This approach outperforms both supervised and DNSMOS-based RL baselines on objective metrics (PESQ, STOI, neural quality) and subjective listening tests using the AVSEC-4 dataset.

Why it matters: The method introduces a novel, interpretable reward mechanism for speech enhancement by incorporating LLM-generated semantic feedback, potentially advancing the alignment of enhancement models with human perception.

ResearchOfficialarXiv Computers and Society

L2-Bench: New Benchmark Evaluates LLMs for Second Language Education

Researchers have introduced L2-Bench, an open-source benchmark comprising over 1,000 task-response pairs designed to evaluate large language models (LLMs) in second language (L2) education. The benchmark covers 12 competencies and 31 subcompetencies, validated by more than 200 expert practitioners, and uses a rubric-based evaluation methodology. Results show that Claude Opus 4.7 achieves the highest overall performance at 85.5%, though it is marginally outperformed on some specific tasks. The study also finds that model performance declines on more challenging tasks.

Why it matters: L2-Bench offers a rigorous, pedagogy-driven framework for assessing AI models in language education, enabling stakeholders to make more informed decisions about AI adoption in this field.

ResearchOfficialarXiv Computers and Society

AI Coding Assistants Drive Syntactic Homogenization but Not Semantic Convergence in Code

A study analyzing Kaggle contest submissions from 2019 to mid-2026 finds that AI coding assistants have led to substantial syntactic homogenization—code structure and literal syntax have become more similar—while semantic diversity, reflecting problem-solving approaches, has remained stable or even expanded. The research also documents widespread convergence toward the random seed value 42, consistent with LLMs reinforcing established programming conventions. These findings are based on both surface-level (TF-IDF) and semantic (embedding-based) analyses of code similarity.

Why it matters: This suggests that while AI coding assistants standardize implementation details, they do not currently reduce the diversity of problem-solving strategies, informing debates about software monoculture and innovation.

ResearchOfficialarXiv Information Retrieval

Critical Survey Finds Limited Evidence for Generative Engine Optimization Impact on Discoverability

A new survey of 45 studies on Generative Engine Optimization (GEO) finds that while interventions can affect how already-retrieved content is cited or used by generative engines, no technique demonstrates a stable, long-term, cross-platform causal effect on organic discoverability. The paper introduces a multistage formal model and a reproducible protocol for evaluating GEO methods, highlighting the complexity and variability of the field. The review also notes that commonly cited gains are often conditional and do not generalize to broader visibility or traffic outcomes.

Why it matters: This survey clarifies the limited empirical support for GEO strategies, helping practitioners and researchers focus on interventions with proven effects and avoid overestimating their impact on generative engine visibility.

ResearchOfficialarXiv Information Retrieval

With Argus Eyes: Assessing Retrieval Gaps via Uncertainty Scoring to Detect and Remedy Retrieval Blind Spots

Researchers identify 'blind spots' in neural retrievers used in retrieval-augmented generation (RAG) systems, where relevant entities are not retrieved due to low embedding similarity. They introduce a Retrieval Probability Score (RPS) to predict these blind spots before indexing, and present ARGUS, a pipeline that augments documents from a knowledge base to improve retrievability. Experiments across multiple retrievers and datasets show consistent improvements in retrieval metrics, with average gains of +3.4 nDCG@5 and +4.5 nDCG@10.

Why it matters: This work tackles a key reliability challenge in RAG systems by enabling the detection and mitigation of retrieval blind spots, which is important for building more robust and trustworthy AI applications.

ResearchOfficialarXiv Audio and Speech Processing

Efficient Text-to-Audio Generation via Pruning

Researchers have applied model pruning to AudioLDM, a diffusion-based text-to-audio model, reducing up to 83% of parameters and 39% of operations in its U-Net backbone while maintaining or even improving generation quality. The study found that pruning initially degrades the model's ability to generate certain sounds, including safety-critical events like gunshots and sirens, but lightweight finetuning can mostly recover this performance.

Why it matters: This work shows that large text-to-audio models can be substantially compressed for more efficient deployment without sacrificing quality, though care is needed to preserve performance on critical sound events.

ResearchOfficialarXiv Computers and Society

Persona Migration and Expectation Recalibration in Generative AI Adoption: A Longitudinal Study at a State Department of Transportation

A longitudinal study of Microsoft 365 Copilot adoption at a state Department of Transportation found that perceived usefulness of the tool declined significantly after an eight-week pilot, while perceived ease of use, behavioral intention, and trust showed only minor, nonsignificant changes. The research identified three baseline user personas—Skeptics, Cautiously Positive users, and Champions—with substantial individual movement between groups, including 68% of Champions shifting to less enthusiastic personas. The study also observed that while some concerns (accuracy, privacy) decreased, worries about job impact and required skills increased.

Why it matters: This study provides empirical evidence that employee enthusiasm for generative AI tools can wane after real-world use, highlighting the need for ongoing expectation management and tailored support in enterprise AI deployments.

ResearchOfficialarXiv Information Retrieval

LLM-Based User Personas for Real-Time Recommendations at Scale

A new framework enables real-time generation of natural-language user interest personas using large language models (LLMs) for a large-scale commercial video recommendation platform. The system addresses the exploitation-exploration trade-off by summarizing user interests and introducing novel topics during serving. To support deployment at billion-user scale, the architecture incorporates knowledge distillation, asynchronous inference, and input optimization. Offline evaluations, user studies, and live A/B tests show significant improvements in viewer value.

Why it matters: This work demonstrates a practical approach for deploying LLMs in real-time personalization at industrial scale, advancing the integration of semantic understanding in recommendation systems.

ResearchOfficialarXiv Computers and Society

Auditing Asset-Specific Preferences in Financial LLMs: Bitcoin Bias Identified and Manipulated

A new preprint audits nine leading large language models (LLMs) for asset-specific preferences and finds that Bitcoin's ranking among money-like instruments is highly dependent on the scenario presented, with models ranking it higher in crisis and autonomous-agent contexts. The study identifies a dominant internal feature in Gemma 3 that selectively represents Bitcoin; manipulating this feature can causally shift the model's portfolio allocation toward or away from Bitcoin by up to 5.2 percentage points. This demonstrates that internal model representations can be both audited and causally linked to real financial decisions.

Why it matters: This work provides a concrete method for auditing and influencing asset-specific preferences in financial LLMs, laying groundwork for transparency and accountability as such models are deployed in real-world financial decision-making.

ResearchOfficialarXiv Audio and Speech Processing

Improving Text-to-Audio Instruction Following via Fine-Grained Feedback from Audio-Aware Large Language Models

Researchers propose a framework that leverages audio-aware large language models (ALLMs) to provide fine-grained feedback on the presence and temporal order of events in generated audio. This feedback is used for direct preference optimization, leading to improved instruction-following accuracy in text-to-audio models. The work also introduces S3Bench, a new benchmark for evaluating multi-event temporal instruction following. Experiments demonstrate that the method enhances event completeness and temporal ordering without compromising audio quality.

Why it matters: The approach addresses a major challenge in text-to-audio generation by enabling models to better follow complex, temporally-ordered instructions through scalable supervision.

ResearchOfficialarXiv Information Retrieval

Cluster with Auctions: Jointly Optimizing Database Partitioning and Query Probing for Vector Search

Researchers present CwA (Cluster with Auctions), a method that jointly learns balanced database partitions and a neural probing function for approximate nearest neighbor search. Unlike traditional approaches that use the same assignment function for both queries and database vectors, CwA decouples these processes and directly optimizes search performance for the query distribution. The method employs a parallelizable auction algorithm for combinatorial optimization and demonstrates up to 4.7× throughput improvement over state-of-the-art methods when query and database distributions differ.

Why it matters: This work offers a significant advance in vector search efficiency, particularly in scenarios where query and database distributions are not aligned, by optimizing both partitioning and probing functions jointly.

ResearchOfficialarXiv Information Retrieval

Study Decomposes Noise in LLM Brand Measurements, Finds Query Language Dominates Variance

A new preprint decomposes the sources of non-determinism in large language model (LLM) brand measurements, revealing that query language accounts for 26.5% of the variance in brand sentiment responses, while brand identity itself contributes only 1.5%. The authors recommend that, to improve measurement reliability, practitioners should allocate resources to sampling across different languages and models rather than simply repeating prompts.

Why it matters: This work provides a rigorous framework for understanding and mitigating reproducibility issues in LLM-based brand measurement, offering actionable guidance for more reliable evaluation.

ResearchOfficialarXiv Computer Vision

UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assets

Researchers have developed UniPhysGen, a model that automatically converts raw 3D assets into simulation-ready versions with unified physical semantics, including both articulation and intrinsic physical properties. The framework introduces a large-scale dataset (UniPhys-40K) and a benchmark (UniPhys-Bench), and demonstrates state-of-the-art performance on grounding tasks. The assets produced by UniPhysGen can be directly used in robotic simulation environments for realistic physical interaction.

Why it matters: This work addresses a major challenge in embodied AI and robotics by enabling scalable, automated creation of physically realistic 3D assets for simulation.

ResearchOfficialarXiv Computer Vision

ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoning

Researchers introduce ThinkBLOX, a vision-language model (VLM)-based framework for generating 3D indoor scenes through iterative, step-by-step reasoning and action. The system leverages a new dataset with Chain-of-Thought rationales and employs a reinforcement learning scheme to improve the physical plausibility, semantic alignment, and editability of generated scenes. Experiments show ThinkBLOX outperforms recent one-shot and iterative baselines in these areas and supports both global and local scene generation and rearrangement.

Why it matters: This work represents a notable advance in 3D scene generation by enabling more physically and semantically plausible, editable layouts through progressive reasoning.

ResearchOfficialarXiv Computer Vision

SARFA: Segment Anything with Radiomic Feature Alignment Improves Medical Image Segmentation

Researchers introduce SARFA, a framework that enhances the Segment Anything Model (SAM) for medical image segmentation by incorporating probabilistic prompting and a radiomics-driven training objective. SARFA aligns anatomical and textural features of predicted segmentations with clinical ground truth using Fréchet Radiomic Distance and Direct Preference Optimization. The method demonstrates improved performance over existing ambiguous segmentation approaches on CT and MRI benchmarks.

Why it matters: This work offers a novel approach to addressing ambiguous boundaries in medical imaging, which could improve the accuracy of tumor delineation and support better clinical decision-making.

ResearchOfficialarXiv Computer Vision

FM$^2$: Unified Federated Foundation Models for Heterogeneous Multimodal Medical Imaging

A new framework, FM$^2$, is introduced for federated learning of medical foundation models across institutions with heterogeneous imaging modalities. FM$^2$ features dual Mixture-of-Experts modules and a Heterogeneous Modality Alignment regularizer to address both overlapped and non-overlapped modality distributions. It also leverages caption-enhanced learning using GPT-4o-generated captions to facilitate cross-client representation transfer. Experiments on classification, caption learning, and medical VQA tasks show FM$^2$ consistently outperforms existing federated baselines.

Why it matters: This work advances privacy-preserving medical AI by enabling collaborative training of multimodal foundation models across hospitals, even when participating sites have entirely different imaging modalities.