Researchers introduce A*-Inspired Batch Selection (A*-BS), a lightweight, model-agnostic method that schedules mini-batches using a heuristic search to enhance convergence and maintain a strong learning signal during CNN training. On the MedMNIST-v2 benchmark, a simple CNN using A*-BS outperformed ResNet-18 and ResNet-50 on half of the twelve tasks, achieving up to 15% higher accuracy and AUC, and trained substantially faster. The method integrates into existing pipelines without modifying architectures or optimizers.
Why it matters: This work demonstrates that intelligent batch ordering can partially offset the need for deeper networks, providing a computationally efficient alternative for CNN training.
Researchers present drXAI, a method that leverages explainable AI (XAI) attribution techniques to reduce the amount of data needed for time series classification. By identifying and retaining only the most salient features, drXAI achieves 80–90% data reduction while maintaining classification accuracy on both synthetic and real-world datasets. This enables computationally intensive models, such as Transformers, to be applied to larger datasets that were previously inaccessible due to memory constraints.
Why it matters: This work demonstrates a novel and practical use of XAI for data reduction, enabling scalable time series analysis with advanced models on large datasets.
Researchers introduce FedGAMMA, a framework for federated learning on multimodal-attributed graphs, which enables collaborative model training across privacy-restricted data silos without sharing raw data. The approach uses a two-stage process involving federated pre-training and prompt-based fine-tuning, incorporating topology-aware alignment and semantic-structural disentanglement. Experiments on twelve datasets show FedGAMMA achieving up to 12.96% improvement over existing baselines.
Why it matters: This work enables effective federated learning on complex multimodal graph data while preserving privacy, advancing collaborative AI in sensitive domains.
Researchers introduce QUADS, a method to stabilize NVFP4 low-precision reinforcement learning for Mixture-of-Experts (MoE) large language models. QUADS addresses activation quantization error, identified as the main source of instability in NVFP4 RL, by aligning quantization errors across training and rollout. The approach achieves BF16-level accuracy and approximately 16% higher rollout throughput than FP8 in MoE RL benchmarks.
Why it matters: This work enables more efficient and stable low-precision reinforcement learning for large MoE models, potentially reducing computational costs without sacrificing performance.
A new preprint introduces Transfer-Selective Replay (TSR), a method for continual learning that selectively replays past data predicted to benefit the current task, rather than replaying all past examples. TSR is guided by a task signature and uses distillation to maintain stability, showing improved forward transfer and outperforming existing replay baselines on both heterogeneous and homogeneous task streams.
Why it matters: This work reframes transfer as a primary objective in continual learning and provides both a theoretical framework and a practical method to achieve more effective transfer between tasks.
A new preprint introduces a Center of Gravity (CoG)-guided weight correction method that enhances the fault tolerance of deep neural networks, particularly in safety-critical applications. The technique detects and corrects hardware-induced weight faults within each layer based on spatial characteristics, without requiring retraining or architectural changes. Experiments report up to 230x improvement in fault tolerance for certain LSTM-based networks and up to 49.55x for CNNs, with negligible accuracy loss.
Why it matters: This method could substantially increase the reliability of AI systems deployed in environments where hardware faults are a concern.
A new preprint applies Wilsonian renormalization group theory to analyze the role of attention in Transformer models, treating attention as a perturbation to MLP residual stacks. The study finds that attention is crucial ('relevant') for data with long-range correlations, driving a phase transition in representation space, but is largely unnecessary ('irrelevant') for short-range correlations. The first-layer attention head is shown to dominate the representational shift, and attention selectively preserves slow Markov modes in long-correlation regimes.
Why it matters: This work offers a predictive theoretical framework linking the usefulness of attention mechanisms to the spectral properties of input data, potentially guiding model design and application.
Researchers introduce Physics-Informed Splines (PI-Splines), a method that replaces neural networks with tensor-product B-spline expansions for solving differential equations in physics-informed learning. PI-Splines offer compact support, explicit smoothness control, and analytical derivatives, while maintaining the residual-based training approach of Physics-Informed Neural Networks (PINNs). Experiments on benchmark problems demonstrate that PI-Splines are a competitive and stable alternative to neural architectures, especially where structured representations and parameter efficiency are important.
Why it matters: This work offers a structured and interpretable alternative to neural networks for physics-informed machine learning, potentially improving efficiency and stability in scientific computing.
Researchers introduce Contrastive Policy Optimization (CPO), a method that leverages token-level contrastive disagreement between reference-guided and vanilla generation distributions for correctness-aware advantage shaping in reinforcement learning with verifiable rewards. The study presents both theoretical and empirical evidence that CPO provides a more reliable correctness signal than traditional entropy-based methods. Experiments show that CPO outperforms entropy-based approaches on both in-domain and out-of-domain benchmarks while maintaining strong generalization.
Why it matters: This work offers a novel approach to improving the reliability and effectiveness of reinforcement learning from verifiable rewards, potentially advancing the field's practical capabilities.
Researchers introduce CARPRT, a training-free method that assigns class-specific weights to prompts for zero-shot image classification using vision-language models. Unlike previous approaches that use the same prompt weights for all classes, CARPRT captures dependencies between prompts and class labels, leading to improved classification accuracy. The method is evaluated on standard benchmarks and shows superior performance over class-independent reweighting. Code is available on GitHub.
Why it matters: CARPRT addresses a key limitation in zero-shot image classification by modeling prompt-class dependencies, resulting in more accurate predictions.
PolyQ is a CPU-oriented compiler and quantization co-design that enables fractional-bit large language model (LLM) inference on edge CPUs by assigning per-channel bit-widths and applying compile-time optimizations. The framework achieves 2.4–32.1% perplexity improvement over prior methods at a 3-bit target and reduces activation reorder traffic by up to 70.8%. End-to-end measurements on various CPUs show that PolyQ enables practical, predictable, and energy-efficient low-bit LLM inference across diverse edge devices.
Why it matters: This work demonstrates that fine-grained, low-bit LLM inference is feasible and efficient on widely available CPUs, broadening the accessibility of on-device AI.
A new preprint rigorously evaluates an adaptive Runge-Kutta variant of Adam (RK-Adam) under a strict compute-matched protocol, finding that it underperforms plain Adam on training loss, with its adaptive step size mechanism largely inactive. When the method is repaired, it achieves much lower training loss in full-batch settings, but this improvement is fragile and does not translate to better test accuracy. The study also finds that while higher-order adaptive integration can provide deeper minimization and a small regularization effect, these benefits are matched or exceeded by cheaper, well-tuned first-order optimizers like Adam, RMSprop, or NAdam.
Why it matters: This work challenges the value of higher-order adaptive optimizers for neural network training, showing that their practical benefits over standard first-order methods are limited under fair compute budgets.
A new preprint introduces interleaved noise injection—alternating between noisy and clean data phases during training—instead of the standard monotonic decay schedule. This approach, combined with a gradient-norm stabilization technique, leads to improved robustness and test performance on clean, corrupted, and out-of-distribution datasets. The method outperforms common augmentations on CIFAR-100-C, ImageNet-C, and ImageNet-R benchmarks for both ResNet and ViT architectures, and is shown to be computationally efficient.
Why it matters: This technique provides a simple and computationally efficient way to enhance model robustness to distribution shifts and data corruption, with theoretical insights into its regularization effects.
Researchers introduce LyaGuide, a Lyapunov-guided framework that formulates flow guidance as a control problem, unifying classifier, reward, and energy-based guidance methods with explicit stability guarantees. The approach uses a pseudo-projection operator to enforce Lyapunov conditions and supports both model-driven and data-driven settings. Experiments on synthetic benchmarks, image inverse problems, reinforcement learning, and energy-based modeling show consistent improvements in sample quality, guidance fidelity, and robustness, with minimal computational overhead.
Why it matters: This work provides a theoretical and practical foundation for reliably guiding pretrained flow models, potentially enabling more stable and efficient adaptation of generative models to new tasks without retraining.
Researchers have established the first non-vacuous generalization bounds for parameter-efficient reinforcement learning with verifiable rewards (RLVR) fine-tuning at the billion-parameter scale. They introduce Progressive RLVR, a framework that integrates RLVR with on-policy distillation, TinyLoRA, and model quantization, retaining 84-97% of standard LoRA performance while producing models that are 14,796x more compressible. The resulting generalization bounds are within 6-11% of fine-tuned model accuracy across four domains: mathematical problem-solving, programming, general-knowledge reasoning, and Text-to-SQL.
Why it matters: This work provides the first theoretical generalization guarantees for RLVR fine-tuning at scale, bridging a critical gap between practical application and theoretical understanding in large language model training.
Researchers have introduced an active evaluation framework that models policy testing as a sequential experimental design problem. By using a probabilistic surrogate model to adaptively select test configurations, the method enables more efficient and systematic evaluation of generalist robot policies. In experiments involving 2331 real-world trials across three tasks and three factor variations, the framework reduced the number of required trials by 20-40% compared to random testing.
Why it matters: This approach addresses a major bottleneck in robotics by making real-world evaluation of generalist robot policies more sample-efficient and comprehensive.
Researchers introduce xHC (Expanded Hyper-Connections), a method that enables Transformer models to expand their residual streams beyond the previous limit of N=4. By combining temporal feature augmentation and a sparse residual-stream architecture, xHC achieves strong and consistent downstream improvements in 18B and 28B MoE models. The xHC-Flash variant further reduces memory traffic, making large-N residual-stream expansion practical for large language model pre-training.
Why it matters: This work establishes a new, practical scaling axis for large language models, enabling more efficient pre-training and consistent performance gains beyond traditional width and depth scaling.
Researchers have developed COAT (Counterfactual Optimal Action Tree), a framework that learns interpretable prescriptive policies from observational data by combining counterfactual outcome estimation with mixed-integer optimization. In a 17-week field pilot with a major global airline, COAT increased upsell revenue per booking by 6.9%, with the airline projecting $50–$150 million in incremental annual premium seat revenue. The pilot's success led to scaled adoption and influenced broader AI-driven decision initiatives within the organization.
Why it matters: COAT provides a practical, transparent approach for deriving actionable business policies from observational data, demonstrating significant real-world financial impact in the airline industry.
Researchers introduce TEDDY, a 1.84-million-parameter decoder transformer trained on 73 million ICD-10 diagnoses from 1.6 million children at a single pediatric institution. TEDDY achieved a median AUC of 72.0% across 797 disease-onset prediction tasks, outperforming several larger and commonly used baseline models. The model demonstrated strong performance even for rare diseases and could detect predictive signals more than two years before diagnosis.
Why it matters: This work shows that compact generative models can provide accurate, early risk predictions for a wide range of pediatric diseases, including rare conditions, without requiring massive datasets or very large models.
Researchers introduce RENEW, a method that leverages human preferences over imagined rollouts to address model exploitation in offline reinforcement learning. The approach, formalized as Dynamics Learning from Human Feedback (DLHF), uses human intuition to identify unrealistic model dynamics. RENEW improves the practicality of preference-based supervision by focusing finetuning on regions where the model is most uncertain, thereby enhancing sample efficiency and reducing exploitation.
Why it matters: This work presents a novel approach to mitigating model exploitation in offline RL by directly incorporating human feedback, potentially reducing reliance on costly expert demonstrations.