New tools, platforms, coding assistants, APIs, and workflows that help developers build with artificial intelligence.
Stability.ai has released Stable Diffusion 3.5, a new generation of image generation models designed for improved speed and quality. The update offers enhancements over previous versions and is available to run on RunPod.
Why it matters: Stable Diffusion 3.5 advances open image generation with better speed and quality, supporting creative AI applications.
GPT-5.6 Sol features five reasoning levels from 'Light' to 'xhigh,' as well as 'Max' and 'Ultra' modes that deploy multiple sub-agents in parallel. OpenAI's Vaibhav Srivastav recommends starting with lower reasoning levels and scaling up only when necessary.
Why it matters: This guidance helps users optimize cost and performance by matching reasoning effort to task complexity.
Falcon-180B, the largest open-source LLM to date, requires 400GB of VRAM to run unquantized. RunPod explains how to deploy it using A100 GPUs.
Why it matters: This provides a practical guide for deploying a massive open-source model, highlighting the hardware demands and accessibility via cloud GPU services.
Together AI published real-world inference benchmarks for coding agents, reporting 31% higher throughput than TensorRT-LLM, 2× better time-to-first-token at saturation, and 76% lower cost than Claude Opus 4.6. The benchmarks focus on scaling inference for agentic coding workloads.
Why it matters: This demonstrates significant performance and cost improvements for deploying coding agents at scale, which could accelerate adoption of AI-assisted development.
Together AI has made NVIDIA Nemotron 3 Super and Nemotron 3 Nano Omni available on its platform. Nemotron 3 Super offers efficient multi-agent reasoning and a 1M-token context window, while Nemotron 3 Nano Omni is a single open model that can process video, images, audio, and text for agentic workloads at scale.
Why it matters: These launches provide developers with production-grade, multimodal AI models optimized for agentic reasoning and scalable deployment.
RunPod has introduced a vLLM worker on its serverless GPU platform, allowing users to deploy Meta's Llama 3.1 efficiently. The company offers step-by-step guides for model setup and emphasizes performance benefits. This update enables users to run large language models without managing complex infrastructure.
Why it matters: It lowers the barrier for developers to deploy advanced LLMs like Llama 3.1 with optimized inference on serverless GPUs.
Together AI has announced an integration with Goose that allows users to deploy any Hugging Face model in a single session using Dedicated Container Inference. This approach removes setup complexity, enabling models to run in a production-grade GPU environment immediately upon release.
Why it matters: This integration streamlines AI model deployment, making it more accessible to developers without requiring infrastructure expertise.
RunPod has launched a redesigned website and refreshed its brand identity, aiming to provide a clearer and faster user experience. The platform continues to focus on powering real-time inference, custom LLMs, and other AI workloads.
Why it matters: The redesign highlights RunPod's ongoing commitment to supporting AI inference and model deployment for developers.
RunPod has introduced updates to its serverless platform, with a focus on supporting faster and more scalable deployments for large language model (LLM) workloads. The 2025 update is designed to improve efficiency and scalability for users deploying LLMs. More information is available on the RunPod blog.
Why it matters: These updates are important for developers and enterprises seeking efficient, scalable serverless infrastructure for LLM deployments.
Together AI has launched DeepSeek-V4 Pro, featuring a 512K context length and controllable reasoning modes. The model offers cached-input pricing for long-context workloads such as code agents, document intelligence, and research synthesis.
Why it matters: This release provides developers with a powerful, cost-efficient model for complex reasoning tasks requiring extended context.
RunPod published a guide on transitioning from Pods to Serverless for model inference after training. The guide discusses the trade-offs involved and offers advice on optimizing for fast deployment. It aims to help users determine the right time to switch deployment strategies.
Why it matters: This guide helps AI developers make informed decisions to optimize inference costs and performance.
Together AI published a blog post detailing how it serves MiniMax-M3 efficiently, enabling 1M-token context and multimodality. The optimizations include KV-block-major sparse attention, paged MSA decode, optimized index scoring, and a Rust-based multimodal gateway.
Why it matters: This demonstrates practical techniques for deploying large multimodal models with long context windows, which is critical for enterprise applications requiring processing of extensive documents and multiple data types.
RunPod's blog introduces SGLang, a framework for structured LLM workflows designed to boost inference performance and enable response customization. The post explains how SGLang can be used to enhance LLMs, targeting developers interested in optimizing their models.
Why it matters: SGLang provides a new approach to improving LLM inference efficiency and customization, which is important for deploying responsive AI applications.
Together AI published a blog post detailing the inference systems work required to serve DeepSeek-V4, which supports million-token context. The post covers compressed KV layouts, prefix caching, kernel maturity, and endpoint profiles for long-context workloads on NVIDIA HGX B200 hardware.
Why it matters: This highlights the growing importance of inference infrastructure as models scale to million-token contexts, a key challenge for enterprise AI deployment.
Google has announced an expansion of managed agents in the Gemini API, introducing support for background tasks and remote MCP. These enhancements are part of a new feature bundle launch aimed at developers.
Why it matters: This update gives developers enhanced agent capabilities within the Gemini API.
RunPod published a performance comparison of AMD's MI300X and Nvidia's H100 SXM GPUs using Mistral's Mixtral 8x7B model. The benchmarks highlight trade-offs in inference speed and cost efficiency between the two accelerators.
Why it matters: This comparison provides developers and enterprises with data to choose between AMD and Nvidia GPUs for large language model inference, potentially impacting deployment costs and performance.
Kandinsky 2.1, an AI art generator that combines CLIP and diffusion models, is now available on RunPod via API. It can generate high-resolution artwork up to 1024×1024 pixels.
Why it matters: This release gives developers and creators access to a new tool for generating high-quality AI art through an API.
Together AI compared Kimi K2.7 Code and Claude Fable 5 by generating 12 landing pages. Kimi K2.7 Code cost 94% less and achieved scores within a few points of Claude Fable 5 on every page. The blog discusses the factors that influenced these results.
Why it matters: This comparison demonstrates a substantial cost advantage for Kimi K2.7 Code while maintaining similar quality, which could impact developer tool selection.
RunPod now offers a one-click template to deploy Invoke AI's Stable Diffusion tools, including the infinite canvas feature. The setup requires minimal configuration, making it easier for users to access advanced image generation capabilities.
Why it matters: This simplifies access to advanced AI image generation tools by reducing deployment complexity.
A new blog post on RunPod discusses how to train StyleGAN3, a generative adversarial network known for high-resolution image generation without aliasing artifacts, using Vision-Aided GAN techniques. The post details the process and benefits of running such training on RunPod's cloud infrastructure.
Why it matters: This highlights practical approaches for developers to train advanced GAN models using cloud resources.