Source archive
Cohere builds language models and enterprise AI products for organizations working with private and business data. Its work includes retrieval, generation, multilingual AI, agents, and controlled deployment of language systems.
Cohere discusses how it ensures fair compute allocation among tenants in its LLM serving infrastructure. The blog outlines strategies to prevent resource monopolization and maintain equitable performance.
Why it matters: As LLM usage scales, fair resource allocation is critical for multi-tenant serving reliability and cost efficiency.
Cohere argues that cultural awareness is essential for AI systems to effectively serve users worldwide. The company emphasizes that integrating this awareness from the outset helps ensure technologies respect and address diverse cultural contexts.
Why it matters: Integrating cultural awareness into AI from the beginning is crucial to avoid bias and ensure respectful, effective service for diverse global populations.
Cohere has announced Command A+, described as its fastest and most powerful language model to date. The open-source model is designed for running high-performance enterprise agents with maximum efficiency.
Why it matters: Command A+ marks a notable advancement in open-source AI models for enterprise use, combining speed and power.
Cohere's blog explains how their team leverages North, Wiz, and a custom MCP server to automate incident response workflows using AI. The post offers a technical overview of building a security agent with these tools.
Why it matters: This highlights a real-world use of AI agents to enhance cybersecurity automation and incident response.
Cohere has deployed AI agents to automate the maintenance of its vLLM fork, handling tasks such as auto-rebasing, testing, and conflict resolution. This automation has reduced the time required to sync with upstream changes from weeks to days.
Why it matters: This demonstrates a practical application of AI agents to streamline software maintenance and save developer time.
Cohere has launched Transcribe Arabic, a state-of-the-art, enterprise-ready speech recognition model for Arabic speakers. The model is available as open source and is designed to capture the full diversity of spoken Arabic.
Why it matters: This release addresses the need for accurate transcription across diverse Arabic dialects, with open-source availability enabling broader enterprise and developer adoption.
Cohere has announced a new method called Dynamic Speculative Decoding (DSD) that adapts the number of speculative tokens generated during inference based on hardware constraints. This technique aims to overcome the limitations of standard speculative decoding by dynamically controlling the optimal K value, improving inference efficiency across different hardware configurations.
Why it matters: This advancement could reduce latency and computational cost for large language model inference by making speculative decoding more adaptable to varying hardware environments.
Cohere has introduced North Mini Code, its first open-source agentic coding model. The 30B MoE model is designed for sovereign developers and delivers strong software development performance with minimal hardware requirements.
Why it matters: This release provides an efficient, open-source coding model that enables developers to run agentic coding capabilities on modest hardware, promoting accessibility and sovereignty.