Google Cloud has announced Agent Compute Engine, a compute service built specifically for AI agents. Google Agent Compute Engine gives […]
Category: Staff
You.com Launches Inference Router: 12 Open-Weight Models With 99.9% Uptime SLA
You.com has launched Inference Router, a managed API for running open-weight models in production. The You.com Inference Router is an […]
Liquid AI Launches RIPL, a Real-Time Inference Engine for Sub-50 ms LFMs
Liquid AI just announced Liquid RIPL, short for Real-time Inference Pipeline. RIPL is a low-latency engine that serves Liquid Foundation […]
Gradium Open-Sources Phonon, a 31M-Parameter On-Device TTS Model Under Apache 2.0
Gradium has open-sourced Phonon, a family of small text-to-speech models built to run on the device. The Gradium Phonon on-device […]
Cohere Releases Rerank 5 With Passage-Level Context Focus and Calibrated Scores
Cohere AI has released Rerank 5, a new reranker family in Pro and Fast tiers. Cohere Rerank 5 is a […]
A Developer’s Guide to OmniParseBench: Leaderboard Benchmarks and OCR Testing
In this tutorial, we implement OmniParseBench, Datalab’s open benchmark for document parsers, which grades a parser’s output with 16,288 small […]
IBM AI Releases Granite Speech 5.0 2B for Multilingual Transcription and Translation
IBM has released Granite Speech 5.0 2B, a new open speech-language model for transcription and translation. Granite Speech 5.0 2B […]
Perplexity and NVIDIA Researchers Introduce JOLT: a Joint Teacher-Student Reinforcement Learning Method
Perplexity, along with NVIDIA team, has introduced JOLT, a new post-training method for language models. JOLT stands for Joint On-policy […]
A Coding Guide to Cactus Whistle: Does a 16.9 MB Speech Model Hold Up Against Whisper Base? Word Error Rate, Speed, Streaming, Timestamps, Keywords, and Speech-to-Tool Calls on a CPU
In this tutorial, we use Whistle, Cactus Compute’s speech-to-text model, a 16.9 MB file that runs on a CPU, transcribes […]
NVIDIA Nsight Python Tutorial: How to Profile GPU Kernels
In this tutorial, we implement on Nsight Python, NVIDIA’s open-source Python interface to its kernel profilers. Instead of running a […]