Mistral AI has been quietly building one of the more practical coding agent ecosystems in the open-source/weights AI space, and […]
Category: Large Language Model
A New NVIDIA Research Shows Speculative Decoding in NeMo RL Achieves 1.8× Rollout Generation Speedup at 8B and Projects 2.5× End-to-End Speedup at 235B
If you have been running reinforcement learning (RL) post-training on a language model for math reasoning, code generation, or any […]
Moonshot AI Open-Sources FlashKDA: CUTLASS Kernels for Kimi Delta Attention with Variable-Length Batching and H20 Benchmarks
The team behind Kimi.ai (Moonshot AI) just made a significant contribution to the open-source AI infrastructure space. The research team […]
Microsoft Research’s World-R1 Uses Flow-GRPO and 3D-Aware Rewards to Inject Geometric Consistency Into Wan 2.1 Without Architectural Changes
Video foundation models can paint a beautiful frame. They are still notoriously bad at remembering it. Push the camera through […]
Top 10 KV Cache Compression Techniques for LLM Inference: Reducing Memory Overhead Across Eviction, Quantization, and Low-Rank Methods
As large language models scale to longer context windows and serve more concurrent users, the key-value (KV) cache has emerged […]
Qwen Team Releases FlashQLA: a High-Performance Linear Attention Kernel Library That Achieves Up to 3× Speedup on NVIDIA Hopper GPUs
The race to make large language models faster and cheaper to run has largely been fought at two levels: the […]
How to Build Traceable and Evaluated LLM Workflows Using Promptflow, Prompty, and OpenAI
In this tutorial, we build a complete, production-style LLM workflow using Promptflow within a Colab environment. We begin by setting […]
Meet Talkie-1930: A 13B Open-Weight LLM Trained on Pre-1931 English Text for Historical Reasoning and Generalization Research
What if a language model had never heard of the internet, smartphones, or even World War II? That’s not a […]
Build a Reinforcement Learning Powered Agent that Learns to Retrieve Relevant Long-Term Memories for Accurate LLM Question Answering
In this tutorial, we build a Reinforcement Learning–driven agent that learns how to retrieve relevant memories from a long-term memory […]
Meta AI Releases Sapiens2: A High-Resolution Human-Centric Vision Model for Pose, Segmentation, Normals, Pointmap, and Albedo
If you’ve ever watched a motion capture system struggle with a person’s fingers, or seen a segmentation model fail to […]