Salesforce AI Research Introduces Reward-Guided Speculative Decoding (RSD): A Novel Framework that Improves the Efficiency of Inference in Large Language Models (LLMs) Up To 4.4× Fewer FLOPs

In recent years, the rapid scaling of large language models (LLMs) has led to extraordinary improvements in natural language understanding […]