Research Salesforce AI Research introduces reward-inducing speculative decoding (RSD): a new framework that improves the efficiency of inference in large-scale language models (LLMS) to up to 4.4 times less flopsFebruary 14, 2025 In recent years, rapid scaling of large-scale language models (LLMS) has resulted in extraordinary improvements in natural language understanding and…
