Benchmarking Speculative Decoding on DGX Spark: 11.5 → 29.5 tok/s

 (alephinitesimal.com)

2 points | by Alephinitesimal  7 hours ago

No comments yet.