RT @Yampeleg: Speculative decoding
The trick that allows ChatGPT to generate text so fast.
TL;DR:
1. Generate some of steps with a small…
Source date (UTC): 2023-09-11 18:03:19 UTC
Original post: https://twitter.com/i/web/status/1701295369907245312
RT @Yampeleg: Speculative decoding
The trick that allows ChatGPT to generate text so fast.
TL;DR:
1. Generate some of steps with a small…
Source date (UTC): 2023-09-11 18:03:19 UTC
Original post: https://twitter.com/i/web/status/1701295369907245312
Leave a Reply