Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The whole point of this architecture is that it can also make use of multi-char patterns, but unlike BPE, they aren't hard-coded. And you can still use speculative decoding. Whether it works better or worse is something that you have to actually measure.
 help



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: