Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Prompt processing time on Apple Silicon might benefit from making use of the NPU/Apple Neural Engine. (Note, the NPU is bad if you're limited by memory bandwidth, but prompt processing is compute limited.) Just needs someone to do the work.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: