Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I'm pretty sure those numbers are for training, not inference. I've run it on _CPU_ and gotten ~1 token per second.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: