Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

That sounds like something is off - I'm using UD-Q4_K_XL on pi with xhigh thinking, and unless I'm vastly underestimating the complexity of the script that's the kind of task I would expect to take a couple of minutes (getting ~30t/s decode). What server are you running, and are you using the recommended parameters from qwen/unsloth?


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: