Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

What would the energy use be for an average query be, when using large models at this speed?


I’ve asked that question on linked in to the Cerebras team a couple times and haven’t ever received a response. There is system max tdp values posted online but I’m not sure you can assume the system is running in max tdp for these queries. If it is the numbers are quite high (I just tried to find the number but couldn’t find it but I had it in my notes as 23kw).

If someone from Cerebras is reading this feel free to dm me as optimizing this power is what we do.


23kw gotdamn




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: