

Julien Delavande , an engineer at AI research firm Hugging Face , has developed a tool that shows in real time the power consumption of the chatbot generating
gnnnnnngh
this shit pisses me off so bad
there’s actually quantifiable shit you can use across vendors[0]. there’s even some software[1] you can just slap in place and get some good free easy numbers with! these things are real! and are usable!
“measure the power consumption of the chatbot generating”
I’m sorry you fucking what? just how exactly are you getting wattage out of openai? are you lovingly coaxing the model to lie to you about total flops spent?
[0] - intel’s def been better on this for a while but leaving that aside for now…
[1] - it’s very open source! (when I last looked there was no continual in-process sampling so you got hella at-observation sampling problems; but, y’know, can be dealt with)
Didn’t know it had come out but I was wondering if they’d manage to continue s2 like s1
Also worried for the next season of the boys…