Phoenix3875@lemmy.world to Programmer Humor@programming.dev · 3 months agoWork of pure human soul (and pure human sweat, and pure human tears)lemmy.worldimagemessage-square54fedilinkarrow-up1404
arrow-up1404imageWork of pure human soul (and pure human sweat, and pure human tears)lemmy.worldPhoenix3875@lemmy.world to Programmer Humor@programming.dev · 3 months agomessage-square54fedilink
minus-squareBaroqueInMind@lemmy.onelinkfedilinkarrow-up3·3 months agoYou don’t even need a GPU, i can run Ollama Open-WebUI on my CPU with an 8B model fast af
minus-squarebi_tux@lemmy.worldlinkfedilinkarrow-up2·3 months agoI tried it with my cpu (with llama 3.0 7B), but unfortunately it ran really slow (I got a ryzen 5700x)
minus-squaretomjuggler@lemmy.worldlinkfedilinkarrow-up2·3 months agoI ran it on my dual core celeron and… just kidding try the mini llama 1B. I’m in the same boat with Ryzen 5000 something cpu
You don’t even need a GPU, i can run Ollama Open-WebUI on my CPU with an 8B model fast af
I tried it with my cpu (with llama 3.0 7B), but unfortunately it ran really slow (I got a ryzen 5700x)
I ran it on my dual core celeron and… just kidding try the mini llama 1B. I’m in the same boat with Ryzen 5000 something cpu