SocialistVibes01@lemmy.ml to Linux@lemmy.mlEnglish · 2 days agoWhich specs are as low as reasonable possible for local LLM models? Do you recommend some distro in particular?message-squaremessage-square14linkfedilinkarrow-up132arrow-down112file-text
arrow-up120arrow-down1message-squareWhich specs are as low as reasonable possible for local LLM models? Do you recommend some distro in particular?SocialistVibes01@lemmy.ml to Linux@lemmy.mlEnglish · 2 days agomessage-square14linkfedilinkfile-text
minus-squaremeowmeow@quokk.aulinkfedilinkEnglisharrow-up2arrow-down1·2 days agoYes, but when you compare it to codex and Claude though, it’s significantly slower. Especially over time. Better crank that AC. I think in a few years we will have current cloud levels running pretty efficiently on current computers.
Yes, but when you compare it to codex and Claude though, it’s significantly slower. Especially over time. Better crank that AC.
I think in a few years we will have current cloud levels running pretty efficiently on current computers.