GolfFoxtrotLima@sh.itjust.works to Technology@lemmy.worldEnglish · 22 hours agoNobody Will Say Why Every Major AI Chatbot Suddenly Went Down Yesterdayfuturism.comexternal-linkmessage-square107linkfedilinkarrow-up1504arrow-down110
arrow-up1494arrow-down1external-linkNobody Will Say Why Every Major AI Chatbot Suddenly Went Down Yesterdayfuturism.comGolfFoxtrotLima@sh.itjust.works to Technology@lemmy.worldEnglish · 22 hours agomessage-square107linkfedilink
minus-squareDamage@feddit.itlinkfedilinkEnglisharrow-up2·8 hours ago it has to share VRAM with the DE. Maybe I’ll set it up for remote development from my laptop instead to free up VRAM. eh, just systemctl isolate multi-user.target
minus-squaresetVeryLoud(true);@lemmy.calinkfedilinkEnglisharrow-up1·8 hours agoCorrect, that’s how I would do it, but then I need another machine to act as a head.
minus-squareDamage@feddit.itlinkfedilinkEnglisharrow-up3·7 hours agoIf your MB has onboard graphics, maybe you could mask the GPU and just pass it off to a container running the LLMs I guess
minus-squaresetVeryLoud(true);@lemmy.calinkfedilinkEnglisharrow-up1·40 minutes agoNo onboard graphics unfortunately, that would have been the easy way out.
minus-squareDamage@feddit.itlinkfedilinkEnglisharrow-up1·9 minutes agoWell it works anyway even with a bit of occupied vram, but you could also buy a cheap videocard to use as an output. I have small intel card like that in my server for jellyfin transcoding, I think I paid 60€ for it, it hardly uses any power
eh, just
systemctl isolate multi-user.targetCorrect, that’s how I would do it, but then I need another machine to act as a head.
If your MB has onboard graphics, maybe you could mask the GPU and just pass it off to a container running the LLMs I guess
No onboard graphics unfortunately, that would have been the easy way out.
Well it works anyway even with a bit of occupied vram, but you could also buy a cheap videocard to use as an output. I have small intel card like that in my server for jellyfin transcoding, I think I paid 60€ for it, it hardly uses any power