The coder model has only that one. The ones bigger than that are like 20GB+, and my GPU has 16GB. I've only tried two models, but it looked like the size balloons after that, so that may be the biggest models that I can run.
RagingHungryPanda
joined 2 years ago
I got it working with my 6800XT. I'm running deep seek r1 14b (somewhere around there) and the deep seek coder V2. I have a link to a blog with those instructions
https://gotosocial.michaeldileo.org/@mdileo/statuses/01JQA4M4Q33PMCADH9M2AWQSS8
oh, I thought that was a mastodon thing or something. Thank you for the clarification :)
I have dynamic dns through cloudflare that provides a proxy ip address for me in addition to some protections.
After that I use a reverse proxy to route specific domain names to services. My router is set up to forward only ports 80 and 443 to that reverse proxy, so there's a good layer of safety there. There could be a weakness on the router, but at this point traffic is pretty limited.
After that, at least for your service, if you can have some control or throttling of signings and be more selective about who you let in, then that could help.
I say do it. Sure there's risk someone could put something on there you don't want, but I wouldn't say it's big enough to not do it.
Did you ever find a solution? I'm having the same problem. I ensured that my user has wildcard permissions for the host, so it's granted ALL on 'friendica'@'%'.
To add on, you can comment in a "binary search" method. Comment out one half of them, if it's still there, half again, etc and keep going down until you find it.
I'm on mobile and can't make out any of it, but good luck!
Writefreely is super light weight and minimalist in its design. It also federates with mastodon.
To add on, your budget here really matters. Ideally, you can have an external NAS or drive enclosure that is managed by the laptop. If you want easy backups, a cloud storage provider can help. I do nightly backups to idrive.
What was your input? I'm really curious now
Thank you! This took so long to figure out
view more: next ›
I haven't tried those, so not really, but with open web UI, you can download and run anything, just make sure it fits in your vram so it doesn't run on the CPU. The deep seek one is decent. I find that i like chatgpt 4-o better, but it's still good.