silverlose

joined 9 months ago
[–] silverlose@lemm.ee 1 points 8 months ago

True. Honestly apples software is just getting worse by the day. It’s sad.

It’s a version with 12gb of vram. I use it to game though. If you want a real GPU for this, I hear the Tesla P40 is the best.

[–] silverlose@lemm.ee 8 points 8 months ago

The French know what’s up. As per usual.

[–] silverlose@lemm.ee 4 points 8 months ago (1 children)

Embezzlement? You mean Tuesday?

[–] silverlose@lemm.ee 2 points 8 months ago (1 children)

I think whats really happening behind the scenes is that the model you’re talking to makes a function call to another model that generates the image.

I haven’t seen it either so if you want that and don’t want to code it might be best to stick with paid, but something like that could easily exist somewhere else.

[–] silverlose@lemm.ee 2 points 8 months ago* (last edited 8 months ago) (2 children)

FWIW speech to text works really well on Apple stuff.

I’m not exactly sure what info you’re looking but: my gaming PC is headless and sits in a closet. I run ollama on that and I connect to it using a client called “ChatBox”. It’s got a gtx 3060 which fits the whole model, so it’s reasonably fast. I’ve tried the 32b model and it does work but slowly.

Honestly, ollama was so easy to setup, if you have any experience with computers I recommend giving it a shot. (Could be a great excuse to get a new gpu 😉)

[–] silverlose@lemm.ee 5 points 8 months ago (1 children)

Very true. I think the tank, much like the cannon, will still have its own niche use case but isn’t the silver bullet so many armies saw it as. Happens a lot I think

[–] silverlose@lemm.ee 6 points 8 months ago (7 children)

Have you heard of ollama? You can run deepseek and stuff locally super easy. I know it’s not a complete replacement, but it feels nice to use an LLM guilt free. I’ve compared the 14b distilled model from deepseek vs the paid version of ChatGPT and it made me cancel my account.

[–] silverlose@lemm.ee 3 points 8 months ago

Maybe. I don’t know what it’s like in Russia at all.

[–] silverlose@lemm.ee 20 points 8 months ago (3 children)

Why would he need a reason though? Couldn’t he just do that at any time?

view more: next ›