this post was submitted on 19 Jul 2026
270 points (89.0% liked)

Technology

86485 readers
3292 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
top 50 comments
sorted by: hot top controversial new old
[–] Postmortal_Pop@lemmy.world 9 points 9 hours ago (2 children)

Not an AI guy, but I do like using niche hardware wrong to get results cheap. Can anyone tell me what this would be like for gaming or general computing? My 1660 super was a budget pick when I got it back in '18.

[–] Flatfire@lemmy.ca 1 points 4 hours ago

A cursory search says somewhere between a 3060 and 4060, which seems about right. Games that parallelize well across the GPU cores will benefit, though that benefit will be niche if it exists at all. HBM2 memory is weird for gaming.

You'd see some benefit for sure, but this really is better suited to parallel computing, given the emphasis on CUDA core counts and memory bandwidth. You may also find you run into some latency, since it requires selecting the V100 as your primary GPU but a secondary card as the video output. Integrated GPUs work well for this, since your motherboard may already have this ability. Otherwise, you could use it in tandem with a 1030 or similar to get display out.

[–] tinfoilhat@lemmy.ml 2 points 5 hours ago

A lot of data center GPUs don't have display outputs or cooling. So you would need to figure out how to cool them.

[–] echodot@feddit.uk 15 points 15 hours ago

Yeah but the 0 point doing this unless you want to run AI models for some reason. These GPUs can't do video game graphics so this isn't a solution to the GPU shortage.

This is a bit like me writing an article about NASCAR, now I can turn left whenever I want. But I haven't magically acquired a functional vehicle for a fraction of its value. I've purchased a second hand specialist product that is usually useless outside of that environment.

[–] Malyca@lemmy.zip 20 points 1 day ago (3 children)

You're in the wrong community if you're asking questions like that.

[–] vaultdweller013@sh.itjust.works 11 points 22 hours ago (1 children)

Ever watched bringus studios? Man played games on a drive through computer. As the old saying goes all hardware is good hardware if you know what to do.

[–] A_Random_Idiot@lemmy.world 3 points 21 hours ago

I cant get past the new hair cut. He looks like a bond villains lacky now lol

[–] palordrolap@fedia.io 57 points 1 day ago (3 children)

Here I was expecting a graphics demo to blow our collective minds but instead I got a story about a local LLM for cheap. It is . I should have known better.

Were I the author / tech cobbler here, I'd be concerned that too much time with an LLM, local or otherwise, might erode or dull my apparently fairly sharp reasoning and tech skills. (Clarification: Not my sharpness, theirs. I'm a potato.)

Other thoughts: For a minute I thought this whole thing was a tribute to, or a troll in the manner of, that one Redditor that always spun their stories around to being about their dad beating them with jumper cables.

Also, my old PC developed an issue like the warm reboot problem, except with the network interface. I couldn't just restart, I had to power off and back on. I never did bother to find out whether it was early signs of hardware failure or whether it was an old hardware / newer kernel mismatch.

[–] axmo@lemmy.ca 1 points 5 hours ago

RogerSimon10! (The jumper cables guy)

Unless maybe he was the similar but later hell-in-a-cell guy? I don’t remember anymore.

[–] Evotech@lemmy.world 5 points 12 hours ago (1 children)
[–] palordrolap@fedia.io 7 points 11 hours ago

The change of the meaning of the G in GPU from "graphics" to "general" is even less well documented and used than the "V" of DVD changing from "video" to "versatile".

Indeed it only occurred to me what it must have changed to and to go looking to confirm after seeing your comment.

And frankly they ought to have changed the name to something like "MPPU" if they wanted it to stick (massively parallel).

[–] Artisian@lemmy.world 7 points 20 hours ago

Back in my day, we memorized logarithm tables and we liked it!

[–] mierdabird@lemmy.dbzer0.com 87 points 1 day ago* (last edited 1 day ago) (2 children)

The article talks a lot trash about AMD and ROCm but vulkan works fine too. In fact from a datacenter GPU standpoint there is an AMD option called the V620 available on US EBay that I was able to haggle to $350, with 32GB VRAM, 512GB/s bandwidth, and runs the same Qwen-3.6-27b at about 20t/s. I would argue that's even more cost effective.
It requires a few of the same fan shenanigans this guy did but there is no need to pull specific past software versions to make it usable in Linux

[–] JohnWorks@sh.itjust.works 7 points 20 hours ago (1 children)

Honestly even for the prices of around 500$ that I'm seeing it for it looks like a pretty good value to get 32gb of vram. I see it says 300w on AMD's product page for it does it have any way of power limiting the card to get more efficiency/less heat?

[–] mierdabird@lemmy.dbzer0.com 8 points 16 hours ago* (last edited 13 hours ago)

I spent a lot of time researching and testing different methods for that, the only thing that worked was LACT in Linux. Using that I was able to undervolt 100mV and GPU power usage dropped about 10%. On my B450 ITX board with a Ryzen 2400GE CPU the entire system pulls 30w idle from the wall, and about 300w inferencing with VRAM filled. (330w before LACT).
My fan solution ended up being to buy the 80mm 3d-printed shroud off ebay, the fan that came with it was super loud so I switched to an arctic p8 Max, and control it with the motherboard targeting a t-sensor header with the probe attached to the backplate.

load more comments (1 replies)
[–] frongt@lemmy.zip 20 points 1 day ago (2 children)

Sure it's got a lot of VRAM, but the 4080 has five times the compute power.

[–] plz1@sh.itjust.works 13 points 1 day ago (3 children)

You're not getting a 4080 for $200 though...

load more comments (3 replies)
[–] LodeMike@lemmy.today 14 points 1 day ago

That's fine I just need to display pictures of your mom (they are very large) (/s)

[–] pech@lemmy.world 21 points 1 day ago (3 children)

eBay has some rad Chinese mezzanine boards for these guys too. Nvlink works and everything lol 3566 file-QvfRnBhkoKQBxmqtmrGBLV

[–] Septimaeus@infosec.pub 6 points 23 hours ago (1 children)

Cool mezzanine boards, but can we talk about your dope af custom jig for offset mounting arbitrary boards?

[–] pech@lemmy.world 4 points 9 hours ago (1 children)

I appreciate the kind words! Until recently, my day job was CAD monkey. I wanted to consolidate the hardware I was cobbling together, found a cheap 8 GPU mining rig and some extra 2020 extrusions to play with.

The seller for the mezzanine said it followed the mATX mounting hole pattern, (it does but is ~75% in the width and doesn't use all the points). I have a tendency to overthink designs and kind of stalled for a bit before finally taking the plunge and whipping up these struts. I used some brass heat set inserts to accept the standoffs and everything pretty much went right together lol

3523

[–] Septimaeus@infosec.pub 4 points 9 hours ago

Damn, even cooler than I expected 🎸 Thank you for the extra details and picture!

load more comments (2 replies)
[–] melfie@lemmy.zip 24 points 1 day ago (4 children)

Seems like an awful lot of trouble to save $100 not buying a 5060 Ti that also has 16GB.

[–] Hubi@feddit.org 2 points 8 hours ago

The 5060 Ti does not support Nvlink though.

[–] ranzispa@mander.xyz 23 points 1 day ago (1 children)

448 GB/s memory vs 900 GB/s and at a cheaper price.

load more comments (1 replies)
load more comments (2 replies)
load more comments
view more: next ›