this post was submitted on 08 Jan 2026
1071 points (99.2% liked)

Technology

78511 readers
3884 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] ulterno@programming.dev 1 points 1 day ago (1 children)

I guess an NPU is better of being a PCIe peripheral then?
And it can then have their specialised RAM too.

[–] Electricd@lemmybefree.net 1 points 1 day ago (1 children)

Sorry, I’m not a hardware expert at all

When you’re talking about the PCIe peripheral, you’re talking about a separate dedicated graphics card or something else?

I guess the main point of NPUs are that they are tiny and built in

[–] ulterno@programming.dev 0 points 1 day ago

When you’re talking about the PCIe peripheral, you’re talking about a separate dedicated graphics card or something else?

Yes, similar to what a PCIe Graphics Card does.
A PCIe slot is the slot in a desktop motherboard that lets you fit various things like networking (ethernet, Wi-Fi and even RTC specialised stuff) cards, sound cards, graphics cards, SATA/SAS adapters, USB adapters and all other kinds of stuff.

I guess the main point of NPUs are that they are tiny and built in

GPUs are also available built-in. Some of them are even tiny.
Go 11-12 years back in time and you'll see video processing units embedded into the Motherboard, instead of in the CPU package.
Eventually some people will want more powerful NPUs with better suited RAM for neural workloads (GPUs have their own type of RAM too), not care about the NPU in the CPU package and will feel like they are uselessly paying for it. Others will not require an NPU and will feel like they are uselessly paying for it.

So, much better to have NPUs be made separately in different tiers, similar to what is done with GPUs rn.

And even external (PCIe) Graphics Cards can be thin and light instead of being a fat package. It's usually just the (i) extra I/O ports and (ii) the cooling fins+fans that make them fat.