this post was submitted on 17 Oct 2026
193 points (92.9% liked)

Technology

89005 readers
4253 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] ofcourse@lemmy.ml 10 points 6 days ago* (last edited 6 days ago) (1 children)

I know everyone hates on Meta but they just released an open weight 800B parameter model: Muse Spark Open.

Their smaller 30B parameter open model Muse Glimmer has also been out for a few weeks and is highly competitive with Qwen 3.8 27B.

So I hope we will start seeing more open models from US labs especially in the sub-20GB category which can be deployed on daily use machines.

[–] brucethemoose@lemmy.world 2 points 4 days ago* (last edited 4 days ago)

In case anyone forgot, Meta was the pioneer of open weight models, with Llama 1 released/leaked February 2023.

They literally set the standard. Yes there was GPT-J before it, but basically everything in the open weights LLM space is derived from the Llama series, its footprint is still in newest Chinese models. The world was Meta’s oyster.

…And after one bad experiment, an experiment Zuckerberg allegedly meddled with (Llama 4), Zuck fired the whole Llama team, paid millions to a bunch of tech bros in their place, who proceeded to nothing for a good long while.


Muse Glimmer is obsolete, IMO.

Muse Spark is… not terrible? Its architecture (GQA + sliding window attention) is about a year or two out of date, but it… could be worse.


But this is just a reminder to anyone who thinks Zuck won’t find some way to feel insecure and fuck Muse up.

He will.

It is what he does. Zuck caused incalculable damage to his company, single-handedly, and he will do it again with zero repercussions.

Same with Musk. And Altman. Not to speak of Microsoft vacuuming up promising startups into a black hole. The U.S. AI industry was basically doomed from the beginning.