this post was submitted on 21 May 2025
300 points (96.6% liked)

Technology

70995 readers
3303 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Absolutely needed: to get high efficiency for this beast ... as it gets better, we'll become too dependent.

"all of this growth is for a new technology that’s still finding its footing, and in many applications—education, medical advice, legal analysis—might be the wrong tool for the job,,,"

you are viewing a single comment's thread
view the rest of the comments
[–] msage@programming.dev 4 points 2 weeks ago (2 children)

Which chatbots are getting smarter?

I know AI has potential, but specifically LLMs (which most people mean when talking about AI) seem to have hit their technological limits.

[–] FreedomAdvocate 2 points 2 weeks ago (1 children)

Copilot, ChatGPT, pretty much all of them.

[–] msage@programming.dev 1 points 2 weeks ago (1 children)

Smarter how? Synthetic benchmarks?

Because I've heard the opposite from users and bloggers.

[–] FreedomAdvocate 1 points 2 weeks ago (1 children)

So you want me to provide some evidence that it's getting smarter, but you can't provide any that it's getting worse other than anecdotal evidence?

What evidence would you accept?

[–] msage@programming.dev 1 points 2 weeks ago (1 children)

Any proof that we have moved past the current architecture.

[–] FreedomAdvocate 0 points 2 weeks ago (1 children)

What does "architecture" mean in this scenario?

[–] msage@programming.dev 1 points 2 weeks ago (1 children)

Any significant shift in the model, or a complete restructuralization of the approach.

As it is, it won't grow anywhere.

[–] FreedomAdvocate 0 points 2 weeks ago* (last edited 2 weeks ago) (1 children)

So you’ve got access to all this stuffs source code and know what has and hasn’t changed with every update?

[–] msage@programming.dev 1 points 2 weeks ago (1 children)

No, if there was any major breakthrough, it would be advertised everywhere.

[–] FreedomAdvocate 1 points 2 weeks ago (2 children)

They’re constantly advertising updates to these chat bots in what they can do.

[–] msage@programming.dev 0 points 2 weeks ago

Small incremental updates on little tasks mean nothing, the underlying issues are still the same.

It has no intelligence, and as such carries big risks.

[–] msage@programming.dev 0 points 2 weeks ago (1 children)

No, they are spreading lies about shit that doesn't matter as to not lose the hype.

If anyone made any significant advance, they would be all over the world.

[–] FreedomAdvocate 1 points 2 weeks ago (1 children)

You’re not backing this up with anything. Those of us who use them know they’ve been making big updates regularly.

[–] msage@programming.dev 1 points 2 weeks ago (1 children)

You're not backing anything up either, just 'my experience'.

[–] FreedomAdvocate 1 points 2 weeks ago

Do you want me to just link to Microsoft and OpenAI’s pages about their AI chatbots updates?

[–] Jakeroxs@sh.itjust.works 2 points 2 weeks ago (1 children)

Advanced Reasoning models came out like 4 months ago lol

[–] msage@programming.dev 4 points 2 weeks ago (2 children)

Advanced reasoning? Having LLM talk to itself?

[–] theterrasque@infosec.pub 2 points 2 weeks ago

Yes, which has improved some tasks measurably. ~20% improvement on programming tasks, as a practical example. It has also improved tool use and agentic tasks, allowing the llm to plan ahead and adjust it's initial approach based on later parts.

Having the llm talk through the tasks allows it to improve or fix bad decisions taken early based on new realizations on later stages. Sort of like when a human thinks through how to do something.

[–] Jakeroxs@sh.itjust.works -1 points 2 weeks ago* (last edited 2 weeks ago) (1 children)

Lul yes but no, but they are clearly better at many types of tasks.

[–] technocrit@lemmy.dbzer0.com -1 points 2 weeks ago* (last edited 2 weeks ago) (2 children)

For example? Citations?

Pretty sure these "tasks" are meaningless metrics made up by pseudo-scientific grifters.

[–] Jakeroxs@sh.itjust.works 3 points 2 weeks ago

Small bits of code, language related tasks, basic context understanding, not metrics I have literally measured simply noticed has improved compared to non reasoning models in my homelab testing. 🤷‍♂️

[–] IsaamoonKHGDT_6143@lemmy.zip 2 points 2 weeks ago

AlphaFold 3 which can help in the prediction of some proteins. Although it has some limitations, it cannot be used in all cases, only in what it can perform without any problem.