Technology

84041 readers

2900 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related news or articles.
Be excellent to each other!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
Check for duplicates before posting, duplicates may be removed
Accounts 7 days and younger will have their posts automatically removed.

founded 2 years ago

MODERATORS

716

submitted 1 month ago by fubarx@lemmy.world to c/technology@lemmy.world

345 comments fedilink hide all child comments

Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the 'reasoning' models.

(page 5) 50 comments

sorted by: hot top controversial new old

[–] Kissaki@feddit.org 1 points 1 month ago* (last edited 1 month ago)

I watched this in a YouTube Shorts format a week ago, where they ask a few models about walking or driving to the car wash.

They have some more funny ask AI shorts.

[–] JustTesting@lemmy.hogru.ch 1 points 1 month ago (3 children)

10 tests per model seems like way too little and they should give confidence intervals…

the 10/10 vs. 8/10 is just as likely due chance than any real difference. But some people will definitely use this to justify model choice.

load more comments (3 replies)

[–] 73ms@sopuli.xyz 1 points 1 month ago

Did this say whether the reasoning models get this right more than the others? Was curious about that but missed it if it was mentioned.