this post was submitted on 23 Dec 2025
821 points (97.6% liked)
Technology
77925 readers
2814 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
It can't even copy and paste a Hello World example properly. If someone says it's working well for them, I'm going to now assume they are too ignorant to understand what's broken.
It works well for recalling something you already know, whether it be computer or human language. What's a word for... what's a command/function that does...
For words, it's pretty good. For code, it often invents a reasonable-sounding function or model name that doesn't exist.
It's not even good for words. AI just writes the same stories over and over and over and over and over and over. It's the same problem as coding. It can't think of anything novel. Hell it can't even think. I'd argue the best and only real use for an llm is to help be a rough draft editor and correct punctuation and grammar. We've gone way way way too far with the scope of what it's actually capable of
@Xenny @frongt it's definitely not good for words with any technical meaning, because it creates references to journal articles and legal precedents that sound plausible but don't exist.
Ultimately it's a *very* expensive replacement for the lorem ipsum generator keyboard shortcut.
According to OpenAis internal test suite and system card, hallucination rate is about 50% and the newer the model the worse it gets.
And that fact remains unchanged on other LLM models.
I use it for things that are simple and monotonous to write. This way I’m able to deliver results to tasks I couldn’t have been arsed to do. I’m a data analyst and mostly use mysql and power query
It works well when you use it for small (or repetitive) and explicit tasks. That you can easily check.
What’s your preferred Hello world language? I’m gunna test this out. The more complex the code you need, the more they suck, but I’ll be amazed if it doesn’t work first try to simply print hello world.
Malbolge is a fun one
Edit: Funny enough, ChatGPT fails to get this right, even with the answer right there on Wikipedia. When I tried running ChatGPT's output the first few characters were correct but it errors with invalid char at 37
Cheeky, I love it.
Got correct code first try. Failed creating working docker first try. Second try worked.
Output: Hello World!
Why the fuck does this language exist lol
I'm actually slightly impressed it got both a working program, and a different one than Wikipedia. The Wikipedia one prints "Hello, world."
I guess there must be another program floating around the web with "Hello World!", since there's no chance the LLM figured it out on its own (it kinda requires specialized algorithms to do anything)
That'd be easy enough to test wouldn't it? Ask it to write something else like 'The hippo farts are smelly'
If it needs to understand whatever the fuck that language is to get that output, it either can or can't?
I’d never even heard of that language, so it was fun to play with.
Definitely agree that the LLM didn’t actually figure anything out, but at least it’s not completely useless