Yes, that's it. I added the link in the OP,
lgsp
joined 2 years ago
Very arrogant answer. Good that you have intuition, but the article is serious, especially given how LLMs are used today. The link to it is in the OP now, but I guess you already know everything...
Thank you. I found the article, linkin the OP
Oh wow thank you! That's it!
I didn't even remember now good this article was and how many experiments it collected
I'm aware of this and agree but:
-
I see that asking how an LLM got to their answers as a "proof" of sound reasoning has become common
-
this new trend of "reasoning" models, where an internal conversation is shown in all its steps, seems to be based on this assumption of trustable train of thoughts. And given the simple experiment I mentioned, it is extremely dangerous and misleading
-
take a look at this video: https://youtube.com/watch?v=Xx4Tpsk_fnM : everything is based on observing and directing this internal reasoning, and these guys are computer scientists. How can they trust this?
So having a good written article at hand is a good idea imho
What are your interests?
Anyway you could try following this community: https://lemmy.world/c/peertube
TL:DR -> https://thelemmy.club/comment/19143233
Examples:
-
The year doesn't start at the shortest day (Persian calendar is better in that regard).
-
month length is not evenly distributed. Why is February shorter?
-
time is almost never power of 10: there is 12, 60, 24
-
time zones are used to follow alliances: see al the nations that went to CET after fall of URSS
-
you can easily estimate your local time by looking at the sun
-
Holidays tend to happen on the same approximate dates even when major cultural changes happen. See how Christianity took over a lot of things from Romans.
High voltage contact shirt. You touch me, you fry
I think I'm on the right side of history
Do you?
I had lobbyists from car companies threaten me in my own office.
Ok thos is the proof. If oil and car lobbyist are angry at you then you definitely are on the right path!
Even if LLM "neurons" and their interconnections are modeled to the biological ones, LLMs aren't modeled on human brain, where a lot is not understood.
The first thing is that how the neurons are organized is completely different. Think about the cortex and the transformer.
Second is the learning process. Nowhere close.
The fact explained in the article about how we do math, through logical steps while LLMs use resemblance is a small but meaningful example. And it also shows that you can see how LLMs work, it's just very difficult