721
Generative AI Is an Engineering Disaster. A shockingly inefficient trillion-dollar project.
(www.theatlantic.com)
This is a most excellent place for technology news and articles.
Yeah, by creating a bunch of .md files of questionable quality that get fed into an already-limited context window, on top of a pile of all sorts of other context cruft from the harness, the model provider, and whatever else is propping up the system to give the illusion of intelligence...
I've experimented with harnesses quite a bit and I don't understand the hype. The difference in quality has been middling in my experience, but the token burn has been significantly more โ which makes sense when you understand that the more of the context window you use, the worse most models perform.