To me the least important part about LLM code is the ability to maintain it. I don't give a fuck about the code at my job or my job or my employer. Fuck them. They're not going to keep me employed for decades, why should I make sure to create code that can be maintained for that time when it won't be me doing it. I hope my company goes out of business.
antinutrient
wait is sucking balls good or bad
Something I like to tell people is that we've been reading AI generated news articles as far back as 2013. I used to work for a company that was a publications services company that produced content and media mostly for textbooks but we had our fingers in a lot of things. One of the big initiatives there was implementing something called Wordsmith which would take structured data like a financial reports, stock tickers, sports scores, and weather reports and turn it into a narrative article that we sold/licensed to places like yahoo news. Sometimes humans had to step in to correct some schema analysis but it mostly just worked in a pipeline and generated text automatically. Looking back and researching the company recently they were actually on the forefront of what ChatGPT got credit for in 2022 and I'm sure a lot of my work at that company went to training the current models.
LLMs are good at translating documents between languages, its statistics based approach works really well for that.