For sure, AIs/llms can be dangerous if you don't also apply critical thinking, but that's been true of the internet forever, and even before. The Anarchist cookbook has recipes that will, at best, waste a bunch of soap and gasoline or have you scraping banana peels with a razorblade, or at worst, have you making chlorine gas in your basement. 4chan had a popular recipe for "peanut butter cookies" that would result in an oven fire, and instructions to drill a hole in your iPhone to use the headphone jack.
It's much more important to protect and promote critical thinking skills than it is to try to shield everybody from misinformation and hallucinations.
But it wasn't life threatening. And still much faster than looking for the technical manual. And took me all of 30 seconds to realise it had misunderstood the photo I sent it.