Replying to a post on startrek.website
An LLM used for language purposes is the best application. It's using that hammer to drive a nail. When they deviate from that role to other things, that's when the effectiveness drops. When Co-pilot was pushed into our enterprise system incorporated into Outlook we played around with seeing what it could do with summarizing emails we would routinely send and get. It made them pretty, I give it that. But it didn't handle the information well and was very inaccurate at time when it was missing data. The whole hallucination thing. So just verify what it produces for you before you hit send.