The reason why LLMs are truly revolutionary is that they suddenly allow to connect and interface systems that used to require a human in the loop because of their ambiguous interfaces.
LLMs can (and will) do a lot more than providing chatbot-like interfaces. Instead, they will power agents that can manipulate a variety of tools and interface with extremely diverse systems, including end users, SMEs, etc.
You're right that LLMs can do this. Well, I guess you might be wrong about that too, but it doesn't matter. That's not the problem. Companies have very large callcenters with actual humans that can do this ... but they don't. They're not allowed to. The only thing callcenters are these days are a semi-human interface to a bad website. LLMs won't be anything more.
LLMs can (and will) do a lot more than providing chatbot-like interfaces. Instead, they will power agents that can manipulate a variety of tools and interface with extremely diverse systems, including end users, SMEs, etc.