> So the whole question makes no sense as there's no real choice.

Of course there is a choice, it's even provided to the LLM directly