Versus just packing all their needs and data into context, and RAG (i.e. context)?

Why isn’t this happening more already?

It takes way more resources to train the model then to use it.

I honestly doubt this; very few companies have enough data. Maybe we could see mergers so it happens but basically it would mean everyone would need to be Google sized for it to work.