Exactly. In my opinion, one of the worst things a designer can do is have an attitude of "My change is better, deal with it". It presumes that everyone who uses their product will have a use case similar to them, and the people that don't are screwed. When the change made is actually good, designers will get praised for a "bold new vision" and such. When it goes wrong, it pisses off a lot of people, often to the point where they'll switch to a competitor. Think before you remove that option. "Clean design" isn't worth a damn if your product has become less useful as a result.
But this is the only way to make progress. There will always be users who oppose changes and maintaining old features cost. Microsoft manages this very well (you can basically make Windows 7 look like 95 if you want) but at a great price. They spend many resources maintaining this compatibility and if they didn't they would have been able to make new software much faster.