The thing is... if you're interested in almost anything else, there's no particular expectation that you spend every possible waking hour doing it. Most hobbies, you spend maybe an hour or two a night on, if that, and spend the rest of your evenings doing something else.

If you get enough flexibility to explore things you're interested in within the context of work, it seems perfectly reasonable that 40 hours a week of that is enough.