Yes, DOE is very interested in DL. I don't work on this personally, but you can see an example e.g. here [1, 2]. You can see in the first link they're using Keras. I'm not up to date on all the details (again, don't work on this personally) but in general the project is commissioned to run on all of DOE's upcoming supercomputers, including Frontier.
[1]: https://github.com/ECP-CANDLE/Benchmarks
[2]: https://www.exascaleproject.org/research-project/candle/