My observations confirm both of these assertions. Leaving a song (I was semi-actively listening to) unfinished will make it stuck in my head, finishing it will remove it.