'ADD' does seem more likely to be used in that flippant way by people who don't have it, but IME ADHDers who self-describe with the term 'ADD' are just older, and for whatever reason have some kind of identity attachment to the nomenclature that was current when they were diagnosed.
That makes sense. I think the earliest evaluation I have is a 1996 one (probably for school accommodations) which uses "ADHD". This tracks with the 1987 terminology switch.