Most of England was conquered by vikings at one time or another before the Norman invasion. First Danelaw expanded from 865 onwards. The viking rule over parts of England continued until England was united in 954. But they only stayed away for less than 60 years. In 1013 Denmark conquered England again, lost it in 1014, and reconquered it in 1016.
King Cnut (Canute) the Great then ruled over Denmark, Norway, parts of Sweden, and the vast majority of England, from 1016 to 1035, followed by his sons, and it was first the death of the second of his sons to hold the English crown that brought England, very temporarily, back under English rule in 1066.
The majority of the first couple of centuries of a united England was under the rule of descendants of viking invaders.
I don't think that's quite accurate - a few parts of what is now the UK were colonized by Vikings and their descendants for hundreds of years.
Places like Orkney and Shetland are very proud of their Viking heritage - e.g. the Up Helly Aa festival in Shetland:
http://www.bbc.co.uk/news/uk-scotland-north-east-orkney-shet...
Then, of course, there are that lot of Vikings who settled in what is now France and went on to do quite well for themselves...