Clean a list of URLs

Normalises URLs conservatively (lower-case host, trims spaces and fragments, removes known tracking parameters) and removes exact duplicates.