How to remove lines containing similar duplicates?

Question

I have a text file which contains URLs. How can I remove duplicated addresses with www, and non www? For example I have two URLs:

example.com
www.example.com

I would like to remove one, or remove 'example.com' from www.example.com then I could remove all www.'s

File contains about 8k urls so I can't do this manually

Urls are separated with new lines, or do it in PHP somehow, explode each to array then compare? (this will be a lot time consuming)

If you know PHP you should forget about notepad++ and do it in PHP. It must be easier. — aalku, Jan 09 '14 at 11:52
possible duplicate of [Regex: Remove lines containing](http://stackoverflow.com/questions/5876296/regex-remove-lines-containing) — Qantas 94 Heavy, Apr 14 '14 at 13:18

score 1 · Answer 1 · answered Jan 09 '14 at 11:56

1

In Notepad++ search for "www." then replace all with a blank space. Then make a PHP file and explode them into an array, then use array_unique()

answered Jan 09 '14 at 11:56

andershagbard

score 0 · Answer 2 · edited May 23 '17 at 12:25

0

I've removed first all www. -> replaced all www. to '' then removed duplicated: Regex: Remove lines containing

edited May 23 '17 at 12:25

Community

answered Jan 09 '14 at 12:05

user2606353

2 Answers2