7

I am looking for a list of (doesnt matter if its not all, just needs to be big as its for generating dummy data)

Im looking for a list like

.net.nz
.co.nz
.edu.nz
.govt.nz
.com.au
.govt.au
.com
.net

any ideas where I can locate a list?

tshepang
  • 12,111
  • 21
  • 91
  • 136
Hailwood
  • 89,623
  • 107
  • 270
  • 423

2 Answers2

3

There are answers here. Most of them are relating to the use of http://publicsuffix.org/, and even some implementations to use it were given in some languages, like Ruby.

Community
  • 1
  • 1
Rafael
  • 1,126
  • 11
  • 16
2

To get all the ICANN domains, this python code should work for you:

import requests
url = 'https://publicsuffix.org/list/public_suffix_list.dat'
page = requests.get(url)

icann_domains = []
for line in page.text.splitlines():
    if 'END ICANN DOMAINS' in line:
        break
    elif line.startswith('//'):
        continue
    else:
        domain = line.strip()
        if domain:
            icann_domains.append(domain)

print(len(icann_domains)) # 7334 as of Nov 2018

Remove the break statement to get private domains as well.

Be careful as you will get some domains like this: *.kh (e.g. http://www.mptc.gov.kh/dns_registration.htm). The * is a wildcard.

Michael
  • 8,362
  • 6
  • 61
  • 88
Alex
  • 12,078
  • 6
  • 64
  • 74