How can I shuffle a large amount of websites quickly?

Question

I have more than 15200 links to websites which I need to shuffle.

If I had a small number of websites, I can enter them manually into python and use the following code to shuffle them:

from random import shuffle
x = ['website_1', 'website_2', 'website_3', 'website_4', 'website_5']
shuffle(x)

But entering more than 15200 links manually into a list is extremely time consuming because I would have to put quotation marks on them individually.

At the moment, I have the links in the following form:

website_1
website_2
website_3
.
.
.
website_15270

Is there a way I can enter the the website in the format shown above and have them shuffled and returned in the same format?

Are the links saved in a file or where are the links availabale? — Oni1, Sep 16 '14 at 08:40
You should probably adjust the title of this case. Your problem isn't shuffling, it's reading data from a file. — dbn, Sep 16 '14 at 08:52

score 1 · Answer 1 · answered Sep 16 '14 at 08:41

1

Since the links are stored in a file:

from random import shuffle
with open(file) as f:
    links = [line.rstrip('\n') for line in f]
shuffle(links)

answered Sep 16 '14 at 08:41

nneonneo

2

If you are going to produce a list of lines without line separators, use `links = f.read().splitlines()`. – Martijn Pieters Sep 16 '14 at 08:45

Oni1 · Answer 2 · 2014-09-16T08:58:30.873

1

You read your file and remove the newlines from each link..

import random

links = [link.rstrip("\n") for link in open("yourFileName").readlines()]
random.shuffle(links)

edited Sep 16 '14 at 08:58

answered Sep 16 '14 at 08:49

Oni1

Where should the text file be saved? – user4010936 Sep 16 '14 at 08:53
insted of .replace maybe .rstrip? – Vizjerei Sep 16 '14 at 08:55
in the same directory as your .py file is saved or type in an absolute path of the path e.g. in linux /home/username/directory1/links.txt – Oni1 Sep 16 '14 at 08:55
@Vizjerei actually in this case it doesn't matter, but you're right i think it's safer! – Oni1 Sep 16 '14 at 08:59

score 0 · Answer 3 · edited May 23 '17 at 12:05

0

I think you can:

edited May 23 '17 at 12:05

Community

answered Sep 16 '14 at 08:50

3 Answers3