How do I save the content of a url to a .txt file?

Question

The code failed.

Could anyone help?

I search in stack overflow, and tried some methods, but I can't seem to find any that work.

from urllib.request import urlopen

link = "https://www.youtube.com/live_chat?v=IKQkjWmqQv8&is_popout=1"

f = urlopen(link)
myfile = f.read()
print (myfile)
output_file = open('1.txt','w')
output_file.write(myfile)
output_file.close()

Possible duplicate of [Python: saving large web page to file](https://stackoverflow.com/questions/8220669/python-saving-large-web-page-to-file) — Mathieu de Lorimier, Sep 27 '17 at 12:57
Thank you. It works. However the content of the website cannot be loaded. It said the browser version does not support — fizz, Sep 28 '17 at 09:01

score 2 · Accepted Answer · answered Sep 27 '17 at 11:08

2

Try this code:

from urllib.request import urlopen

link = "https://www.youtube.com/live_chat?v=IKQkjWmqQv8&is_popout=1"

f = urlopen(link)
myfile = f.read()
print (myfile)
output_file = open('1.txt','wb')
output_file.write(myfile)
output_file.close()

answered Sep 27 '17 at 11:08

Eivind

44
5

Thank you. It works. However the content of the website cannot be loaded. It said the browser version does not support – fizz Sep 28 '17 at 06:16

Martin Evans · Answer 2 · 2017-09-28T09:07:09.807

1

You are getting a bytes back from your read(), you could just write this to your file in binary mode by adding a b as follows:

from urllib.request import urlopen

link = "https://www.youtube.com/live_chat?v=IKQkjWmqQv8&is_popout=1"

f = urlopen(link)
myfile = f.read()
print (myfile)

with open('output.html','wb') as output_file:
    output_file.write(myfile)

Note: Using with is the preferred method for dealing with files. It will automatically close your file for you afterwards.

edited Sep 28 '17 at 09:07

answered Sep 27 '17 at 11:06

Martin Evans

45,791
17
81
97

Thank you. It works. However the content of the website cannot be loaded. It said the browser version does not support. – fizz Sep 28 '17 at 06:16
I suggest you rename the output file to `output.html` and try loading that into you browser. – Martin Evans Sep 28 '17 at 09:07

score 0 · Answer 3 · answered Sep 27 '17 at 11:11

0

Other answers are true, but you can decode bytes to string. To do that, just modify these 2 lines:

...
output_file = open('1.txt', 'w', encoding="utf8")
output_file.write(myfile.decode("utf8"))
...

answered Sep 27 '17 at 11:11

Alperen

3,772
3
27
49

Thank you. It works. However the content of the website cannot be loaded. It said the browser version does not support – fizz Sep 28 '17 at 09:01

How do I save the content of a url to a .txt file?

3 Answers3