python requests synchronous callback

Question

I am using the python requests library to download data from a web server e.g:

import requests

fname = 'guppy-0.1.10.tar.gz'
url = 'https://pypi.python.org/packages/source/g/guppy/' + fname
r = requests.get(url)
open(fname, 'wb').write(r.content)

Which is working as expected.

But I am needing to download data (and save) from a web server that is continuously streaming data.

So is there a callback function that I can use with the requests api that lets me do this?

When downloading files, enable `stream` for the request. Try `requests.get(url, tream=True)`. — Artyom Vancyan, Aug 18 '22 at 10:29

score 1 · Accepted Answer · answered Aug 18 '22 at 11:51

When downloading files, you should enable the stream option.

requests.get(url, stream=True)

Of course, this has some limitations in some cases.

If the file is large
The internet is slow

In the above cases, a timeout exception will be thrown. If you face such an issue, see how to fix.

python requests synchronous callback

1 Answers1