Python requests doesn't load site content anymore

Question

I'm using requests module to retrieve content from the website kat.cr and here is the code I used:

try:
    response = requests.get('http://kat.cr')
    response.raise_for_status()
except Exception as e:
    print(e)
else:
    return response.text

At first the code works just fine and I could retrieve the website source code, but then it stopped and I keep receiving this message "404 Client Error: Not Found for url: https://kat.cr"

I tried fixing this issue with user-agent like this:

from fake_useragent import UserAgent

try:
    ua = UserAgent()
    ua.update()
    headers = {'User-Agent': ua.random}
    response = requests.get(url, headers=headers)
    response.raise_for_status()
except Exception as e:
    print(e)
else:
    return response.text

But this doesn't seem to work either

Can you please help me fix this problem and thanks.

I copied your code and ran it 1000 times. Always got a 200 back. — quikst3r, Jul 13 '16 at 20:57
Same here. Did they block your ip as a rate limit or something? — Paul Becotte, Jul 13 '16 at 20:58
Same here, works just fine. Try opening this url in browser or use different tool - like curl: curl -L kat.cr — grundic, Jul 13 '16 at 21:00
Your code uses `http:`, but your reported error message has `https:`. Which is it supposed to be? — John Gordon, Jul 13 '16 at 21:03
It worked for me too at the first day, but then it just stopped, and it works in the browser too, so I don't think they blocked my IP — user3885884, Jul 13 '16 at 21:05

score 0 · Answer 1 · answered Aug 02 '21 at 16:51

0

I think that, as users suggested, you may be ip-blocked.

Try a proxy.

Proxies with Python 'Requests' module

answered Aug 02 '21 at 16:51

jwu

11
10

Python requests doesn't load site content anymore

1 Answers1