Capturing Response Body for a HTTP Error in python

Question

Need to capture the response body for a HTTP error in python. Currently using the python request module's raise_for_status(). This method only returns the Status Code and description. Need a way to capture the response body for a detailed error log.

Please suggest alternatives to python requests module if similar required feature is present in some different module. If not then please suggest what changes can be done to existing code to capture the said response body.

Current implementation contains just the following:

resp.raise_for_status()

score 9 · Answer 1 · answered Oct 02 '20 at 22:34

I guess I'll write this up quickly. This is working fine for me:

try:
  r = requests.get('https://www.google.com/404')
  r.raise_for_status()
except requests.exceptions.HTTPError as err:
  print(err.request.url)
  print(err)
  print(err.response.text)

score 5 · Accepted Answer · edited Apr 29 '21 at 06:41

5

you can do something like below, which returns the content of the response, in unicode.

response.text

or

try:
    r = requests.get('http://www.google.com/nothere')
    r.raise_for_status()
except requests.exceptions.HTTPError as err:
    print(err)
    sys.exit(1) 
# 404 Client Error: Not Found for url: http://www.google.com/nothere

here you'll get the full explanation on how to handle the exception. please check out Correct way to try/except using Python requests module?

edited Apr 29 '21 at 06:41

jed

103
5

answered Sep 21 '18 at 07:08

Chandu

2,053
3
25
39

1

To state this more clearly, and maybe what has been missed: the error object has `.request` and `.response` attributes that that make it easy to get the transfer details. `err.response.content` is what is needed. – fuzzyTew Oct 02 '20 at 22:31

score 2 · Answer 3 · answered Sep 21 '18 at 07:10

2

You can log resp.text if resp.status_code >= 400.

answered Sep 21 '18 at 07:10

blhsing

91,368
6
71
106

score 0 · Answer 4 · answered Sep 21 '18 at 07:11

0

There are some tools you may pick up such as Fiddler, Charles, wireshark.

However, those tools can just display the body of the response without including the reason or error stack why the error raises.

answered Sep 21 '18 at 07:11

CandyCrusher

308
1
14

Capturing Response Body for a HTTP Error in python

4 Answers4