Python Requests adds additional headers to any GET or POST request

Question

For the simple request like following with python requests

r = requests.get("http://google.com", headers={'Connection': 'close'})

There are additional request headers sent with request like following

>>> r.request.headers
{'Connection': 'close', 'User-Agent': 'python-requests/2.9.1', 'Accept': '*/*', 'Accept-Encoding': 'gzip, deflate'}

Is there any way to force python requests to just send the supplied headers and nothing more?

Thank you, Sudu

Have you tried providing empty values for those headers in your `headers={...}` value? — DisappointedByUnaccountableMod, Jun 18 '19 at 19:31
Thank you for quick response. Yeah I added `Connection` header in the request and along with it there are more headers like `Accept: */*` which I don't want to be seen — Sudu, Jun 18 '19 at 19:33
Have you even bothered to try searching? I very easily found this by using a popular search engine https://stackoverflow.com/questions/27043402/python-requests-remove-the-content-length-header-from-post — DisappointedByUnaccountableMod, Jun 18 '19 at 19:36

score 0 · Accepted Answer · answered Jun 18 '19 at 19:37

0

You need to send all other headers as None. For example:-

headers = {'Connection': 'close', 'Accept-Encoding': None, 'User-Agent': None}
r = requests.get("http://google.com", headers=headers)

P.S - But some websites may fail to respond if you send them as None

answered Jun 18 '19 at 19:37

Tech at The Sparks Foundation

1,123
2
7
15

Thank you! :) setting `None` value to default headers ['Connection','User-Agent','Accept','Accept-Encoding'] sent by requests worked for my application. :) – Sudu Jun 18 '19 at 19:56

score 0 · Answer 2 · answered Jun 18 '19 at 19:38

Please try 'head':

>>> r = requests.head('http://google.com',headers={'Connection':'close'})                                                               
>>> r.request.headers
{'Connection': 'close', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'User-Agent': 'python-requests/2.19.1'}                    
>>> r.text                                                                                                                              
u''

abhijeet raj · Answer 3 · 2021-06-06T09:37:15.957

0

There are additional request headers sent with request like following

headers = {'Connection': 'close',  'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'User-Agent': 'python-requests/2.19.1'}
r = requests.get("http://google.com", headers=headers)

edited Jun 06 '21 at 09:37

answered Jun 06 '21 at 09:31

abhijeet raj

1
2

2

OP already knows this. The question is not _whether_ they are sent, but rather how to _prevent_ those additional headers. – Nelewout Jun 06 '21 at 09:40

Python Requests adds additional headers to any GET or POST request

3 Answers3