Get source code of website with Python without being redirected?

Question

I'm trying to get the source-code of a website: "https://004.lmvz.ch/disdonc/block/5d3f06e7f323590019034257/test?identifier=004lmvzch-disdonc-5d3f06e7f323590019034257&identifier=004lmvzch-disdonc-5d3f06e7f323590019034257". But if I'm trying it with requests:

import requests
url = "https://004.lmvz.ch/disdonc/block/5d3f06e7f323590019034257/test?identifier=004lmvzch-disdonc-5d3f06e7f323590019034257&identifier=004lmvzch-disdonc-5d3f06e7f323590019034257"
print(requests.get(url).text)

But it returns the sourcecode of the login page: "https://login.lmvz.ch", so I think I get redirected. How can I bypass this? I tried it with: allow_redirects=False, but it does still not work.

Greetings, Dave

You may need to use post instead of get, and add additional data like cookies, — Filip Młynarski, Aug 10 '21 at 13:55
@FilipMłynarski I've tried it, but it loads a webpage that says "MethodNotAllowedHttpException" — Genius1512, Aug 10 '21 at 14:13
@Carcigenicate It gives me the source code of the webpage in the response tab — Genius1512, Aug 10 '21 at 14:15

score 0 · Answer 1 · answered Aug 10 '21 at 15:49

0

It's because it requires authentication info, the website automatically redirects to login page if you don't provide it.

Solution:

Login with valid credentials
Get the authen session info
Add authen info to header (in cookie) to request.

Check it out: How to send cookies in a post request with the Python Requests library?

answered Aug 10 '21 at 15:49

lucas-nguyen-17

5,516
2
9
20

This led me to a page that says: MethodNotAllowedHttpException as title – Genius1512 Aug 10 '21 at 16:45
Did you try to change GET to POST? Please read my anwser, I didn't suggest you to do that. Just login (manualy), copy the right cookie to GET request in python. – lucas-nguyen-17 Aug 11 '21 at 01:57

Get source code of website with Python without being redirected?

1 Answers1