Web scraping using python(BeautifulSoup and requests)

Asked Apr 27 '21 at 17:43

Active May 18 '21 at 20:52

Viewed 30 times

I am trying to scrape a website currently I have this but it's scraping in Html but I need Javascript

import requests
import urllib.request
import time
from bs4 import BeautifulSoup
url = 'website'
response = requests.get(url)
soup = BeautifulSoup(response.text, "html.parse")
soup.findAll('a')
print(soup)

edited May 18 '21 at 20:52

DisappointedByUnaccountableMod

6,656
4
18
22

asked Apr 27 '21 at 17:43

apple

1

"but I need Javascript" -> Can you clarify what you mean? Are you trying to extract information within the JavaScript? Is JavaScript being used to render content dynamically? Is the webpage blocking access without JavasScript? – Wondercricket Apr 27 '21 at 17:48
1. I need to scarp the website as JS 2.website is not blocking I'm just scarping as htlm – apple Apr 27 '21 at 18:01
It’s __scrape__ and __scraping__ not scarp or scarping – DisappointedByUnaccountableMod May 18 '21 at 20:52

Web scraping using python(BeautifulSoup and requests)

0 Answers0