Can't find values in table using BeautifulSoup (python)

Asked Feb 25 '19 at 04:45

Active Jan 31 '20 at 06:30

Viewed 85 times

I've been using:

from bs4 import BeautifulSoup


soup = BeautifulSoup(page_html, 'lxml')

tables = soup.find_all('table')

but it just gives me dummy text like "Lorem Ipsum..."

I can see the text I want to scrape when I inspect the element, but I cannot see it when I press "View Page Source".

Does this mean this code is Javascript driven? If so, how do I get around this without a driver?

Here is some of the code when I inspect the element (table is highlighted):

edited Jan 31 '20 at 06:30

Martin Gergov

asked Feb 25 '19 at 04:45

EggSpectrum

3

can you provide an url? Also, please don't post pictures of html. Use the snippet tool via [edit] so we can use for testing. – QHarr Feb 25 '19 at 08:05
having the url would be helpful. – chitown88 Feb 25 '19 at 11:39
Refer to https://stackoverflow.com/questions/26393231/using-python-requests-with-javascript-pages – Kamal Feb 27 '19 at 03:52

0 Answers0