I have a page which scrolls from the bottom (the latest feeds) to the top (the older feeds). I am trying to get Selenium to scroll all the way to the top so I can get all the information. Currently, I am using this for testing and it worked, but I have to give specific number of loops to make it work. Problem is that numbers vary so I am looking for a way where it stops when it scrolls all the way to the top.
This is working but not reusable solution.
number_of_loops = 1
while number_of_loops != 10:
html = driver.find_element(By.TAG_NAME,'html')
html.send_keys(Keys.PAGE_UP)
time.sleep(1)
print("Number of Loops:",number_of_loops)
number_of_loops += 1
I tried this but it did not scroll at all. I think it was in a constant loop but again nothing happened.
while True:
html = driver.find_element(By.TAG_NAME,'html')
html.send_keys(Keys.PAGE_UP)
time.sleep(1)
I tried some of these solutions but nothing worked so far for me.
How can I scroll a web page using selenium webdriver in python?