How to simulate clicking on "Next" until the end?

Question

I am not sure how to simulate clicking the "Next", my current code will just stop at first instance..I also created a for loop but it would just say object is not iterable..any way to revise my code?

from selenium import webdriver
browser = webdriver.Firefox()
import time
browser.get('https://www.autocodes.com/obd-code-list/powertrain/1')

linkElem = browser.find_element_by_css_selector("#pag > a")
type(linkElem)
linkElem.click() # follows the "Next" link

Answer 1

try the following code:

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC


browser = webdriver.Firefox()
import time
count = 0
browser.get('https://www.autocodes.com/obd-code-list/powertrain/1')
while(1):
    try:
        linkElem = WebDriverWait(browser, 10).until(EC.presence_of_element_located((By.XPATH, "//div[@id='pag']//a[contains(text(),'Next')]")))
    except:
        import traceback
        traceback.print_exc()
        print "last page reached."
        break;
    # type(linkElem)
    count += 1
    print "count " , count
    linkElem.click() # follows the "Next" link
    time.sleep(1)

---

the code continuously checks whether the Next element is present in an infinite while loop. If present, clicks it. Otherwise, break the loop.

Note: count variable is added as a debug statement to know the loop count. If not required, you can remove the code related to it.

Note: similarly, traceback is added to print the complete trace. just prints the exception trace for your reference.

Note: break keyword, breaks the infinite loop once it reaches the last page and comes out of while loop and continues with the next code.

References:

1. http://selenium-python.readthedocs.io/waits.html

Answer 2

May be your element id or type of "linkElem" get changed after first click.