Overriding Python Selenium WebDriver.get() to catch TimeoutException

Question

I'm using Python Selenium with Chromedriver. Every once in a while, a webdriver.get() call will throw a TimeoutException. I'm successfully catching every other exception through explicit waits, but the TimeoutException seems to occur when the network stream gets dropped.

What I want to do is modify the webdriver.get() method (through overrides or subclassing) so that every time my application calls get(), it will automatically:

Catch and handle TimeoutException
Retry the get() request a few times

How do I accomplish this?

Note: This question is not a duplicate of How to set the timeout of 'driver.get' for python selenium 3.8.0? -- I'm trying to add implicit functionality to the get() method. The reason I don't just wrap my get() calls in a try/except block manually is because I'm making a lot of them througout my application and am attempting to be DRY.

@DebanjanB This does not look look like a duplicate of this question. While the content of that question would certainly help, it is not what the question asks. — Asyranok, Jun 17 '19 at 20:29
@pcalkins I added some info about that. I'm making a lot of get() calls. — gnome, Jun 17 '19 at 23:22

score 0 · Answer 1 · answered Jun 18 '19 at 07:40

I think that the best way is to do a try/except and make the except only catch the TimeOutException

from selenium.common.exceptions import TimeoutException
try:
    webdriver.get(url)
except TimeoutException:
    time.sleep(5)
    webdriver.get(url)

If the problem is that you have to do this several times encapsulate it in a method

score 0 · Answer 2 · answered Jun 18 '19 at 18:04

I figured it out. You have to subclass EventFiringWebDriver like this:

from selenium.support.events import EventFiringWebDriver

class MyWebDriver(EventFiringWebDriver):
    def get( self ,url):
        try:
            super().get(url)
        except TimeoutException:
            # your exception handling code goes here

Overriding Python Selenium WebDriver.get() to catch TimeoutException

2 Answers2