How to reexecute if an error occurs in python?

Question

I'm working with Twint(a Twitter scraper) but somehow there is a problem that I can't fix. I wonder if there is a way that when an error occurs, wait 1 min and re-execute this? My code is like this:

import twint

geos = ["40.74566208501717, -73.99137569478954", "35.68802408270403, 139.76489869554837", "31.22521968438549, 121.51655148017774"]
    
for geo in geos:
    print(str(geo)+','+'10km')
    c = twint.Config()
    c.Limit = 20
    c.Geo = str(geo)+','+'10km'
    twint.run.Search(c)

Sometimes,twint.run.Search(c) can't function correctly.So, once there is an error, is there a way to only execute this loop again but not re-executing the whole loop?

Would anyone help me? Any idea would be really helpful. Thank you much!

What happens in the situation where it doesn't function correctly. Does it crash? — Sam, Dec 16 '21 at 16:27

score 2 · Accepted Answer · answered Dec 16 '21 at 16:28

2

If you want to simply pretend the error didn't happen, you could do:

try:
    twint.run.Search(c)
except WhateverExceptionType:
    pass

(replace WhateverExceptionType with the actual type of error you're seeing)

If when there's an error you wanted to have the whole program wait for a minute before continuing the loop, put that in the except:

import time

...

    try:
        twint.run.Search(c)
    except WhateverExceptionType:
        time.sleep(60)

If you want it to re-execute that specific search after waiting (rather than continuing with the next loop iteration), put that in the except. Note that if code within an except raises, then it will raise out of the except and stop your program.

    try:
        twint.run.Search(c)
    except WhateverExceptionType:
        time.sleep(60)
        twint.run.Search(c)

answered Dec 16 '21 at 16:28

Samwise

68,105
3
30
44

Thanks a lot! For an error like ` twint.token.RefreshTokenException: Could not find the Guest token in HTML`, how could I know what type of error it is? – Haotian Ma Dec 16 '21 at 16:38
`twint.token.RefreshTokenException` -- or if you do `from twint.token import RefreshTokenException` then it's just `RefreshTokenException`. – Samwise Dec 16 '21 at 16:39
It works! thanks! – Haotian Ma Dec 16 '21 at 16:45
Is there an approach to show the error type I get on the terminal? – Haotian Ma Dec 17 '21 at 02:35
Make it `except RefreshTokenException as e` and then `print(e)` inside the `except`. – Samwise Dec 17 '21 at 15:58

Jacques Gaudin · Answer 2 · 2021-12-16T17:52:39.363

0

You could do something like this to try the search again after 60 sec and with say maximum 10 retries:

import time

for geo in geos:
    print(str(geo)+','+'10km')
    c = twint.Config()
    c.Limit = 20
    c.Geo = str(geo)+','+'10km'

    success=False
    retries = 0
    while not success and retries <= 10:
        try:
            twint.run.Search(c)
            success=True
        except twint.token.RefreshTokenException:
            time.sleep(60)
            retries += 1
        except: # <- catches all other exceptions
            retries = 11  # <- e.g. stop trying if another exception was raised

edited Dec 16 '21 at 17:52

answered Dec 16 '21 at 16:30

Jacques Gaudin

15,779
10
54
75

1

Looks it has been solved! Thank you very much! – Haotian Ma Dec 16 '21 at 16:43
Is there a way to take a look at what error I get in your solution? – Haotian Ma Dec 16 '21 at 17:18
Sure, I just put an example of how you could take different actions depending on the exception that was raised. – Jacques Gaudin Dec 16 '21 at 17:53

How to reexecute if an error occurs in python?

2 Answers2