How to Handle exception while scraping data from multiple pages?

Asked Apr 29 '19 at 08:55

Active Jan 31 '21 at 19:25

Viewed 47 times

I have a character vector(x) which consists of multiple URL. I am scraping data from each url using rvest. It was found that one of the url in the vector is incorrect because of which error 404 occurred, without scraping data from other pages. How to run the program, ignoring the incorrect url.

lapply(x ,
          function(url){
                         
                         url %>% read_html() %>% 
                         html_nodes("") %>% 
                         html_text()
                               
                             })

edited Jan 31 '21 at 19:25

DisappointedByUnaccountableMod

6,656
4
18
22

asked Apr 29 '19 at 08:55

mohitji

Please have a look at `try catch` – Clemsang Apr 29 '19 at 09:12
That would be `?tryCatch`. – Roman Luštrik Apr 29 '19 at 09:27
You can check this answer for a try catch example: [https://stackoverflow.com/a/12195574/10710995](https://stackoverflow.com/a/12195574/10710995) – Erdem Emin Akcay Apr 30 '19 at 12:47

How to Handle exception while scraping data from multiple pages?

0 Answers0