I have a script that scrapes URLs through an API that manages proxy rotation and keeps things that websites do to get in the way of web scraping from stopping me when making scraping requests through the API.
What I want to do is make concurrent or parallel scraping requests, some people call it threading, with Google Apps Script.
Can anyone give me a little advice regarding how to do this or where to find information concerning making concurrent requests in Google Apps Script or tell me to stop looking because it is not possible and why?
I am looking for any information I can get that tells me how to make requests in parallel so I can give it to my developer or save them from doing tons of Google searches looking for a solution and possibly not finding one.
I know that different languages use specific tools to make and manage concurrent requests. However, so far I have not found anything available with Google Apps Script that I can use. I have read posts here about Google Cloud functions, Google Apps Script, and Puppeteer but don't fully understand if I could use Puppeteer to manage concurrent requests and how it would work within a Google Apps Script script.
The script I have that scapes Amazon.com URLs uses a day timeframe trigger that runs the scraping script regularly. I included this just in case knowing it changes the advice you have.
