3

Just start using the firebase + react to build a website. One of the designed features of my website is to crawl and show users the data parsed from another website (e.g., the stock price changes). I already have a python crawler responsible to parse the data, but I have no idea how to execute this python crawler (in the background) of my server in firebase (or it is not even possible)?

Here is the example usage of my system

  1. user login and subscribe the website/data they are interesting
  2. my crawler will parse that website every 1 hour and update the data to database
  3. user can see the summary of change of website from database

One option I have in mind is running the crawler in my local machine and use the REST api to update the parsed data to firebase database. However, it seems a very inefficient/naive approach because it is kind of losing the meaning of deploying my server with cloud service, like firebase.

Yu-Chih
  • 345
  • 4
  • 13
  • What you have done with this? I'm kind of the same situation, I have a NodeJs API that has crawlers inside triggered by sending requests to API I'm thinking of cloud function with firebase bu afraid from the costing :"D I don't use any kind of database here – hesham shawky Oct 15 '19 at 03:38

1 Answers1

0

Firebase does not have any service/feature that allows you to periodically run Python or any other code. The closest thing to that is Cloud Functions, which can be triggered through an external service like cron-job.org.

For more in this, see:

Frank van Puffelen
  • 565,676
  • 79
  • 828
  • 807