I have what I think is a very basic question. What are the best practices for integrating a machine learning algorithm with Firebase data structure? To be more specific, I have a data structure that continually grows on Firebase that collects, essentially, survey data. Think Survey Monkey.
I also have a script written in python that pulls the relevant data I need out of the data structure and turns the survey responses into clean, usable numbers for the users.
The way I have been doing it is simply exporting the JSON from Firebase. Of course, as the data structure grows it is going to become unreasonable to do this on my local computer... I think.
What is the best practices for this workflow? I see that Google Cloud has some database management programs available. How do I do my pre-processing on the cloud, or at least move from this incredibly janky manual solution I'm currently doing, that is not scalable at all.
Thank you!