I need to replicate an Odata API. I am using node.js and postgress. The use case is making a replication of a large real estate MLS. Once replicated, I will be able to hit the API every 15 min for updates. I was going to write that part in Node, unless NIFI makes more sense.
My question is: can NIFI help me parse the API metadata and then create the database schema in Postgress ? I did not see a lot of Odata-to-Postgress support so I am trying this NIFI approach.
I am super new to development so can anyone tell me if this approach is feasible ? And if so, what processors would I use in NIFI ? If there are other databases that play better with Odata let me know, but I want to keep this in budget. Otherwise, I am going to stick with Postgress. Thank you very much.
I have tried numerous plugins for Odata-to-Postgress and none were well documented and I could not get them to work. Perhaps what I want doesn't exist: and easyish way to replicate this Odata API from the meta data. I then decided on the NIFI plan. NIFI is installed and I am learning what it can do.
