Elasticsearch to index RDBMS data

Question

These are three simple questions which was surprisingly hard to find definite answers.

Does ElasticSearch support indexing data in RDBMS tables ( Oracle/SQLServer/Informix) out of the box?
If yes, can you please point me to documentation on how to do it
If not, what are alternate ways (plugins like Rivers - deprecated) with good reputation

This might provide the answer you expect: http://stackoverflow.com/questions/34477095/elasticsearch-replication-of-other-system-data/34477639#34477639 — Val, Jan 29 '16 at 05:52
@Val Logstash did the trick. thanks. I want to but I am not sure how to accept it as an answer. — Ishan Hettiarachchi, Jan 29 '16 at 11:07
Awesome!! You can still upvote the other answer since that's the one that helped you solve your problem ;) — Val, Jan 29 '16 at 12:10

score 7 · Accepted Answer · answered Jun 14 '17 at 13:49

I'm surprised there isn't any solid answer as yet for this. So here's the solution. Logstash directly gives us the ability to push data from a RDBMS into Elasticsearch.

Here's a link to a tutorial which tell you how to go about it. Briefly(all details in link 1), you simply need a JDBC driver for the relational database you'll be using (Postgres, MySQL etc) and make a config file specifying your input as the Relational Database and your output as Elasticsearch. You can also specify a cron which would allow you to keep updating one regular intervals.

Here's the article which mentions the configuration and gets you started (See Example 2): https://www.elastic.co/blog/logstash-jdbc-input-plugin
Here's the article which tells you how to configure the Cronjob as such: https://www.elastic.co/guide/en/logstash/current/plugins-inputs-jdbc.html#_scheduling

Elasticsearch to index RDBMS data

1 Answers1