Questions tagged [elasticsearch-jdbc-river]

The Java Database Connection (JDBC) river allows to fetch data from JDBC sources for indexing into Elasticsearch.

It is implemented as an Elasticsearch plugin.

The relational data is internally transformed into structured JSON objects for the schema-less indexing model in Elasticsearch.

Creating a JDBC river is easy. Install the plugin. Download a JDBC driver jar from your vendor's site (here MySQL) and put the jar into the folder of the plugin $ES_HOME/plugins/river-jdbc. Then issue this simple command:

curl -XPUT 'localhost:9200/_river/my_jdbc_river/_meta' -d '{
    "type" : "jdbc",
    "jdbc" : {
        "url" : "jdbc:mysql://localhost:3306/test",
        "user" : "",
        "password" : "",
        "sql" : "select * from orders",
        "index" : "my_jdbc_index",
        "type" : "my_jdbc_type"
    }
}'

Reference :-

Elasticsearch Jdbc River Quick Start

Elasticsearch JBDC River Parameters

124 questions
16
votes
1 answer

Elasticsearch : set up parent/child using jdbc-rivers

I am reading data from Sql Server database/table using jdbc-river currently. As of now I have created a individual type for each of the table in my database. As next step in my implementation I would like to use parent/child types so that I can…
jsp
  • 2,546
  • 5
  • 36
  • 63
14
votes
2 answers

Alternatives to Elasticsearch river plugins

I want to synchronize an Elasticsearch index with the contents of an SQL database. The Elasticsearch JDBC river meets all my requirements, but in the documentation it is said that the plugin is deprecated. I don't want to use a tool that won't be…
Heschoon
  • 2,915
  • 9
  • 26
  • 55
10
votes
2 answers

Preferred method of indexing bulk data into ElasticSearch?

I've been looking at ElasticSearch as solution get some better search and analytics functionality at my company. All of our data is in SQL Server at the moment and I've successfully installed the JDBC River and gotten some test data into ES. Rivers…
Cuthbert
  • 2,908
  • 5
  • 33
  • 60
6
votes
2 answers

elasticsearch failed to parse date

I've the following index definition for the date: "handshaketime" : {"type":"date","format":"YYYY-MM-ddTHH:mm:ss.SSSZ"} And the actual date is of this form: "handshaketime":"2015-04-07T10:43:03.000-07:00" I've specified that date coming from DB…
BoCode
  • 847
  • 4
  • 17
  • 33
6
votes
1 answer

elasticsearch dynamic query - Add another field to each document returned

What I need is very simple, but I am unable to find how to do it in Elasticsearch, possibly because of the complexity of what is required to be done. Input (two sample JSON documents) { "car" : 150, "bike" : 300 } { "car" : 100, "bike" : 200} What…
5
votes
3 answers

Fetching changes from table with ElasticSearch JDBC river

I'm configuring JDBC river for ElasticSearch but I can't find any good config example. I've read all pages on elasticsearch-river-jdbc GitHub. I have a SQL query and I need to fetch changes from all table columns every X seconds. How can I tell JDBC…
Xdg
  • 1,735
  • 2
  • 27
  • 42
5
votes
2 answers

jprante elasticsearch jdbc river changing the date value

I am trying to index mysql records in elasticsearch using the jprante's elasticsearch jdbc river. I just noticed that the value in the date field is getting changed in the index. Mapping: content_date:{ "type":"date" } content_date field for a…
mansk
  • 101
  • 2
  • 7
4
votes
1 answer

Indexing MySQL data with ElasticSearch

I would like to get some feedback from anyone who's had experience indexing MySQL data with ElasticSearch for full-text searching. How did you accomplish this? I've been researching this a bit and unfortunately I've noticed that ElasticSearch has…
3
votes
1 answer

Syntax SQL multiline with feeder and batch file?

I success configure with yours advices. With a simple line of sql, it's run. But with multiline SQL, it's not run. What is it the sql syntax with multiline? "jdbc" : { "url" : "url", "user" : "user", "password" : "password", …
3
votes
1 answer

Elasticsearch + Oracle JDBC River

Maybe this is a simple question but im new at ElasticSearch.. Installed es 1.4, Oracle 10g is up and running, jdbc plugin loaded in ES without issue. Marvel also working.. Tried to create a river with this statement in Marvel/Sense: PUT…
3
votes
4 answers

ElasticSearch Error: MapperParsingException failed to parse

I am trying to integrate MYSQL in ElasticSearch On windows 7 from this link I have completed the following steps: 1: Download & Unzip in C Directory https://download.elasticsearch.org/elasticsearch/elasticsearch/elasticsearch-1.3.4.zip 2: Run…
Shoaib Ijaz
  • 5,347
  • 12
  • 56
  • 84
3
votes
0 answers

failed to send join request to master

I am using elasticsearch version 1.3.0. After restarting data node its unable to detect master node. I am getting error failed to send join request to master In Error log…
Roopendra
  • 7,674
  • 16
  • 65
  • 92
3
votes
2 answers

Mapping mac address into elasticsearch index using jdbc river

We have a type that contains mac address field. the data is brought using jdbc river The cause is that when we run a term aggregation on the mac_address field the results looks like the field is broke into indexed keys: Action: GET…
Ben Diamant
  • 6,186
  • 4
  • 35
  • 50
3
votes
1 answer

Error will be Raised when parse data into elasticsearch from mysql

curl -XPUT localhost:9200/_river/my_jdbc_river/_meta -d "{ "type" : "jdbc", "jdbc" : { "driver" : "com.mysql.jdbc.Driver", …
3
votes
1 answer

How can I set index_settings for Elasticsearch in elasticsearch-jdbc-river?

I'm trying to configure the index settings using elasticsearch-jdbc-river. So far this is what I do : curl -XPUT localhost:9200/_river/my_river/_meta?pretty=true --data @index.json and this is my json file : { "type":"jdbc", "jdbc":{ …
eliasah
  • 39,588
  • 11
  • 124
  • 154
1
2 3
8 9