Questions tagged [logstash-input-jdbc]

jdbc is an input plugin for Logstash. You can use it to get data into logstash from any database that has a JDBC interface.

Jdbc is an Input plugin for Logstash which allows to ship data into Logstash from any database that has JDBC interface.

The jdbc plugin does not come with jdbc driver settings. You have to pass the jdbc configuration explicitly while defining the plugin in logstash input.

For more information on how and when to use jdbc input plugin visit: https://www.elastic.co/guide/en/logstash/current/plugins-inputs-jdbc.html

11 questions
3
votes
1 answer

Set Null values pulled from Mysql to Elasticsearch to a default value using logstash input jdbc plugin

The fields that I want to get them with default value could be NULL in MYSQL. This is my configuration for the logstash plugin. input { jdbc { jdbc_connection_string => "jdbc:mysql://localhost:3306/elements" jdbc_user =>…
Sadok Mtir
  • 585
  • 6
  • 15
3
votes
0 answers

How to sync Mysql delete operation with logstash-input-jdbc?

Now, I have been test insert, update operations with logstash-input-jdbc plugin, when the mysql changed(insert or update), elasticsearch also changed sync. But when use mysql delete one row, the row exist in the elasticsearch, we can't delete it…
1
vote
0 answers

How to take data that have auth and args from Websocket server to Logstash using Websocket input plugin

I am trying to take data that have auth and args from Websocket server to Logstash using Websocket input plugin. My Logstash conf file input { websocket { mode => client url => "wss://0.0.0.0/api" } } output { stdout {codec =>…
1
vote
0 answers

how to install logstash plugin (logstash-integration-jdbc)

I'm trying to install logstash-integration-jdbc following this git logstash-integration-jdbc running logstash 7.12.1 I've installed jruby $ jruby --version jruby 9.1.17.0 (2.3.3) 2020-02-29 fffffff OpenJDK 64-Bit Server VM…
yuliansen
  • 470
  • 2
  • 14
  • 29
1
vote
2 answers

Can we configure logstash input to listen onlyto paricular set of hosts

Currently my logstash input is listening to filebeat on port XXXX,my requirement is to collect log data only from a particular hosts(let's say only from Webservers). I dont want to modify the filebeat configuration directly on to the servers but I…
1
vote
1 answer

Mongodb driver class for Logstash input plugin JDBC

I am using Logstash to replcate a database from MongoDB to Elasticsearch using Logstash 6.0.0, here is my config file: input{ jdbc{ jdbc_driver_library => "/usr/share/logstash/driver/mongodb-driver-3.6.1.jar" jdbc_driver_class =>…
PhiloJunkie
  • 1,111
  • 4
  • 13
  • 27
1
vote
0 answers

Logstash indexing using jdbc-input

I am using Logstash together with logstash-input-jdbc in order to ship data to Elasticsearch. I'm running it as a service on Windows machine using NSSM. This is config file (I've cut some repetitive code from filters): input { jdbc { …
Evaldas Buinauskas
  • 13,739
  • 11
  • 55
  • 107
0
votes
0 answers

Unable to sync MongoDB data to Elasticseach via logstash

I am new to ELK stack. Stuck with data ingestion in elasticsearch using logstash. I am mentioning the steps I followed:- Installed ELK Stack successfully. Then installed plugin logstash-input-mongodb. After that configured logstash with below…
0
votes
0 answers

Logstash .odx file input

I was hoping someone could help me regarding input in logstash. I am very new to logstash and I have a requirement where my logstash input file is an unconventional file. How do I input an ODX input file? I think delimiter for the input file is # as…
0
votes
1 answer

logstash-input-jdbc: “Unknown setting 'jdbc_driver_libary' for jdbc {:level=>:error}”

I try to access to MySQL service with logstash. I installed logstash-input-jdbc (/opt/logstash/bin/logstash-plugin install logstash-input-jdbc) and created /etc/logstash/conf.d/sample.conf: input{ lumberjack{ ... } jdbc{ type =>…
ELosada
  • 33
  • 6
0
votes
2 answers

Logstash sequential thread execution flow

I made two jdbc sections in my config, but I want always execute first actionA and than actionB, it's important for me. How can I do this? Here is my config: input { jdbc { type => "actionA" jdbc_validate_connection => true …
Frank
  • 3
  • 4