Stack Overflow
Stack Overflow

Questions tagged [elastic-beats]

81 questions
5
votes
2 answers

Filebeat and AWS Elasticsearch - Not Working

I have good experience in working with Elasticsearch, I have worked with version 2.4 and now trying to learn new Elasticsearch. I am trying to implement Filebeat to send my apache and system logs to my Elasticsearch endpoint. To save my time I…
Shivkumar Mallesappa
  • 2,875
  • 7
  • 41
  • 68
4
votes
0 answers

Filebeat kafka input using multiline parser gives no output

Filebeat is configured to use input from kafka and output to file When the multiline setting is turned off, the output is published to a file. But when kafka input is configured with mutiline, no output in the file(file is not even created) Here is…
Sniper
  • 1,428
  • 1
  • 12
  • 28
4
votes
3 answers

Logstash beats input "invalid version of beats protocol"

I'm writing a kibana plugin and a logstash pipeline. For my tests, I just wrote a logstash input like that: input { beats { port => 9600 ssl => false ssl_verify_mode => "none" } } But when I try to open a connection…
Pikappa
  • 181
  • 1
  • 2
  • 11
4
votes
1 answer

What happens when the ouput of Auditbeat is down

I am using the following pipeline to forward data Auditbeat ---> logstash ---> ES Suppose if the logstash machine goes down, I want to know how the Auditbeat handles the situation. I would like to know the specifics like is there a retry…
Voodoo
  • 349
  • 3
  • 11
4
votes
1 answer

How to re-direct logs from Azure Databricks to another destination?

We could use some help on how to send Spark Driver and worker logs to a destination outside Azure Databricks, like e.g. Azure Blob storage or Elastic search using Eleastic-beats. When configuring a new cluster, the only options on get reg log…
Jean Vache
  • 83
  • 1
  • 10
3
votes
1 answer

Processing multiple logs from the same machine using ELK

I have a single host containing multiple log files. 2 such log files are csab and oneapplogs. The corrseponding Groks are opeapplog : match => {"message" =>…
Tony Stark
  • 511
  • 2
  • 15
3
votes
1 answer

Elastalert simplified multiple rules in one file

I'm writing Elastalart rules for heartbeat i.e if service or machine are/is down, I should get notified. Right now I can create one rule for service per one file like below. name: My Alert type: frequency index: heartbeat-* num_events: 5 timeframe: …
Veerendra K
  • 2,145
  • 7
  • 32
  • 61
2
votes
1 answer

Problem with Kibana unable to load Dashboards (Exiting: resource 'metricbeat-7.5.0' exists, but it is not an alias)

I have installed metric-beat , but unable to load he kibana dashboard for mongodb. i am getting below error, [10.0.1.1:9300][indices:data/read/search[phase/query]] Caused by: java.lang.IllegalArgumentException: Fielddata is disabled on text fields…
Chandu
  • 21
  • 3
2
votes
1 answer

Pull logs from remote server into elasticsearch

The short question is: Is it possible to pull logs (within logfiles) from a remote server and ingest them into the ELK stack. The long story is the following: We have a setup with a DMZ which is publically facing We have an intranet environment…
pfeigl
  • 457
  • 5
  • 12
2
votes
1 answer

Logstash with Elastic index only 10,000 documents

I am working with Filebeat and Logstash to upload logs to Elastic (all are 7.3-oss version). My log file contain billions of rows, yet elastic only show 10K documents. When adding stdout output it seems like all the data is coming to Logstash, but…
Maya
  • 31
  • 2
2
votes
1 answer

Filebeat unable to send logs to Kafka

File Beat is unable to send logs from a particular folder, This is the application logs folder. Things that have been tried : Created a new topic in kafka to retest the settings. Checked for file permission for the folder and the file to…
user3636989
  • 161
  • 1
  • 9
2
votes
2 answers

Beat input in Logstash is losing fields

I have the following infrastructure: ELK installed as docker containers, each in its own container. And on a virtual machine running CentOS I installed nginx web server and Filebeat to collect the logs. I enabled the nginx module in filebeat. >…
500 Server error
  • 644
  • 13
  • 28
2
votes
1 answer

How to generate custom Auditbeat field?

I need to insert a field for each event for the auditbeat data. That is each document should contain a field "enviornment": "production" Note: I need a solution not involving Logstash How can I do this?.
Arun Mohan
  • 898
  • 3
  • 18
  • 37
1
vote
1 answer

How to monitor https traffic using packetbeat?

Is there way to get the response code of https calls using packetbeat. I don’t see any protocol for https. The goal is to monitor https traffic
Sowmiya
  • 57
  • 4
1
vote
1 answer

Running filebeat setup fails

I installed Elasticsearch and Kibana on docker. I need to add Filebeat to the workflow, so I followed the official documentation Run filebeat setup I run this command: docker run docker.elastic.co/beats/filebeat:8.1.2 setup -E…
Abdelmoughit Gardam
  • 113
  • 2
  • 11
1
2 3 4 5 6