Questions tagged [promtail]

Promtail is an agent which ships the contents of local logs to a private Grafana Loki instance or Grafana Cloud. Use with grafana-loki tag.

See documentation

145 questions
6
votes
3 answers

why my Loki log retention is not working?

"12h" old logs are not deleting even after specifying "retention_period: 12h" due to this I'm facing storage issue because, log are not deleting. please help me with config loki: enabled: true isDefault: true table_manager: …
Vinayak Pawar
  • 93
  • 1
  • 4
6
votes
0 answers

Promtail: Loki Server returned HTTP status 429 Too Many Requests

I'm running Loki for test purposes in Docker and am recently getting following error from the Promtail and Loki containers: level=warn ts=2022-02-18T09:41:39.186511145Z caller=client.go:349 component=client host=loki:3100 msg="error sending batch,…
Selwyn Rogers
  • 101
  • 2
  • 5
6
votes
3 answers

Grafana does not see loki (docker-compose setup)

I am trying to log my application into grafana/loki/promtail using the same docker compose ,and I get the following error when connecting to loki : localhost:3100 -> 404 page not found and when i try to hook it in grafana : URL [http://loki:3100 ]->…
Illidan
  • 149
  • 1
  • 8
5
votes
2 answers

How to filter logs in Grafana-Loki?

I use the last versions of: Prometheus prometheus-cpp library Grafana Loki Promtail in Windows 10. So I just start bin files of these applications. And I get my logfile.log in Grafana panel. There are lines marked [INFO] in the log file. There…
SuperPuper
  • 51
  • 1
  • 1
  • 5
4
votes
1 answer

promtail: transform the whole log line based on regex

I'm having some challenges with coercing my log lines in a certain format. I'm running one promtail instance on several log files, of which some are logfmt and others are free-form. My objective is to transform the free-form ones to the same logfmt…
ppenguin
  • 155
  • 1
  • 11
4
votes
1 answer

Promtail config to filter out log lines

I have read the docs for promtail and doing pipelines and I cannot make heads nor tails of it. All I want to do is drop log lines that originated from Uptimerobot software we use to determine if our site is up or not. Promtail docs:…
Bodger
  • 1,342
  • 4
  • 16
  • 23
3
votes
1 answer

Decrypting Docker Container Names in Grafana with Loki and Promtail

My task is to configure Docker log monitoring for around 70 containers. Consolidating all logs into a single panel is not ideal, especially during stress tests and monitoring Docker applications. I want to be able to select a Docker container…
worrum
  • 90
  • 1
  • 13
3
votes
0 answers

Promtail to parse all available objects in nested JSON array for Grafana Loki

Using Loki and Promtail and I have some JSON which I am looking to parse with a pipeline stage. I have defined expressions and created a new JSON stage for every nested object/array, however the logs that I am parsing do not have a definite number…
snorkrat
  • 41
  • 4
3
votes
1 answer

Drop logs from promtail

I have prometheus + loki + grafana + promtail setup. I need to drop the logs which have the words healthcheck or health-check. My values.yaml file: https://github.com/grafana/helm-charts/blob/main/charts/promtail/values.yaml Please help me how can I…
3
votes
1 answer

Promtail - service discovery based on label with docker-compose and label in Grafana log explorer

I am playing with Grafana and Promtail. I have the following setup: version: "3.3" networks: loki: services: loki: image: grafana/loki:k88-c660a7e ports: - "3100:3100" command: -config.file=/etc/loki/local-config.yaml …
Slav
  • 147
  • 2
  • 13
3
votes
2 answers

Remove a part of a log in Loki

I have installed Grafana, Loki, Promtail and Prometheus with the grafana/loki-stack. I also have Nginx set up with the Nginx helm chart. Promtail is ingesting logs fine into Loki, but I want to customise the way my logs look. Specifically I want to…
eikooc
  • 2,363
  • 28
  • 37
3
votes
1 answer

Correct way to parse docker JSON logs in promtail

I've created some monitoring with grafana, loki and promtail. The container i'm getting the logs from outputs them in JSON format…
Inbell1s
  • 31
  • 2
3
votes
1 answer

Promtail multiline does not merge stacktrace

Promtail, Grafana, Loki version is 2.4.1. running is Kubernetes. I was following the documentation. The exception in the log matches the regular expression. (ZeroWidthSpace is at the beginning of a log line) multiline stage is set see the attached…
balint.steinbach
  • 278
  • 3
  • 16
3
votes
1 answer

Loki Distributed with S3 backend - Timestamp and Grafana connection issues

I have set up Loki Distributed using the official helm charts. nameOverride: null # -- Overrides the chart's computed full name fullnameOverride: null # -- Image pull secrets for Docker images imagePullSecrets: [] loki: # Configures the…
Vaibhav Jain
  • 2,155
  • 5
  • 27
  • 41
3
votes
1 answer

configure Promtail/loki to collect other logs files from the container running in a kubernetes pod using helm chart

I have installed the promtail/loki using the helm chart in my Kubernetes cluster by following the below link https://grafana.com/docs/loki/latest/installation/helm/ But By default, it collects only container logs. I want to configure my promtail in…
1
2 3
9 10