Questions tagged [kube-prometheus-stack]

78 questions
8
votes
2 answers

Add PodMonitor or ServiceMonitor outside of kube-prometheus-stack helm values

Using kube-prometheus-stack helm chart, version 35.2.0. So far, I add my custom PrometheusRules, PodMonitor and ServiceMonitor via helm custom values. helm install my-kubpromstack prometheus-community/kube-prometheus-stack -n monitoring \ -f…
Polymerase
  • 6,311
  • 11
  • 47
  • 65
6
votes
2 answers

How to overwrite alertmanager configuration in kube-prometheus-stack helm chart

I am deploying a monitoring stack from the kube-prometheus-stack helm chart and I am trying to configure alertmanager so that it has my custom configuration for alerting in a Slack channel. The configuration in the pod is loaded from…
5
votes
2 answers

Thanos-Query/Query-Frontend does not show any metrics

Basically, I had installed Prometheues-Grafana from the kube-prometheus-stack using the provided helm chart repo prometheus-community # helm repo add prometheus-community https://prometheus-community.github.io/helm-charts # helm install…
vjwilson
  • 754
  • 2
  • 14
  • 30
5
votes
1 answer

Prometheus kubelet metrics with pod labels

I am trying to figure out how to get pod labels into the metric tags from kubelet metrics using prometheus-stack. In our environment, we need to hash pod names (due to length limitations) so our app name, env, and unit name are saved in pod…
4
votes
3 answers

Helm Prometheus operator doesn't add new ServiceMonitor endpoints to targets

I'm trying to monitor my app using helm prometheus https://github.com/prometheus-community/helm-charts. I've installed this helm chart successfully. prometheus-kube-prometheus-operator-5d8dcd5988-bw222 1/1 Running 0 …
2
votes
0 answers

Conflict with kube-prometheus when installing metric-server

I use AWS EKS environment, and I have https://github.com/prometheus-operator/kube-prometheus installed for monitoring. I'd like to get autoscaler installed where one of the prerequisites is https://github.com/kubernetes-sigs/metrics-server. I first…
wxh
  • 619
  • 7
  • 20
2
votes
1 answer

Pattern for deploying dashboards using kube prometheus stack's grafana dashboard sidecar

I am trying to get kube prometheus stack's grafana dashboard sidecar to deploy dashboards depending on the environment (dev, staging, prod, all environments). I can't quite figure out a good way to do this. My folder structure currently looks like…
sebastian
  • 2,008
  • 4
  • 31
  • 49
2
votes
0 answers

Prometheus context deadline exceeded

I am getting an following error: Get "https://192.168.188.161:10250/metrics": context deadline exceeded I am running kube-prometheus v6.5.3 in AWS EKS K8S. I am using default config. What should be wrong? Or how can I debug…
2
votes
1 answer

alertmanagerconfig matches about namespace not work

my alertmanagerconfigs: apiVersion: monitoring.coreos.com/v1alpha1 kind: AlertmanagerConfig metadata: name: configlinkflowalertmanager labels: alertmanagerConfig: linkflowAlertmanager spec: route: groupBy: ['alertname'] groupWait:…
1
vote
1 answer

Pull nuclio metrics into prometheus-operator

I am currently trying to pull metrics from nuclio functions to my prometheus operator. But I don't realy understand how I am supposed to do. So far, I have 2 namespaces : monitoring : for my kube-prometheus-stack nuclio : for everything related to…
Mulu
  • 13
  • 2
1
vote
0 answers

PromQL alert error - Vector contains metrics with the same labelset after applying rule labels

I have setup a Cronjob for a container that exits with a non-zero code. I have a PrometheusRule and AlertManagerConfig setup against this CronJob but the alert is not firing as expected. The alerting is based on this example. This is the CronJob…
Golide
  • 835
  • 3
  • 13
  • 36
1
vote
1 answer

How can you set the upload interval of the TSDB blocks in Thanos sidecar?

We are using the kube-prometheus-stack deploying Prometheus together with Thanos. The Thanos-Sidecar uploads TSDB blocks to an object storage bucket as Prometheus produces them every 2 hours. This is the default behaviour. In the helm-chart I set…
user5580578
  • 1,134
  • 1
  • 12
  • 28
1
vote
1 answer

How to pass notification template from values.yaml for Grafana Helm chart

have been trying to create a notification template from values but it doesn't seem to be working. Code: alerting: rules.yaml: apiVersion: 1 templates: - orgID: 1 name: Slack Template template: | …
1
vote
0 answers

deploy kube-prometheus can not acess grafana

i deploy kube-prometheus on k8s .but i can not access grafana 。 kube-prometheus version: release-0.12 k8s version: clientVersion: buildDate: "2022-12-08T19:58:30Z" compiler: gc gitCommit: b46a3f887ca979b1a5d14fd39cb1af43e7e5d12d …
1
vote
1 answer

Problems with Prometheus Alertmanager sending Slack notifications

I have Prometheus (et al) deployed on my K8s cluster via the kube-prometheus-stack Helm chart. I am trying to get the Prometheus Alertmanager to send notifications to Slack. Here is the alertmanager block from my chart values.yaml: alertmanager: …
Joseph Gagnon
  • 1,731
  • 3
  • 30
  • 63
1
2 3 4 5 6