Stack Overflow
Stack Overflow

Questions tagged [thanos]

55 questions
5
votes
2 answers

Thanos-Query/Query-Frontend does not show any metrics

Basically, I had installed Prometheues-Grafana from the kube-prometheus-stack using the provided helm chart repo prometheus-community # helm repo add prometheus-community https://prometheus-community.github.io/helm-charts # helm install…
vjwilson
  • 754
  • 2
  • 14
  • 30
5
votes
2 answers

Variable substitution in Prometheus yaml file

I am deploying Prometheus with Thanos with the given config: global: scrape_interval: 15s # By default, scrape targets every 15 seconds. # Attach these labels to any time series or alerts when communicating with # external systems (federation,…
swetad90
  • 784
  • 1
  • 13
  • 34
4
votes
2 answers

Is there a way in promql to get all the available label names using thanos api?

I have a promql which is giving me the metric result as a whole from the server, but I am interested in filtering and getting results of a specific value, but I am not sure what can be the label name for that value, if I can see all the available…
RITESH DUBEY
  • 55
  • 1
  • 7
3
votes
1 answer

I am trying to find a suitable promQL on Thanos Query which will give me the count of Readiness and Liveness Probe failures

I am trying to migrate a dashboard which shows the count of Readiness and Liveness Probe Failures, from Kibana(ElasticSearch) to a Grafana Dashboard(Sauron). In kibana the we can get both the probe failures separately using kubernetes.event.message…
Soumik Laik
  • 31
  • 3
2
votes
2 answers

Find exact CPU percentage from the metrics exported by prometheus-node-exporter

I use the node_cpu_seconds_total metrics for this. Basically, I want to subtract mode="idle" from the total CPU usage and then take the avg rate of the result, then a percentage calculation. I tried something like: 100 -…
vjwilson
  • 754
  • 2
  • 14
  • 30
2
votes
0 answers

In thanos query，prometheus sidecar status is health，but when I query，Report an error：grpc: the client connection is closing

In thanos query,prometheus sidecar status is health： 10.0.66.140:10901 | UP | prometheus="monitoring/k8s"prometheus_replica="prometheus-k8s-0" | 2021-10-03 01:41:57 | | 793.000ms ago But when I query,will report an error: Error executing query:…
moweiraul
  • 43
  • 4
1
vote
1 answer

How can you set the upload interval of the TSDB blocks in Thanos sidecar?

We are using the kube-prometheus-stack deploying Prometheus together with Thanos. The Thanos-Sidecar uploads TSDB blocks to an object storage bucket as Prometheus produces them every 2 hours. This is the default behaviour. In the helm-chart I set…
user5580578
  • 1,134
  • 1
  • 12
  • 28
1
vote
1 answer

Testing thanos object storage upload without waiting 2 hours

I was working on a docker-compose file using Prometheus to remote write data to a Thanos receiver. This data would then be queried by Thanos Querier as well as uploaded to minIO. When configuring the minIO portion, I ran into an issue where I could…
Chris Howe
  • 173
  • 1
  • 10
1
vote
0 answers

Thanos Receiver - Error on series with out-of-order labels

Sorry am a beginner and very much new to this tech stack. I installed Thanos using helm and my receiver pod is running but when I try to write to the exposed service I get the following in my pod logs: level=warn ts=2022-12-19T06:22:59.025976065Z…
VtI
  • 21
  • 4
1
vote
0 answers

Thanos Ruler Query Config Bearer for Oauth based API not working

I'm using Thanos Ruler and trying to add a an API based query url to its configuration. Referring from the Thanos Official docs of building Thanos Ruler (https://thanos.io/tip/components/rule.md/#query-api), we configured the oauth based token…
Sakthivel Eka
  • 21
  • 4
1
vote
1 answer

Aggregate 2 PromQL gauge metrics without including extra labels from right operand

Is it possible to aggregate 2 gauge metrics (i.e. kube_pod_labels and kube_pod_container_resource_requests_cpu_cores) so that by executing the query both resulting elements would be combined (i.e. all pod labels as resulting element and…
srodi
  • 41
  • 10
1
vote
0 answers

Prometheus statefulset is not created after deploying prometheus operator with kubernetes stack

I have deployed prometheus operator on k8s cluster.Kubernetes stack is also deployed along with it.All the CRD files created but prometheus statefulset is not created (prometheus-k8s-0 is not created).
Usama Malick
  • 31
  • 1
  • 6
1
vote
1 answer

Thanos Querier Deduplication Issue with Prometheus

We are new to Prometheus Monitoring and are facing an issue. On our Kubernetes cluster, to monitor our MongoDB application, we are using the following setup : MongoDB exporter (installed using prometheus-community prometheus-mongodb-exporter Helm…
user1601155
  • 23
  • 7
1
vote
1 answer

Is there a metrics endpoint for thanos querier which shows all the metrics from the stores and not just thanos itself?

I tried using '/metrics' on thanos querier url, but I only see the thanos metrics. Is there a way to view the store metrics using an endpoint?
shan
  • 125
  • 3
  • 16
1
vote
1 answer

Missing data in Thanos at specific resolution

Question Problem: When querying Thanos for a graph at resolution lower than a certain threshold, Thanos will return data with missing data points when Prometheus does not (see screenshots later). Setup: A kubernetes cluster. Thanos’s querier is…
Frizlab
  • 846
  • 9
  • 30
1
2 3 4