Stack Overflow
Stack Overflow

Questions tagged [pv]

Pipe viewer is a terminal utility tool for monitoring the progress of data through a pipeline. Do not use this tag for photovoltaics or principal value calculation!

33 questions
4
votes
2 answers

Linux Pipe viewer, how to split the pipe

I'm trying to extract large .tar file using pv. pv large_file.tar.gz | tar -xcf /../MyFolder. The pv command works like expected,showing the progress in the console. I'm trying to split the stdout, to show the progress both in the console and save…
slivinn
  • 85
  • 7
3
votes
2 answers

Output of pv on docker-compose startup not working as expected

I am trying to output the progress of an import of an .sql file inside a mariadb docker container. I have the following file/directory setup: │- docker-compose.yml │- Dockerfile │- import.sh └── sql - test.sql (rather big: ~ 1GB) My…
jones1008
  • 157
  • 1
  • 15
3
votes
1 answer

Progress bar + ETA on same line with pv command

Intro I'm using the pv command in a pipe to show a progress bar. I tried it with a simple counter: for (( i = 1 ; i <= 100 ; i++ )); do sleep 1; echo $i; done | pv --progress --line-mode --size 100 --eta --timer This works fine, but I'd like the…
Rolf W.
  • 1,379
  • 1
  • 15
  • 25
2
votes
1 answer

Print pv output (stderr) to file

How can I print the stderr output of pv to a file? For example: timeout 5s dd if=/dev/random | pv -r > /dev/null [ 505kiB/s] The rate line output is "updated" over the course of my five second timeout. I tried this but it does not work (log is…
dtmland
  • 2,136
  • 4
  • 22
  • 45
2
votes
1 answer

Why is Python subprocess not working as expected with named_pipe?

I am using python subprocess to run a mysqlimport command. For tracking the uploading progress, I am using a named pipe and pipe_viewer. Here is another similar problem. The subprocess Pipes are running without any error, but mysqlimport command is…
Rohit Thaply
  • 31
  • 2
1
vote
0 answers

Why does my microk8s AdGuard Home container need to be reconfigured every time it shuts down?

I'm having experiencing an issue with my AGH pod where it has to be reconfigured every time the container shuts down; be it manually, or at server restart. These are the various YAMLs: Namespace --- apiVersion: v1 kind: Namespace metadata: name:…
telometto
  • 111
  • 5
1
vote
1 answer

GNU Parallel progress bar in docker

I'm using GNU Parallel to speed up downloading of several thousand files during a build process running in docker container. This operation is lengthy and I want to have a progress bar that will periodically log that everything is going OK. This…
MatXXX
  • 31
  • 2
1
vote
0 answers

Solar PV seasonal pattern visualization using fanplot in python

I want to build some figures using the package fan plot or similar in Python I want to have a visualization of the intervals running from the darkest shade of the figures for the 50th percentile to the lightest ones at the 10th at the bottom and the…
cebep27
  • 37
  • 4
1
vote
2 answers

Extract .tar.xz with pv progress bar

I have a problem with extracting files with a progress bar. It always gives me an error: pv "file.tar.xz" | tar -xf tar: need argument -- f
heavyblack1
  • 72
  • 2
  • 9
1
vote
1 answer

file compressed through command "pv" are different from ordinary compressed file

here is my script: tar cf - testdir | pv -s $(du -sb testdir | awk '{print $1}') | pigz -1 > pv.tar.gz tar cf - testdir | pigz -1 > nopv.tar.gz diff pv.tar.gz nopv.tar.gz and then the output is "Binary files pv.tar.gz and nopv.tar.gz differ". I…
CJD
  • 185
  • 1
  • 2
  • 8
1
vote
0 answers

Bash process substitution behaves differently than named pipe?

Kind of a follow up to this question. I use bash process substitution expecting to see 5 lines of output (corresponding to 5s timeout) however I only see 4 lines: timeout 5s dd if=/dev/random | pv -fr > /dev/null 2> >(tr '\r' '\n'…
dtmland
  • 2,136
  • 4
  • 22
  • 45
1
vote
2 answers

gzip on multiple cores with pv progression bar

Following this 2010 question Gzip with all cores, I would like to gzip files using multiple core and indicate a progress bar with pv tool. How do I improve this code? CORES=$(grep -c '^processor' /proc/cpuinfo) find /source -type f -print0 | xargs…
Michel Hua
  • 1,614
  • 2
  • 23
  • 44
1
vote
0 answers

Print a word after a piped command output to the same line

I have a command pipeline using pv (pipe viewer). I would like print 'done' after the pipeline output in the same line. I use pv, and it has a parameter -c/--cursor which perhaps could provide this, but I cannot find out how to use it. The…
charisz
  • 302
  • 4
  • 12
0
votes
0 answers

data wipe out for Persistent volume after new pod created for EFS even though reclaimPolicy: Retain

I am trying to migrate a simple gitlab docker container to EKS cluster with Helm chart(it is custom helm chart created by helm create gitlab-ce command and not ready made gitlab helm chart ). for this, I am using EFS volume with static provision…
Ganesh Pol
  • 413
  • 1
  • 8
  • 29
0
votes
1 answer

Persistent Volume deletion issue

while I scale down EC2 node count into zero (basically EC2 gets terminated)under each ASG of EKS cluster and scale up again , then dynamically provisioned EBS(PV) volume gets deleted , though "Delete on termination" flag is set to "No" in case of…
Schatt
  • 1
  • 2
1
2 3