94

I'm looping over a large file that I know the length of, but am processing lazily since it's too large to fit in memory. I'd like to be able to use tqdm to keep track of my progress through the file, but since it can't get the total number of examples out of the generator I'm using, the only thing it shows is the estimated iterations/second. Is there any way to tell tqdm how many elements it's going to be looping over total so I can get some of the other statistics?

George
  • 1,843
  • 2
  • 13
  • 24

1 Answers1

159

You can pass the length to the argument total to make it work.

Example:

from tqdm import tqdm

length = 1000000
generator = (3 * n for n in range(length))  # just doing something random
for n in tqdm(generator, total=length):
    pass
O. Edholm
  • 2,044
  • 2
  • 12
  • 13
  • What is the case for using an iterator with a generator inside (with __len__ implemented) and the case against, compared to just specifying the `total` parameter for tqdm? – David Cian Jan 19 '23 at 08:54