2

I have been trying to download this dataset through my Mac terminal. I know it's huge! https://zenodo.org/record/3606810

I have the tar.zst file, and when I try to decompress (using zstd -d pol_0616-1119_labeled.tar.zst), it throws me this error:

1119_labeled.tar.zst : Read error (39) : premature end

I've looked like crazy for ways to troubleshoot. Is there something obvious I'm missing? Thanks in advance for any help.

Ellen Jean Chapin
  • 21
  • 1
  • 1
  • 2
  • Maybe the file is corrupted ? A classical issue could be that the end was truncated. This could be tested using `zstd -t pol_0616-1119_labeled.tar.zst` – Cyan May 27 '20 at 16:12

1 Answers1

3

The error might be a corrupted file, or a file that wasn't closed properly. Annoyingly in this case zstd gives you nothing. You can work around this by letting zstd output to stdout and redirecting that into a file

zstd -d pol_0616-1119_labeled.tar.zst --stdout > pol_0616-1119_labeled.tar

This trick gives you as much data as it can successfully decompress

Jannis Froese
  • 1,347
  • 2
  • 10
  • 23