Questions tagged [lzma]

Lempel–Ziv–Markov chain Algorithm is an compression algorithm which uses a dictionary compression. Is a default 7-zip algorithm.

Lempel–Ziv–Markov chain Algorithm is an compression algorithm which uses a dictionary compression. Is a default 7-zip algorithm.

More about LZMA at Wikipedia article on LZMA

233 questions
77
votes
9 answers

Why is *.tar.gz still much more common than *.tar.xz?

Whenever I see some source packages or binaries which are compressed with GZip I wonder if there are still reasons to favor gz over xz (excluding time travel to 2000), the savings of the LZMA compression algorithm are substantial and decompressions…
soc
  • 27,983
  • 20
  • 111
  • 215
58
votes
11 answers

ModuleNotFoundError: No module named '_lzma' when building python using pyenv on macos

Trying to use pyenv to build python versions on macOS, but every install I make ends up with ❯ python >>> import lzma ModuleNotFoundError: No module named '_lzma' I have installed all of the following packages: brew install openssl readline…
Paulo Costa
  • 965
  • 2
  • 10
  • 15
32
votes
3 answers

How to use the 7z SDK to compress and decompress a file

According to this link How do I create 7-Zip archives with .NET? , WOPR tell us how to compress a file with LMZA (7z compression algorithm) using 7z SDK ( http://www.7-zip.org/sdk.html ) using SevenZip.Compression.LZMA; private static void…
Djax
  • 421
  • 1
  • 4
  • 5
24
votes
6 answers

why is LZMA SDK (7-zip) so slow

I found 7-zip great and I will like to use it on .net applications. I have a 10MB file (a.001) and it takes: 2 seconds to encode. Now it will be nice if I could do the same thing on c#. I have downloaded http://www.7-zip.org/sdk.html LZMA SDK c#…
Tono Nam
  • 34,064
  • 78
  • 298
  • 470
19
votes
5 answers

Free compression library for C# which supports 7zip (LZMA)

I have a program (written in C#) that reads/writes its data directly (direct file access without server) to firebird database files. For a better exchange I want to (un)compress them on import/export for a better exchange over the internet without…
Xn0vv3r
  • 17,766
  • 13
  • 58
  • 65
17
votes
1 answer

C++ lzma compression and decompression of large stream by parts

I need to do lzma compression and decompression on the fly. I'm receiving a large file via qnetworkmanager in Qt and I need to decompress it as the data stream is downloading. When I receive part of the data stream I need to decompress it, append to…
sss123next
  • 295
  • 1
  • 3
  • 13
17
votes
6 answers

How to use LZMA SDK to compress/decompress in Java

http://www.7-zip.org/sdk.html This site provide a LZMA SDK for compress/decompress files, I would like to give it a shot but I am lost. Anyone got experience on this? Or a tutorial? Thanks.
lamwaiman1988
  • 3,729
  • 15
  • 55
  • 87
16
votes
1 answer

How to decompress a .xz file which has multiple folders/files inside, in a single go?

I'm trying to uncompress a .xz file which has a few foders and files inside. I don't see a direct way to do this using lzma module. This is what I'm seeing for a decompress method : In [1]: import lzma In [2]: f =…
vimal
  • 393
  • 1
  • 3
  • 11
15
votes
1 answer

What's the difference between 7z and lzma compressors?

7-Zip claims using LZMA as the compression algorithm. However, the LZMA SDK comes with two executables, 7zr.exe and lzma.exe, which have different options/switches and which produce different results which are not interchangeble, even though they…
Carles Sala
  • 1,989
  • 1
  • 16
  • 34
14
votes
3 answers

import pandas results in ModuleNotFoundError :_lzma

On Ubuntu 18.04 with python 3.7.3, I'm attempting to import pandas but this fails because it can't find _lzma. I've verified that _lzma is installed with dpkg: /usr/lib/python3.7/lib-dynload/_lzma.cpython-37m-x86_64-linux-gnu.so. Oddly, _lzma is…
14
votes
2 answers

Which algorithm is used in standard ZIP?

I have googled, wikied and read the RFC of ZIP, but can't find any info about the exact algorithm which is used in ZIP. I have found info about ZIP == TAR + GZIP But, I'm confused by this info. Since GZIP uses LZW algorithm as I remember, and TAR…
user1131997
12
votes
1 answer

extract 7z file using python 3

I was trying to decompress a 7z file using python, but I can't seem to figure it out. I figured I could use the lzma module in python 3, but I can't seem to figure it out: I thought it would work like the zipfile package: import lzma with…
code base 5000
  • 3,812
  • 13
  • 44
  • 73
11
votes
4 answers

Python decompression relative performance?

TLDR; Of the various compression algorithms available in python gzip, bz2, lzma, etc, which has the best decompression performance? Full discussion: Python 3 has various modules for compressing/decompressing data including gzip, bz2 and lzma. gzip…
ibrewster
  • 3,482
  • 5
  • 42
  • 54
11
votes
5 answers

Decompress and read Dukascopy .bi5 tick files

I need to open a .bi5 file and read the contents to cut a long story short. The problem: I have tens of thousands of .bi5 files containing time-series data that I need to decompress and process (read, dump into pandas). I ended up installing Python…
ajsp
  • 2,512
  • 22
  • 34
10
votes
2 answers

Problem with creating an environment from .yml file, error "CondaEnvException: Pip failed" raised

I am trying to create an environment based on a .yml file, the name of the file is env.yml . I run the following snippet on terminal: conda env create -f env.yml Then anaconda starts installing all packages outlined in the .yml file, until it…
1
2 3
15 16