LinuxQuestions.org - LZMA & Parallel Processing (<2 Cores)

- Linux - Newbie (https://www.linuxquestions.org/questions/linux-newbie-8/)

- - LZMA & Parallel Processing (<2 Cores) (https://www.linuxquestions.org/questions/linux-newbie-8/lzma-and-parallel-processing-2-cores-4175731279/)

LZMA & Parallel Processing (<2 Cores)

Can LZMA be used with more than 2 cores with something like 'paralell' or 'xargs'?

I may be mistaken but I thought that LZMA was designed for 2 cores only either for 32 bit systems or for some compression related reason.
Even 7zip has to use LZMA2 to use more than 2 cores and the man page mentions that it's slightly worse in compression but with utilization of all cores available is easily faster and worth the compression loss.
This leaves me wondering what plzip is actually doing. Does plzip utilize all cores for LZMA or is it just using LZMA2 or a similar variant?
This is why I mention xargs and parallel. I don't think any archiver can change how the LZMA algorithm is decrypted for more than 2 cores.

Quote:

Originally Posted by shirase (Post 6469020)

This leaves me wondering what plzip is actually doing. Does plzip utilize all cores for LZMA or is it just using LZMA2 or a similar variant?

It's described on the website. It's using threading techniques and chunking the object(s) for compression.

I don't know to be frank, I just know about plzip, and it claims to be doing what you're looking for.