LinuxQuestions.org
Latest LQ Deal: Latest LQ Deals
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 11-27-2023, 05:51 AM   #1
shirase
LQ Newbie
 
Registered: Nov 2023
Distribution: Linux for PlayStation 2
Posts: 8

Rep: Reputation: 0
Question LZMA & Parallel Processing (<2 Cores)


Can LZMA be used with more than 2 cores with something like 'paralell' or 'xargs'?
 
Old 11-27-2023, 06:19 AM   #2
zeebra
Senior Member
 
Registered: Dec 2011
Distribution: Slackware
Posts: 1,834
Blog Entries: 17

Rep: Reputation: 642Reputation: 642Reputation: 642Reputation: 642Reputation: 642Reputation: 642
plzip?
 
Old 12-07-2023, 10:42 AM   #3
shirase
LQ Newbie
 
Registered: Nov 2023
Distribution: Linux for PlayStation 2
Posts: 8

Original Poster
Rep: Reputation: 0
I may be mistaken but I thought that LZMA was designed for 2 cores only either for 32 bit systems or for some compression related reason.
Even 7zip has to use LZMA2 to use more than 2 cores and the man page mentions that it's slightly worse in compression but with utilization of all cores available is easily faster and worth the compression loss.
This leaves me wondering what plzip is actually doing. Does plzip utilize all cores for LZMA or is it just using LZMA2 or a similar variant?
This is why I mention xargs and parallel. I don't think any archiver can change how the LZMA algorithm is decrypted for more than 2 cores.
 
Old 12-07-2023, 04:23 PM   #4
replica9000
Senior Member
 
Registered: Jul 2006
Distribution: Debian Unstable
Posts: 1,131
Blog Entries: 2

Rep: Reputation: 260Reputation: 260Reputation: 260
pixz
 
Old 12-07-2023, 06:35 PM   #5
zeebra
Senior Member
 
Registered: Dec 2011
Distribution: Slackware
Posts: 1,834
Blog Entries: 17

Rep: Reputation: 642Reputation: 642Reputation: 642Reputation: 642Reputation: 642Reputation: 642
Quote:
Originally Posted by shirase View Post
This leaves me wondering what plzip is actually doing. Does plzip utilize all cores for LZMA or is it just using LZMA2 or a similar variant?
It's described on the website. It's using threading techniques and chunking the object(s) for compression.

I don't know to be frank, I just know about plzip, and it claims to be doing what you're looking for.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: Intel NUC 13 Pro Mini PC Running Linux: P-Cores and E-Cores LXer Syndicated Linux News 0 10-31-2023 12:51 PM
AMD Cores/Threads/Virtual Cores dman777 Linux - Hardware 2 05-07-2013 02:04 AM
LXer: Nvidia and ARM: It's a parallel, parallel, parallel world LXer Syndicated Linux News 0 03-21-2013 06:10 PM
installing aufs & lzma & squashfs modules ? yban Slackware 6 09-30-2009 03:16 AM
Gotta love those &#1649;&#1649;&#1649;&#1649;&#1649;&#1649;&#1649;&# iLLuSionZ Linux - General 5 11-18-2003 07:14 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 01:34 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration