Linux - GeneralThis Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.
Notices
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
By default GNU tar does a number of checks to ensure that an extracted file(s) do not manage to escape the root directory of where it's being extracted too. This can slow things down quite a bit if the archive contains a lot of links. If you trust the archive not to have any malicious content then extracting with the --absolute-names option turns off these checks and should speed things up.
Here's a blog post about the issue, and a follow-up hacker news thread. which also has some interesting comments.
Can you get another (same) USB and format to ext4 and do a timing run on that and compare to the NTFS one?
Engineering experiment
Always test rather than assume.
Glad to see you did the timing experiment earlier
Yes, I do plan on trying the ext4 thing, but may not be for while. I needed to get this tarfile restored under system-down conditions, so I just grabbed a drive that was handy and used that. Normally most of our USB drives are formatted to ext4, but this particular one was a retired Windows workstation external drive used for Acronis image backups and was therefore NTFS. Usually, I recycle these for one-shot quarterly backup on Linux and do reformat to ext4, but hadn't done that on this one. I am curious if it would work faster as ext4.
Quote:
Originally Posted by GazL
By default GNU tar does a number of checks to ensure that an extracted file(s) do not manage to escape the root directory of where it's being extracted too. This can slow things down quite a bit if the archive contains a lot of links. If you trust the archive not to have any malicious content then extracting with the --absolute-names option turns off these checks and should speed things up.
Here's a blog post about the issue, and a follow-up hacker news thread. which also has some interesting comments.
Wow! that fellow did some extensive research on tar! Very interesting stuff. Great post.
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.