Backup to external usb disk with ext4 or ext3 is dead slow
Linux - ServerThis forum is for the discussion of Linux Software used in a server related context.
Notices
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
Backup to external usb disk with ext4 or ext3 is dead slow
Hi,
I have an Oracle Linux Server and I have been backing up my server on an external usb 2 drive with a fat32 file system for ages without any problems. In order to backup about 20GB it took about 45 minutes. But I reached a point where I had some large files > 4GB which could not be backed up on a fat32 system.
So I decided to re-format the external drive to an ext4 partition. The results were devastating. It took about 15 hours to complete the backup.
I tried the same with an ext3 format, but the results were the same.
I'm not sure why you're seeing such a drop in performance but try disabling journaling on ext4. I've experienced some fairly substantial speed ups in usb drives from that.
Yes, but the difference in performance is very big, i.e. 45 minutes vs 15 hours.
I do not think disabling journalling will do the trick. By the way, I just reformatted the external drive to NTFS and a backup of 20GB was done in just 15 minutes.
I am forced to use NTFS as I have not other choice. Am I the only one having such slow performance on ext3/ ext4?
By the way, the actual file system on the server is ext3.
I do not create a specific entry in fstab, the drive simply gets mounted automatically when I plug it in. But you say that you copy 14GB in about 8 minutes. I need 10-15 hours to store 20GB. Do you think that the way it was mounted makes a difference?
If yes, can you please send me your example fstab mount command?
Fuse was not even installed. I installed it a few days ago just to be able to use NTFS file systems. Currently I am backing up on an NTFS external drive. It takes only about 45 minutes to back up 33GB.
But I really would like to find out what am I doing wrong and ext3/4 takes so long.
By the way, the server is using ext3 for its main OS partition and I have not experienced any problems with that.
Is this an "Advanced Format" drive with 4KB physical sectors? If so, a partition that is not aligned on a 4KB boundary (multiple of 8 512-byte logical sectors) can reduce write performance by a factor of 10. Example:
i use Gparted live cd
unless you must use special settings
leave it at the default settings and format to ext4
for a back up drive one partition is fine
if you need partitions, then 3 normal primary
one extended
then as many logical as needed
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.