LinuxQuestions.org
Help answer threads with 0 replies.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices


Reply
  Search this Thread
Old 11-05-2022, 04:55 PM   #1
Janvanl
Member
 
Registered: Apr 2015
Posts: 145

Rep: Reputation: Disabled
Copying from Server to server what is better


Hi,

i need to copy 37 Gb from one server to another.
I know that scp or rsync is the best way to do that.

Only, does one chop this in smaller portions or is 37 Gb in one run
a feasable option?

Has anyone experience with this large portions of data?

Regards,
Jan
 
Old 11-05-2022, 05:01 PM   #2
TB0ne
LQ Guru
 
Registered: Jul 2003
Location: Birmingham, Alabama
Distribution: SuSE, RedHat, Slack,CentOS
Posts: 26,753

Rep: Reputation: 7983Reputation: 7983Reputation: 7983Reputation: 7983Reputation: 7983Reputation: 7983Reputation: 7983Reputation: 7983Reputation: 7983Reputation: 7983Reputation: 7983
Quote:
Originally Posted by Janvanl View Post
Hi,
i need to copy 37 Gb from one server to another. I know that scp or rsync is the best way to do that. Only, does one chop this in smaller portions or is 37 Gb in one run
a feasable option? Has anyone experience with this large portions of data?
Not sure what your question is, and honestly it makes zero difference what you use. 37GB is always going to be 37GB...your limiting factor is the network itself. Yes, there is some overhead with the protocol, but it's not going to make THAT much of a difference. SCP is a good choice.
 
Old 11-05-2022, 05:16 PM   #3
michaelk
Moderator
 
Registered: Aug 2002
Posts: 25,784

Rep: Reputation: 5937Reputation: 5937Reputation: 5937Reputation: 5937Reputation: 5937Reputation: 5937Reputation: 5937Reputation: 5937Reputation: 5937Reputation: 5937Reputation: 5937
rsync would have an advantage because you could resume copying with the --partial option in case the transfer was interrupted.
 
Old 11-05-2022, 05:31 PM   #4
Janvanl
Member
 
Registered: Apr 2015
Posts: 145

Original Poster
Rep: Reputation: Disabled
Thanks TBone and michaelk

this is exactly the information i needed because i feared that an incomplete copy could bring trouble,
considering the large amount to be copied.

It is hard to estimate how fast the network is, because the servers are with two different vendors.
I found scp to be blazing fast when i copied a couple of hundred MB's.
I was used to "slow" ftp and slow internet - just shortly i have 5G which is more then 10 times as fast the cablemodem i used before,
which however has nothing to do with copying from server to server.

Because of the --partial option i will go for rsync.

Regards,
Jan
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Copying home folder from command line without copying hidden directories and files rm_-rf_windows Linux - General 2 04-12-2016 08:24 AM
drag-drop copying and cp command both hang at last few KB when copying to flash drive slacker_ Linux - Newbie 1 09-05-2013 07:17 AM
[SOLVED] Copying the files inside a folder, without copying the folder (hopefully easy) tibberous Linux - Software 3 12-23-2010 01:50 AM
Better wireless or better graphics? anax93 Linux - General 1 06-05-2007 11:10 AM
better drivers for better speed? lukeprog Linux - Hardware 1 03-23-2006 06:24 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 03:14 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration