View Single Post

  #6 (permalink)  
Old 10-10-2004
Keith Keller
 
Posts: n/a
Default Re: secure transfer of huge files between two hosts?

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 2004-10-09, peter pilsl <pilsl@goldfisch.at> wrote:

> Fifth attempt was rsync via ssh, which takes a *very* long time to
> determine the needed delta-pieces and then fails anyway (there was
> enough space on the targetdrive ...)


[...]

> My last attempt will be to invoke dd or split to split the file to
> chunks<2GB and transfer them seperately.



I use a similar strategy for a slightly different problem: I need to
transfer largish files over a poor, slow, and unreliable link. I use
bzip2 compression, split the tarball, then rsync. This way, if the link
dies midway, I've gotten at least something.

I usually split into sizes which will go over in 5-10 minutes. I don't
mind having to redo that much copying, but much longer than that is
too much wasted time. (Too much shorter generates too many split pieces,
which is just an aesthetic issue; you may not care about that.)

- --keith

- --
kkeller-usenet@wombat.san-francisco.ca.us
(try just my userid to email me)
AOLSFAQ=http://wombat.san-francisco.ca.us/cgi-bin/fom

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.4 (GNU/Linux)

iD8DBQFBaLiJhVcNCxZ5ID8RAgkjAJ9HW+D+0xnqboYhuysM6m 2WiFB0KQCeKIET
sHyqySRgCTg7RLX54A8zM8U=
=s3Lh
-----END PGP SIGNATURE-----
Reply With Quote