Peer-Joachim Koch wrote:
> Hi,
>
> I'm currently trying to reduce our backup time. We have to transfer
> ~250GB/day (50GB-2000GB).
> We tried to connect one of the file server using bonding and 2 unused
> network interfaces to improve the performance, but we are only seeing
> a small improvement (5-10%; averg. is currently 60MB/s).
>
> So I started to play a little bit on our cluster, where we have a couple
> of nodes with bonding interfaces. Using netcat I can transfer a file
> of 670MB within 5.9 sek, but this is only the theor. value for
> 1 GBit.
>
> Using scp I can only see ~45MB/s. (it's a 8 core node, so it's fast
> enough ...).
>
> Is there anything to improve this values substantial ?
> Is it principal not possible to jumb over the single link speed ?
>
> Any hints is welcome !!
>

Maybe not the answer you're looking for, but we had a similar problem
(apart from the fact that we could not increase the linespeed between
the two locations) and solved it by using two netapp filers. The netapp
filers have the ability to sync volumes (snapmirror) on a very regular
basis on block-level changes. This way, we can keep two storage arrays
(one containing our production database and one backup in a different
location) synced without having to burst every day.