gigabit+bonding = no performance improve ?
Hi,
I'm currently trying to reduce our backup time. We have to transfer
~250GB/day (50GB-2000GB).
We tried to connect one of the file server using bonding and 2 unused
network interfaces to improve the performance, but we are only seeing
a small improvement (5-10%; averg. is currently 60MB/s).
So I started to play a little bit on our cluster, where we have a couple
of nodes with bonding interfaces. Using netcat I can transfer a file
of 670MB within 5.9 sek, but this is only the theor. value for
1 GBit.
Using scp I can only see ~45MB/s. (it's a 8 core node, so it's fast
enough ...).
Is there anything to improve this values substantial ?
Is it principal not possible to jumb over the single link speed ?
Any hints is welcome !!
Bye, Peer
-------
OS: Novell SLES9 SP3, AMD64
Network E1000 (from Sles)
Bounding (RR) <-> Alcatel OS6800 using static linkagg
cluster nodes have 16GB RAM / 8 Cores
basic tuning using sysctl has been done:
net.ipv4.tcp_westwood = 0
net.ipv4.tcp_low_latency = 0
net.ipv4.tcp_frto = 0
net.ipv4.tcp_tw_reuse = 0
net.ipv4.tcp_adv_win_scale = 2
net.ipv4.tcp_app_win = 31
net.ipv4.tcp_rmem = 10485760 10485760 10485760
net.ipv4.tcp_wmem = 10485760 10485760 10485760
net.ipv4.tcp_mem = 10485760 10485760 10485760
net.ipv4.tcp_dsack = 1
net.ipv4.tcp_ecn = 0
net.ipv4.tcp_reordering = 3
net.ipv4.tcp_fack = 1
net.ipv4.tcp_orphan_retries = 0
net.ipv4.tcp_max_syn_backlog = 4096
net.ipv4.tcp_rfc1337 = 0
net.ipv4.tcp_stdurg = 0
net.ipv4.tcp_abort_on_overflow = 0
net.ipv4.tcp_tw_recycle = 0
net.ipv4.tcp_syncookies = 1
net.ipv4.tcp_fin_timeout = 60
net.ipv4.tcp_retries2 = 15
net.ipv4.tcp_retries1 = 3
net.ipv4.tcp_keepalive_intvl = 75
net.ipv4.tcp_keepalive_probes = 9
net.ipv4.tcp_keepalive_time = 7200
net.ipv4.tcp_max_tw_buckets = 180000
net.ipv4.tcp_max_orphans = 65536
net.ipv4.tcp_synack_retries = 5
net.ipv4.tcp_syn_retries = 5
net.ipv4.tcp_retrans_collapse = 1
net.ipv4.tcp_sack = 0
net.ipv4.tcp_window_scaling = 1
net.ipv4.tcp_timestamps = 1
|