RE: 923Mbits/s across the ocean

[Antony Antony <antony () phenome org>]

Les > The jumbo frames effectively increase the congestion avoidance additive 
Les > increase of the congestion avoidance phase of TCP by a factor of 6.  
Les > Thus after a congestion event, that reduces the window by a factor of 2, 

Jumbo frames helps a lot. Also NAPI in Linux 2.5.x will help a lot.
The way most Linux (till 2.4.20) NIC drivers handle TX and RX interrupt
moderation and SMP with multiple NICs are not very efficient. 
That really kill the performance of TCP over Long Fat Networks.  
Jumbo frames alleviate the problem very much. 

Poor x86 CPU is swamped with large number of interrupts when TCP send/receive
burst of data about the size of congestion window, ~32Mbytes in our case.

-antony