nanog mailing list archives
Re: 923Mbits/s across the ocean
From: Iljitsch van Beijnum <iljitsch () muada com>
Date: Sat, 8 Mar 2003 22:49:01 +0100 (CET)
On Sat, 8 Mar 2003, Cottrell, Les wrote:
We used a stock TCP (Linux kernel TCP). We did however, use jumbo frames (9000Byte MTUs).
What kind of difference did you see as opposed to standard 1500 byte packets? I did some testing once and things actually ran slightly faster with 1500 byte packets, completely contrary to my expectations... (This was UDP and just 0.003 km rather than 10,000, though.)
The remarks about window size and buffer are interesting also. It is true large windows are needed. To approach 1Gbits/s we require 40MByte windows. If this is going to be a problem, then we need to raise question like this soon and figure out how to address (add more memory, use other protocols etc.). In practice to approcah 2.5Gbits/s requires 120MByte windows.
So how much packet loss did you see? Even with a few packets in a million lost this would bring your transfer way down and/or you'd need even bigger windows. However, bigger windows mean more congestion. When two of those boxes start pushing traffic at 1 Gbps with a 40 MB window, you'll see 20 MB worth of lost packets due to congestion in a single RTT. A test where the high-bandwidth session or several high-bandwidth sessions have to live side by side with other traffic would be very interesting. If this works well it opens up possibilities of doing this type of application over real networks rather than (virtual) point-to-point links where congestion management isn't an issue.
Current thread:
- Re: 923Mbits/s across the ocean Cottrell, Les (Mar 08)
- Re: 923Mbits/s across the ocean E.B. Dreger (Mar 08)
- Re: 923Mbits/s across the ocean alex (Mar 08)
- Re: 923Mbits/s across the ocean David G. Andersen (Mar 08)
- Re: 923Mbits/s across the ocean alex (Mar 08)
- Re: 923Mbits/s across the ocean Douglas F. Calvert (Mar 10)
- Re: 923Mbits/s across the ocean David G. Andersen (Mar 08)
- Re: 923Mbits/s across the ocean Iljitsch van Beijnum (Mar 08)
- <Possible follow-ups>
- RE: 923Mbits/s across the ocean Cottrell, Les (Mar 08)
- RE: 923Mbits/s across the ocean alex (Mar 08)
- RE: 923Mbits/s across the ocean E.B. Dreger (Mar 08)
- RE: 923Mbits/s across the ocean Cottrell, Les (Mar 08)
- Re: 923Mbits/s across the ocean Joe St Sauver (Mar 08)
- Re: 923Mbits/s across the ocean Iljitsch van Beijnum (Mar 09)
- Re: 923Mbits/s across the ocean David G. Andersen (Mar 09)
- Re: 923Mbits/s across the ocean Iljitsch van Beijnum (Mar 09)
- RE: 923Mbits/s across the ocean Cottrell, Les (Mar 08)
- RE: 923Mbits/s across the ocean Cottrell, Les (Mar 09)
- Re: 923Mbits/s across the ocean Richard A Steenbergen (Mar 09)