From nobody@FreeBSD.org  Wed May  3 13:18:57 2006
Return-Path: <nobody@FreeBSD.org>
Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125])
	by hub.freebsd.org (Postfix) with ESMTP id 9CF5016A402
	for <freebsd-gnats-submit@FreeBSD.org>; Wed,  3 May 2006 13:18:57 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (www.freebsd.org [216.136.204.117])
	by mx1.FreeBSD.org (Postfix) with ESMTP id 67B6A43D45
	for <freebsd-gnats-submit@FreeBSD.org>; Wed,  3 May 2006 13:18:57 +0000 (GMT)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (localhost [127.0.0.1])
	by www.freebsd.org (8.13.1/8.13.1) with ESMTP id k43DIvU8094064
	for <freebsd-gnats-submit@FreeBSD.org>; Wed, 3 May 2006 13:18:57 GMT
	(envelope-from nobody@www.freebsd.org)
Received: (from nobody@localhost)
	by www.freebsd.org (8.13.1/8.13.1/Submit) id k43DIvea094063;
	Wed, 3 May 2006 13:18:57 GMT
	(envelope-from nobody)
Message-Id: <200605031318.k43DIvea094063@www.freebsd.org>
Date: Wed, 3 May 2006 13:18:57 GMT
From: Frank Rosenbaum <fr@bytecamp.net>
To: freebsd-gnats-submit@FreeBSD.org
Subject: very low network throughput between networks on systems with more than one nic
X-Send-Pr-Version: www-2.3

>Number:         96715
>Category:       kern
>Synopsis:       [em] [fxp] low speed if speed/duplex set
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    remko
>State:          closed
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Wed May 03 13:20:15 GMT 2006
>Closed-Date:    Sat Jan 27 18:54:55 GMT 2007
>Last-Modified:  Sat Jan 27 18:54:55 GMT 2007
>Originator:     Frank Rosenbaum
>Release:        6.0-RELEASE-p6
>Organization:
>Environment:
FreeBSD housing56.bytecamp.net 6.0-RELEASE-p6 FreeBSD 6.0-RELEASE-p6 #1: Tue Apr  4 04:34:39 CEST 2006     root@housing56.bytecamp.net:/usr/obj/usr/src/sys/BC-TUNED  i386
>Description:
The problem is the very low network throughput between the networks on
systems with more than one nic. Five NICs are present in the system, two
of them "fxp" and the other three "em". Polling is on all NICs enabled.
We always set the connection type for each NIC in the /etc/rc.conf like
ifconfig_fxp0="inet ... netmask ... media 100baseTX mediaopt full-duplex
polling".

On a 100baseTX <full-duplex> connection we got 500 kilobytes per second as
maximum throughput and the throughput always decreased during the tests. It
does not matter if we use only fxp or em NICs for this test.
>How-To-Repeat:
Set up a system with more than 1 NIC. Set the connectiontype for all NICs
in the /etc/rc.conf on "media 100baseTX mediaopt full-duplex" or directly
with ifconfig, this should have the same effect.

Setup different networks on NICs and enable routing.

Now test the throughput between the networks.

It could be that only "fxp" and "em" NICs are affected, i do not have other
NICs to test.

But we reproduce this bug on a new machine running an new installed
RELENG 6_1 with four "fxp" NICs.
>Fix:
Delete the media and mediaopt options in the /etc/rc.conf so it looks like

ifconfig_fxp0="inet ... netmask ... polling"

Now the NICs use the autoselect function and ifconfig now say "media:
Ethernet autoselect (100baseTX <full-duplex>)"

After this we got the "normal" throughput with more then 10 megabytes per
second.
>Release-Note:
>Audit-Trail:
State-Changed-From-To: open->feedback 
State-Changed-By: remko 
State-Changed-When: Mon Dec 25 20:28:51 UTC 2006 
State-Changed-Why:  
hello, can you tell us what switch you are using? I use 
hardcoded if settings at work and I do not see the same 
behaviour there. The hardware on the other side might 
do strange things with the hardcoded assignment. 


Responsible-Changed-From-To: freebsd-bugs->remko 
Responsible-Changed-By: remko 
Responsible-Changed-When: Mon Dec 25 20:28:51 UTC 2006 
Responsible-Changed-Why:  
grab the pr for feedback tracing. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=96715 
State-Changed-From-To: feedback->closed 
State-Changed-By: remko 
State-Changed-When: Sat Jan 27 18:54:53 UTC 2007 
State-Changed-Why:  
feedback timeout 

http://www.freebsd.org/cgi/query-pr.cgi?pr=96715 
>Unformatted:
