From nobody@FreeBSD.org  Wed Mar 20 15:37:07 2013
Return-Path: <nobody@FreeBSD.org>
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1])
	by hub.freebsd.org (Postfix) with ESMTP id B568C723
	for <freebsd-gnats-submit@FreeBSD.org>; Wed, 20 Mar 2013 15:37:07 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from red.freebsd.org (red.freebsd.org [IPv6:2001:4f8:fff6::22])
	by mx1.freebsd.org (Postfix) with ESMTP id A7348F3C
	for <freebsd-gnats-submit@FreeBSD.org>; Wed, 20 Mar 2013 15:37:07 +0000 (UTC)
Received: from red.freebsd.org (localhost [127.0.0.1])
	by red.freebsd.org (8.14.5/8.14.5) with ESMTP id r2KFb6qh021714
	for <freebsd-gnats-submit@FreeBSD.org>; Wed, 20 Mar 2013 15:37:06 GMT
	(envelope-from nobody@red.freebsd.org)
Received: (from nobody@localhost)
	by red.freebsd.org (8.14.5/8.14.5/Submit) id r2KFb6V4021713;
	Wed, 20 Mar 2013 15:37:06 GMT
	(envelope-from nobody)
Message-Id: <201303201537.r2KFb6V4021713@red.freebsd.org>
Date: Wed, 20 Mar 2013 15:37:06 GMT
From: David Robertson <david@dr.eclipse.co.uk>
To: freebsd-gnats-submit@FreeBSD.org
Subject: igb drops ethernet ports 2 and 3
X-Send-Pr-Version: www-3.1
X-GNATS-Notify:

>Number:         177139
>Category:       kern
>Synopsis:       [igb] igb drops ethernet ports 2 and 3
>Confidential:   no
>Severity:       non-critical
>Priority:       low
>Responsible:    freebsd-net
>State:          open
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Wed Mar 20 15:40:01 UTC 2013
>Closed-Date:    
>Last-Modified:  Thu Mar 21 17:50:00 UTC 2013
>Originator:     David Robertson
>Release:        9.1
>Organization:
>Environment:
9.1-RELEASE FreeBSD 9.1-RELEASE #0 r243825: Tue Dec  4 09:23:10 UTC 2012     root@farrell.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC  amd64
>Description:
We have two Dell servers which have an Intel I350 Gig 4 way network
cards.  Both servers drop igb2 and igb3 after a short time.  igb0 and
igb1 have so far been stable.  We are running the latest firmware from
Dell and driver version - 2.3.4.

Any help or advice on fixing this would be much appreciated.

Nothing is logged apart from the interface going down with status: no
carrier
>How-To-Repeat:
Configure igb2 and/or igb3 and wait.
>Fix:


>Release-Note:
>Audit-Trail:
Responsible-Changed-From-To: freebsd-amd64->freebsd-net 
Responsible-Changed-By: linimon 
Responsible-Changed-When: Thu Mar 21 00:04:05 UTC 2013 
Responsible-Changed-Why:  
Over to maintainer(s). 

http://www.freebsd.org/cgi/query-pr.cgi?pr=177139 

From: "Vogel, Jack" <jack.vogel@intel.com>
To: "bug-followup@FreeBSD.org" <bug-followup@FreeBSD.org>,
	"david@dr.eclipse.co.uk" <david@dr.eclipse.co.uk>
Cc:  
Subject: Re: kern/177139: [igb] igb drops ethernet ports 2 and 3
Date: Thu, 21 Mar 2013 00:17:03 +0000

 --_000_BC1B13FD0226B0479C795193AC1B25721CA94605ORSMSX108amrcor_
 Content-Type: text/plain; charset="us-ascii"
 Content-Transfer-Encoding: quoted-printable
 
 Please provide more details, are the ports described as 'dropped' just losi=
 ng link, or some other symptoms as well.  Also, is there any different in t=
 he link-partner between the sets of ports? Is the activity different, etc..=
 .
 
 Jack
 
 
 --_000_BC1B13FD0226B0479C795193AC1B25721CA94605ORSMSX108amrcor_
 Content-Type: text/html; charset="us-ascii"
 Content-Transfer-Encoding: quoted-printable
 
 <html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr=
 osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
 xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:=
 //www.w3.org/TR/REC-html40">
 <head>
 <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
 >
 <meta name=3D"Generator" content=3D"Microsoft Word 14 (filtered medium)">
 <style><!--
 /* Font Definitions */
 @font-face
 	{font-family:Calibri;
 	panose-1:2 15 5 2 2 2 4 3 2 4;}
 /* Style Definitions */
 p.MsoNormal, li.MsoNormal, div.MsoNormal
 	{margin:0in;
 	margin-bottom:.0001pt;
 	font-size:11.0pt;
 	font-family:"Calibri","sans-serif";}
 a:link, span.MsoHyperlink
 	{mso-style-priority:99;
 	color:blue;
 	text-decoration:underline;}
 a:visited, span.MsoHyperlinkFollowed
 	{mso-style-priority:99;
 	color:purple;
 	text-decoration:underline;}
 span.EmailStyle17
 	{mso-style-type:personal-compose;
 	font-family:"Calibri","sans-serif";
 	color:windowtext;}
 .MsoChpDefault
 	{mso-style-type:export-only;
 	font-family:"Calibri","sans-serif";}
 @page WordSection1
 	{size:8.5in 11.0in;
 	margin:1.0in 1.0in 1.0in 1.0in;}
 div.WordSection1
 	{page:WordSection1;}
 --></style><!--[if gte mso 9]><xml>
 <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
 </xml><![endif]--><!--[if gte mso 9]><xml>
 <o:shapelayout v:ext=3D"edit">
 <o:idmap v:ext=3D"edit" data=3D"1" />
 </o:shapelayout></xml><![endif]-->
 </head>
 <body lang=3D"EN-US" link=3D"blue" vlink=3D"purple">
 <div class=3D"WordSection1">
 <p class=3D"MsoNormal">Please provide more details, are the ports described=
  as &#8216;dropped&#8217; just losing link, or some other symptoms as well.=
 &nbsp; Also, is there any different in the link-partner between the sets of=
  ports? Is the activity different, etc&#8230;<o:p></o:p></p>
 <p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
 <p class=3D"MsoNormal">Jack<o:p></o:p></p>
 <p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
 </div>
 </body>
 </html>
 
 --_000_BC1B13FD0226B0479C795193AC1B25721CA94605ORSMSX108amrcor_--

From: david@dr.eclipse.co.uk
To: "Vogel Jack" <jack.vogel@intel.com>,
 bug-followup@FreeBSD.org
Cc:  
Subject: Re: kern/177139: [igb] igb drops ethernet ports 2 and 3
Date: Thu, 21 Mar 2013 11:02:49 +0000

 --=_839ebb776a4668cec96eeb4f50d4c37a
 Content-Type: text/plain; charset=UTF-8
 Content-Transfer-Encoding: quoted-printable
 
 =C2=A0=0A=0A Hi Jack,=0A=0AIn dmesg and /var/log/messages we see=0A=0Aig=
 b2: link state changed to UP=0Aigb2: link state changed to DOWN=0A=C2=A0=
 =0Aifconfig reports=0A=0A=C2=A0igb2: flags=3D8c02 metric 0 mtu 1500=0A=
 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 options=3D401bb=0A=C2=A0=C2=
 =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ether bc:30:5b:f6:12:de=0A=C2=A0=C2=A0=
 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 inet6 fe80::be30:5bff:fef6:12de%igb2 pref=
 ixlen 64=0Ascopeid 0x3=0A=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 inet=
  192.168.179.134 netmask 0xffffff00 broadcast=0A192.168.179.255=0A=C2=A0=
 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 nd6 options=3D29=0A=C2=A0=C2=A0=C2=
 =A0=C2=A0=C2=A0=C2=A0=C2=A0 media: Ethernet 1000baseT  (autoselect)=0A=
 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 status: no carrier=0A=0AThis=
  interface is being used exclusively for Postgresql database=0Areplicati=
 on from one server to another.=0ABoth servers do the same.=C2=A0 They ca=
 n stay up for anything from a few=0Aminutes to a few hours but always di=
 e.=0AOne major difference is that the two interfaces are connected with=
  a=0Acrossover (also tried straight through) cable.=0AThis is a configur=
 ation we have been using with great success for a=0Anumber of years with=
  broadcom adapters.=0AOpted for the Intel card on these servers as we ha=
 d trouble with the=0Alatest broadcom drivers. =0AI have tried disabling=
  msix as I read this could possibly help and=0Aalso tried disabling auto=
 select and manually configuring the=0Ainterfaces.=0ANone of these have h=
 elped.=C2=A0 igb0 and igb1 are connect to switches=0Aand have been stabl=
 e.=0ASo at the moment I have created a vlan on one of our switches and=
 =0Ahave plugged both servers into these vlan ports and they have=0Aremai=
 ned up over night.=0ACould it be that this network card does not like di=
 rect connections=0Aand is looking for a switch?=0A=0ADavid=0A=0A----- Or=
 iginal Message -----=0AFrom: "Vogel Jack" =0ATo:"bug-followup@FreeBSD.or=
 g" , "david@dr.eclipse.co.uk" =0ACc:=0ASent:Thu, 21 Mar 2013 00:17:03 +0=
 000=0ASubject:Re: kern/177139: [igb] igb drops ethernet ports 2 and 3=0A=
 =0A=09Please provide more details, are the ports described as=0A=E2=80=
 =98dropped=E2=80=99 just losing link, or some other symptoms as well.=C2=
 =A0=0AAlso, is there any different in the link-partner between the sets=
  of=0Aports? Is the activity different, etc=E2=80=A6=0A=0A=09=C2=A0=0A=
 =0A=09Jack=0A=0A=09=C2=A0=0A=0A=09
 
 --=_839ebb776a4668cec96eeb4f50d4c37a
 Content-Type: text/html; charset=UTF-8
 Content-Transfer-Encoding: quoted-printable
 
 <html><body>=C2=A0<br /><br />=09=09Hi Jack,<br /><br />In dmesg and /va=
 r/log/messages we see<br /><br />igb2: link state changed to UP<br />igb=
 2: link state changed to DOWN<br />=C2=A0<br />ifconfig reports<br /><br=
  />=C2=A0igb2: flags=3D8c02&lt;BROADCAST,OACTIVE,SIMPLEX,MULTICAST&gt; m=
 etric 0 mtu 1500<br />=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 options=
 =3D401bb&lt;RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,=
 TSO4,VLAN_HWTSO&gt;<br />=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ethe=
 r bc:30:5b:f6:12:de<br />=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 inet=
 6 fe80::be30:5bff:fef6:12de%igb2 prefixlen 64 scopeid 0x3<br />=C2=A0=C2=
 =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 inet 192.168.179.134 netmask 0xffffff0=
 0 broadcast 192.168.179.255<br />=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
 =A0 nd6 options=3D29&lt;PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL&gt;<br />=
 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 media: Ethernet 1000baseT &lt=
 ;full-duplex&gt; (autoselect)<br />=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
 =C2=A0 status: no carrier<br /><br />This interface is being used exclus=
 ively for Postgresql database replication from one server to another.<br=
  />Both servers do the same.=C2=A0 They can stay up for anything from a=
  few minutes to a few hours but always die.<br />One major difference is=
  that the two interfaces are connected with a crossover (also tried stra=
 ight through) cable.<br />This is a configuration we have been using wit=
 h great success for a number of years with broadcom adapters.<br />Opted=
  for the Intel card on these servers as we had trouble with the latest b=
 roadcom drivers. <br />I have tried disabling msix as I read this could=
  possibly help and also tried disabling autoselect and manually configur=
 ing the interfaces.<br />None of these have helped.=C2=A0 igb0 and igb1=
  are connect to switches and have been stable.<br />So at the moment I h=
 ave created a vlan on one of our switches and have plugged both servers=
  into these vlan ports and they have remained up over night.<br />Could=
  it be that this network card does not like direct connections and is lo=
 oking for a switch?<br /><br />David<br /><blockquote><br />----- Origin=
 al Message -----<br /><div style=3D"width:100%;background:rgb(228,228,22=
 8);"><div style=3D"font-weight:bold;">From:</div> "Vogel Jack" &lt;jack.=
 vogel@intel.com&gt;</div><br /><div style=3D"font-weight:bold;">To:</div=
 >"bug-followup@FreeBSD.org" &lt;bug-followup@FreeBSD.org&gt;, "david@dr.=
 eclipse.co.uk" &lt;david@dr.eclipse.co.uk&gt;<br /><div style=3D"font-we=
 ight:bold;">Cc:</div><br /><div style=3D"font-weight:bold;">Sent:</div>T=
 hu, 21 Mar 2013 00:17:03 +0000<br /><div style=3D"font-weight:bold;">Sub=
 ject:</div>Re: kern/177139: [igb] igb drops ethernet ports 2 and 3<br />=
 <br /><br /><div class=3D"WordSection1">=0A<p class=3D"MsoNormal">Please=
  provide more details, are the ports described as =E2=80=98dropped=E2=80=
 =99 just losing link, or some other symptoms as well.=C2=A0 Also, is the=
 re any different in the link-partner between the sets of ports? Is the a=
 ctivity different, etc=E2=80=A6</p><p></p><p></p>=0A<p class=3D"MsoNorma=
 l"></p><p>=C2=A0</p><p></p>=0A<p class=3D"MsoNormal">Jack</p><p></p><p><=
 /p>=0A<p class=3D"MsoNormal"></p><p>=C2=A0</p><p></p>=0A</div>=0A=0A=0A=
 =0A</blockquote></body></html>
 
 --=_839ebb776a4668cec96eeb4f50d4c37a--
 

From: Jack Vogel <jfvogel@gmail.com>
To: bug-followup@FreeBSD.org, david@dr.eclipse.co.uk
Cc:  
Subject: Re: kern/177139: [igb] igb drops ethernet ports 2 and 3
Date: Thu, 21 Mar 2013 10:04:14 -0700

 --20cf3078114c10128504d872541e
 Content-Type: text/plain; charset=ISO-8859-1
 
 So, when the igb ports are in the failing configuration what are they
 connected to specifically, what device/nic?
 
 There is no special procedure "looking for a switch", its just the autoneg
 between two devices, so maybe there
 is some compatibility issue. Also occurs to me that an interesting test
 would be to swap the two pair of devices
 and see if the problem follows the function or not, do you understand?
 
 Regards,
 
 Jack
 
 --20cf3078114c10128504d872541e
 Content-Type: text/html; charset=ISO-8859-1
 
 So, when the igb ports are in the failing configuration what are they connected to specifically, what device/nic?<br><br>There is no special procedure &quot;looking for a switch&quot;, its just the autoneg between two devices, so maybe there<br>
 is some compatibility issue. Also occurs to me that an interesting test would be to swap the two pair of devices<br>and see if the problem follows the function or not, do you understand?<br><br>Regards,<br><br>Jack<br><br>
 
 --20cf3078114c10128504d872541e--

From: david@dr.eclipse.co.uk
To: bug-followup@FreeBSD.org
Cc:  
Subject: Fwd: Re: kern/177139: [igb] igb drops ethernet ports 2 and 3
Date: Thu, 21 Mar 2013 17:31:57 +0000

 --=_0e01cef1795d0a99970a4500053df16b
 Content-Type: text/plain; charset=UTF-8
 Content-Transfer-Encoding: quoted-printable
 
 It is an Intel I350-t4 nic to a I350-t4 nic.=0AThe problem occurs at bot=
 h sides.=0ANot sure I follow your swap suggestion as both devices should=
  be=0Aidentical.=0A=0ADavid
 
 --=_0e01cef1795d0a99970a4500053df16b
 Content-Type: text/html; charset=UTF-8
 Content-Transfer-Encoding: quoted-printable
 
 <html><body>It is an Intel I350-t4 nic to a I350-t4 nic.<br />The proble=
 m occurs at both sides.<br />Not sure I follow your swap suggestion as b=
 oth devices should be identical.<br /><br />David</body></html>
 
 --=_0e01cef1795d0a99970a4500053df16b--
 
>Unformatted:
