From test@vpn-test.uib.no  Mon Apr  7 08:57:28 2003
Return-Path: <test@vpn-test.uib.no>
Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125])
	by hub.freebsd.org (Postfix) with ESMTP id F23A137B401
	for <FreeBSD-gnats-submit@freebsd.org>; Mon,  7 Apr 2003 08:57:27 -0700 (PDT)
Received: from vpn-test.uib.no (vpn-test.uib.no [129.177.23.36])
	by mx1.FreeBSD.org (Postfix) with ESMTP id F178543F85
	for <FreeBSD-gnats-submit@freebsd.org>; Mon,  7 Apr 2003 08:57:26 -0700 (PDT)
	(envelope-from test@vpn-test.uib.no)
Received: from vpn-test.uib.no (localhost [127.0.0.1])
	by vpn-test.uib.no (8.12.9/8.12.9) with ESMTP id h37Fuxud000354
	for <FreeBSD-gnats-submit@freebsd.org>; Mon, 7 Apr 2003 17:56:59 +0200 (CEST)
	(envelope-from test@vpn-test.uib.no)
Received: (from root@localhost)
	by vpn-test.uib.no (8.12.9/8.12.9/Submit) id h37Fuxab000353;
	Mon, 7 Apr 2003 17:56:59 +0200 (CEST)
Message-Id: <200304071556.h37Fuxab000353@vpn-test.uib.no>
Date: Mon, 7 Apr 2003 17:56:59 +0200 (CEST)
From: roar.pettersen@it.uib.no
Reply-To: roar.pettersen@it.uib.no
To: FreeBSD-gnats-submit@freebsd.org
Cc:
Subject:
X-Send-Pr-Version: 3.113
X-GNATS-Notify:

>Number:         50683
>Category:       kern
>Synopsis:       fxp broken
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    jhb
>State:          closed
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Mon Apr 07 09:00:28 PDT 2003
>Closed-Date:    Mon Jan 12 12:18:47 PST 2004
>Last-Modified:  Mon Jan 12 12:18:47 PST 2004
>Originator:     Roar Pettersen
>Release:        FreeBSD 4.8-STABLE i386
>Organization:
University of Bergen 
>Environment:
System: FreeBSD vpn-test.uib.no 4.8-STABLE FreeBSD 4.8-STABLE #7: Sun Apr 6 21:14:06 CEST 2003 root@vpn-test.uib.no:/usr/obj/usr/src/sys/VPN-GW i386


	
>Description:
"fxp2 : device timeout", "fxp3 : device timeout".Both fxp2 & fxp3 doesn't work.

Hardware is a Compaq ProLiant DL380 with dual Intel(R) Pentium(R) III CPU - S 1400MHz
two fxp interfaces are on the motherboard, two fxp interfaces are on a pci card.
The two on the pci card is the problem.

BIOS info :

4.04 P24-11/15/2002
 13 Mar 03

pciconf -lv :

fxp0@pci0:2:0:  class=0x020000 card=0xb1340e11 chip=0x12298086 rev=0x08 hdr=0x00
    vendor   = 'Intel Corporation'
    device   = '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter'
    class    = network
    subclass = ethernet
fxp1@pci0:4:0:  class=0x020000 card=0xb1340e11 chip=0x12298086 rev=0x08 hdr=0x00
    vendor   = 'Intel Corporation'
    device   = '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter'
    class    = network
    subclass = ethernet
fxp2@pci8:4:0:  class=0x020000 card=0x10f08086 chip=0x12298086 rev=0x05 hdr=0x00
    vendor   = 'Intel Corporation'
    device   = '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter'
    class    = network
    subclass = ethernet
fxp3@pci8:5:0:  class=0x020000 card=0x10f08086 chip=0x12298086 rev=0x05 hdr=0x00
    vendor   = 'Intel Corporation'
    device   = '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter'
    class    = network
    subclass = ethernet

	
>How-To-Repeat:
Compile kernel with SMP.
	
>Fix:
Compile kernel without SMP.

	


>Release-Note:
>Audit-Trail:
Responsible-Changed-From-To: gnats-admin->freebsd-bugs 
Responsible-Changed-By: ceri 
Responsible-Changed-When: Fri Apr 11 12:59:51 PDT 2003 
Responsible-Changed-Why:  
Reassign misfiled PR. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=50683 
State-Changed-From-To: open->feedback 
State-Changed-By: ceri 
State-Changed-When: Fri Apr 11 13:01:14 PDT 2003 
State-Changed-Why:  
I believe this was a known issue which was fixed recently; can you duplicate 
this with a recent kernel ? 

http://www.freebsd.org/cgi/query-pr.cgi?pr=50683 
State-Changed-From-To: feedback->open 
State-Changed-By: ceri 
State-Changed-When: Fri Apr 11 14:04:25 PDT 2003 
State-Changed-Why:  
Response received from originator: 

On Fri, Apr 11, 2003 at 10:55:11PM +0200, Roar Pettersen wrote: 
> Hello ! 
> 
> >I believe this was a known issue which was fixed recently; can you 
> >duplicate this with a recent kernel ? 
> 
> I csvup'ed the source tree today and build a new kernel with 
> smp support, I still have the same problem with 
> the fxp2 & fxp3 interfaves. 
> 
> Please read my e-mail sent today to smp e-mail list. 
> 
> 
> 
> -- 
> Med vennlig hilsen / Regards; 
> 
>   Roar Pettersen 
>   Universitetet i Bergen -  The University of Bergen 
>   Nygardsgt. 5  -  N-5020 BERGEN  - Norway 
>   Tlf: +47 55 58 40 55  VIP: 81503  fax: +47 55 58 40 70 
>   roar.pettersen@it.uib.no - IT-Avd, UiB - http://www.uib.no 

http://www.freebsd.org/cgi/query-pr.cgi?pr=50683 

From: "Dominik Brettnacher" <dominik.brettnacher@teresto.net>
To: freebsd-gnats-submit@FreeBSD.org, roar.pettersen@it.uib.no
Cc:  
Subject: Re: kern/50683: fxp broken
Date: Tue, 22 Jul 2003 18:47:26 +0200

 I have the same problems on an SMP-machine with two fxp cards: it works
 for a few days without a flaw, then more or less suddenly, the kernel says
 fxp{0,1}: device timeout. Only a reboot helps to reanimate the NIC:
 
 Copyright (c) 1992-2003 The FreeBSD Project.
 Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
 	The Regents of the University of California. All rights reserved.
 FreeBSD 4.8-RELEASE #0: Sat May 17 21:59:26 CEST 2003
     domi@rennix.teresto.net:/usr/src/sys/compile/RENNIX
 Timecounter "i8254"  frequency 1193182 Hz
 CPU: Intel Pentium III (730.80-MHz 686-class CPU)
   Origin = "GenuineIntel"  Id = 0x683  Stepping = 3
  
 Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
 real memory  = 1610547200 (1572800K bytes)
 avail memory = 1561874432 (1525268K bytes)
 Programming 24 pins in IOAPIC #0
 IOAPIC #0 intpin 2 -> irq 0
 FreeBSD/SMP: Multiprocessor motherboard
  cpu0 (BSP): apic id:  0, version: 0x00040011, at 0xfee00000
  cpu1 (AP):  apic id:  1, version: 0x00040011, at 0xfee00000
  io0 (APIC): apic id:  2, version: 0x00170011, at 0xfec00000
 Preloaded elf kernel "kernel" at 0xc0521000.
 Pentium Pro MTRR support enabled
 md0: Malloc disk
 Using $PIR table, 8 entries at 0xc00f7220
 npx0: <math processor> on motherboard
 npx0: INT 16 interface
 pcib0: <Host to PCI bridge> on motherboard
 IOAPIC #0 intpin 18 -> irq 2
 IOAPIC #0 intpin 17 -> irq 16
 pci0: <PCI bus> on pcib0
 agp0: <VIA 82C691 (Apollo Pro) host to PCI bridge> mem
 0xe0000000-0xe07fffff at device 0.0 on pci0
 pcib1: <VIA 82C598MVP (Apollo MVP3) PCI-PCI (AGP) bridge> at device 1.0 on
 pci0
 IOAPIC #0 intpin 16 -> irq 17
 pci1: <PCI bus> on pcib1
 pci1: <ATI Mobility-1 graphics accelerator> at 0.0 irq 17
 isab0: <VIA 82C686 PCI-ISA bridge> at device 7.0 on pci0
 isa0: <ISA bus> on isab0
 atapci0: <VIA 82C686 ATA66 controller> port 0xffa0-0xffaf at device 7.1 on
 pci0
 ata0: at 0x1f0 irq 14 on atapci0
 ata1: at 0x170 irq 15 on atapci0
 pci0: <unknown card> (vendor=0x1106, dev=0x3057) at 7.4
 fxp0: <Intel Pro 10/100B/100+ Ethernet> port 0xd800-0xd83f mem
 0xdffc0000-0xdffdffff,0xdfffe000-0xdfffefff irq 2 at device 10.0 on pci0
 fxp0: Ethernet address 00:02:b3:27:37:22
 inphy0: <i82555 10/100 media interface> on miibus0
 inphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
 fxp1: <Intel Pro 10/100B/100+ Ethernet> port 0xdc00-0xdc3f mem
 0xdfe00000-0xdfefffff,0xdffff000-0xdfffffff irq 16 at device 13.0 on pci0
 fxp1: Ethernet address 00:90:27:50:2d:f2
 inphy1: <i82555 10/100 media interface> on miibus1
 inphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
 orm0: <Option ROMs> at iomem 0xc0000-0xcefff,0xcf000-0xcffff on isa0
 fdc0: <NEC 72065B or clone> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0
 fdc0: FIFO enabled, 8 bytes threshold
 fd0: <1440-KB 3.5" drive> on fdc0 drive 0
 atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
 atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
 kbd0 at atkbd0
 vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
 sc0: <System console> at flags 0x100 on isa0
 sc0: VGA <16 virtual consoles, flags=0x300>
 sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
 sio0: type 16550A
 sio1 at port 0x2f8-0x2ff irq 3 on isa0
 sio1: type 16550A
 ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
 ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
 ppc0: FIFO with 16/16/8 bytes threshold
 plip0: <PLIP network interface> on ppbus0
 lpt0: <Printer> on ppbus0
 lpt0: Interrupt-driven port
 ppi0: <Parallel I/O> on ppbus0
 APIC_IO: Testing 8254 interrupt delivery
 APIC_IO: routing 8254 via IOAPIC #0 intpin 2
 SMP: AP CPU #1 Launched!
 ad0: 117800MB <ASI ARAID99 1000 Ver1.00> [239340/16/63] at ata0-master
 UDMA66
 Mounting root from ufs:/dev/ad0s1a
 

From: Ari Suutari <ari@suutari.iki.fi>
To: freebsd-gnats-submit@FreeBSD.org, roar.pettersen@it.uib.no
Cc:  
Subject: Re: kern/50683: fxp broken
Date: Tue, 02 Sep 2003 19:33:26 +0300

 Same problem here. A machine, which has been running
 about 2 years without problem, had a second CPU installed
 and was upgraded to 4.8-RELEASE. Last night the machine
 started complaing 'fxp1: device timeout'. Taking device
 down & up did not help. After reboot the interface started
 working again. fxp1 is a card on pci slot.
 

From: Josef Pojsl <jp@tns.cz>
To: freebsd-gnats-submit@FreeBSD.org, freebsd-bugs@freebsd.org
Cc: roar.pettersen@it.uib.no
Subject: Re: kern/50683: fxp broken
Date: Wed, 19 Nov 2003 10:03:05 +0100

 Hello,
 
 this problem is still present in 4.9-RELEASE.
 I've got Intel motherboard, two Intel PRO/100(B) interfaces on board,
 they both work fine. Additional Intel PRO/100(B) dual cards
 do not work with SMP kernel; kernel complains "fxp[0123]: device timeout".
 I can either not ping at all or I receive 15 ping responses at once,
 then 15 seconds silence, then again 15 responses etc.
 Without SMP, everything is fine.
 
 I am able to provide more details if anyone is interested.
 
 With regards,
 --
 Josef
Responsible-Changed-From-To: freebsd-bugs->jhb 
Responsible-Changed-By: rwatson 
Responsible-Changed-When: Wed Nov 19 08:38:21 PST 2003 
Responsible-Changed-Why:  
Assign ownership to John; he likes interrupts and SMP. 


http://www.freebsd.org/cgi/query-pr.cgi?pr=50683 
State-Changed-From-To: open->feedback 
State-Changed-By: jhb 
State-Changed-When: Wed Nov 19 10:20:33 PST 2003 
State-Changed-Why:  
This is a known problem on 4.x and cannot be easily fixed.  This 
problem should be fixed in the upcoming 5.2 release.  The changes 
in 5.2 that fix this problem are too large to backport to 4.x. 

For ideas on how to fix, the submitter could attempt to hack the 
apic code to route PCI interrupts across bridges using the swizzle 
method for bridges not listed in the MP table. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=50683 

From: Ari Suutari <ari.suutari@syncrontech.com>
To: freebsd-gnats-submit@FreeBSD.org, roar.pettersen@it.uib.no
Cc:  
Subject: Re: kern/50683: fxp broken
Date: Mon, 12 Jan 2004 09:30:24 +0200

 My problem was solved by changing a setting in BIOS.
 This is a Intel Server motherboard (some years old), there
 was setting 'route pci interrupts via ioapic', turning
 it on solved the problem completely. The system
 has been running without any problems for
 several weeks.
 
    Ari S.
 
State-Changed-From-To: feedback->closed 
State-Changed-By: jhb 
State-Changed-When: Mon Jan 12 12:17:11 PST 2004 
State-Changed-Why:  
Problem can be fixed on 4.x by a BIOS setting on this particular motherboard. 
The problem should also be fixed in general in 5.2 release and later. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=50683 
>Unformatted:
