From nobody@FreeBSD.org  Tue Jun  8 10:25:05 2010
Return-Path: <nobody@FreeBSD.org>
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 6E5601065675
	for <freebsd-gnats-submit@FreeBSD.org>; Tue,  8 Jun 2010 10:25:05 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (www.freebsd.org [IPv6:2001:4f8:fff6::21])
	by mx1.freebsd.org (Postfix) with ESMTP id 5D7798FC0C
	for <freebsd-gnats-submit@FreeBSD.org>; Tue,  8 Jun 2010 10:25:05 +0000 (UTC)
Received: from www.freebsd.org (localhost [127.0.0.1])
	by www.freebsd.org (8.14.3/8.14.3) with ESMTP id o58AP5tO005769
	for <freebsd-gnats-submit@FreeBSD.org>; Tue, 8 Jun 2010 10:25:05 GMT
	(envelope-from nobody@www.freebsd.org)
Received: (from nobody@localhost)
	by www.freebsd.org (8.14.3/8.14.3/Submit) id o58AP4pB005768;
	Tue, 8 Jun 2010 10:25:04 GMT
	(envelope-from nobody)
Message-Id: <201006081025.o58AP4pB005768@www.freebsd.org>
Date: Tue, 8 Jun 2010 10:25:04 GMT
From: Alex Forencich <alex@alexforencich.com>
To: freebsd-gnats-submit@FreeBSD.org
Subject: nVidia MCP55 driver blocks IPMI LAN on load
X-Send-Pr-Version: www-3.1
X-GNATS-Notify:

>Number:         147684
>Category:       kern
>Synopsis:       [nfe] nVidia MCP55 driver blocks IPMI LAN on load
>Confidential:   no
>Severity:       serious
>Priority:       high
>Responsible:    yongari
>State:          suspended
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Tue Jun 08 10:30:02 UTC 2010
>Closed-Date:    
>Last-Modified:  Thu Jan 20 02:58:34 UTC 2011
>Originator:     Alex Forencich
>Release:        FreeBSD-8.0-STABLE
>Organization:
UCSD
>Environment:
FreeBSD shanghai.local 8.0-STABLE-201004 FreeBSD 8.0-STABLE-201004 #0: Mon Apr  5 15:59:06 UTC 2010     root@mason.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC  amd64
>Description:
Running on a dual AMD opteron system, Supermicro H8DME motherboard with
AOC-SIMLC IPMI card.  Card works fine when system is first powered, before
FreeBSD is allowed to start.  Also works fine under solaris, as the cards
were accessible when solaris was running on the system in question before
I decided to switch to FreeBSD.  As soon as FreeBSD starts, the IPMI card
is no longer accessible over the internal nVidia MCP55 NIC.  The card is
visible to ipmitool after FreeBSD starts, and it shows the IP address that
it should be responding to in the output of 'ipmitool lan print 1'.  Before
you ask, it is NOT an IP address conflict.  Since this bug renders the IPMI
card completely useless for all remote management procedures, I have marked
this bug CRITICAL and HIGH PRIORITY.  

I found a fix that looked promising that involved placing hw.bge.allow
asf in /boot/loader.conf, but that fix is only for broadcom (em) cards
and my card is an nvidia (nfe) card.  
>How-To-Repeat:
Plug in network and power, don't allow server to start, wait for IPMI card
to start.  Ping the card (success).  Log in to IPMI card over network.
Power on server via IPMI web interface or via front panel.  Once FreeBSD
starts, try connecting to IMPI card again - connection times out.  Pinging
the card now fails.  
>Fix:
None known at this time.  Only fix to get IPMI card accessible over network
again is to completely remove power from computer.  However, once FreeBSD
starts, the card is once again rendered utterly useless.  
>Release-Note:
>Audit-Trail:
Responsible-Changed-From-To: freebsd-bugs->freebsd-net 
Responsible-Changed-By: linimon 
Responsible-Changed-When: Wed Jun 9 00:19:24 UTC 2010 
Responsible-Changed-Why:  
Over to maintainer(s). 

http://www.freebsd.org/cgi/query-pr.cgi?pr=147684 
Responsible-Changed-From-To: freebsd-net->yongari 
Responsible-Changed-By: andre 
Responsible-Changed-When: Mon Aug 23 14:31:33 UTC 2010 
Responsible-Changed-Why:  
Over to expert 

http://www.freebsd.org/cgi/query-pr.cgi?pr=147684 
State-Changed-From-To: open->feedback 
State-Changed-By: yongari 
State-Changed-When: Mon Oct 25 23:31:27 UTC 2010 
State-Changed-Why:  
So far NVIDIA didn't release any data sheet for MCP controllers to 
open source developers. If you see SVN/CVS logs of nfe(4) how the 
driver was written you would be surprised with its history. The 
driver is fruit of many BSD developers hard work and came from 
numerous trial and errors. Ironically the driver is actually much 
more stable than vendor's broken binary blob. It's shame that 
NVIDIA still does not release data sheet for their controller. All 
major ethernet controller vendors opened it and they even actively 
maintain/support their driver. 

The IPMI is one of area that is not covered by nfe(4). It seems 
Linux has some support code but I'm not sure how well it works. If 
Linux can successfully use IPMI we can guess required register 
access patterns to make IPMI work MCP55. So would you boot off 
Linux LiveCD and see whether it works? If it works, I'm willing to 
start working on it. Because I don't have the hardware in question 
I need remote hardware access. Please see the following URL and let 
me know your opinions. 
http://people.freebsd.org/~yongari/remote_debugging.txt 

http://www.freebsd.org/cgi/query-pr.cgi?pr=147684 
State-Changed-From-To: feedback->suspended 
State-Changed-By: yongari 
State-Changed-When: Thu Jan 20 02:57:33 UTC 2011 
State-Changed-Why:  
Feedback timeout. 
Put it into suspended until I get access to the controller. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=147684 
>Unformatted:
