From nobody@FreeBSD.org  Mon Mar  5 18:17:37 2007
Return-Path: <nobody@FreeBSD.org>
Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52])
	by hub.freebsd.org (Postfix) with ESMTP id EBA0716A400
	for <freebsd-gnats-submit@FreeBSD.org>; Mon,  5 Mar 2007 18:17:37 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (www.freebsd.org [69.147.83.33])
	by mx1.freebsd.org (Postfix) with ESMTP id DC9CF13C494
	for <freebsd-gnats-submit@FreeBSD.org>; Mon,  5 Mar 2007 18:17:37 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (localhost [127.0.0.1])
	by www.freebsd.org (8.13.1/8.13.1) with ESMTP id l25IHbil050650
	for <freebsd-gnats-submit@FreeBSD.org>; Mon, 5 Mar 2007 18:17:37 GMT
	(envelope-from nobody@www.freebsd.org)
Received: (from nobody@localhost)
	by www.freebsd.org (8.13.1/8.13.1/Submit) id l25IHbe0050649;
	Mon, 5 Mar 2007 18:17:37 GMT
	(envelope-from nobody)
Message-Id: <200703051817.l25IHbe0050649@www.freebsd.org>
Date: Mon, 5 Mar 2007 18:17:37 GMT
From: Ludger Bolmerg<lbolmerg@web.de>
To: freebsd-gnats-submit@FreeBSD.org
Subject: SMP kernel performance problem on FSC TX600
X-Send-Pr-Version: www-3.0

>Number:         109936
>Category:       kern
>Synopsis:       [smp] SMP kernel performance problem on FSC TX600
>Confidential:   no
>Severity:       serious
>Priority:       high
>Responsible:    freebsd-bugs
>State:          closed
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Mon Mar 05 18:20:03 GMT 2007
>Closed-Date:    Sat Sep 24 20:41:24 UTC 2011
>Last-Modified:  Sat Sep 24 20:41:24 UTC 2011
>Originator:     Ludger Bolmerg
>Release:        6.2
>Organization:
>Environment:
FreeBSD bsd60.myname.de 6.2-RELEASE-p2 FreeBSD 6.2-RELEASE-p2 #1
>Description:
I installed FreeBSD 6.2 on a Fujitsu Siemens TX600 S3 with 2 dual core
Xeon processors and 4G RAM.

Here is the link to the data sheet of the server on Fujitsu-Siemens' Web
page.  It may be helpful

http://extranet.fujitsu-siemens.com/vil/pc/vil/primergy/model_line_400/rack_server/ds_prim-rx600-s3.pdf

The SMP kernel is awfully slow.  make buildkernel takes about 6 hours
to complete.  When I boot a UP kernel the build completes within 12
minutes.  I don't see any unusual message in any log file.

Booting the SMP kernel with kern.smp.disabled=1 shows good performance values.

When booting the SMP kernel with 

hint.lapic.10.disabled=1
hint.lapic.12.disabled=1
hint.lapic.14.disabled=1

also results in good performance.  Disabling single CPUs didn't work.
I had to apply a patch provided by John Baldwin.
http://lists.freebsd.org/pipermail/freebsd-smp/2007-February/001320.html

Disabling all but one CPU also gives good performance. As soon as the second CPU gets enabled it becomes slow again.



>How-To-Repeat:
Install on same hardware
>Fix:

>Release-Note:
>Audit-Trail:

From: Remko Lodder <remko@FreeBSD.org>
To: Ludger Bolmerg <lbolmerg@web.de>
Cc: freebsd-gnats-submit@FreeBSD.org
Subject: Re: kern/109936: SMP kernel performance problem on FSC TX600
Date: Mon, 05 Mar 2007 20:07:02 +0100

 Can you tell us what your kernel configuration is?
 What kind of scheduler do you use etc..
 
 Thanks!
 
 -- 
 Kind regards,
 
       Remko Lodder               ** remko@elvandar.org
       FreeBSD                    ** remko@FreeBSD.org
 
       /* Quis custodiet ipsos custodes */

From: lbolmerg@web.de
To: remko@FreeBSD.org
Cc: freebsd-gnats-submit@FreeBSD.org
Subject: Re: kern/109936: SMP kernel performance problem on FSC TX600
Date: Tue, 06 Mar 2007 09:40:48 +0100

 I used the kernel installed from CD.  I also tried GENERIC with a few chan=
 ges.  Scheduler used is 4BSD
 
 #diff MYSMP GENERIC
 22,23c22,23
 < #cpu          I486=5FCPU
 < #cpu          I586=5FCPU
 ---
 > cpu           I486=5FCPU
 > cpu           I586=5FCPU
 25,42c25
 < ident         MYSMP
 <=20
 < # maxusers        256
 <=20
 < # min(max(VM=5FKMEM=5FSIZE, Physical memory/VM=5FKMEM=5FSIZE=5FSCALE), VM=5FKMEM=5FSIZ=
 E=5FMAX)=20
 < # is the total KVA space allocated for
 < # kmem=5Fmap. E.g. used by Soft Updates.
 < # For large memory machines (> 1GB RAM) VM=5FKMEM=5FSIZE=5FMAX should
 < # be set to at least 400M.
 < #options        VM=5FKMEM=5FSIZE=3D(12*1024*1024)             # 12 MB
 < #options        VM=5FKMEM=5FSIZE=5FMAX=3D(200*1024*1024)        # 200 MB
 < #options        VM=5FKMEM=5FSIZE=5FSCALE=3D(3)                  # 1/3 RAM
 < options         VM=5FKMEM=5FSIZE=5FMAX=3D(400*1024*1024)        # 400 MB
 <=20
 < options         SMP
 <=20
 < device          acpi=5Ffujitsu
 <=20
 ---
 > ident         GENERIC
 
 It may also be interesting that 6.1 showed the same behaviour.  6.0 boots
 from CD but hangs completely on the first sysinstall screen.
 
 Best regards,
 Ludger Bolmerg
 
 

From: Ludger Bolmerg <lbolmerg@web.de>
To: remko@freebsd.org
Cc: freebsd-gnats-submit@freebsd.org
Subject: Re: kern/109936: SMP kernel performance problem on FSC TX600
Date: Tue, 06 Mar 2007 20:18:51 +0100

 Here is some more information that may be interesting.  I ran the Linux 
 firmware kit from http://www.linuxfirmwarekit.org/ and got the following 
 results:
 
 - the CPUs have version 8 microcode, the tool reports this to be 
 outdated, version 9 seems to be available
 
 - Fail: HPET configuration test: failed to locate HPET base
 
 - Fail: MTRR validation gives the following output
 Memory range 0x0 to 0x9fbff (System RAM) has incorrect attribute default
 Memory range 0x0 to 0x9fbff (System RAM) is lacking attribute write-back
 Memory range 0x100000 to 0xbf891fff (System RAM) has incorrect attribute 
 default
 Memory range 0x100000 to 0xbf891fff (System RAM) is lacking attribute 
 write-back
 Memory range 0xbf912000 to 0xbf941fff (System RAM) has incorrect 
 attribute default
 Memory range 0xbf912000 to 0xbf941fff (System RAM) is lacking attribute 
 write-back
 Memory range 0xbfa12000 to 0xbfa6afff (System RAM) has incorrect 
 attribute default
 Memory range 0xbfa12000 to 0xbfa6afff (System RAM) is lacking attribute 
 write-back
 Memory range 0xbfa92000 to 0xbfb05fff (System RAM) has incorrect 
 attribute default
 Memory range 0xbfa92000 to 0xbfb05fff (System RAM) is lacking attribute 
 write-back
 Memory range 0xbfb12000 to 0xbfb1ffff (System RAM) has incorrect 
 attribute default
 Memory range 0xbfb12000 to 0xbfb1ffff (System RAM) is lacking attribute 
 write-back
 Memory range 0xbfb33000 to 0xbfb79fff (System RAM) has incorrect 
 attribute default
 0Memory range xbfb33000 to 0xbfb79fff (System RAM) is lacking attribute 
 write-back
 Memory range xbfbfa000 to 0xbfbfffff (System RAM) has incorrect 
 attribute default
 Memory range 0xbfbfa000 to 0xbfbfffff (System RAM) is lacking attribute 
 write-back
 Memory range 0xd0000000 to 0xd7ffffff (0000:11:00.0) has incorrect 
 attribute uncached
 Memory range 0xe3000000 to 0xe300ffff (000:0f:0e.0) has incorrect 
 attribute uncached
 
 - Fail: MCFG PCI Express* memory mapped config space
 E820: MCFG mmio config space at 0xc0000000 is not reserved in ..
 detailed list of E820 memory layout follows (12 lines) 5 memory ranges 
 are marked as 'OS used ram', 5 ranges are marked as 'reserved', 2 ranges 
 are marked as 'ACPI use'
 
 - Fail: General ACPI information
 PCI Express port driver reports an invalid IRQ  (multiple lines same output)
 _PSD domain information is corrupt (multiple lines same output)
 
 I don't know if this is of any value. Thought it might be.
 
 Ludger Bolmerg
State-Changed-From-To: open->feedback 
State-Changed-By: jh 
State-Changed-When: Fri Sep 23 19:36:00 UTC 2011 
State-Changed-Why:  
Can you still reproduce this on recent FreeBSD versions? 

http://www.freebsd.org/cgi/query-pr.cgi?pr=109936 
State-Changed-From-To: feedback->closed 
State-Changed-By: jh 
State-Changed-When: Sat Sep 24 20:41:23 UTC 2011 
State-Changed-Why:  
Submitter doesn't have access to the hardware anymore. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=109936 
>Unformatted:
