From nobody@FreeBSD.org  Wed Nov 19 00:50:29 2008
Return-Path: <nobody@FreeBSD.org>
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 1AAAA1065670
	for <freebsd-gnats-submit@FreeBSD.org>; Wed, 19 Nov 2008 00:50:29 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (www.freebsd.org [IPv6:2001:4f8:fff6::21])
	by mx1.freebsd.org (Postfix) with ESMTP id 037E88FC12
	for <freebsd-gnats-submit@FreeBSD.org>; Wed, 19 Nov 2008 00:50:29 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (localhost [127.0.0.1])
	by www.freebsd.org (8.14.3/8.14.3) with ESMTP id mAJ0oSnL069424
	for <freebsd-gnats-submit@FreeBSD.org>; Wed, 19 Nov 2008 00:50:28 GMT
	(envelope-from nobody@www.freebsd.org)
Received: (from nobody@localhost)
	by www.freebsd.org (8.14.3/8.14.3/Submit) id mAJ0oS5a069423;
	Wed, 19 Nov 2008 00:50:28 GMT
	(envelope-from nobody)
Message-Id: <200811190050.mAJ0oS5a069423@www.freebsd.org>
Date: Wed, 19 Nov 2008 00:50:28 GMT
From: Kumar Krishnamoorthy <kumark@vmware.com>
To: freebsd-gnats-submit@FreeBSD.org
Subject: FreeBSD 6.3 64-bit  panics at boot time during installation on HP DL580 G5 with 128GB physical memory
X-Send-Pr-Version: www-3.1
X-GNATS-Notify:

>Number:         128978
>Category:       amd64
>Synopsis:       [install] FreeBSD 6.3 64-bit  panics at boot time during installation on HP DL580 G5 with 128GB physical memory
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    freebsd-amd64
>State:          closed
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Wed Nov 19 01:00:14 UTC 2008
>Closed-Date:    Sun Dec 05 11:47:31 UTC 2010
>Last-Modified:  Sun Dec 05 11:47:31 UTC 2010
>Originator:     Kumar Krishnamoorthy
>Release:        FreeBSD 6.3 64-bit GA
>Organization:
VMare Inc
>Environment:
NA
>Description:
When I try to install freeBSD-64 6.3 GA on a system with 128GB physical memory, it reports  kmem_suballoc : bad status retirn of 3
panic : kmem_suballoc 

When I read the faq from freebsd site, it mentions that the 64-bit version would support systems upto 1TB of physical memory.

Server used 
-----------
Server Model              : HP ProLoant DL580 G5 
Physical memory installed : 128 GB Installed
ProLiant System BIOS      : P61 (08/08/2007)
CPU                       : 
Proc 1: Quad-Core Intel(R) Xeon(TM) Processor (2.40 GHz/1066 MHz, 2x4MB L2)
Proc 2: Quad-Core Intel(R) Xeon(TM) Processor (2.40 GHz/1066 MHz, 2x4MB L2)
Proc 3: Quad-Core Intel(R) Xeon(TM) Processor (2.40 GHz/1066 MHz, 2x4MB L2)
Proc 4: Quad-Core Intel(R) Xeon(TM) Processor (2.40 GHz/1066 MHz, 2x4MB L2)

Failure details.
-----------------
ISO used for installation
6.3-RELEASE-amd64-disc1.iso
.
.
Attempting Boot From CD-ROM
CD Loader 1.2

Building the boot loader arguments
Looking up /BOOT/LOADER... Found
Relocating the loader and the BTX
Starting the BTX loader


Consoles: internal video/keyboard
BIOS CD is cd0
BIOS drive A: is disk0
BIOS drive C: is disk1
BIOS 637kB/3404056kB available memory

FreeBSD/i386 bootstrap loader, Revision 1.1
(root@palmer.cse.buffalo.edu, Tue Jan 15 23:20:25 UTC 2008)
Loading /boot/defaults/loader.conf
/boot/kernel/kernel text=0x6b30f8 syms=[0x8+0xa10a0+0x8+0x8
8855]


+-----------------------------------------+
 |                                         |
 |                                         |      ______
 |                                         |     |  ____| __ ___  ___
 |          Welcome to FreeBSD!            |     | |__ | '__/ _ \/ _ \
 |                                         |     |  __|| | |  __/  __/
 |                                         |     | |   | | |    |    |
 |  1. Boot FreeBSD [default]              |     |_|   |_|  \___|\___|
 |  2. Boot FreeBSD with ACPI disabled     |      ____   _____ _____
 |  3. Boot FreeBSD in Safe Mode           |     |  _ \ / ____|  __ \
 |  4. Boot FreeBSD in single user mode    |     | |_) | (___ | |  | |
 |  5. Boot FreeBSD with verbose logging   |     |  _ < \___ \| |  | |
 |  6. Escape to loader prompt             |     | |_) |____) | |__| |
 |  7. Reboot                              |     |     |      |      |
 |                                         |     |____/|_____/|_____/
 |                                         |
 |                                         |
 |                                         |
 |  Select option, [Enter] for default     |
 |  or [Space] to pause timer  8           |
 +-----------------------------------------+


FreeBSD 6.3-RELEASE #0: Wed Jan 16 01:31:10 UTC 2008
  root@palmet.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC
kmem_suballoc : bad status retirn of 3
panic : kmem_suballoc
Uptime: 1s




Note : I tried the following things.
a) freeBSD7.0-64 did not panic while installation
b) freeBSD6.3-64 could boot without any problems till 90GB memory on a virtual machine created on ESX40 



Let me know if you need more details for debugging.

>How-To-Repeat:
Try to install freeBSD6.3-64 on a physical machine with 128GB of physical memory
>Fix:


>Release-Note:
>Audit-Trail:
State-Changed-From-To: open->feedback 
State-Changed-By: gavin 
State-Changed-When: Fri Nov 21 11:47:42 UTC 2008 
State-Changed-Why:  
To submitter: are you able to boot using the "verbose logging" option 
from the menu and show any additional messages you see?  I'm especially 
interested in any lines beginning with SMAP. 

Can I just confirm that 7.0 works fine on this machine? 


http://www.freebsd.org/cgi/query-pr.cgi?pr=128978 

From: Kumar Krishnamoorthy <kumark@vmware.com>
To: "bug-followup@FreeBSD.org" <bug-followup@FreeBSD.org>, Kumar
 Krishnamoorthy <kumark@vmware.com>
Cc:  
Subject: Re: amd64/128978: [install] FreeBSD 6.3 64-bit  panics at boot time
 during installation on HP DL580 G5 with 128GB physical memory
Date: Sun, 7 Dec 2008 00:50:55 -0800

 --_000_7A7D327E99D30143AC98BDABFCABFF012271549D65PAEXMBX04vmwa_
 Content-Type: text/plain; charset="us-ascii"
 Content-Transfer-Encoding: quoted-printable
 
 This is from freeBSD6.4 64 GA
 SMAP type=3D01 base=3D0000000000000000   len 000000000009f800
 SMAP type=3D02 base=3D000000000009f800    len 0000000000000800
 SMAP type=3D02 base=3D00000000000ca000   len 0000000000002000
 SMAP type=3D02 base=3D00000000000dc000   len 0000000000004000
 SMAP type=3D02 base=3D00000000000e4000   len 000000000001c000
 SMAP type=3D01 base=3D0000000000100000   len 00000000bfdf0000
 SMAP type=3D03 base=3D00000000bfef0000     len 000000000000f000
 SMAP type=3D04 base=3D00000000bfeff000      len 0000000000001000
 SMAP type=3D01 base=3D00000000bff00000     len 0000000000100000
 SMAP type=3D02 base=3D00000000e0000000   len 0000000010000000
 SMAP type=3D02 base=3D00000000fec00000    len 0000000000010000
 SMAP type=3D02 base=3D00000000fee00000    len 0000000000001000
 SMAP type=3D02 base=3D00000000fffe0000      len 0000000000020000
 SMAP type=3D01 base=3D0000000100000000   len 0000001f40000000
 
 I could not reproduce this on freeBSD7.0 GA. It boots well without any issu=
 es.
 
 -Kumar
 
 --_000_7A7D327E99D30143AC98BDABFCABFF012271549D65PAEXMBX04vmwa_--

From: Kumar Krishnamoorthy <kumark@vmware.com>
To: "bug-followup@FreeBSD.org" <bug-followup@FreeBSD.org>, Kumar
 Krishnamoorthy <kumark@vmware.com>
Cc:  
Subject: Re: amd64/128978: [install] FreeBSD 6.3 64-bit  panics at boot time
 during installation on HP DL580 G5 with 128GB physical memory
Date: Sun, 7 Dec 2008 23:50:40 -0800

 --_000_7A7D327E99D30143AC98BDABFCABFF012271549D98PAEXMBX04vmwa_
 Content-Type: text/plain; charset="us-ascii"
 Content-Transfer-Encoding: quoted-printable
 
 I could see the failure on all freebsd6.x-64 with more than 64GB of memory.=
   I ran this test on virtual machine that was created on the same HP DL580 =
 G5 server with 128GB server.
 Failures
   7 FAIL Duration=3D15m29s guestOS=3Dfreebsd6.2-64           memSize=3D1310=
 72
   8 FAIL Duration=3D15m35s guestOS=3Dfreebsd6.3-64           memSize=3D1310=
 72
   9 FAIL Duration=3D15m33s guestOS=3Dfreebsd6.4-beta1-64 memSize=3D131072
  10 FAIL Duration=3D15m32s guestOS=3Dfreebsd6.4-rc1-64    memSize=3D131072
  11 FAIL Duration=3D15m32s guestOS=3Dfreebsd6.4-rc2-64    memSize=3D131072
 Passed
   0 PASS Duration=3D46m53s guestOS=3Dfreebsd6.2-64          memSize=3D65536
   1 PASS Duration=3D52m48s guestOS=3Dfreebsd6.3-64          memSize=3D65536
   3 PASS Duration=3D23m14s guestOS=3Dfreebsd6.4-rc1-64    memSize=3D65536
   4 PASS Duration=3D23m20s guestOS=3Dfreebsd6.4-rc2-64    memSize=3D65536 .=
 .
 memSize - Guest memory that was used for the test in MB.
 Duration  -  Time it tool to install the guestOS.
 
From: Kumar Krishnamoorthy <kumark@vmware.com>
To: "bug-followup@FreeBSD.org" <bug-followup@FreeBSD.org>
Date: Sun, 7 Dec 2008 00:05:49 -0800
Subject: Re: amd64/128978: [install] FreeBSD 6.3 64-bit panics at boot time during installation on HP DL580 G5 with 128GB physical memory
 
 Please see the following for details on more logging:
 
 http://people.freebsd.org/~linimon/tmp/freebsd-panic.bmp
 
 I did not see this on freeBSD7.0-64 GA.
 
 Kumar
State-Changed-From-To: feedback->open 
State-Changed-By: gavin 
State-Changed-When: Thu Aug 27 14:51:32 UTC 2009 
State-Changed-Why:  
Feedback was received on this some time ago.  Although FreeBSD 7 is happy 
with 128G RAM, FreeBSD 6.x cannot boot.  I don't know if setting something like 
'options KVA_PAGES=512' in the kernel may help?  It might be worth trying. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=128978 
State-Changed-From-To: open->closed 
State-Changed-By: avg 
State-Changed-When: Sun Dec 5 11:46:40 UTC 2010 
State-Changed-Why:  
6.4 and the whole 6 branch has been EoL-ed, so I guess 
there will be no fixing there. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=128978 
>Unformatted:
