From nobody@FreeBSD.org  Tue Apr 10 19:32:27 2007
Return-Path: <nobody@FreeBSD.org>
Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52])
	by hub.freebsd.org (Postfix) with ESMTP id A019616A400
	for <freebsd-gnats-submit@FreeBSD.org>; Tue, 10 Apr 2007 19:32:27 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (www.freebsd.org [69.147.83.33])
	by mx1.freebsd.org (Postfix) with ESMTP id 850E013C483
	for <freebsd-gnats-submit@FreeBSD.org>; Tue, 10 Apr 2007 19:32:27 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (localhost [127.0.0.1])
	by www.freebsd.org (8.13.1/8.13.1) with ESMTP id l3AJWRwF086992
	for <freebsd-gnats-submit@FreeBSD.org>; Tue, 10 Apr 2007 19:32:27 GMT
	(envelope-from nobody@www.freebsd.org)
Received: (from nobody@localhost)
	by www.freebsd.org (8.13.1/8.13.1/Submit) id l3AJRPCX085299;
	Tue, 10 Apr 2007 19:27:25 GMT
	(envelope-from nobody)
Message-Id: <200704101927.l3AJRPCX085299@www.freebsd.org>
Date: Tue, 10 Apr 2007 19:27:25 GMT
From: Michael Wayne<freebsd@wayne47.com>
To: freebsd-gnats-submit@FreeBSD.org
Subject: Panic on 6.2-RELEASE AMD in kern_mutex
X-Send-Pr-Version: www-3.0

>Number:         111458
>Category:       kern
>Synopsis:       [panic] Panic on 6.2-RELEASE AMD in kern_mutex
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    freebsd-bugs
>State:          closed
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Tue Apr 10 19:40:01 GMT 2007
>Closed-Date:    Thu Jul 26 06:52:18 GMT 2007
>Last-Modified:  Thu Jul 26 06:52:18 GMT 2007
>Originator:     Michael Wayne
>Release:        6.2 RELEASE-p2
>Organization:
Msen, Inc.
>Environment:
FreeBSD 6.2-RELEASE-p2 FreeBSD 6.2-RELEASE-p2
>Description:
uname:
   FreeBSD 6.2-RELEASE-p2 FreeBSD 6.2-RELEASE-p2

conf file:
   include GENERIC
   ident           MsenWeb
   options         QUOTA                   # Add quotas
   options         SMP                     # Support multiple processors
   makeoptions     DEBUG=-g


Console messages (via serial port):
   cpuid = 0; apic id = 00
   fault virtual address   = 0x18c
   fault code              = supervisor read, page not present
   instruction pointer     = 0x8:0xffffffff803eead7
   stack pointer           = 0x10:0xffffffffa54e9b60
   frame pointer           = 0x10:0x4
   code segment            = base 0x0, limit 0xfffff, type 0x1b
                           = DPL 0, pres 1, long 1, def32 0, gran 1
   processor eflags        = resume, IOPL = 0
   current process         = 5 (thread taskq)
   trap number             = 12
   panic: page fault
   cpuid = 0
   Uptime: 9d11h33m44s

info file:
   Dump header from device /dev/twed0s1b
     Architecture: amd64
     Architecture Version: 2
     Dump Length: 1073184768B (1023 MB)
     Blocksize: 512
     Dumptime: Thu Apr  5 15:41:03 2007
     Hostname: ww8.msen.com
     Magic: FreeBSD Kernel Dump
     Version String: FreeBSD 6.2-RELEASE-p2 #0: Wed Mar 14 09:38:47 EST 2007
       root@ww8.msen.com:/usr/obj/usr/src/sys/WW8
     Panic String: page fault
     Dump Parity: 2156304966
     Bounds: 13
     Dump Status: good

gdb:
   [GDB will not be able to debug user-mode threads: /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
   GNU gdb 6.1.1 [FreeBSD]
   Copyright 2004 Free Software Foundation, Inc.
   GDB is free software, covered by the GNU General Public License, and you are
   welcome to change it and/or distribute copies of it under certain conditions.
   Type "show copying" to see the conditions.
   There is absolutely no warranty for GDB.  Type "show warranty" for details.
   This GDB was configured as "amd64-marcel-freebsd".

   Unread portion of the kernel message buffer:
   kernel trap 12 with interrupts disabled


   Fatal trap 12: page fault while in kernel mode
   cpuid = 0; apic id = 00
   fault virtual address   = 0x18c
   fault code              = supervisor read, page not present
   instruction pointer     = 0x8:0xffffffff803eead7
   stack pointer           = 0x10:0xffffffffa54e9b60
   frame pointer           = 0x10:0x4
   code segment            = base 0x0, limit 0xfffff, type 0x1b
                           = DPL 0, pres 1, long 1, def32 0, gran 1
   processor eflags        = resume, IOPL = 0
   current process         = 5 (thread taskq)
   trap number             = 12
   panic: page fault
   cpuid = 0
   Uptime: 9d11h33m44s
   Dumping 1023 MB (2 chunks)
     chunk 0: 1MB (151 pages) ... ok
     chunk 1: 1023MB (261856 pages) 1007 991 975twe0: completion event for nonbusy command
    959 943 927 911 895 879 863 847 831 815 799 783 767 751 735 719 703 687 671 655 639 623 607 591 575 559 543 527 511 495 479 463 447 431 415 399 383 367 351 335 319 303 287 271 255 239 223 207 191
175 159 143 127 111 95 79 63 47 31 15

   #0  doadump () at pcpu.h:172
   172             __asm __volatile("movq %%gs:0,%0" : "=r" (td));
   (kgdb) list *0xffffffff803eead7
   0xffffffff803eead7 is in _mtx_lock_sleep (/usr/src/sys/kern/kern_mutex.c:548).
   543                      * If the current owner of the lock is executing on another
   544                      * CPU, spin instead of blocking.
   545                      */
   546                     owner = (struct thread *)(v & MTX_FLAGMASK);
   547     #ifdef ADAPTIVE_GIANT
   548                     if (TD_IS_RUNNING(owner)) {
   549     #else
   550                     if (m != &Giant && TD_IS_RUNNING(owner)) {
   551     #endif
   552                             turnstile_release(&m->mtx_object);
   (kgdb) backtrace
   #0  doadump () at pcpu.h:172
   #1  0x0000000000000004 in ?? ()
   #2  0xffffffff803f9067 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:409
   #3  0xffffffff803f9701 in panic (fmt=0xffffff003dbb6260 "\xb0\xc6\xbb=") at /usr/src/sys/kern/kern_shutdown.c:565
   #4  0xffffffff8061a1ef in trap_fatal (frame=0xffffff003dbb6260, eva=18446742975233640112) at /usr/src/sys/amd64/amd64/trap.c:660
   #5  0xffffffff8061a716 in trap (frame=
         {tf_rdi = 108, tf_rsi = -1098475937184, tf_rdx = 6, tf_rcx = 3221225730, tf_r8 = -1521574640, tf_r9 = -1098687417816, tf_rax = 1, tf_rbx = -1099181396776, tf_rbp = 4, tf_r10 = -2138022504, tf
_r11 = 0, tf_r12 = -1098475937184, tf_r13 = 4, tf_r14 = 1, tf_r15 = 20, tf_trapno = 12, tf_addr = 396, tf_flags = -1099181396776, tf_err = 0, tf_rip = -2143360297, tf_cs = 8, tf_rflags = 65538, tf_rsp
 = -1521575056, tf_ss = 16}) at /usr/src/sys/amd64/amd64/trap.c:238
   #6  0xffffffff806059ab in calltrap () at /usr/src/sys/amd64/amd64/exception.S:168
   #7  0xffffffff803eead7 in _mtx_lock_sleep (m=0xffffff0013aeecd8, tid=18446742975233614432, opts=6, file=0xc0000102 <Address 0xc0000102 out of bounds>, line=-1521574640)
       at /usr/src/sys/kern/kern_mutex.c:546
   #8  0xffffffff8044e3ad in unp_gc (arg=0x6c, pending=1035690592) at /usr/src/sys/kern/uipc_usrreq.c:1714
   #9  0xffffffff80420875 in taskqueue_run (queue=0xffffff0000c1ae00) at /usr/src/sys/kern/subr_taskqueue.c:257
   #10 0xffffffff804215c5 in taskqueue_thread_loop (arg=0x6c) at /usr/src/sys/kern/subr_taskqueue.c:376
   #11 0xffffffff803de037 in fork_exit (callout=0xffffffff80421540 <taskqueue_thread_loop>, arg=0xffffffff8090d3d0, frame=0xffffffffa54e9c50) at /usr/src/sys/kern/kern_fork.c:821
   #12 0xffffffff80605d0e in fork_trampoline () at /usr/src/sys/amd64/amd64/exception.S:394
   #13 0x0000000000000000 in ?? ()
   #14 0x0000000000000000 in ?? ()
   #15 0x0000000000000001 in ?? ()
   #16 0x0000000000000000 in ?? ()
   #17 0x0000000000000000 in ?? ()
   #18 0x0000000000000000 in ?? ()
   #19 0x0000000000000000 in ?? ()
   #20 0x0000000000000000 in ?? ()
   #21 0x0000000000000000 in ?? ()
   #22 0x0000000000000000 in ?? ()
   #23 0x0000000000000000 in ?? ()
   #24 0x0000000000000000 in ?? ()
   #25 0x0000000000000000 in ?? ()
   #26 0x0000000000000000 in ?? ()
   #27 0x0000000000000000 in ?? ()
   #28 0x0000000000000000 in ?? ()
   #29 0x0000000000000000 in ?? ()
   #30 0x0000000000000000 in ?? ()
   #31 0x0000000000000000 in ?? ()
   #32 0x0000000000000000 in ?? ()
   #33 0x0000000000000000 in ?? ()
   #34 0x0000000000000000 in ?? ()
   #35 0x0000000000000000 in ?? ()
   #36 0x0000000000000000 in ?? ()
   #37 0x0000000000000000 in ?? ()
   #38 0x0000000000000000 in ?? ()
   #39 0x0000000000000000 in ?? ()
   #40 0x0000000000000000 in ?? ()
   #41 0x0000000000000000 in ?? ()
   #42 0x0000000000000000 in ?? ()
   #43 0x0000000000000000 in ?? ()
   #44 0x0000000000000000 in ?? ()
   #45 0x0000000000b7e000 in ?? ()
   #46 0xffffff0013aeecd8 in ?? ()
   #47 0xffffffff8090f680 in turnstile_chains ()
   #48 0x0000000000000001 in ?? ()
   #49 0xffffff003dbbc6b0 in ?? ()
   #50 0xffffff002869d980 in ?? ()
   #51 0xffffffffa54e9aa8 in ?? ()
   #52 0xffffff003dbb6260 in ?? ()
   #53 0xffffffff8040f7d6 in sched_switch (td=0xffffffff8090d3d0, newtd=0x0, flags=0) at /usr/src/sys/kern/sched_4bsd.c:973
   #54 0x0000000000000000 in ?? ()
   #55 0x0000000000000000 in ?? ()
   #56 0x0000000000000000 in ?? ()
   #57 0x0000000000000000 in ?? ()
   #58 0x0000000000000000 in ?? ()
   #59 0x0000000000000000 in ?? ()
   #60 0x0000000000000000 in ?? ()
   #61 0x0000000000000000 in ?? ()
   #62 0x0000000000000000 in ?? ()
   #63 0x0000000000000000 in ?? ()
   #64 0x0000000000000000 in ?? ()
   #65 0x0000000000000000 in ?? ()
   #66 0x0000000000000000 in ?? ()
   #67 0x0000000000000000 in ?? ()
   #68 0x0000000000000000 in ?? ()
   #69 0x0000000000000000 in ?? ()
   #70 0x0000000000000000 in ?? ()
   #71 0x0000000000000000 in ?? ()
   #72 0x0000000000000000 in ?? ()
   #73 0x0000000000000000 in ?? ()
   #74 0x0000000000000000 in ?? ()
   #75 0x0000000000000000 in ?? ()
   #76 0x0000000000000000 in ?? ()
   #77 0x0000000000000000 in ?? ()
   #78 0x0000000000000000 in ?? ()
   #79 0x0000000000000000 in ?? ()
   #80 0x0000000000000000 in ?? ()
   #81 0x0000000000000000 in ?? ()
   #82 0x0000000000000000 in ?? ()
   #83 0x0000000000000000 in ?? ()
   #84 0x0000000000000000 in ?? ()
   #85 0x0000000000000000 in ?? ()
   #86 0x0000000000000000 in ?? ()
   #87 0x0000000000000000 in ?? ()
   #88 0x0000000000000000 in ?? ()
   #89 0x0000000000000000 in ?? ()
   #90 0x0000000000000000 in ?? ()
   #91 0x0000000000000000 in ?? ()
   #92 0x0000000000000000 in ?? ()
   #93 0x0000000000000000 in ?? ()
   #94 0x0000000000000000 in ?? ()
   #95 0x0000000000000000 in ?? ()
   #96 0x0000000000000000 in ?? ()
   #97 0x0000000000000000 in ?? ()
   #98 0x0000000000000000 in ?? ()
   #99 0x0000000000000000 in ?? ()
   #100 0x0000000000000000 in ?? ()
   #101 0x0000000000000000 in ?? ()
   #102 0x0000000000000000 in ?? ()
   #103 0x0000000000000000 in ?? ()
   #104 0x0000000000000000 in ?? ()
   #105 0x0000000000000000 in ?? ()
   #106 0x0000000000000000 in ?? ()
   #107 0x0000000000000000 in ?? ()
   #108 0x0000000000000000 in ?? ()
   #109 0x0000000000000000 in ?? ()
   #110 0x0000000000000000 in ?? ()
   #111 0x0000000000000000 in ?? ()
   #112 0x0000000000000000 in ?? ()
   #113 0x0000000000000000 in ?? ()
   #114 0x0000000000000000 in ?? ()
   #115 0x0000000000000000 in ?? ()
   #116 0x0000000000000000 in ?? ()
   #117 0x0000000000000000 in ?? ()
   #118 0x0000000000000000 in ?? ()
   #119 0x0000000000000000 in ?? ()
   #120 0x0000000000000000 in ?? ()
   #121 0x0000000000000000 in ?? ()
   #122 0x0000000000000000 in ?? ()
   #123 0x0000000000000000 in ?? ()
   #124 0x0000000000000000 in ?? ()
   #125 0x0000000000000000 in ?? ()
   Cannot access memory at address 0xffffffffa54ea000
   (kgdb) quit

>How-To-Repeat:
Machine seems to panic each week or two.
>Fix:

>Release-Note:
>Audit-Trail:

From: Remco Bressers <rbressers@signet.nl>
To: bug-followup@FreeBSD.org
Cc:  
Subject: Re: kern/111458: [panic] Panic on 6.2-RELEASE AMD in kern_mutex
Date: Tue, 24 Apr 2007 21:59:04 +0200

 To update this bugreport and to keep it 'warm'
 
 I've got the very same problem overhere.
 
 Our box : 
 
 # uname -r
 6.2-RELEASE-p2
 
 This is an amd64 release
 
 Updates on GENERIC : 
 
 options         QUOTA 
 device          pf
 device          pflog
 options		SMP
 
 Kernel messages : 
 
 cpuid = 0; apic id = 00
 fault virtual address = 0x18c
 fault code = supervisor read, page not present
 current process = 5 (thread taskq)
 trap number = 12
 panic: page fault
 cpuid = 0
 
 
 The hardware i'm using :
 
 - Tyan S5380G2NN motherboard with Intel 5000P chipset
 - Dual Intel Xeon 5140 dual-core 2,33GHz processors
 - 2GB FB-DIMM RAM
 - 3Ware 9550SX-4LP RAID controller code-set 9.3.0.7 PCI-X
 
 
 Software :
 
 - Dovecot POP3/IMAP
 - Apache HTTP/HTTPS
 - Postfix SMTP
 - 3DM2 for 3Ware management
 
 
 Symptoms : 
 
 The system locks up once every few days with the kernel messages shown.
 It doesn't auto-reboot (although it says that on the terminal), it just
 freezes and power-down is my only help.
 
 
 

From: John Baldwin <jhb@FreeBSD.org>
To: bug-followup@FreeBSD.org, freebsd@wayne47.com
Cc:  
Subject: Re: kern/111458: [panic] Panic on 6.2-RELEASE AMD in kern_mutex
Date: Wed, 25 Jul 2007 12:55:17 -0400

 See PR 113823 for a followup with the fix.
 
 -- 
 John Baldwin
State-Changed-From-To: open->closed 
State-Changed-By: linimon 
State-Changed-When: Thu Jul 26 06:52:00 UTC 2007 
State-Changed-Why:  
See PR 113823 for a followup with the fix. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=111458 
>Unformatted:
