From nobody@FreeBSD.org  Sun Oct 14 14:07:18 2007
Return-Path: <nobody@FreeBSD.org>
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id D21D816A418
	for <freebsd-gnats-submit@FreeBSD.org>; Sun, 14 Oct 2007 14:07:18 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (www.freebsd.org [IPv6:2001:4f8:fff6::21])
	by mx1.freebsd.org (Postfix) with ESMTP id A549713C468
	for <freebsd-gnats-submit@FreeBSD.org>; Sun, 14 Oct 2007 14:07:18 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (localhost [127.0.0.1])
	by www.freebsd.org (8.14.1/8.14.1) with ESMTP id l9EE7DlR037028
	for <freebsd-gnats-submit@FreeBSD.org>; Sun, 14 Oct 2007 14:07:13 GMT
	(envelope-from nobody@www.freebsd.org)
Received: (from nobody@localhost)
	by www.freebsd.org (8.14.1/8.14.1/Submit) id l9EE7DkE037027;
	Sun, 14 Oct 2007 14:07:13 GMT
	(envelope-from nobody)
Message-Id: <200710141407.l9EE7DkE037027@www.freebsd.org>
Date: Sun, 14 Oct 2007 14:07:13 GMT
From: Stefan Krger <skrueger@europe.com>
To: freebsd-gnats-submit@FreeBSD.org
Subject: 7.0-PRERELEASE with ULE: panic: sleeping thread
X-Send-Pr-Version: www-3.1
X-GNATS-Notify:

>Number:         117182
>Category:       kern
>Synopsis:       7.0-PRERELEASE with ULE: panic: sleeping thread
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    freebsd-bugs
>State:          closed
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Sun Oct 14 14:10:01 UTC 2007
>Closed-Date:    Sat Oct 27 16:30:39 UTC 2007
>Last-Modified:  Sat Oct 27 16:30:39 UTC 2007
>Originator:     Stefan Krger
>Release:        FreeBSD 7.0-PRERELEASE i386
>Organization:
>Environment:
FreeBSD localhost 7.0-PRERELEASE FreeBSD 7.0-PRERELEASE #1: Sun Oct 14 03:30:36 CEST 2007     skrueger@localhost:/usr/obj/usr/src/sys/SMP_ULE  i386
>Description:
$ kgdb /boot/kernel/kernel.symbols /var/crash/vmcore.2
[...]
Unread portion of the kernel message buffer:
Sleeping thread (tid 100047, pid 97714) owns a non-sleepable lock
panic: sleeping thread
cpuid = 0
Uptime: 3h42m19s
Physical memory: 1015 MB
Dumping 189 MB: 174 158 142 126 110 94 78 62 46 30 14

#0  doadump () at pcpu.h:195
195     pcpu.h: No such file or directory.
        in pcpu.h
(kgdb) bt
#0  doadump () at pcpu.h:195
#1  0xc05159c6 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:409
#2  0xc0515c9e in panic (fmt=Variable "fmt" is not available.
) at /usr/src/sys/kern/kern_shutdown.c:563
#3  0xc054817c in propagate_priority (td=0xc3c5caa0)
    at /usr/src/sys/kern/subr_turnstile.c:222
#4  0xc0549045 in turnstile_wait (ts=0xc3adfd20, owner=0xc3c5caa0, queue=Variable "queue" is not available.
)
    at /usr/src/sys/kern/subr_turnstile.c:739
#5  0xc05094da in _mtx_lock_sleep (m=0xc07f3e6c, tid=3283112480, opts=0, 
    file=0x0, line=0) at /usr/src/sys/kern/kern_mutex.c:394
#6  0xc062647e in tcp_input (m=0xc402c300, off0=20)
    at /usr/src/sys/netinet/tcp_input.c:400
#7  0xc05c80a0 in ip_input (m=0xc402c300)
    at /usr/src/sys/netinet/ip_input.c:665
#8  0xc05b3392 in netisr_dispatch (num=2, m=0xc402c300)
    at /usr/src/sys/net/netisr.c:185
#9  0xc05af8b1 in ether_demux (ifp=0xc3bcec00, m=0xc402c300)
    at /usr/src/sys/net/if_ethersubr.c:834
#10 0xc05afcdf in ether_input (ifp=0xc3bcec00, m=0xc402c300)
    at /usr/src/sys/net/if_ethersubr.c:692
#11 0xc047047a in fxp_intr (xsc=0xc3ba7000)
    at /usr/src/sys/dev/fxp/if_fxp.c:1706
#12 0xc04f88cb in ithread_loop (arg=0xc3c2c340)
    at /usr/src/sys/kern/kern_intr.c:1036
#13 0xc04f5554 in fork_exit (callout=0xc04f8700 <ithread_loop>, 
    arg=0xc3c2c340, frame=0xe2603d38) at /usr/src/sys/kern/kern_fork.c:796
#14 0xc0724740 in fork_trampoline () at /usr/src/sys/i386/i386/exception.s:205


(kgdb) info threads
[...]
    at /usr/src/sys/kern/sched_ule.c:1908
  90 Thread 100147 (PID=97714: squid)  sched_switch (td=0xc6fb8000, newtd=Variable "newtd" is not available.
)
[...]
(kgdb) thread 90
[Switching to thread 90 (Thread 100147)]#0  sched_switch (td=0xc6fb8000, newtd=Variable "newtd" is not available.

) at /usr/src/sys/kern/sched_ule.c:1908
1908                    cpuid = PCPU_GET(cpuid);
(kgdb) bt
#0  sched_switch (td=0xc6fb8000, newtd=Variable "newtd" is not available.
) at /usr/src/sys/kern/sched_ule.c:1908
#1  0xc051db46 in mi_switch (flags=Variable "flags" is not available.
) at /usr/src/sys/kern/kern_synch.c:442
#2  0xc0545478 in sleepq_switch (wchan=Variable "wchan" is not available.
)
    at /usr/src/sys/kern/subr_sleepqueue.c:459
#3  0xc054573a in sleepq_catch_signals (wchan=0xc6820280)
    at /usr/src/sys/kern/subr_sleepqueue.c:414
#4  0xc0545fdd in sleepq_wait_sig (wchan=0xc6820280)
    at /usr/src/sys/kern/subr_sleepqueue.c:556
#5  0xc051df87 in _sleep (ident=0xc6820280, lock=0xc07e7cc0, priority=256, 
    wmesg=0xc07748da "ucond", timo=0) at /usr/src/sys/kern/kern_synch.c:226
#6  0xc0529dca in __umtx_op_cv_wait (td=0xc6fb8000, uap=0xe669bcfc)
    at /usr/src/sys/kern/kern_umtx.c:467
#7  0xc0527ee7 in _umtx_op (td=0xc6fb8000, uap=0xe669bcfc)
    at /usr/src/sys/kern/kern_umtx.c:2490
#8  0xc073d3b5 in syscall (frame=0xe669bd38)
    at /usr/src/sys/i386/i386/trap.c:1008
#9  0xc0724730 in Xint0x80_syscall () at /usr/src/sys/i386/i386/exception.s:196
#10 0x00000033 in ?? ()
Previous frame inner to this frame (corrupt stack?)

>How-To-Repeat:
- install squid with aufs support
- setup squid using aufs
- start a webbrowser (firefox in my case) and open many sites at once (e.g. using Bookmarks -> * -> "Open All in Tabs")


- kernel + vmcore available on request
>Fix:


>Release-Note:
>Audit-Trail:

From: =?UTF-8?B?U3RlZmFuIEtyw7zCn2dlcg==?= <stadtkind2@gmx.de>
To: bug-followup@FreeBSD.org
Cc:  
Subject: Re: kern/117182: 7.0-PRERELEASE with ULE: panic: sleeping thread
Date: Sun, 14 Oct 2007 19:37:53 +0200

 I'm so sorry, I took the wrong thread :(
 
 here's the right one:
 
 (kgdb) info threads
 [...]
      at /usr/src/sys/kern/sched_ule.c:1908
    78 Thread 100047 (PID=97714: squid)  sched_switch (td=0xc3c5caa0, 
 newtd=Variable "newtd" is not available.
 )
 [...]
 (kgdb) thread 78
 [Switching to thread 78 (Thread 100047)]#0  sched_switch (td=0xc3c5caa0, 
 newtd=Variable "newtd" is not available.
 
 ) at /usr/src/sys/kern/sched_ule.c:1908
 1908                    cpuid = PCPU_GET(cpuid);
 (kgdb) bt
 #0  sched_switch (td=0xc3c5caa0, newtd=Variable "newtd" is not available.
 ) at /usr/src/sys/kern/sched_ule.c:1908
 #1  0xc051db46 in mi_switch (flags=Variable "flags" is not available.
 ) at /usr/src/sys/kern/kern_synch.c:442
 #2  0xc0545478 in sleepq_switch (wchan=Variable "wchan" is not available.
 )
      at /usr/src/sys/kern/subr_sleepqueue.c:459
 #3  0xc0545aa6 in sleepq_wait (wchan=0xc3fd1c40)
      at /usr/src/sys/kern/subr_sleepqueue.c:542
 #4  0xc051d336 in _sx_xlock_hard (sx=0xc3fd1c40, tid=3284519584, opts=0,
      file=0xc3fcbfe3 
 "/usr/src/sys/modules/ipfilter/../../contrib/ipfilter/netinet/ip_state.c", 
 line=3957) at /usr/src/sys/kern/kern_sx.c:555
 #5  0xc051d708 in _sx_xlock (sx=0xc3fd1c40, opts=0,
      file=0xc3fcbfe3 
 "/usr/src/sys/modules/ipfilter/../../contrib/ipfilter/netinet/ip_state.c", 
 line=3957) at sx.h:153
 #6  0xc3fb0a66 in fr_statederef (isp=0xe42dba20)
      at 
 /usr/src/sys/modules/ipfilter/../../contrib/ipfilter/netinet/ip_state.c:3957
 #7  0xc3fc82b8 in fr_check (ip=0xc4491844, hlen=20, ifp=0xc3e31800, out=1,
      mp=0xe42dba90)
      at 
 /usr/src/sys/modules/ipfilter/../../contrib/ipfilter/netinet/fil.c:2629
 #8  0xc3fc170d in fr_check_wrapper (arg=0x0, mp=0xe42dba90, ifp=0xc3e31800,
      dir=2)
      at 
 /usr/src/sys/modules/ipfilter/../../contrib/ipfilter/netinet/ip_fil_freebsd.c:178
 #9  0xc05b3858 in pfil_run_hooks (ph=0xc07f31e0, mp=0xe42dbb20,
      ifp=0xc3e31800, dir=2, inp=0xc8a4eb28) at /usr/src/sys/net/pfil.c:78
 #10 0xc05c99ec in ip_output (m=0xc4491800, opt=0x0, ro=0xe42dbaf4, flags=0,
      imo=0x0, inp=0xc8a4eb28) at /usr/src/sys/netinet/ip_output.c:438
 #11 0xc06288a3 in tcp_output (tp=0xc63206f0)
      at /usr/src/sys/netinet/tcp_output.c:1127
 #12 0xc06338b1 in tcp_usr_connect (so=0xc67c5c60, nam=0xc69c4180,
      td=0xc3c5caa0) at /usr/src/sys/netinet/tcp_usrreq.c:479
 #13 0xc05685e0 in soconnect (so=0xc67c5c60, nam=0xc69c4180, td=0xc3c5caa0)
      at /usr/src/sys/kern/uipc_socket.c:765
 #14 0xc056f32f in kern_connect (td=0xc3c5caa0, fd=63, sa=0xc69c4180)
      at /usr/src/sys/kern/uipc_syscalls.c:558
 #15 0xc056f4e6 in connect (td=0xc3c5caa0, uap=0xe42dbcfc)
      at /usr/src/sys/kern/uipc_syscalls.c:526
 #16 0xc073d3b5 in syscall (frame=0xe42dbd38)
      at /usr/src/sys/i386/i386/trap.c:1008
 #17 0xc0724730 in Xint0x80_syscall () at 
 /usr/src/sys/i386/i386/exception.s:196
 #18 0x00000033 in ?? ()
 (kgdb)
State-Changed-From-To: open->closed 
State-Changed-By: darrenr 
State-Changed-When: Sat Oct 27 16:30:12 UTC 2007 
State-Changed-Why:  
This is a duplicate of 117216 

http://www.freebsd.org/cgi/query-pr.cgi?pr=117182 
>Unformatted:
