From nobody@FreeBSD.org  Thu Nov 18 09:29:28 2010
Return-Path: <nobody@FreeBSD.org>
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 38834106564A
	for <freebsd-gnats-submit@FreeBSD.org>; Thu, 18 Nov 2010 09:29:28 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (www.freebsd.org [IPv6:2001:4f8:fff6::21])
	by mx1.freebsd.org (Postfix) with ESMTP id 263368FC1E
	for <freebsd-gnats-submit@FreeBSD.org>; Thu, 18 Nov 2010 09:29:28 +0000 (UTC)
Received: from www.freebsd.org (localhost [127.0.0.1])
	by www.freebsd.org (8.14.3/8.14.3) with ESMTP id oAI9TRqB006668
	for <freebsd-gnats-submit@FreeBSD.org>; Thu, 18 Nov 2010 09:29:27 GMT
	(envelope-from nobody@www.freebsd.org)
Received: (from nobody@localhost)
	by www.freebsd.org (8.14.3/8.14.3/Submit) id oAI9TRPl006667;
	Thu, 18 Nov 2010 09:29:27 GMT
	(envelope-from nobody)
Message-Id: <201011180929.oAI9TRPl006667@www.freebsd.org>
Date: Thu, 18 Nov 2010 09:29:27 GMT
From: Pawel Tyll <ptyll@nitronet.pl>
To: freebsd-gnats-submit@FreeBSD.org
Subject: Crash related to dummynet.
X-Send-Pr-Version: www-3.1
X-GNATS-Notify:

>Number:         152360
>Category:       kern
>Synopsis:       [dummynet] [panic] Crash related to dummynet.
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    freebsd-ipfw
>State:          closed
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Thu Nov 18 09:30:08 UTC 2010
>Closed-Date:    Tue Jun 14 14:54:45 UTC 2011
>Last-Modified:  Tue Jun 14 14:54:45 UTC 2011
>Originator:     Pawel Tyll
>Release:        8.1-STABLE
>Organization:
>Environment:
FreeBSD hostname 8.1-STABLE FreeBSD 8.1-STABLE #0: Mon Nov  8 12:16:53 CET 2010     user@hostname:/usr/obj/usr/src/sys/HOSTNAME  amd64

>Description:
Note that problem also happened on 8.1-RELEASE.
This machine relies heavily on dummynet and traffic shaping is its primary purpose.

Full core dump available.

hostname.domain.tld dumped core - see /var/crash/vmcore.0

Sun Nov  7 00:16:09 CET 2010

FreeBSD hostname.domain.tld 8.1-RELEASE FreeBSD 8.1-RELEASE #1: Tue Jul 27 04:18:54 CEST 2010     user@hostname.domain.tld:/usr/obj/usr/src/sys/hostname  amd64

panic: page fault

GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "amd64-marcel-freebsd"...

Unread portion of the kernel message buffer:

			= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags	= 
processor eflags	= interrupt enabled, interrupt enabled, resume, resume, IOPL = 0IOPL = 0
current process		= 
current process		= 12 (irq257: em1)0 (dummynet)
trap number		= 12
trap number		= 12
panic: page fault

cpuid = 6
Uptime: 16d23h57m45s
Physical memory: 4044 MB
Dumping 1704 MB: 1689 1673 1657 1641 1625 1609 1593 1577 1561 1545 1529 1513 1497 1481 1465 1449 1433 1417 1401 1385 1369 1353 1337 1321 1305 1289 1273 1257 1241 1225 1209 1193 1177 1161 1145 1129 1113 1097 1081 1065 1049 1033 1017 1001 985 969 953 937 921 905 889 873 857 841 825 809 793 777 761 745 729 713 697 681 665 649 633 617 601 585 569 553 537 521 505 489 473 457 441 425 409 393 377 361 345 329 313 297 281 265 249 233 217 201 185 169 153 137 121 105 89 73 57 41 25 9

Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /boot/kernel/zfs.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/zfs.ko
Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /boot/kernel/opensolaris.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/opensolaris.ko
Reading symbols from /boot/kernel/geom_mirror.ko...Reading symbols from /boot/kernel/geom_mirror.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/geom_mirror.ko
Reading symbols from /boot/kernel/if_em.ko...Reading symbols from /boot/kernel/if_em.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/if_em.ko
Reading symbols from /boot/kernel/ahci.ko...Reading symbols from /boot/kernel/ahci.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/ahci.ko
Reading symbols from /boot/kernel/ipmi.ko...Reading symbols from /boot/kernel/ipmi.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/ipmi.ko
Reading symbols from /boot/kernel/smbus.ko...Reading symbols from /boot/kernel/smbus.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/smbus.ko
#0  doadump () at pcpu.h:223
223	pcpu.h: No such file or directory.
	in pcpu.h
(kgdb) #0  doadump () at pcpu.h:223
#1  0xffffffff8059af59 in boot (howto=260)
    at /usr/src/sys/kern/kern_shutdown.c:416
#2  0xffffffff8059b38c in panic (fmt=0xffffffff8096d354 "%s")
    at /usr/src/sys/kern/kern_shutdown.c:590
#3  0xffffffff80894128 in trap_fatal (frame=0xffffff00031a27c0, eva=Variable "eva" is not available.
)
    at /usr/src/sys/amd64/amd64/trap.c:777
#4  0xffffffff808944f4 in trap_pfault (frame=0xffffff81b1c88560, usermode=0)
    at /usr/src/sys/amd64/amd64/trap.c:693
#5  0xffffffff80894d3a in trap (frame=0xffffff81b1c88560)
    at /usr/src/sys/amd64/amd64/trap.c:451
#6  0xffffffff8087a703 in calltrap ()
    at /usr/src/sys/amd64/amd64/exception.S:223
#7  0xffffffff80698abf in in_localaddr (in=Variable "in" is not available.
) at /usr/src/sys/netinet/in.c:115
#8  0xffffffff806b0deb in ipfw_chk (args=0xffffff81b1c887d0)
    at /usr/src/sys/netinet/ipfw/ip_fw2.c:1688
#9  0xffffffff806b3e4a in ipfw_check_hook (arg=Variable "arg" is not available.
)
    at /usr/src/sys/netinet/ipfw/ip_fw_pfil.c:139
#10 0xffffffff8065438c in pfil_run_hooks (ph=Variable "ph" is not available.
) at /usr/src/sys/net/pfil.c:82
#11 0xffffffff806b94b3 in ip_input (m=dwarf2_read_address: Corrupted DWARF expression.
) at /usr/src/sys/netinet/ip_input.c:535
#12 0xffffffff8065379e in netisr_dispatch_src (proto=1, source=Variable "source" is not available.
)
    at /usr/src/sys/net/netisr.c:917
#13 0xffffffff80649c2d in ether_demux (ifp=0xffffff0005572000, 
    m=0xffffff0005c94e00) at /usr/src/sys/net/if_ethersubr.c:901
#14 0xffffffff80649ff7 in ether_input (ifp=0xffffff0005572000, 
    m=0xffffff0005c94e00) at /usr/src/sys/net/if_ethersubr.c:760
#15 0xffffffff80649b4f in ether_demux (ifp=0xffffff000306e800, 
    m=0xffffff0005c94e00) at /usr/src/sys/net/if_ethersubr.c:810
#16 0xffffffff80649ff7 in ether_input (ifp=0xffffff000306e800, 
    m=0xffffff0005c94e00) at /usr/src/sys/net/if_ethersubr.c:760
#17 0xffffffff8103b235 in em_refresh_mbufs (rxr=0xffffff00031a27c0, 
    limit=-1062727311) at /usr/src/sys/modules/em/../../dev/e1000/if_em.c:3680
#18 0xffffffff8103b452 in em_refresh_mbufs (rxr=0xffffff000306e800, limit=1)
    at mbuf.h:564
#19 0xffffffff805732fd in intr_event_execute_handlers (p=Variable "p" is not available.
)
    at /usr/src/sys/kern/kern_intr.c:1220
#20 0xffffffff805749ae in ithread_loop (arg=0xffffff000318f6a0)
    at /usr/src/sys/kern/kern_intr.c:1233
#21 0xffffffff805712b8 in fork_exit (
    callout=0xffffffff80574920 <ithread_loop>, arg=0xffffff000318f6a0, 
    frame=0xffffff81b1c88c80) at /usr/src/sys/kern/kern_fork.c:844
#22 0xffffffff8087abde in fork_trampoline ()
    at /usr/src/sys/amd64/amd64/exception.S:562
#23 0x0000000000000000 in ?? ()
#24 0x0000000000000000 in ?? ()
#25 0x0000000000000001 in ?? ()
#26 0x0000000000000000 in ?? ()
#27 0x0000000000000000 in ?? ()
#28 0x0000000000000000 in ?? ()
#29 0x0000000000000000 in ?? ()
#30 0x0000000000000000 in ?? ()
#31 0x0000000000000000 in ?? ()
#32 0x0000000000000000 in ?? ()
#33 0x0000000000000000 in ?? ()
#34 0x0000000000000000 in ?? ()
#35 0x0000000000000000 in ?? ()
#36 0x0000000000000000 in ?? ()
#37 0x0000000000000000 in ?? ()
#38 0x0000000000000000 in ?? ()
#39 0x0000000000000000 in ?? ()
#40 0x0000000000000000 in ?? ()
#41 0x0000000000000000 in ?? ()
#42 0x0000000000000000 in ?? ()
#43 0x0000000000000000 in ?? ()
#44 0x0000000000000000 in ?? ()
#45 0x0000000000000000 in ?? ()
#46 0x0000000000000000 in ?? ()
#47 0x00000000010cc000 in ?? ()
#48 0x0000000000000000 in ?? ()
#49 0x0000000000000000 in ?? ()
#50 0xffffffff80c59458 in sleepq_chains ()
#51 0xffffff0002eeb7c0 in ?? ()
#52 0xffffff81b1c87e60 in ?? ()
#53 0xffffff81b1c87e18 in ?? ()
#54 0xffffff00031a27c0 in ?? ()
#55 0xffffffff805beb9a in sched_switch (td=0xffffff000318f6a0, 
    newtd=0xffffffff80574920, flags=Variable "flags" is not available.
) at /usr/src/sys/kern/sched_ule.c:1844
Previous frame inner to this frame (corrupt stack?)
(kgdb) 

>How-To-Repeat:
Unknown. Problem happens every 2-3 weeks of uptime.
>Fix:


>Release-Note:
>Audit-Trail:
Responsible-Changed-From-To: freebsd-bugs->freebsd-net 
Responsible-Changed-By: linimon 
Responsible-Changed-When: Thu Nov 18 17:34:27 UTC 2010 
Responsible-Changed-Why:  
reclassify. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=152360 

From: Pawel Tyll <ptyll@nitronet.pl>
To: bug-followup@FreeBSD.org
Cc:  
Subject: Re: kern/152360: [dummynet] [panic] Crash related to dummynet.
Date: Thu, 25 Nov 2010 18:40:16 +0100

 Confirmed crash on FreeBSD 8.1-STABLE #0: Mon Nov  8 12:16:53 CET
 2010. System also hang without dumping. Help? :(
 
 

From: Pawel Tyll <ptyll@nitronet.pl>
To: bug-followup@FreeBSD.org
Cc: Brandon Gooch <jamesbrandongooch@gmail.com>
Subject: Re: kern/152360: [dummynet] [panic] Crash related to dummynet.
Date: Sun, 9 Jan 2011 03:14:09 +0100

 As per Brandon Gooch's suggestion system was updated today to FreeBSD
 8.2-PRERELEASE #1: Fri Jan  7 17:19:28 CET 2011 due to bug that has
 been fixed with
 http://svn.freebsd.org/viewvc/base?view=3Drevision&sortby=3Ddate&revision=
 =3D216440
 
 Should the system not crash in next 30 days, I'll consider the problem
 solved and will report back accordingly.
 
 Thanks Brandon!
 
 

From: Pawel Tyll <ptyll@nitronet.pl>
To: bug-followup@FreeBSD.org
Cc: Brandon Gooch <jamesbrandongooch@gmail.com>
Subject: Re: kern/152360: [dummynet] [panic] Crash related to dummynet.
Date: Mon, 24 Jan 2011 02:04:10 +0100

 Machine fell after 14 days, 22:31:42 for the same reason according to
 what was left of panic screen. It didn't do a dump, nor reboot as is
 customary since some time on S3420GP boards. It was NOT fixed by
 mentioned commit :(
 
 What can I try next?
 
 
Responsible-Changed-From-To: freebsd-net->freebsd-ipfw 
Responsible-Changed-By: ae 
Responsible-Changed-When: Tue Jun 14 06:56:18 UTC 2011 
Responsible-Changed-Why:  
Reassign. It's ipfw related. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=152360 

From: Pawel Tyll <ptyll@nitronet.pl>
To: bug-followup@FreeBSD.org, ptyll@nitronet.pl
Cc:  
Subject: Re: kern/152360: [dummynet] [panic] Crash related to dummynet.
Date: Tue, 14 Jun 2011 16:10:52 +0200

 Hi,
 
 It has been fixed already. Thanks.
 
 Kind regards.
 
 
State-Changed-From-To: open->closed 
State-Changed-By: ae 
State-Changed-When: Tue Jun 14 14:52:41 UTC 2011 
State-Changed-Why:  
Submitter has confirmed that the problem is already fixed. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=152360 
>Unformatted:
