From nobody@FreeBSD.org  Sun Sep 28 14:26:39 2008
Return-Path: <nobody@FreeBSD.org>
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id E57F61065686
	for <freebsd-gnats-submit@FreeBSD.org>; Sun, 28 Sep 2008 14:26:39 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (www.freebsd.org [IPv6:2001:4f8:fff6::21])
	by mx1.freebsd.org (Postfix) with ESMTP id D46F88FC08
	for <freebsd-gnats-submit@FreeBSD.org>; Sun, 28 Sep 2008 14:26:39 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (localhost [127.0.0.1])
	by www.freebsd.org (8.14.3/8.14.3) with ESMTP id m8SEQdsA070033
	for <freebsd-gnats-submit@FreeBSD.org>; Sun, 28 Sep 2008 14:26:39 GMT
	(envelope-from nobody@www.freebsd.org)
Received: (from nobody@localhost)
	by www.freebsd.org (8.14.3/8.14.3/Submit) id m8SEQdZL070032;
	Sun, 28 Sep 2008 14:26:39 GMT
	(envelope-from nobody)
Message-Id: <200809281426.m8SEQdZL070032@www.freebsd.org>
Date: Sun, 28 Sep 2008 14:26:39 GMT
From: Wouter Snels <nospam@ofloo.net>
To: freebsd-gnats-submit@FreeBSD.org
Subject: Fatal trap 12: page fault while in kernel mode
X-Send-Pr-Version: www-3.1
X-GNATS-Notify:

>Number:         127699
>Category:       kern
>Synopsis:       [panic][stf] stf causes panic in RTFREE
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    freebsd-bugs
>State:          closed
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Sun Sep 28 14:30:01 UTC 2008
>Closed-Date:    Wed Oct 22 15:12:36 UTC 2008
>Last-Modified:  Tue Jul 10 03:39:59 UTC 2012
>Originator:     Wouter Snels
>Release:        7.0-RELEASE-p4
>Organization:
>Environment:
FreeBSD spark.ofloo.net 7.0-RELEASE-p4 FreeBSD 7.0-RELEASE-p4 #1: Sat Sep  6 19:20:57 CEST 2008     ofloo@spark.ofloo.net:/usr/obj/usr/src/sys/OFL  i386

>Description:
Fatal trap 12: page fault while in kernel mode
cpuid = 2; apic id = 01
fault virtual address   = 0x4c
fault code              = supervisor read, page not present
instruction pointer     = 0x20:0xc083b4ac
stack pointer           = 0x28:0xe8d14790
frame pointer           = 0x28:0xe8d14800
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, def32 1, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 2917 (irssi)
trap number             = 12
panic: page fault
cpuid = 2
Uptime: 1d1h1m11s
Physical memory: 2035 MB
Dumping 224 MB: 209 193
** DUMP FAILED (ERROR 60) **
Automatic reboot in 15 seconds - press a key on the console to abort
Rebooting...
cpu_reset: Stopping other CPUs
/boot/kernel/kernel text=0x70c230 data=0xae13c+0x5f424 syms=[0x4+0x71010+0x4+0x91b89]
>How-To-Repeat:
I been having this problem ever since I've started using FreeBSD5 with smp to 6,7, .. the only time i was able to recreate it was while running a connection over IPv6 on sshd authenticated with certificates, then flood the screen or buildworld or something, so a lot of data comes over the terminal screen, though this time it just randomly occurred, as it often does, i just did a fresh install few days ago, because the previous system had this problem every 30mins, it started out with once a month, once every 10 days, .. up until the point i booted up and just crashed instantly, currently i see the process seems to be irssi, usually when I see it on the screen it's sshd.

I use IPv6 through stf interface (6to4), in case it matters.
>Fix:


>Release-Note:
>Audit-Trail:
State-Changed-From-To: open->feedback 
State-Changed-By: vwe 
State-Changed-When: Wed Oct 1 21:21:18 UTC 2008 
State-Changed-Why:  
Wouter, 

can you please provide us a backtrace from a kernel dump? 
It might also be fine to see your kernel configuration file. 
Have you made sure world and kernel are in sync, 3rd party kld's 
are build? 
To get the kernel dump, please use swapspace at least as large as 
your machine has memory (RAM) installed and set dumpdev properly. 
A dmesg also does not hurt to see how your machine is equipped. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=127699 

From: Wouter Snels <nospam@ofloo.org>
To: bug-followup@FreeBSD.org, nospam@ofloo.net
Cc:  
Subject: Re: kern/127699: [panic] Fatal trap 12: page fault while in kernel
 mode
Date: Fri, 03 Oct 2008 12:37:54 +0200

 This is a multi-part message in MIME format.
 --------------050205020809030709010103
 Content-Type: text/plain; charset=ISO-8859-1
 Content-Transfer-Encoding: 7bit
 
 There are no patches or 3rd party modules loaded.
 
 kldstat
 Id Refs Address    Size     Name
  1    4 0xc0400000 91d344   kernel
  2    1 0xc0d1e000 6a32c    acpi.ko
  3    1 0xc5772000 3000     if_stf.ko
 
 I'm not sure what you mean by world and kernel being sync'ed, I compiled
 the kernel and world like this.
 
 cd /usr/src/sys/i386/conf
 config OFL
 cd ../compile/OFL
 make -j9 cleandepend
 make -j9 depend
 cd /usr/src
 make -j9 buildworld
 make -j9 buildkernel
 make -j9 installkernel
 reboot
 mergemaster -p
 make -j9 installworld
 mergemaster
 reboot
 
 I did a quick search on google on how to backtrace kernel but I couldn't
 find any information which pointed to what you are asking, could you
 please explain or provide a page which does.
 
 I also included make.conf though it might be useful.
 
 Regards, WS
 
 --------------050205020809030709010103
 Content-Type: text/plain;
  name="make.conf"
 Content-Transfer-Encoding: 7bit
 Content-Disposition: inline;
  filename="make.conf"
 
 # added by use.perl 2008-08-30 14:55:15
 PERL_VER=5.8.8
 PERL_VERSION=5.8.8
 MASTER_SORT_REGEX?= ://[^/]*\.be/ ://[^/]*\.be\.
 KERNCONF=OFL
 #NO_GAMES=yes
 NO_X=yes
 WITHOUT_X11=yes
 PORT_UPGRADE=yes
 SUP_UPDATE=yes
 SUP=/usr/local/bin/cvsup
 SUPFLAGS=-g -L 2
 #SUPHOST=cvsup3.nl.freebsd.org
 SUPFILE=/usr/local/etc/cvsup/RELENG_7_0/src-supfile
 PORTSSUPFILE=/usr/local/etc/cvsup/RELENG_7_0/ports-supfile
 DOCSUPFILE=/usr/local/etc/cvsup/RELENG_7_0/doc-supfile
 NO_USB=yes
 NO_BLUETOOTH=true
 FORCE_PKG_REGISTER=yes
 # COM1: = 0x3F8, COM2: = 0x2F8, COM3: = 0x3E8, COM4: = 0x2E8 # 
 BOOT_COMCONSOLE_PORT=0x3F8
 BOOT_COMCONSOLE_SPEED=115200
 PYTHON_DEFAULT_VERSION=python2.5
 
 --------------050205020809030709010103
 Content-Type: text/plain;
  name="dmesg.boot"
 Content-Transfer-Encoding: 7bit
 Content-Disposition: inline;
  filename="dmesg.boot"
 
 Copyright (c) 1992-2008 The FreeBSD Project.
 Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
 	The Regents of the University of California. All rights reserved.
 FreeBSD is a registered trademark of The FreeBSD Foundation.
 FreeBSD 7.0-RELEASE-p4 #1: Sat Sep  6 19:20:57 CEST 2008
     ofloo@spark.ofloo.net:/usr/obj/usr/src/sys/OFL
 Timecounter "i8254" frequency 1193182 Hz quality 0
 CPU: Intel Pentium III Xeon (701.60-MHz 686-class CPU)
   Origin = "GenuineIntel"  Id = 0x6a1  Stepping = 1
   Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
 real memory  = 2147467264 (2047 MB)
 avail memory = 2091917312 (1995 MB)
 ACPI APIC Table: <COMPAQ 00000083>
 FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
  cpu0 (BSP): APIC ID:  3
  cpu1 (AP): APIC ID:  0
  cpu2 (AP): APIC ID:  1
  cpu3 (AP): APIC ID:  2
 ioapic0: Changing APIC ID to 8
 MADT: Forcing active-low polarity and level trigger for SCI
 ioapic0 <Version 1.1> irqs 0-34 on motherboard
 kbd1 at kbdmux0
 ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
 hptrr: HPT RocketRAID controller driver v1.1 (Sep  6 2008 19:18:46)
 acpi0: <COMPAQ YORKTOWN> on motherboard
 acpi0: [ITHREAD]
 acpi0: Power Button (fixed)
 Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x240-0x243 on acpi0
 cpu0: <ACPI CPU> on acpi0
 cpu1: <ACPI CPU> on acpi0
 cpu2: <ACPI CPU> on acpi0
 cpu3: <ACPI CPU> on acpi0
 pcib0: <ACPI Host-PCI bridge> on acpi0
 pci0: <ACPI PCI bus> on pcib0
 pci0: <base peripheral> at device 3.0 (no driver attached)
 ida0: <Compaq Integrated Array controller> port 0x2000-0x20ff mem 0xec000000-0xecffffff,0xeb000000-0xebffffff irq 29 at device 4.0 on pci0
 ida0: [GIANT-LOCKED]
 ida0: [ITHREAD]
 ida0: drives=1 firm_rev=1.44
 idad0: <Compaq Logical Drive> on ida0
 idad0: 34719MB (71106240 sectors), blocksize=512
 vgapci0: <VGA-compatible display> port 0x2400-0x24ff mem 0xe9000000-0xe9ffffff,0xeaff0000-0xeaff0fff at device 5.0 on pci0
 isab0: <PCI-ISA bridge> at device 15.0 on pci0
 isa0: <ISA bus> on isab0
 atapci0: <ServerWorks ROSB4 UDMA33 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x2800-0x280f at device 15.1 on pci0
 ata0: <ATA channel 0> on atapci0
 ata0: [ITHREAD]
 ata1: <ATA channel 1> on atapci0
 ata1: [ITHREAD]
 pcib1: <ACPI Host-PCI bridge> on acpi0
 pci2: <ACPI PCI bus> on pcib1
 pci2: <base peripheral, PCI hot-plug controller> at device 5.0 (no driver attached)
 txp0: <3Com 3cR990-SRV-97 Etherlink Server with 3XP Processor> port 0x3000-0x307f mem 0xf2a80000-0xf2abffff irq 20 at device 9.0 on pci2
 txp0: using obsoleted if_watchdog interface
 txp0: Ethernet address: 00:01:03:bc:64:7a
 txp0: [ITHREAD]
 pcib2: <ACPI Host-PCI bridge> on acpi0
 pci7: <ACPI PCI bus> on pcib2
 pci7: <base peripheral, PCI hot-plug controller> at device 5.0 (no driver attached)
 pcib3: <PCI-PCI bridge> at device 7.0 on pci7
 pci8: <PCI bus> on pcib3
 fxp0: <Intel 82559 Pro/100 Ethernet> port 0x8000-0x803f mem 0xf7ff0000-0xf7ff0fff,0xf7e00000-0xf7efffff irq 24 at device 4.0 on pci8
 miibus0: <MII bus> on fxp0
 inphy0: <i82555 10/100 media interface> PHY 1 on miibus0
 inphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
 fxp0: Ethernet address: 00:02:a5:6b:c7:0e
 fxp0: [ITHREAD]
 fxp1: <Intel 82559 Pro/100 Ethernet> port 0x8040-0x807f mem 0xf7df0000-0xf7df0fff,0xf7c00000-0xf7cfffff irq 25 at device 5.0 on pci8
 miibus1: <MII bus> on fxp1
 inphy1: <i82555 10/100 media interface> PHY 1 on miibus1
 inphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
 fxp1: Ethernet address: 00:02:a5:6b:c7:0f
 fxp1: [ITHREAD]
 acpi_tz0: <Thermal Zone> on acpi0
 atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
 atkbd0: <AT Keyboard> irq 1 on atkbdc0
 kbd0 at atkbd0
 atkbd0: [GIANT-LOCKED]
 atkbd0: [ITHREAD]
 fdc0: <floppy drive controller> port 0x3f2-0x3f5 irq 6 drq 2 on acpi0
 fdc0: [FILTER]
 fd0: <1440-KB 3.5" drive> on fdc0 drive 0
 sio0: <Standard PC COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
 sio0: type 16550A, console
 sio0: [FILTER]
 sio1: configured irq 3 not in bitmap of probed irqs 0
 sio1: port may not be enabled
 sio1: configured irq 3 not in bitmap of probed irqs 0
 sio1: port may not be enabled
 pmtimer0 on isa0
 orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcbfff,0xe8000-0xedfff,0xee000-0xeffff pnpid ORM0000 on isa0
 ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
 ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode
 ppbus0: <Parallel port bus> on ppc0
 ppbus0: [ITHREAD]
 plip0: <PLIP network interface> on ppbus0
 lpt0: <Printer> on ppbus0
 lpt0: Interrupt-driven port
 ppi0: <Parallel I/O> on ppbus0
 ppc0: [GIANT-LOCKED]
 ppc0: [ITHREAD]
 sc0: <System console> at flags 0x100 on isa0
 sc0: VGA <16 virtual consoles, flags=0x300>
 sio1: configured irq 3 not in bitmap of probed irqs 0
 sio1: port may not be enabled
 vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
 Timecounters tick every 1.000 msec
 ipfw2 (+ipv6) initialized, divert loadable, rule-based forwarding enabled, default to accept, logging unlimited
 hptrr: no controller detected.
 acd0: CDROM <CD-224E/9.0C> at ata0-master PIO4
 SMP: AP CPU #1 Launched!
 SMP: AP CPU #2 Launched!
 SMP: AP CPU #3 Launched!
 Trying to mount root from ufs:/dev/idad0s1a
 WARNING: / was not properly dismounted
 WARNING: /tmp was not properly dismounted
 /tmp: mount pending error: blocks 0 files 1
 WARNING: /usr was not properly dismounted
 /usr: mount pending error: blocks 220 files 13
 WARNING: /var was not properly dismounted
 
 --------------050205020809030709010103
 Content-Type: text/plain;
  name="OFL"
 Content-Transfer-Encoding: 7bit
 Content-Disposition: inline;
  filename="OFL"
 
 cpu		I686_CPU
 ident		OFL
 
 # To statically compile in device wiring instead of /boot/device.hints
 #hints		"GENERIC.hints"		# Default places to look for devices.
 
 makeoptions	DEBUG=-g		# Build kernel with gdb(1) debug symbols
 
 options 	SCHED_ULE		# 4BSD scheduler
 options 	PREEMPTION		# Enable kernel thread preemption
 options 	INET			# InterNETworking
 options 	INET6			# IPv6 communications protocols
 options 	SCTP			# Stream Control Transmission Protocol
 options 	FFS			# Berkeley Fast Filesystem
 options 	SOFTUPDATES		# Enable FFS soft updates support
 options 	UFS_ACL			# Support for access control lists
 options 	UFS_DIRHASH		# Improve performance on big directories
 options 	UFS_GJOURNAL		# Enable gjournal-based UFS journaling
 options 	MD_ROOT			# MD is a potential root device
 options 	NFSCLIENT		# Network Filesystem Client
 options 	NFSSERVER		# Network Filesystem Server
 options 	NFS_ROOT		# NFS usable as /, requires NFSCLIENT
 options 	MSDOSFS			# MSDOS Filesystem
 options 	CD9660			# ISO 9660 Filesystem
 options 	PROCFS			# Process filesystem (requires PSEUDOFS)
 options 	PSEUDOFS		# Pseudo-filesystem framework
 options 	GEOM_PART_GPT		# GUID Partition Tables.
 options 	GEOM_LABEL		# Provides labelization
 options 	COMPAT_43TTY		# BSD 4.3 TTY compat [KEEP THIS!]
 options 	COMPAT_FREEBSD4		# Compatible with FreeBSD4
 options 	COMPAT_FREEBSD5		# Compatible with FreeBSD5
 options 	COMPAT_FREEBSD6		# Compatible with FreeBSD6
 options 	SCSI_DELAY=5000		# Delay (in ms) before probing SCSI
 options 	KTRACE			# ktrace(1) support
 options 	SYSVSHM			# SYSV-style shared memory
 options 	SYSVMSG			# SYSV-style message queues
 options 	SYSVSEM			# SYSV-style semaphores
 options 	_KPOSIX_PRIORITY_SCHEDULING # POSIX P1003_1B real-time extensions
 options 	KBD_INSTALL_CDEV	# install a CDEV entry in /dev
 options 	ADAPTIVE_GIANT		# Giant mutex is adaptive.
 options 	STOP_NMI		# Stop CPUS using NMI instead of IPI
 options 	AUDIT			# Security event auditing
 
 # To make an SMP kernel, the next two lines are needed
 options 	SMP			# Symmetric MultiProcessor Kernel
 device		apic			# I/O APIC
 
 # CPU frequency control
 device		cpufreq
 
 # Bus support.
 device		eisa
 device		pci
 
 # Floppy drives
 device		fdc
 
 # ATA and ATAPI devices
 device		ata
 device		atadisk		# ATA disk drives
 device		ataraid		# ATA RAID drives
 device		atapicd		# ATAPI CDROM drives
 device		atapifd		# ATAPI floppy drives
 device		atapist		# ATAPI tape drives
 options 	ATA_STATIC_ID	# Static device numbering
 
 # SCSI Controllers
 device		ahb		# EISA AHA1742 family
 device		ahc		# AHA2940 and onboard AIC7xxx devices
 options 	AHC_REG_PRETTY_PRINT	# Print register bitfields in debug
 					# output.  Adds ~128k to driver.
 device		ahd		# AHA39320/29320 and onboard AIC79xx devices
 options 	AHD_REG_PRETTY_PRINT	# Print register bitfields in debug
 					# output.  Adds ~215k to driver.
 device		amd		# AMD 53C974 (Tekram DC-390(T))
 device		hptiop		# Highpoint RocketRaid 3xxx series
 device		isp		# Qlogic family
 #device 	ispfw		# Firmware for QLogic HBAs- normally a module
 device		mpt		# LSI-Logic MPT-Fusion
 #device		ncr		# NCR/Symbios Logic
 device		sym		# NCR/Symbios Logic (newer chipsets + those of `ncr')
 device		trm		# Tekram DC395U/UW/F DC315U adapters
 
 device		adv		# Advansys SCSI adapters
 device		adw		# Advansys wide SCSI adapters
 device		aha		# Adaptec 154x SCSI adapters
 device		aic		# Adaptec 15[012]x SCSI adapters, AIC-6[23]60.
 device		bt		# Buslogic/Mylex MultiMaster SCSI adapters
 
 device		ncv		# NCR 53C500
 device		nsp		# Workbit Ninja SCSI-3
 device		stg		# TMC 18C30/18C50
 
 # SCSI peripherals
 device		scbus		# SCSI bus (required for SCSI)
 device		ch		# SCSI media changers
 device		da		# Direct Access (disks)
 device		sa		# Sequential Access (tape etc)
 device		cd		# CD
 device		pass		# Passthrough device (direct SCSI access)
 device		ses		# SCSI Environmental Services (and SAF-TE)
 
 # RAID controllers interfaced to the SCSI subsystem
 device		amr		# AMI MegaRAID
 device		arcmsr		# Areca SATA II RAID
 device		asr		# DPT SmartRAID V, VI and Adaptec SCSI RAID
 device		ciss		# Compaq Smart RAID 5*
 device		dpt		# DPT Smartcache III, IV - See NOTES for options
 device		hptmv		# Highpoint RocketRAID 182x
 device		hptrr		# Highpoint RocketRAID 17xx, 22xx, 23xx, 25xx
 device		iir		# Intel Integrated RAID
 device		ips		# IBM (Adaptec) ServeRAID
 device		mly		# Mylex AcceleRAID/eXtremeRAID
 device		twa		# 3ware 9000 series PATA/SATA RAID
 
 # RAID controllers
 device		aac		# Adaptec FSA RAID
 device		aacp		# SCSI passthrough for aac (requires CAM)
 device		ida		# Compaq Smart RAID
 device		mfi		# LSI MegaRAID SAS
 device		mlx		# Mylex DAC960 family
 device		pst		# Promise Supertrak SX6000
 device		twe		# 3ware ATA RAID
 
 # atkbdc0 controls both the keyboard and the PS/2 mouse
 device		atkbdc		# AT keyboard controller
 device		atkbd		# AT keyboard
 device		psm		# PS/2 mouse
 
 device		kbdmux		# keyboard multiplexer
 
 device		vga		# VGA video card driver
 
 device		splash		# Splash screen and screen saver support
 
 # syscons is the default console driver, resembling an SCO console
 device		sc
 
 device		agp		# support several AGP chipsets
 
 # Power management support (see NOTES for more options)
 #device		apm
 # Add suspend/resume support for the i8254.
 device		pmtimer
 
 # PCCARD (PCMCIA) support
 # PCMCIA and cardbus bridge support
 device		cbb		# cardbus (yenta) bridge
 device		pccard		# PC Card (16-bit) bus
 device		cardbus		# CardBus (32-bit) bus
 
 # Serial (COM) ports
 device		sio		# 8250, 16[45]50 based serial ports
 device		uart		# Generic UART driver
 
 # Parallel port
 device		ppc
 device		ppbus		# Parallel port bus (required)
 device		lpt		# Printer
 device		plip		# TCP/IP over parallel
 device		ppi		# Parallel port interface device
 #device		vpo		# Requires scbus and da
 
 # If you've got a "dumb" serial or parallel PCI card that is
 # supported by the puc(4) glue driver, uncomment the following
 # line to enable it (connects to sio, uart and/or ppc drivers):
 #device		puc
 
 # PCI Ethernet NICs.
 device		de		# DEC/Intel DC21x4x (``Tulip'')
 device		em		# Intel PRO/1000 adapter Gigabit Ethernet Card
 device		ixgb		# Intel PRO/10GbE Ethernet Card
 device		le		# AMD Am7900 LANCE and Am79C9xx PCnet
 device		txp		# 3Com 3cR990 (``Typhoon'')
 device		vx		# 3Com 3c590, 3c595 (``Vortex'')
 
 # PCI Ethernet NICs that use the common MII bus controller code.
 # NOTE: Be sure to keep the 'device miibus' line in order to use these NICs!
 device		miibus		# MII bus support
 device		bce		# Broadcom BCM5706/BCM5708 Gigabit Ethernet
 device		bfe		# Broadcom BCM440x 10/100 Ethernet
 device		bge		# Broadcom BCM570xx Gigabit Ethernet
 device		dc		# DEC/Intel 21143 and various workalikes
 device		fxp		# Intel EtherExpress PRO/100B (82557, 82558)
 device		lge		# Level 1 LXT1001 gigabit Ethernet
 device		msk		# Marvell/SysKonnect Yukon II Gigabit Ethernet
 device		nfe		# nVidia nForce MCP on-board Ethernet
 device		nge		# NatSemi DP83820 gigabit Ethernet
 #device		nve		# nVidia nForce MCP on-board Ethernet Networking
 device		pcn		# AMD Am79C97x PCI 10/100 (precedence over 'le')
 device		re		# RealTek 8139C+/8169/8169S/8110S
 device		rl		# RealTek 8129/8139
 device		sf		# Adaptec AIC-6915 (``Starfire'')
 device		sis		# Silicon Integrated Systems SiS 900/SiS 7016
 device		sk		# SysKonnect SK-984x & SK-982x gigabit Ethernet
 device		ste		# Sundance ST201 (D-Link DFE-550TX)
 device		stge		# Sundance/Tamarack TC9021 gigabit Ethernet
 device		ti		# Alteon Networks Tigon I/II gigabit Ethernet
 device		tl		# Texas Instruments ThunderLAN
 device		tx		# SMC EtherPower II (83c170 ``EPIC'')
 device		vge		# VIA VT612x gigabit Ethernet
 device		vr		# VIA Rhine, Rhine II
 device		wb		# Winbond W89C840F
 device		xl		# 3Com 3c90x (``Boomerang'', ``Cyclone'')
 
 # ISA Ethernet NICs.  pccard NICs included.
 device		cs		# Crystal Semiconductor CS89x0 NIC
 # 'device ed' requires 'device miibus'
 device		ed		# NE[12]000, SMC Ultra, 3c503, DS8390 cards
 device		ex		# Intel EtherExpress Pro/10 and Pro/10+
 device		ep		# Etherlink III based cards
 device		fe		# Fujitsu MB8696x based cards
 device		ie		# EtherExpress 8/16, 3C507, StarLAN 10 etc.
 device		sn		# SMC's 9000 series of Ethernet chips
 device		xe		# Xircom pccard Ethernet
 
 # Wireless NIC cards
 device		wlan		# 802.11 support
 device		wlan_wep	# 802.11 WEP support
 device		wlan_ccmp	# 802.11 CCMP support
 device		wlan_tkip	# 802.11 TKIP support
 device		wlan_amrr	# AMRR transmit rate control algorithm
 device		wlan_scan_ap	# 802.11 AP mode scanning
 device		wlan_scan_sta	# 802.11 STA mode scanning
 device		an		# Aironet 4500/4800 802.11 wireless NICs.
 device		ath		# Atheros pci/cardbus NIC's
 device		ath_hal		# Atheros HAL (Hardware Access Layer)
 device		ath_rate_sample	# SampleRate tx rate control for ath
 device		awi		# BayStack 660 and others
 device		ral		# Ralink Technology RT2500 wireless NICs.
 device		wi		# WaveLAN/Intersil/Symbol 802.11 wireless NICs.
 #device		wl		# Older non 802.11 Wavelan wireless NIC.
 
 # Pseudo devices.
 device		loop		# Network loopback
 device		random		# Entropy device
 device		ether		# Ethernet support
 device		sl		# Kernel SLIP
 device		ppp		# Kernel PPP
 device		tun		# Packet tunnel.
 device		pty		# Pseudo-ttys (telnet etc)
 device		md		# Memory "disks"
 device		gif		# IPv6 and IPv4 tunneling
 device		faith		# IPv6-to-IPv4 relaying (translation)
 device		firmware	# firmware assist module
 
 # The `bpf' device enables the Berkeley Packet Filter.
 # Be aware of the administrative consequences of enabling this!
 # Note that 'bpf' is required for DHCP.
 device		bpf		# Berkeley packet filter
 
 # USB support
 device		uhci		# UHCI PCI->USB interface
 device		ohci		# OHCI PCI->USB interface
 device		ehci		# EHCI PCI->USB interface (USB 2.0)
 device		usb		# USB Bus (required)
 #device		udbp		# USB Double Bulk Pipe devices
 device		ugen		# Generic
 device		uhid		# "Human Interface Devices"
 device		ukbd		# Keyboard
 device		ulpt		# Printer
 device		umass		# Disks/Mass storage - Requires scbus and da
 device		ums		# Mouse
 device		ural		# Ralink Technology RT2500USB wireless NICs
 device		rum		# Ralink Technology RT2501USB wireless NICs
 device		urio		# Diamond Rio 500 MP3 player
 device		uscanner	# Scanners
 # USB Ethernet, requires miibus
 device		aue		# ADMtek USB Ethernet
 device		axe		# ASIX Electronics USB Ethernet
 device		cdce		# Generic USB over Ethernet
 device		cue		# CATC USB Ethernet
 device		kue		# Kawasaki LSI USB Ethernet
 device		rue		# RealTek RTL8150 USB Ethernet
 
 # FireWire support
 device		firewire	# FireWire bus code
 device		sbp		# SCSI over FireWire (Requires scbus and da)
 device		fwe		# Ethernet over FireWire (non-standard!)
 device		fwip		# IP over FireWire (RFC 2734,3146)
 device		dcons		# Dumb console driver
 device		dcons_crom	# Configuration ROM for dcons
 
 options		QUOTA
 options		IPFIREWALL
 options		IPFIREWALL_VERBOSE
 options		IPFIREWALL_DEFAULT_TO_ACCEPT
 options		IPFIREWALL_FORWARD
 options		DUMMYNET
 options		HZ=1000
 
 --------------050205020809030709010103--

From: Wouter Snels <nospam@ofloo.org>
To: bug-followup@FreeBSD.org, nospam@ofloo.net
Cc:  
Subject: Re: kern/127699: [panic] Fatal trap 12: page fault while in kernel
 mode
Date: Fri, 03 Oct 2008 12:40:43 +0200

 This is a multi-part message in MIME format.
 --------------080607010008040707090704
 Content-Type: text/plain; charset=ISO-8859-1
 Content-Transfer-Encoding: 7bit
 
 There are no patches or 3rd party modules loaded.
 
 kldstat
 Id Refs Address    Size     Name
  1    4 0xc0400000 91d344   kernel
  2    1 0xc0d1e000 6a32c    acpi.ko
  3    1 0xc5772000 3000     if_stf.ko
 
 I'm not sure what you mean by world and kernel being sync'ed, I compiled
 the kernel and world like this.
 
 cd /usr/src/sys/i386/conf
 config OFL
 cd ../compile/OFL
 make -j9 cleandepend
 make -j9 depend
 cd /usr/src
 make -j9 buildworld
 make -j9 buildkernel
 make -j9 installkernel
 reboot
 mergemaster -p
 make -j9 installworld
 mergemaster
 reboot
 
 I did a quick search on google on how to backtrace kernel but I couldn't
 find any information which pointed to what you are asking, could you
 please explain or provide a page which does.
 
 I also included make.conf though it might be useful.
 
 Regards, WS
 
 --------------080607010008040707090704
 Content-Type: text/plain;
  name="make.conf"
 Content-Transfer-Encoding: 7bit
 Content-Disposition: inline;
  filename="make.conf"
 
 # added by use.perl 2008-08-30 14:55:15
 PERL_VER=5.8.8
 PERL_VERSION=5.8.8
 MASTER_SORT_REGEX?= ://[^/]*\.be/ ://[^/]*\.be\.
 KERNCONF=OFL
 #NO_GAMES=yes
 NO_X=yes
 WITHOUT_X11=yes
 PORT_UPGRADE=yes
 SUP_UPDATE=yes
 SUP=/usr/local/bin/cvsup
 SUPFLAGS=-g -L 2
 #SUPHOST=cvsup3.nl.freebsd.org
 SUPFILE=/usr/local/etc/cvsup/RELENG_7_0/src-supfile
 PORTSSUPFILE=/usr/local/etc/cvsup/RELENG_7_0/ports-supfile
 DOCSUPFILE=/usr/local/etc/cvsup/RELENG_7_0/doc-supfile
 NO_USB=yes
 NO_BLUETOOTH=true
 FORCE_PKG_REGISTER=yes
 # COM1: = 0x3F8, COM2: = 0x2F8, COM3: = 0x3E8, COM4: = 0x2E8 # 
 BOOT_COMCONSOLE_PORT=0x3F8
 BOOT_COMCONSOLE_SPEED=115200
 PYTHON_DEFAULT_VERSION=python2.5
 
 --------------080607010008040707090704
 Content-Type: text/plain;
  name="dmesg.boot"
 Content-Transfer-Encoding: 7bit
 Content-Disposition: inline;
  filename="dmesg.boot"
 
 Copyright (c) 1992-2008 The FreeBSD Project.
 Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
 	The Regents of the University of California. All rights reserved.
 FreeBSD is a registered trademark of The FreeBSD Foundation.
 FreeBSD 7.0-RELEASE-p4 #1: Sat Sep  6 19:20:57 CEST 2008
     ofloo@spark.ofloo.net:/usr/obj/usr/src/sys/OFL
 Timecounter "i8254" frequency 1193182 Hz quality 0
 CPU: Intel Pentium III Xeon (701.60-MHz 686-class CPU)
   Origin = "GenuineIntel"  Id = 0x6a1  Stepping = 1
   Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
 real memory  = 2147467264 (2047 MB)
 avail memory = 2091917312 (1995 MB)
 ACPI APIC Table: <COMPAQ 00000083>
 FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
  cpu0 (BSP): APIC ID:  3
  cpu1 (AP): APIC ID:  0
  cpu2 (AP): APIC ID:  1
  cpu3 (AP): APIC ID:  2
 ioapic0: Changing APIC ID to 8
 MADT: Forcing active-low polarity and level trigger for SCI
 ioapic0 <Version 1.1> irqs 0-34 on motherboard
 kbd1 at kbdmux0
 ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
 hptrr: HPT RocketRAID controller driver v1.1 (Sep  6 2008 19:18:46)
 acpi0: <COMPAQ YORKTOWN> on motherboard
 acpi0: [ITHREAD]
 acpi0: Power Button (fixed)
 Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x240-0x243 on acpi0
 cpu0: <ACPI CPU> on acpi0
 cpu1: <ACPI CPU> on acpi0
 cpu2: <ACPI CPU> on acpi0
 cpu3: <ACPI CPU> on acpi0
 pcib0: <ACPI Host-PCI bridge> on acpi0
 pci0: <ACPI PCI bus> on pcib0
 pci0: <base peripheral> at device 3.0 (no driver attached)
 ida0: <Compaq Integrated Array controller> port 0x2000-0x20ff mem 0xec000000-0xecffffff,0xeb000000-0xebffffff irq 29 at device 4.0 on pci0
 ida0: [GIANT-LOCKED]
 ida0: [ITHREAD]
 ida0: drives=1 firm_rev=1.44
 idad0: <Compaq Logical Drive> on ida0
 idad0: 34719MB (71106240 sectors), blocksize=512
 vgapci0: <VGA-compatible display> port 0x2400-0x24ff mem 0xe9000000-0xe9ffffff,0xeaff0000-0xeaff0fff at device 5.0 on pci0
 isab0: <PCI-ISA bridge> at device 15.0 on pci0
 isa0: <ISA bus> on isab0
 atapci0: <ServerWorks ROSB4 UDMA33 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x2800-0x280f at device 15.1 on pci0
 ata0: <ATA channel 0> on atapci0
 ata0: [ITHREAD]
 ata1: <ATA channel 1> on atapci0
 ata1: [ITHREAD]
 pcib1: <ACPI Host-PCI bridge> on acpi0
 pci2: <ACPI PCI bus> on pcib1
 pci2: <base peripheral, PCI hot-plug controller> at device 5.0 (no driver attached)
 txp0: <3Com 3cR990-SRV-97 Etherlink Server with 3XP Processor> port 0x3000-0x307f mem 0xf2a80000-0xf2abffff irq 20 at device 9.0 on pci2
 txp0: using obsoleted if_watchdog interface
 txp0: Ethernet address: 00:01:03:bc:64:7a
 txp0: [ITHREAD]
 pcib2: <ACPI Host-PCI bridge> on acpi0
 pci7: <ACPI PCI bus> on pcib2
 pci7: <base peripheral, PCI hot-plug controller> at device 5.0 (no driver attached)
 pcib3: <PCI-PCI bridge> at device 7.0 on pci7
 pci8: <PCI bus> on pcib3
 fxp0: <Intel 82559 Pro/100 Ethernet> port 0x8000-0x803f mem 0xf7ff0000-0xf7ff0fff,0xf7e00000-0xf7efffff irq 24 at device 4.0 on pci8
 miibus0: <MII bus> on fxp0
 inphy0: <i82555 10/100 media interface> PHY 1 on miibus0
 inphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
 fxp0: Ethernet address: 00:02:a5:6b:c7:0e
 fxp0: [ITHREAD]
 fxp1: <Intel 82559 Pro/100 Ethernet> port 0x8040-0x807f mem 0xf7df0000-0xf7df0fff,0xf7c00000-0xf7cfffff irq 25 at device 5.0 on pci8
 miibus1: <MII bus> on fxp1
 inphy1: <i82555 10/100 media interface> PHY 1 on miibus1
 inphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
 fxp1: Ethernet address: 00:02:a5:6b:c7:0f
 fxp1: [ITHREAD]
 acpi_tz0: <Thermal Zone> on acpi0
 atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
 atkbd0: <AT Keyboard> irq 1 on atkbdc0
 kbd0 at atkbd0
 atkbd0: [GIANT-LOCKED]
 atkbd0: [ITHREAD]
 fdc0: <floppy drive controller> port 0x3f2-0x3f5 irq 6 drq 2 on acpi0
 fdc0: [FILTER]
 fd0: <1440-KB 3.5" drive> on fdc0 drive 0
 sio0: <Standard PC COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
 sio0: type 16550A, console
 sio0: [FILTER]
 sio1: configured irq 3 not in bitmap of probed irqs 0
 sio1: port may not be enabled
 sio1: configured irq 3 not in bitmap of probed irqs 0
 sio1: port may not be enabled
 pmtimer0 on isa0
 orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcbfff,0xe8000-0xedfff,0xee000-0xeffff pnpid ORM0000 on isa0
 ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
 ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode
 ppbus0: <Parallel port bus> on ppc0
 ppbus0: [ITHREAD]
 plip0: <PLIP network interface> on ppbus0
 lpt0: <Printer> on ppbus0
 lpt0: Interrupt-driven port
 ppi0: <Parallel I/O> on ppbus0
 ppc0: [GIANT-LOCKED]
 ppc0: [ITHREAD]
 sc0: <System console> at flags 0x100 on isa0
 sc0: VGA <16 virtual consoles, flags=0x300>
 sio1: configured irq 3 not in bitmap of probed irqs 0
 sio1: port may not be enabled
 vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
 Timecounters tick every 1.000 msec
 ipfw2 (+ipv6) initialized, divert loadable, rule-based forwarding enabled, default to accept, logging unlimited
 hptrr: no controller detected.
 acd0: CDROM <CD-224E/9.0C> at ata0-master PIO4
 SMP: AP CPU #1 Launched!
 SMP: AP CPU #2 Launched!
 SMP: AP CPU #3 Launched!
 Trying to mount root from ufs:/dev/idad0s1a
 WARNING: / was not properly dismounted
 WARNING: /tmp was not properly dismounted
 /tmp: mount pending error: blocks 0 files 1
 WARNING: /usr was not properly dismounted
 /usr: mount pending error: blocks 220 files 13
 WARNING: /var was not properly dismounted
 
 --------------080607010008040707090704
 Content-Type: text/plain;
  name="OFL"
 Content-Transfer-Encoding: 7bit
 Content-Disposition: inline;
  filename="OFL"
 
 cpu		I686_CPU
 ident		OFL
 
 # To statically compile in device wiring instead of /boot/device.hints
 #hints		"GENERIC.hints"		# Default places to look for devices.
 
 makeoptions	DEBUG=-g		# Build kernel with gdb(1) debug symbols
 
 options 	SCHED_ULE		# 4BSD scheduler
 options 	PREEMPTION		# Enable kernel thread preemption
 options 	INET			# InterNETworking
 options 	INET6			# IPv6 communications protocols
 options 	SCTP			# Stream Control Transmission Protocol
 options 	FFS			# Berkeley Fast Filesystem
 options 	SOFTUPDATES		# Enable FFS soft updates support
 options 	UFS_ACL			# Support for access control lists
 options 	UFS_DIRHASH		# Improve performance on big directories
 options 	UFS_GJOURNAL		# Enable gjournal-based UFS journaling
 options 	MD_ROOT			# MD is a potential root device
 options 	NFSCLIENT		# Network Filesystem Client
 options 	NFSSERVER		# Network Filesystem Server
 options 	NFS_ROOT		# NFS usable as /, requires NFSCLIENT
 options 	MSDOSFS			# MSDOS Filesystem
 options 	CD9660			# ISO 9660 Filesystem
 options 	PROCFS			# Process filesystem (requires PSEUDOFS)
 options 	PSEUDOFS		# Pseudo-filesystem framework
 options 	GEOM_PART_GPT		# GUID Partition Tables.
 options 	GEOM_LABEL		# Provides labelization
 options 	COMPAT_43TTY		# BSD 4.3 TTY compat [KEEP THIS!]
 options 	COMPAT_FREEBSD4		# Compatible with FreeBSD4
 options 	COMPAT_FREEBSD5		# Compatible with FreeBSD5
 options 	COMPAT_FREEBSD6		# Compatible with FreeBSD6
 options 	SCSI_DELAY=5000		# Delay (in ms) before probing SCSI
 options 	KTRACE			# ktrace(1) support
 options 	SYSVSHM			# SYSV-style shared memory
 options 	SYSVMSG			# SYSV-style message queues
 options 	SYSVSEM			# SYSV-style semaphores
 options 	_KPOSIX_PRIORITY_SCHEDULING # POSIX P1003_1B real-time extensions
 options 	KBD_INSTALL_CDEV	# install a CDEV entry in /dev
 options 	ADAPTIVE_GIANT		# Giant mutex is adaptive.
 options 	STOP_NMI		# Stop CPUS using NMI instead of IPI
 options 	AUDIT			# Security event auditing
 
 # To make an SMP kernel, the next two lines are needed
 options 	SMP			# Symmetric MultiProcessor Kernel
 device		apic			# I/O APIC
 
 # CPU frequency control
 device		cpufreq
 
 # Bus support.
 device		eisa
 device		pci
 
 # Floppy drives
 device		fdc
 
 # ATA and ATAPI devices
 device		ata
 device		atadisk		# ATA disk drives
 device		ataraid		# ATA RAID drives
 device		atapicd		# ATAPI CDROM drives
 device		atapifd		# ATAPI floppy drives
 device		atapist		# ATAPI tape drives
 options 	ATA_STATIC_ID	# Static device numbering
 
 # SCSI Controllers
 device		ahb		# EISA AHA1742 family
 device		ahc		# AHA2940 and onboard AIC7xxx devices
 options 	AHC_REG_PRETTY_PRINT	# Print register bitfields in debug
 					# output.  Adds ~128k to driver.
 device		ahd		# AHA39320/29320 and onboard AIC79xx devices
 options 	AHD_REG_PRETTY_PRINT	# Print register bitfields in debug
 					# output.  Adds ~215k to driver.
 device		amd		# AMD 53C974 (Tekram DC-390(T))
 device		hptiop		# Highpoint RocketRaid 3xxx series
 device		isp		# Qlogic family
 #device 	ispfw		# Firmware for QLogic HBAs- normally a module
 device		mpt		# LSI-Logic MPT-Fusion
 #device		ncr		# NCR/Symbios Logic
 device		sym		# NCR/Symbios Logic (newer chipsets + those of `ncr')
 device		trm		# Tekram DC395U/UW/F DC315U adapters
 
 device		adv		# Advansys SCSI adapters
 device		adw		# Advansys wide SCSI adapters
 device		aha		# Adaptec 154x SCSI adapters
 device		aic		# Adaptec 15[012]x SCSI adapters, AIC-6[23]60.
 device		bt		# Buslogic/Mylex MultiMaster SCSI adapters
 
 device		ncv		# NCR 53C500
 device		nsp		# Workbit Ninja SCSI-3
 device		stg		# TMC 18C30/18C50
 
 # SCSI peripherals
 device		scbus		# SCSI bus (required for SCSI)
 device		ch		# SCSI media changers
 device		da		# Direct Access (disks)
 device		sa		# Sequential Access (tape etc)
 device		cd		# CD
 device		pass		# Passthrough device (direct SCSI access)
 device		ses		# SCSI Environmental Services (and SAF-TE)
 
 # RAID controllers interfaced to the SCSI subsystem
 device		amr		# AMI MegaRAID
 device		arcmsr		# Areca SATA II RAID
 device		asr		# DPT SmartRAID V, VI and Adaptec SCSI RAID
 device		ciss		# Compaq Smart RAID 5*
 device		dpt		# DPT Smartcache III, IV - See NOTES for options
 device		hptmv		# Highpoint RocketRAID 182x
 device		hptrr		# Highpoint RocketRAID 17xx, 22xx, 23xx, 25xx
 device		iir		# Intel Integrated RAID
 device		ips		# IBM (Adaptec) ServeRAID
 device		mly		# Mylex AcceleRAID/eXtremeRAID
 device		twa		# 3ware 9000 series PATA/SATA RAID
 
 # RAID controllers
 device		aac		# Adaptec FSA RAID
 device		aacp		# SCSI passthrough for aac (requires CAM)
 device		ida		# Compaq Smart RAID
 device		mfi		# LSI MegaRAID SAS
 device		mlx		# Mylex DAC960 family
 device		pst		# Promise Supertrak SX6000
 device		twe		# 3ware ATA RAID
 
 # atkbdc0 controls both the keyboard and the PS/2 mouse
 device		atkbdc		# AT keyboard controller
 device		atkbd		# AT keyboard
 device		psm		# PS/2 mouse
 
 device		kbdmux		# keyboard multiplexer
 
 device		vga		# VGA video card driver
 
 device		splash		# Splash screen and screen saver support
 
 # syscons is the default console driver, resembling an SCO console
 device		sc
 
 device		agp		# support several AGP chipsets
 
 # Power management support (see NOTES for more options)
 #device		apm
 # Add suspend/resume support for the i8254.
 device		pmtimer
 
 # PCCARD (PCMCIA) support
 # PCMCIA and cardbus bridge support
 device		cbb		# cardbus (yenta) bridge
 device		pccard		# PC Card (16-bit) bus
 device		cardbus		# CardBus (32-bit) bus
 
 # Serial (COM) ports
 device		sio		# 8250, 16[45]50 based serial ports
 device		uart		# Generic UART driver
 
 # Parallel port
 device		ppc
 device		ppbus		# Parallel port bus (required)
 device		lpt		# Printer
 device		plip		# TCP/IP over parallel
 device		ppi		# Parallel port interface device
 #device		vpo		# Requires scbus and da
 
 # If you've got a "dumb" serial or parallel PCI card that is
 # supported by the puc(4) glue driver, uncomment the following
 # line to enable it (connects to sio, uart and/or ppc drivers):
 #device		puc
 
 # PCI Ethernet NICs.
 device		de		# DEC/Intel DC21x4x (``Tulip'')
 device		em		# Intel PRO/1000 adapter Gigabit Ethernet Card
 device		ixgb		# Intel PRO/10GbE Ethernet Card
 device		le		# AMD Am7900 LANCE and Am79C9xx PCnet
 device		txp		# 3Com 3cR990 (``Typhoon'')
 device		vx		# 3Com 3c590, 3c595 (``Vortex'')
 
 # PCI Ethernet NICs that use the common MII bus controller code.
 # NOTE: Be sure to keep the 'device miibus' line in order to use these NICs!
 device		miibus		# MII bus support
 device		bce		# Broadcom BCM5706/BCM5708 Gigabit Ethernet
 device		bfe		# Broadcom BCM440x 10/100 Ethernet
 device		bge		# Broadcom BCM570xx Gigabit Ethernet
 device		dc		# DEC/Intel 21143 and various workalikes
 device		fxp		# Intel EtherExpress PRO/100B (82557, 82558)
 device		lge		# Level 1 LXT1001 gigabit Ethernet
 device		msk		# Marvell/SysKonnect Yukon II Gigabit Ethernet
 device		nfe		# nVidia nForce MCP on-board Ethernet
 device		nge		# NatSemi DP83820 gigabit Ethernet
 #device		nve		# nVidia nForce MCP on-board Ethernet Networking
 device		pcn		# AMD Am79C97x PCI 10/100 (precedence over 'le')
 device		re		# RealTek 8139C+/8169/8169S/8110S
 device		rl		# RealTek 8129/8139
 device		sf		# Adaptec AIC-6915 (``Starfire'')
 device		sis		# Silicon Integrated Systems SiS 900/SiS 7016
 device		sk		# SysKonnect SK-984x & SK-982x gigabit Ethernet
 device		ste		# Sundance ST201 (D-Link DFE-550TX)
 device		stge		# Sundance/Tamarack TC9021 gigabit Ethernet
 device		ti		# Alteon Networks Tigon I/II gigabit Ethernet
 device		tl		# Texas Instruments ThunderLAN
 device		tx		# SMC EtherPower II (83c170 ``EPIC'')
 device		vge		# VIA VT612x gigabit Ethernet
 device		vr		# VIA Rhine, Rhine II
 device		wb		# Winbond W89C840F
 device		xl		# 3Com 3c90x (``Boomerang'', ``Cyclone'')
 
 # ISA Ethernet NICs.  pccard NICs included.
 device		cs		# Crystal Semiconductor CS89x0 NIC
 # 'device ed' requires 'device miibus'
 device		ed		# NE[12]000, SMC Ultra, 3c503, DS8390 cards
 device		ex		# Intel EtherExpress Pro/10 and Pro/10+
 device		ep		# Etherlink III based cards
 device		fe		# Fujitsu MB8696x based cards
 device		ie		# EtherExpress 8/16, 3C507, StarLAN 10 etc.
 device		sn		# SMC's 9000 series of Ethernet chips
 device		xe		# Xircom pccard Ethernet
 
 # Wireless NIC cards
 device		wlan		# 802.11 support
 device		wlan_wep	# 802.11 WEP support
 device		wlan_ccmp	# 802.11 CCMP support
 device		wlan_tkip	# 802.11 TKIP support
 device		wlan_amrr	# AMRR transmit rate control algorithm
 device		wlan_scan_ap	# 802.11 AP mode scanning
 device		wlan_scan_sta	# 802.11 STA mode scanning
 device		an		# Aironet 4500/4800 802.11 wireless NICs.
 device		ath		# Atheros pci/cardbus NIC's
 device		ath_hal		# Atheros HAL (Hardware Access Layer)
 device		ath_rate_sample	# SampleRate tx rate control for ath
 device		awi		# BayStack 660 and others
 device		ral		# Ralink Technology RT2500 wireless NICs.
 device		wi		# WaveLAN/Intersil/Symbol 802.11 wireless NICs.
 #device		wl		# Older non 802.11 Wavelan wireless NIC.
 
 # Pseudo devices.
 device		loop		# Network loopback
 device		random		# Entropy device
 device		ether		# Ethernet support
 device		sl		# Kernel SLIP
 device		ppp		# Kernel PPP
 device		tun		# Packet tunnel.
 device		pty		# Pseudo-ttys (telnet etc)
 device		md		# Memory "disks"
 device		gif		# IPv6 and IPv4 tunneling
 device		faith		# IPv6-to-IPv4 relaying (translation)
 device		firmware	# firmware assist module
 
 # The `bpf' device enables the Berkeley Packet Filter.
 # Be aware of the administrative consequences of enabling this!
 # Note that 'bpf' is required for DHCP.
 device		bpf		# Berkeley packet filter
 
 # USB support
 device		uhci		# UHCI PCI->USB interface
 device		ohci		# OHCI PCI->USB interface
 device		ehci		# EHCI PCI->USB interface (USB 2.0)
 device		usb		# USB Bus (required)
 #device		udbp		# USB Double Bulk Pipe devices
 device		ugen		# Generic
 device		uhid		# "Human Interface Devices"
 device		ukbd		# Keyboard
 device		ulpt		# Printer
 device		umass		# Disks/Mass storage - Requires scbus and da
 device		ums		# Mouse
 device		ural		# Ralink Technology RT2500USB wireless NICs
 device		rum		# Ralink Technology RT2501USB wireless NICs
 device		urio		# Diamond Rio 500 MP3 player
 device		uscanner	# Scanners
 # USB Ethernet, requires miibus
 device		aue		# ADMtek USB Ethernet
 device		axe		# ASIX Electronics USB Ethernet
 device		cdce		# Generic USB over Ethernet
 device		cue		# CATC USB Ethernet
 device		kue		# Kawasaki LSI USB Ethernet
 device		rue		# RealTek RTL8150 USB Ethernet
 
 # FireWire support
 device		firewire	# FireWire bus code
 device		sbp		# SCSI over FireWire (Requires scbus and da)
 device		fwe		# Ethernet over FireWire (non-standard!)
 device		fwip		# IP over FireWire (RFC 2734,3146)
 device		dcons		# Dumb console driver
 device		dcons_crom	# Configuration ROM for dcons
 
 options		QUOTA
 options		IPFIREWALL
 options		IPFIREWALL_VERBOSE
 options		IPFIREWALL_DEFAULT_TO_ACCEPT
 options		IPFIREWALL_FORWARD
 options		DUMMYNET
 options		HZ=1000
 
 --------------080607010008040707090704--

From: Wouter Snels <nospam@ofloo.net>
To: Volker Werth <vwe@freebsd.org>, bug-followup@freebsd.org
Cc:  
Subject: Re: kern/127699: [panic] Fatal trap 12: page fault while in kernel
 mode
Date: Fri, 03 Oct 2008 23:19:23 +0200

 kgdb /boot/kernel/kernel /var/crash/vmcore.3
 [GDB will not be able to debug user-mode threads:
 /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
 GNU gdb 6.1.1 [FreeBSD]
 Copyright 2004 Free Software Foundation, Inc.
 GDB is free software, covered by the GNU General Public License, and you are
 welcome to change it and/or distribute copies of it under certain
 conditions.
 Type "show copying" to see the conditions.
 There is absolutely no warranty for GDB.  Type "show warranty" for details.
 This GDB was configured as "i386-marcel-freebsd".
 bt
 
 Unread portion of the kernel message buffer:
 
 
 Fatal trap 12: page fault while in kernel mode
 cpuid = 3; apic id = 02
 fault virtual address    = 0x4c
 fault code        = supervisor read, page not present
 instruction pointer    = 0x20:0xc577373d
 stack pointer            = 0x28:0xe8edd808
 frame pointer            = 0x28:0xe8edd84c
 code segment        = base 0x0, limit 0xfffff, type 0x1b
             = DPL 0, pres 1, def32 1, gran 1
 processor eflags    = interrupt enabled, resume, IOPL = 0
 current process        = 7569 (irssi)
 trap number        = 12
 panic: page fault
 cpuid = 3
 Uptime: 14h39m53s
 Physical memory: 2035 MB
 Dumping 182 MB: 167 151 135 119 103 87 71 55 39 23 7
 
 #0  doadump () at pcpu.h:195
 195    pcpu.h: No such file or directory.
     in pcpu.h
 (kgdb) bt
 #0  doadump () at pcpu.h:195
 #1  0xc0754507 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:409
 #2  0xc07547c9 in panic (fmt=Variable "fmt" is not available.
 ) at /usr/src/sys/kern/kern_shutdown.c:563
 #3  0xc0a5632c in trap_fatal (frame=0xe8edd7c8, eva=76)
     at /usr/src/sys/i386/i386/trap.c:899
 #4  0xc0a56590 in trap_pfault (frame=0xe8edd7c8, usermode=0, eva=76)
     at /usr/src/sys/i386/i386/trap.c:812
 #5  0xc0a56f12 in trap (frame=0xe8edd7c8) at
 /usr/src/sys/i386/i386/trap.c:490
 #6  0xc0a3d88b in calltrap () at /usr/src/sys/i386/i386/exception.s:139
 #7  0xc577373d in ?? ()
 Previous frame inner to this frame (corrupt stack?)
 (kgdb)
 
 
 
 Volker Werth schreef:
 > On 10/02/08 00:07, Wouter Snels wrote:
 >   
 >> First, want to thank you for your respond. There arn't any additional
 >> modules/patches installed, ..
 >>
 >> kldstat
 >> Id Refs Address    Size     Name
 >>  1    4 0xc0400000 91d344   kernel
 >>  2    1 0xc0d1e000 6a32c    acpi.ko
 >>  3    1 0xc5772000 3000     if_stf.ko
 >>
 >> I included make.conf because I thought it might be useful.
 >>
 >> I'm not exactly sure what mean by, world and kernel being sync'ed, I
 >> compiled according to the freebsd manual, ..
 >>
 >> I followed exactly those steps:
 >> http://www.freebsd.org/doc/en/books/handbook/makeworld.html
 >>
 >> # cd /usr/src/sys/i386/conf
 >> # config OFL
 >> # cd ../compile/OFL
 >> # make -j9 cleandepend
 >> # make -j9 depend
 >> # cd /usr/src
 >> # make -j9 buildworld
 >> # make -j9 buildkernel
 >> # make -j9 installkernel
 >> # reboot
 >> # mergemaster -p
 >> # make -j9 installworld
 >> # mergemaster
 >> # reboot
 >>
 >>
 >> Can you tell me how to do a kernel backtrace, I've done a quick search
 >> on google but couldn't really find any information on how to do this. Or
 >> give me a link to a page which explains it.
 >>
 >> Regards, WS
 >>     
 >
 > Wouter,
 >
 > sorry for the delay (I think I didn't already answer back, did I?).
 >
 > First, a short explanation about your kernel build process. You can
 > combine all your painful commands into a simple one (as clean,
 > cleandepend and others are automagically executed):
 >
 > # cd /usr/src ; make buildworld buildkernel KERNCONF=OFL
 >
 > and after successful build:
 >
 > # make installkernel && nextboot -o "-s" -k kernel
 > (now it's booting into single user mode)
 > # cd /usr/src ; make installworld && mergemaster
 >
 > Don't forget to do: # cd /usr/src && make check-old
 > and probably a ``make delete-old'' as check-old may or may not suggest.
 >
 > Anyway, now to your problem.
 >
 > If your kernel panics, it will (if well configured) write a kernel core
 > dump into swapspace. On the next reboot, the system executes ``savecore
 > -C'' to check for a core dump in swapspace and will save it into
 > /var/crash(/vmcore.N).
 >
 > If that goes well, you can inspect that dump using ``kgdb'':
 >
 > # kgdb /boot/kernel/kernel /var/crash/vmcore.N (N=latest written core dump)
 >
 > When kgdb comes up, issue a ''bt'' command at the (kgdb) prompt. Please
 > send me the output (best is to include bug-followup@freebsd.org in CC so
 > we have that information attached to the PR).
 >
 > If you need to know anything else, please let me know.
 >
 > Regards
 >
 > Volker
 >   
 

From: Wouter Snels <nospam@ofloo.net>
To: Volker Werth <vwe@freebsd.org>, bug-followup@freebsd.org
Cc:  
Subject: Re: kern/127699: [panic] Fatal trap 12: page fault while in kernel
 mode
Date: Fri, 03 Oct 2008 23:22:23 +0200

 kgdb /boot/kernel/kernel /var/crash/vmcore.3
 [GDB will not be able to debug user-mode threads:
 /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
 GNU gdb 6.1.1 [FreeBSD]
 Copyright 2004 Free Software Foundation, Inc.
 GDB is free software, covered by the GNU General Public License, and you are
 welcome to change it and/or distribute copies of it under certain
 conditions.
 Type "show copying" to see the conditions.
 There is absolutely no warranty for GDB.  Type "show warranty" for details.
 This GDB was configured as "i386-marcel-freebsd".
 bt
 
 Unread portion of the kernel message buffer:
 
 
 Fatal trap 12: page fault while in kernel mode
 cpuid = 3; apic id = 02
 fault virtual address    = 0x4c
 fault code        = supervisor read, page not present
 instruction pointer    = 0x20:0xc577373d
 stack pointer            = 0x28:0xe8edd808
 frame pointer            = 0x28:0xe8edd84c
 code segment        = base 0x0, limit 0xfffff, type 0x1b
             = DPL 0, pres 1, def32 1, gran 1
 processor eflags    = interrupt enabled, resume, IOPL = 0
 current process        = 7569 (irssi)
 trap number        = 12
 panic: page fault
 cpuid = 3
 Uptime: 14h39m53s
 Physical memory: 2035 MB
 Dumping 182 MB: 167 151 135 119 103 87 71 55 39 23 7
 
 #0  doadump () at pcpu.h:195
 195    pcpu.h: No such file or directory.
     in pcpu.h
 (kgdb) bt
 #0  doadump () at pcpu.h:195
 #1  0xc0754507 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:409
 #2  0xc07547c9 in panic (fmt=Variable "fmt" is not available.
 ) at /usr/src/sys/kern/kern_shutdown.c:563
 #3  0xc0a5632c in trap_fatal (frame=0xe8edd7c8, eva=76)
     at /usr/src/sys/i386/i386/trap.c:899
 #4  0xc0a56590 in trap_pfault (frame=0xe8edd7c8, usermode=0, eva=76)
     at /usr/src/sys/i386/i386/trap.c:812
 #5  0xc0a56f12 in trap (frame=0xe8edd7c8) at
 /usr/src/sys/i386/i386/trap.c:490
 #6  0xc0a3d88b in calltrap () at /usr/src/sys/i386/i386/exception.s:139
 #7  0xc577373d in ?? ()
 Previous frame inner to this frame (corrupt stack?)
 (kgdb)
 
 
 
 Volker Werth schreef:
 > On 10/02/08 00:07, Wouter Snels wrote:
 >   
 >> First, want to thank you for your respond. There arn't any additional
 >> modules/patches installed, ..
 >>
 >> kldstat
 >> Id Refs Address    Size     Name
 >>  1    4 0xc0400000 91d344   kernel
 >>  2    1 0xc0d1e000 6a32c    acpi.ko
 >>  3    1 0xc5772000 3000     if_stf.ko
 >>
 >> I included make.conf because I thought it might be useful.
 >>
 >> I'm not exactly sure what mean by, world and kernel being sync'ed, I
 >> compiled according to the freebsd manual, ..
 >>
 >> I followed exactly those steps:
 >> http://www.freebsd.org/doc/en/books/handbook/makeworld.html
 >>
 >> # cd /usr/src/sys/i386/conf
 >> # config OFL
 >> # cd ../compile/OFL
 >> # make -j9 cleandepend
 >> # make -j9 depend
 >> # cd /usr/src
 >> # make -j9 buildworld
 >> # make -j9 buildkernel
 >> # make -j9 installkernel
 >> # reboot
 >> # mergemaster -p
 >> # make -j9 installworld
 >> # mergemaster
 >> # reboot
 >>
 >>
 >> Can you tell me how to do a kernel backtrace, I've done a quick search
 >> on google but couldn't really find any information on how to do this. Or
 >> give me a link to a page which explains it.
 >>
 >> Regards, WS
 >>     
 >
 > Wouter,
 >
 > sorry for the delay (I think I didn't already answer back, did I?).
 >
 > First, a short explanation about your kernel build process. You can
 > combine all your painful commands into a simple one (as clean,
 > cleandepend and others are automagically executed):
 >
 > # cd /usr/src ; make buildworld buildkernel KERNCONF=OFL
 >
 > and after successful build:
 >
 > # make installkernel && nextboot -o "-s" -k kernel
 > (now it's booting into single user mode)
 > # cd /usr/src ; make installworld && mergemaster
 >
 > Don't forget to do: # cd /usr/src && make check-old
 > and probably a ``make delete-old'' as check-old may or may not suggest.
 >
 > Anyway, now to your problem.
 >
 > If your kernel panics, it will (if well configured) write a kernel core
 > dump into swapspace. On the next reboot, the system executes ``savecore
 > -C'' to check for a core dump in swapspace and will save it into
 > /var/crash(/vmcore.N).
 >
 > If that goes well, you can inspect that dump using ``kgdb'':
 >
 > # kgdb /boot/kernel/kernel /var/crash/vmcore.N (N=latest written core dump)
 >
 > When kgdb comes up, issue a ''bt'' command at the (kgdb) prompt. Please
 > send me the output (best is to include bug-followup@freebsd.org in CC so
 > we have that information attached to the PR).
 >
 > If you need to know anything else, please let me know.
 >
 > Regards
 >
 > Volker
 >   
 

From: Wouter Snels <nospam@ofloo.net>
To: Volker Werth <vwe@freebsd.org>, bug-followup@freebsd.org
Cc:  
Subject: Re: kern/127699: [panic] Fatal trap 12: page fault while in kernel
 mode
Date: Fri, 03 Oct 2008 23:37:22 +0200

 I'm glad someone is anwering, I did however do make update just today in
 /usr/src i was planning to update the kernel since i've noticed there is
 a new IPv6 security issue, .. incase it matters, ..
 
 Also thank you for the for the information on compiling the kernel.
 
 vmcore.3
 
 kgdb /boot/kernel/kernel /var/crash/vmcore.3
 [GDB will not be able to debug user-mode threads:
 /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
 GNU gdb 6.1.1 [FreeBSD]
 Copyright 2004 Free Software Foundation, Inc.
 GDB is free software, covered by the GNU General Public License, and you are
 welcome to change it and/or distribute copies of it under certain
 conditions.
 Type "show copying" to see the conditions.
 There is absolutely no warranty for GDB.  Type "show warranty" for details.
 This GDB was configured as "i386-marcel-freebsd".
 bt
 
 Unread portion of the kernel message buffer:
 
 
 Fatal trap 12: page fault while in kernel mode
 cpuid = 3; apic id = 02
 fault virtual address    = 0x4c
 fault code        = supervisor read, page not present
 instruction pointer    = 0x20:0xc577373d
 stack pointer            = 0x28:0xe8edd808
 frame pointer            = 0x28:0xe8edd84c
 code segment        = base 0x0, limit 0xfffff, type 0x1b
             = DPL 0, pres 1, def32 1, gran 1
 processor eflags    = interrupt enabled, resume, IOPL = 0
 current process        = 7569 (irssi)
 trap number        = 12
 panic: page fault
 cpuid = 3
 Uptime: 14h39m53s
 Physical memory: 2035 MB
 Dumping 182 MB: 167 151 135 119 103 87 71 55 39 23 7
 
 #0  doadump () at pcpu.h:195
 195    pcpu.h: No such file or directory.
     in pcpu.h
 (kgdb) bt
 #0  doadump () at pcpu.h:195
 #1  0xc0754507 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:409
 #2  0xc07547c9 in panic (fmt=Variable "fmt" is not available.
 ) at /usr/src/sys/kern/kern_shutdown.c:563
 #3  0xc0a5632c in trap_fatal (frame=0xe8edd7c8, eva=76)
     at /usr/src/sys/i386/i386/trap.c:899
 #4  0xc0a56590 in trap_pfault (frame=0xe8edd7c8, usermode=0, eva=76)
     at /usr/src/sys/i386/i386/trap.c:812
 #5  0xc0a56f12 in trap (frame=0xe8edd7c8) at
 /usr/src/sys/i386/i386/trap.c:490
 #6  0xc0a3d88b in calltrap () at /usr/src/sys/i386/i386/exception.s:139
 #7  0xc577373d in ?? ()
 Previous frame inner to this frame (corrupt stack?)
 (kgdb)
 
 vmcore.2
 
 kgdb /boot/kernel/kernel /var/crash/vmcore.2
 [GDB will not be able to debug user-mode threads:
 /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
 GNU gdb 6.1.1 [FreeBSD]
 Copyright 2004 Free Software Foundation, Inc.
 GDB is free software, covered by the GNU General Public License, and you are
 welcome to change it and/or distribute copies of it under certain
 conditions.
 Type "show copying" to see the conditions.
 There is absolutely no warranty for GDB.  Type "show warranty" for details.
 This GDB was configured as "i386-marcel-freebsd".
 b
 Unread portion of the kernel message buffer:
 
 
 Fatal trap 12: page fault while in kernel mode
 cpuid = 3; apic id = 02
 fault virtual address    = 0x4c
 fault code        = supervisor read, page not present
 instruction pointer    = 0x20:0xc576e73d
 stack pointer            = 0x28:0xe8d9e808
 frame pointer            = 0x28:0xe8d9e84c
 code segment        = base 0x0, limit 0xfffff, type 0x1b
             = DPL 0, pres 1, def32 1, gran 1
 processor eflags    = interrupt enabled, resume, IOPL = 0
 current process        = 7173 (irssi)
 trap number        = 12
 panic: page fault
 cpuid = 3
 Uptime: 1d6h11m9s
 Physical memory: 2035 MB
 Dumping 242 MB: 227 211 195 179 163 147 131 115 99 83 67 51 35 19 3
 
 #0  doadump () at pcpu.h:195
 195    pcpu.h: No such file or directory.
     in pcpu.h
 (kgdb) bt
 #0  doadump () at pcpu.h:195
 #1  0xc0754507 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:409
 #2  0xc07547c9 in panic (fmt=Variable "fmt" is not available.
 ) at /usr/src/sys/kern/kern_shutdown.c:563
 #3  0xc0a5632c in trap_fatal (frame=0xe8d9e7c8, eva=76) at
 /usr/src/sys/i386/i386/trap.c:899
 #4  0xc0a56590 in trap_pfault (frame=0xe8d9e7c8, usermode=0, eva=76) at
 /usr/src/sys/i386/i386/trap.c:812
 #5  0xc0a56f12 in trap (frame=0xe8d9e7c8) at
 /usr/src/sys/i386/i386/trap.c:490
 #6  0xc0a3d88b in calltrap () at /usr/src/sys/i386/i386/exception.s:139
 #7  0xc576e73d in ?? ()
 Previous frame inner to this frame (corrupt stack?)
 (kgdb)
 
 
 vmcore.1
 
 kgdb /boot/kernel/kernel /var/crash/vmcore.1
 [GDB will not be able to debug user-mode threads:
 /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
 GNU gdb 6.1.1 [FreeBSD]
 Copyright 2004 Free Software Foundation, Inc.
 GDB is free software, covered by the GNU General Public License, and you are
 welcome to change it and/or distribute copies of it under certain
 conditions.
 Type "show copying" to see the conditions.
 There is absolutely no warranty for GDB.  Type "show warranty" for details.
 This GDB was configured as "i386-marcel-freebsd".
 bt
 
 Unread portion of the kernel message buffer:
 <118>Aug 31 15:32:26  syslogd: exiting on signal 15
 Waiting (max 60 seconds) for system process `vnlru' to stop...done
 Waiting (max 60 seconds) for system process `bufdaemon' to stop...done
 Waiting (max 60 seconds) for system process `syncer' to stop...
 Syncing disks, vnodes remaining...3 2 1 0 0 0 done
 All buffers synced.
 panic: dqflush: stray dquot
 cpuid = 0
 Uptime: 21h5m59s
 Physical memory: 2035 MB
 Dumping 230 MB: 215 199 183 167 151 135 119 103 87 71 55 39 23 7
 
 #0  doadump () at pcpu.h:195
 195    pcpu.h: No such file or directory.
     in pcpu.h
 (kgdb) bt
 #0  doadump () at pcpu.h:195
 #1  0xc0754507 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:409
 #2  0xc07547c9 in panic (fmt=Variable "fmt" is not available.
 ) at /usr/src/sys/kern/kern_shutdown.c:563
 #3  0xc0969a1c in quotaoff1 (td=0xc6786880, mp=Variable "mp" is not
 available.
 ) at /usr/src/sys/ufs/ufs/ufs_quota.c:1443
 #4  0xc0969d08 in quotaoff_inchange (td=Variable "td" is not available.
 ) at /usr/src/sys/ufs/ufs/ufs_quota.c:721
 #5  0xc0969f81 in quotaoff (td=0xc6786880, mp=0xc551c7d4, type=0) at
 /usr/src/sys/ufs/ufs/ufs_quota.c:763
 #6  0xc095afb1 in ffs_flushfiles (mp=0xc551c7d4, flags=2, td=0xc6786880)
 at /usr/src/sys/ufs/ffs/ffs_vfsops.c:1096
 #7  0xc09506f7 in softdep_flushfiles (oldmnt=0xc551c7d4, flags=2,
 td=0xc6786880) at /usr/src/sys/ufs/ffs/ffs_softdep.c:1095
 #8  0xc095b10d in ffs_unmount (mp=0xc551c7d4, mntflags=524288,
 td=0xc6786880) at /usr/src/sys/ufs/ffs/ffs_vfsops.c:1031
 #9  0xc07c72df in dounmount (mp=0xc551c7d4, flags=524288, td=0xc6786880)
 at /usr/src/sys/kern/vfs_mount.c:1286
 #10 0xc07cd4c3 in vfs_unmountall () at /usr/src/sys/kern/vfs_subr.c:2936
 #11 0xc0754294 in boot (howto=0) at /usr/src/sys/kern/kern_shutdown.c:391
 #12 0xc07546b7 in reboot (td=0xc6786880, uap=0xe8e34cfc) at
 /usr/src/sys/kern/kern_shutdown.c:169
 #13 0xc0a568e5 in syscall (frame=0xe8e34d38) at
 /usr/src/sys/i386/i386/trap.c:1035
 #14 0xc0a3d8f0 in Xint0x80_syscall () at
 /usr/src/sys/i386/i386/exception.s:196
 #15 0x00000033 in ?? ()
 Previous frame inner to this frame (corrupt stack?)
 (kgdb)
 
 vmcore.0
 
 kgdb /boot/kernel/kernel /var/crash/vmcore.0
 [GDB will not be able to debug user-mode threads:
 /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
 GNU gdb 6.1.1 [FreeBSD]
 Copyright 2004 Free Software Foundation, Inc.
 GDB is free software, covered by the GNU General Public License, and you are
 welcome to change it and/or distribute copies of it under certain
 conditions.
 Type "show copying" to see the conditions.
 There is absolutely no warranty for GDB.  Type "show warranty" for details.
 This GDB was configured as "i386-marcel-freebsd".
 bt
 
 Unread portion of the kernel message buffer:
 <118>Aug 30 18:24:32  syslogd: exiting on signal 15
 Waiting (max 60 seconds) for system process `vnlru' to stop...done
 Waiting (max 60 seconds) for system process `bufdaemon' to stop...done
 Waiting (max 60 seconds) for system process `syncer' to stop...
 Syncing disks, vnodes remaining...5 1 1 1 0 0 done
 All buffers synced.
 panic: dqflush: stray dquot
 cpuid = 0
 Uptime: 33m20s
 Physical memory: 2035 MB
 Dumping 147 MB: 132 116 100 84 68 52 36 20 4
 
 #0  doadump () at pcpu.h:195
 195    pcpu.h: No such file or directory.
     in pcpu.h
 (kgdb) bt
 #0  doadump () at pcpu.h:195
 #1  0xc0754507 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:409
 #2  0xc07547c9 in panic (fmt=Variable "fmt" is not available.
 ) at /usr/src/sys/kern/kern_shutdown.c:563
 #3  0xc0969a1c in quotaoff1 (td=0xc6925aa0, mp=Variable "mp" is not
 available.
 )
     at /usr/src/sys/ufs/ufs/ufs_quota.c:1443
 #4  0xc0969d08 in quotaoff_inchange (td=Variable "td" is not available.
 )
     at /usr/src/sys/ufs/ufs/ufs_quota.c:721
 #5  0xc0969f81 in quotaoff (td=0xc6925aa0, mp=0xc55f9000, type=0)
     at /usr/src/sys/ufs/ufs/ufs_quota.c:763
 #6  0xc095afb1 in ffs_flushfiles (mp=0xc55f9000, flags=2, td=0xc6925aa0)
     at /usr/src/sys/ufs/ffs/ffs_vfsops.c:1096
 #7  0xc09506f7 in softdep_flushfiles (oldmnt=0xc55f9000, flags=2,
     td=0xc6925aa0) at /usr/src/sys/ufs/ffs/ffs_softdep.c:1095
 #8  0xc095b10d in ffs_unmount (mp=0xc55f9000, mntflags=524288,
 td=0xc6925aa0)
     at /usr/src/sys/ufs/ffs/ffs_vfsops.c:1031
 #9  0xc07c72df in dounmount (mp=0xc55f9000, flags=524288, td=0xc6925aa0)
     at /usr/src/sys/kern/vfs_mount.c:1286
 #10 0xc07cd4c3 in vfs_unmountall () at /usr/src/sys/kern/vfs_subr.c:2936
 #11 0xc0754294 in boot (howto=0) at /usr/src/sys/kern/kern_shutdown.c:391
 #12 0xc07546b7 in reboot (td=0xc6925aa0, uap=0xe8dc5cfc)
     at /usr/src/sys/kern/kern_shutdown.c:169
 #13 0xc0a568e5 in syscall (frame=0xe8dc5d38)
     at /usr/src/sys/i386/i386/trap.c:1035
 ---Type <return> to continue, or q <return> to quit---
 #14 0xc0a3d8f0 in Xint0x80_syscall () at
 /usr/src/sys/i386/i386/exception.s:196
 #15 0x00000033 in ?? ()
 Previous frame inner to this frame (corrupt stack?)
 (kgdb)
 
 Regards, .. WS
 
 Volker Werth schreef:
 > On 10/02/08 00:07, Wouter Snels wrote:
 >   
 >> First, want to thank you for your respond. There arn't any additional
 >> modules/patches installed, ..
 >>
 >> kldstat
 >> Id Refs Address    Size     Name
 >>  1    4 0xc0400000 91d344   kernel
 >>  2    1 0xc0d1e000 6a32c    acpi.ko
 >>  3    1 0xc5772000 3000     if_stf.ko
 >>
 >> I included make.conf because I thought it might be useful.
 >>
 >> I'm not exactly sure what mean by, world and kernel being sync'ed, I
 >> compiled according to the freebsd manual, ..
 >>
 >> I followed exactly those steps:
 >> http://www.freebsd.org/doc/en/books/handbook/makeworld.html
 >>
 >> # cd /usr/src/sys/i386/conf
 >> # config OFL
 >> # cd ../compile/OFL
 >> # make -j9 cleandepend
 >> # make -j9 depend
 >> # cd /usr/src
 >> # make -j9 buildworld
 >> # make -j9 buildkernel
 >> # make -j9 installkernel
 >> # reboot
 >> # mergemaster -p
 >> # make -j9 installworld
 >> # mergemaster
 >> # reboot
 >>
 >>
 >> Can you tell me how to do a kernel backtrace, I've done a quick search
 >> on google but couldn't really find any information on how to do this. Or
 >> give me a link to a page which explains it.
 >>
 >> Regards, WS
 >>     
 >
 > Wouter,
 >
 > sorry for the delay (I think I didn't already answer back, did I?).
 >
 > First, a short explanation about your kernel build process. You can
 > combine all your painful commands into a simple one (as clean,
 > cleandepend and others are automagically executed):
 >
 > # cd /usr/src ; make buildworld buildkernel KERNCONF=OFL
 >
 > and after successful build:
 >
 > # make installkernel && nextboot -o "-s" -k kernel
 > (now it's booting into single user mode)
 > # cd /usr/src ; make installworld && mergemaster
 >
 > Don't forget to do: # cd /usr/src && make check-old
 > and probably a ``make delete-old'' as check-old may or may not suggest.
 >
 > Anyway, now to your problem.
 >
 > If your kernel panics, it will (if well configured) write a kernel core
 > dump into swapspace. On the next reboot, the system executes ``savecore
 > -C'' to check for a core dump in swapspace and will save it into
 > /var/crash(/vmcore.N).
 >
 > If that goes well, you can inspect that dump using ``kgdb'':
 >
 > # kgdb /boot/kernel/kernel /var/crash/vmcore.N (N=latest written core dump)
 >
 > When kgdb comes up, issue a ''bt'' command at the (kgdb) prompt. Please
 > send me the output (best is to include bug-followup@freebsd.org in CC so
 > we have that information attached to the PR).
 >
 > If you need to know anything else, please let me know.
 >
 > Regards
 >
 > Volker
 >   
 

From: Volker Werth <vwe@freebsd.org>
To: Wouter Snels <nospam@ofloo.net>
Cc: bug-followup@freebsd.org
Subject: Re: kern/127699: [panic] Fatal trap 12: page fault while in kernel
 mode
Date: Sat, 04 Oct 2008 02:42:58 +0200

 On 10/03/08 23:37, Wouter Snels wrote:
 > I'm glad someone is anwering, I did however do make update just today in
 > /usr/src i was planning to update the kernel since i've noticed there is
 > a new IPv6 security issue, .. incase it matters, ..
 
 Have you already recompiled and installed a new kernel? This would make
 our debugging much harder.
 
 > Also thank you for the for the information on compiling the kernel.
 > 
 > vmcore.3
 > 
 > kgdb /boot/kernel/kernel /var/crash/vmcore.3
 > [GDB will not be able to debug user-mode threads:
 > /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
 > GNU gdb 6.1.1 [FreeBSD]
 > Copyright 2004 Free Software Foundation, Inc.
 > GDB is free software, covered by the GNU General Public License, and you are
 > welcome to change it and/or distribute copies of it under certain
 > conditions.
 > Type "show copying" to see the conditions.
 > There is absolutely no warranty for GDB.  Type "show warranty" for details.
 > This GDB was configured as "i386-marcel-freebsd".
 > bt
 > 
 > Unread portion of the kernel message buffer:
 > 
 > 
 > Fatal trap 12: page fault while in kernel mode
 > cpuid = 3; apic id = 02
 > fault virtual address    = 0x4c
 > fault code        = supervisor read, page not present
 > instruction pointer    = 0x20:0xc577373d
 > stack pointer            = 0x28:0xe8edd808
 > frame pointer            = 0x28:0xe8edd84c
 > code segment        = base 0x0, limit 0xfffff, type 0x1b
 >             = DPL 0, pres 1, def32 1, gran 1
 > processor eflags    = interrupt enabled, resume, IOPL = 0
 > current process        = 7569 (irssi)
 > trap number        = 12
 > panic: page fault
 > cpuid = 3
 > Uptime: 14h39m53s
 > Physical memory: 2035 MB
 > Dumping 182 MB: 167 151 135 119 103 87 71 55 39 23 7
 > 
 > #0  doadump () at pcpu.h:195
 > 195    pcpu.h: No such file or directory.
 >     in pcpu.h
 > (kgdb) bt
 > #0  doadump () at pcpu.h:195
 > #1  0xc0754507 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:409
 > #2  0xc07547c9 in panic (fmt=Variable "fmt" is not available.
 > ) at /usr/src/sys/kern/kern_shutdown.c:563
 > #3  0xc0a5632c in trap_fatal (frame=0xe8edd7c8, eva=76)
 >     at /usr/src/sys/i386/i386/trap.c:899
 > #4  0xc0a56590 in trap_pfault (frame=0xe8edd7c8, usermode=0, eva=76)
 >     at /usr/src/sys/i386/i386/trap.c:812
 > #5  0xc0a56f12 in trap (frame=0xe8edd7c8) at
 > /usr/src/sys/i386/i386/trap.c:490
 > #6  0xc0a3d88b in calltrap () at /usr/src/sys/i386/i386/exception.s:139
 > #7  0xc577373d in ?? ()
 > Previous frame inner to this frame (corrupt stack?)
 > (kgdb)
 
 Ok, this is from within if_stf.ko which has not been loaded while you
 were running kgdb.
 
 Assuming the kernel hasn't been recompiled since your last crash, can
 you please try:
 
 ``kgdb -q''
 (kgdb) list *0xc577373d
 
 This will get a code fragment from your currently running kernel and
 list us the source of the lines causing the crash.
 
 From your output, I'm pretty sure the fault is caused by if_stf. We just
 need to figure out what's causing this so we need a hint which function
 has called what.
 
 > vmcore.1
 > 
 > kgdb /boot/kernel/kernel /var/crash/vmcore.1
 > [GDB will not be able to debug user-mode threads:
 > /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
 > GNU gdb 6.1.1 [FreeBSD]
 > Copyright 2004 Free Software Foundation, Inc.
 > GDB is free software, covered by the GNU General Public License, and you are
 > welcome to change it and/or distribute copies of it under certain
 > conditions.
 > Type "show copying" to see the conditions.
 > There is absolutely no warranty for GDB.  Type "show warranty" for details.
 > This GDB was configured as "i386-marcel-freebsd".
 > bt
 > 
 > Unread portion of the kernel message buffer:
 > <118>Aug 31 15:32:26  syslogd: exiting on signal 15
 > Waiting (max 60 seconds) for system process `vnlru' to stop...done
 > Waiting (max 60 seconds) for system process `bufdaemon' to stop...done
 > Waiting (max 60 seconds) for system process `syncer' to stop...
 > Syncing disks, vnodes remaining...3 2 1 0 0 0 done
 > All buffers synced.
 > panic: dqflush: stray dquot
 > cpuid = 0
 > Uptime: 21h5m59s
 > Physical memory: 2035 MB
 > Dumping 230 MB: 215 199 183 167 151 135 119 103 87 71 55 39 23 7
 > 
 > #0  doadump () at pcpu.h:195
 > 195    pcpu.h: No such file or directory.
 >     in pcpu.h
 > (kgdb) bt
 > #0  doadump () at pcpu.h:195
 > #1  0xc0754507 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:409
 > #2  0xc07547c9 in panic (fmt=Variable "fmt" is not available.
 > ) at /usr/src/sys/kern/kern_shutdown.c:563
 > #3  0xc0969a1c in quotaoff1 (td=0xc6786880, mp=Variable "mp" is not
 > available.
 > ) at /usr/src/sys/ufs/ufs/ufs_quota.c:1443
 > #4  0xc0969d08 in quotaoff_inchange (td=Variable "td" is not available.
 > ) at /usr/src/sys/ufs/ufs/ufs_quota.c:721
 > #5  0xc0969f81 in quotaoff (td=0xc6786880, mp=0xc551c7d4, type=0) at
 > /usr/src/sys/ufs/ufs/ufs_quota.c:763
 > #6  0xc095afb1 in ffs_flushfiles (mp=0xc551c7d4, flags=2, td=0xc6786880)
 > at /usr/src/sys/ufs/ffs/ffs_vfsops.c:1096
 > #7  0xc09506f7 in softdep_flushfiles (oldmnt=0xc551c7d4, flags=2,
 > td=0xc6786880) at /usr/src/sys/ufs/ffs/ffs_softdep.c:1095
 > #8  0xc095b10d in ffs_unmount (mp=0xc551c7d4, mntflags=524288,
 > td=0xc6786880) at /usr/src/sys/ufs/ffs/ffs_vfsops.c:1031
 > #9  0xc07c72df in dounmount (mp=0xc551c7d4, flags=524288, td=0xc6786880)
 > at /usr/src/sys/kern/vfs_mount.c:1286
 > #10 0xc07cd4c3 in vfs_unmountall () at /usr/src/sys/kern/vfs_subr.c:2936
 > #11 0xc0754294 in boot (howto=0) at /usr/src/sys/kern/kern_shutdown.c:391
 > #12 0xc07546b7 in reboot (td=0xc6786880, uap=0xe8e34cfc) at
 > /usr/src/sys/kern/kern_shutdown.c:169
 > #13 0xc0a568e5 in syscall (frame=0xe8e34d38) at
 > /usr/src/sys/i386/i386/trap.c:1035
 > #14 0xc0a3d8f0 in Xint0x80_syscall () at
 > /usr/src/sys/i386/i386/exception.s:196
 > #15 0x00000033 in ?? ()
 > Previous frame inner to this frame (corrupt stack?)
 > (kgdb)
 
 This one is different. It's caused by quotas. Can you reproduce this?
 
 Volker

From: Volker Werth <vwe@freebsd.org>
To: Wouter Snels <nospam@ofloo.net>
Cc: bug-followup@freebsd.org
Subject: Re: kern/127699: [panic] Fatal trap 12: page fault while in kernel
 mode
Date: Sun, 05 Oct 2008 00:38:38 +0200

 This is a multi-part message in MIME format.
 --------------030100040509040701090805
 Content-Type: text/plain; charset=ISO-8859-1
 Content-Transfer-Encoding: 7bit
 
 Wouter,
 
 please run the attached script and file a followup to the PR (leave
 bug-followup@ in CC).
 
 The script will rebuild the environment of your crashed kernel (load
 your old kernel from /boot/kernel.old and load kld's into address
 space), then will give us the backtrace and some code snippets of the
 faulting code.
 
 I've included three instruction addresses picked from your various panic
 messages.
 
 At least two of them are related to if_stf.ko (judged from their code
 addresses).
 
 Volker
 
 --------------030100040509040701090805
 Content-Type: text/plain;
  name="vmcore.sh"
 Content-Transfer-Encoding: 7bit
 Content-Disposition: attachment;
  filename="vmcore.sh"
 
 #!/bin/sh +x
 # automated inspection of vmcore.3, PR kern/127699
 
 cat << EOF | asf -s /boot/kernel.old /tmp/vmcore.txt
 1 4 0xc0400000 91d344 kernel
 2 1 0xc0d1e000 6a32c acpi.ko
 3 1 0xc5772000 3000 if_stf.ko
 EOF
 
 cat << EOF >> /tmp/vmcore.txt
 bt
 list *0xc083b4ac
 list *0xc577373d
 list *0xc576e73d
 quit
 EOF
 
 kgdb /boot/kernel.old/kernel /var/crash/vmcore.3 < /tmp/vmcore.txt
 
 
 --------------030100040509040701090805--

From: Wouter Snels <nospam@ofloo.net>
To: Volker Werth <vwe@freebsd.org>, bug-followup@freebsd.org
Cc:  
Subject: Re: kern/127699: [panic] Fatal trap 12: page fault while in kernel
 mode
Date: Sun, 05 Oct 2008 01:18:11 +0200

 This is a multi-part message in MIME format.
 --------------040406060501050806010706
 Content-Type: text/plain; charset=ISO-8859-1
 Content-Transfer-Encoding: 7bit
 
 I ran ./vmcore.sh  >/tmp/vmcore.log 2>&1 because it seems like there was
 a lot of data which was still send to stdout and stderr, .. incase you
 needed it, it should be in vmcore.log
 
 Regards, ..
 
 Volker Werth schreef:
 > Wouter,
 >
 > please run the attached script and file a followup to the PR (leave
 > bug-followup@ in CC).
 >
 > The script will rebuild the environment of your crashed kernel (load
 > your old kernel from /boot/kernel.old and load kld's into address
 > space), then will give us the backtrace and some code snippets of the
 > faulting code.
 >
 > I've included three instruction addresses picked from your various panic
 > messages.
 >
 > At least two of them are related to if_stf.ko (judged from their code
 > addresses).
 >
 > Volker
 >   
 
 
 --------------040406060501050806010706
 Content-Type: text/plain;
  name="vmcore.txt"
 Content-Transfer-Encoding: 7bit
 Content-Disposition: inline;
  filename="vmcore.txt"
 
 add-symbol-file /boot/kernel.old/acpi.ko.symbols 0xc0d30210 -s .data 0xc0d71100 -s .bss 0xc0d734a0
 add-symbol-file /boot/kernel.old/if_stf.ko.symbols 0xc5772e50 -s .data 0xc5774be0 -s .bss 0xc5774d94
 bt
 list *0xc083b4ac
 list *0xc577373d
 list *0xc576e73d
 quit
 
 --------------040406060501050806010706
 Content-Type: text/plain;
  name="vmcore.log"
 Content-Transfer-Encoding: base64
 Content-Disposition: inline;
  filename="vmcore.log"
 
 W0dEQiB3aWxsIG5vdCBiZSBhYmxlIHRvIGRlYnVnIHVzZXItbW9kZSB0aHJlYWRzOiAvdXNy
 L2xpYi9saWJ0aHJlYWRfZGIuc286IFVuZGVmaW5lZCBzeW1ib2wgInBzX3BnbG9iYWxfbG9v
 a3VwIl0KR05VIGdkYiA2LjEuMSBbRnJlZUJTRF0KQ29weXJpZ2h0IDIwMDQgRnJlZSBTb2Z0
 d2FyZSBGb3VuZGF0aW9uLCBJbmMuCkdEQiBpcyBmcmVlIHNvZnR3YXJlLCBjb3ZlcmVkIGJ5
 IHRoZSBHTlUgR2VuZXJhbCBQdWJsaWMgTGljZW5zZSwgYW5kIHlvdSBhcmUKd2VsY29tZSB0
 byBjaGFuZ2UgaXQgYW5kL29yIGRpc3RyaWJ1dGUgY29waWVzIG9mIGl0IHVuZGVyIGNlcnRh
 aW4gY29uZGl0aW9ucy4KVHlwZSAic2hvdyBjb3B5aW5nIiB0byBzZWUgdGhlIGNvbmRpdGlv
 bnMuClRoZXJlIGlzIGFic29sdXRlbHkgbm8gd2FycmFudHkgZm9yIEdEQi4gIFR5cGUgInNo
 b3cgd2FycmFudHkiIGZvciBkZXRhaWxzLgpUaGlzIEdEQiB3YXMgY29uZmlndXJlZCBhcyAi
 aTM4Ni1tYXJjZWwtZnJlZWJzZCIuCgpVbnJlYWQgcG9ydGlvbiBvZiB0aGUga2VybmVsIG1l
 c3NhZ2UgYnVmZmVyOgoKCkZhdGFsIHRyYXAgMTI6IHBhZ2UgZmF1bHQgd2hpbGUgaW4ga2Vy
 bmVsIG1vZGUKY3B1aWQgPSAzOyBhcGljIGlkID0gMDIKZmF1bHQgdmlydHVhbCBhZGRyZXNz
 CT0gMHg0YwpmYXVsdCBjb2RlCQk9IHN1cGVydmlzb3IgcmVhZCwgcGFnZSBub3QgcHJlc2Vu
 dAppbnN0cnVjdGlvbiBwb2ludGVyCT0gMHgyMDoweGM1NzczNzNkCnN0YWNrIHBvaW50ZXIJ
 ICAgICAgICA9IDB4Mjg6MHhlOGVkZDgwOApmcmFtZSBwb2ludGVyCSAgICAgICAgPSAweDI4
 OjB4ZThlZGQ4NGMKY29kZSBzZWdtZW50CQk9IGJhc2UgMHgwLCBsaW1pdCAweGZmZmZmLCB0
 eXBlIDB4MWIKCQkJPSBEUEwgMCwgcHJlcyAxLCBkZWYzMiAxLCBncmFuIDEKcHJvY2Vzc29y
 IGVmbGFncwk9IGludGVycnVwdCBlbmFibGVkLCByZXN1bWUsIElPUEwgPSAwCmN1cnJlbnQg
 cHJvY2VzcwkJPSA3NTY5IChpcnNzaSkKdHJhcCBudW1iZXIJCT0gMTIKcGFuaWM6IHBhZ2Ug
 ZmF1bHQKY3B1aWQgPSAzClVwdGltZTogMTRoMzltNTNzClBoeXNpY2FsIG1lbW9yeTogMjAz
 NSBNQgpEdW1waW5nIDE4MiBNQjogMTY3IDE1MSAxMzUgMTE5IDEwMyA4NyA3MSA1NSAzOSAy
 MyA3CgojMCAgZG9hZHVtcCAoKSBhdCBwY3B1Lmg6MTk1CjE5NQlwY3B1Lmg6IE5vIHN1Y2gg
 ZmlsZSBvciBkaXJlY3RvcnkuCglpbiBwY3B1LmgKKGtnZGIpIGFkZCBzeW1ib2wgdGFibGUg
 ZnJvbSBmaWxlICIvYm9vdC9rZXJuZWwub2xkL2FjcGkua28uc3ltYm9scyIgYXQKCS50ZXh0
 X2FkZHIgPSAweGMwZDMwMjEwCgkuZGF0YV9hZGRyID0gMHhjMGQ3MTEwMAoJLmJzc19hZGRy
 ID0gMHhjMGQ3MzRhMApSZWFkaW5nIHN5bWJvbHMgZnJvbSAvYm9vdC9rZXJuZWwub2xkL2Fj
 cGkua28uc3ltYm9scy4uLmRvbmUuCihrZ2RiKSBhZGQgc3ltYm9sIHRhYmxlIGZyb20gZmls
 ZSAiL2Jvb3Qva2VybmVsLm9sZC9pZl9zdGYua28uc3ltYm9scyIgYXQKCS50ZXh0X2FkZHIg
 PSAweGM1NzcyZTUwCgkuZGF0YV9hZGRyID0gMHhjNTc3NGJlMAoJLmJzc19hZGRyID0gMHhj
 NTc3NGQ5NApSZWFkaW5nIHN5bWJvbHMgZnJvbSAvYm9vdC9rZXJuZWwub2xkL2lmX3N0Zi5r
 by5zeW1ib2xzLi4uZG9uZS4KKGtnZGIpICMwICBkb2FkdW1wICgpIGF0IHBjcHUuaDoxOTUK
 IzEgIDB4YzA3NTQ1MDcgaW4gYm9vdCAoaG93dG89MjYwKSBhdCAvdXNyL3NyYy9zeXMva2Vy
 bi9rZXJuX3NodXRkb3duLmM6NDA5CiMyICAweGMwNzU0N2M5IGluIHBhbmljIChmbXQ9VmFy
 aWFibGUgImZtdCIgaXMgbm90IGF2YWlsYWJsZS4KKSBhdCAvdXNyL3NyYy9zeXMva2Vybi9r
 ZXJuX3NodXRkb3duLmM6NTYzCiMzICAweGMwYTU2MzJjIGluIHRyYXBfZmF0YWwgKGZyYW1l
 PTB4ZThlZGQ3YzgsIGV2YT03NikKICAgIGF0IC91c3Ivc3JjL3N5cy9pMzg2L2kzODYvdHJh
 cC5jOjg5OQojNCAgMHhjMGE1NjU5MCBpbiB0cmFwX3BmYXVsdCAoZnJhbWU9MHhlOGVkZDdj
 OCwgdXNlcm1vZGU9MCwgZXZhPTc2KQogICAgYXQgL3Vzci9zcmMvc3lzL2kzODYvaTM4Ni90
 cmFwLmM6ODEyCiM1ICAweGMwYTU2ZjEyIGluIHRyYXAgKGZyYW1lPTB4ZThlZGQ3YzgpIGF0
 IC91c3Ivc3JjL3N5cy9pMzg2L2kzODYvdHJhcC5jOjQ5MAojNiAgMHhjMGEzZDg4YiBpbiBj
 YWxsdHJhcCAoKSBhdCAvdXNyL3NyYy9zeXMvaTM4Ni9pMzg2L2V4Y2VwdGlvbi5zOjEzOQoj
 NyAgMHhjNTc3MzczZCBpbiBzdGZfb3V0cHV0IChpZnA9MHhjNTU1MzQwMCwgbT0weGM1OTA4
 NzAwLCBkc3Q9MHhjNTU5N2M1YywgCiAgICBydD0weGM1NjQ5NzA4KSBhdCAvdXNyL3NyYy9z
 eXMvbW9kdWxlcy9pZl9zdGYvLi4vLi4vbmV0L2lmX3N0Zi5jOjUxOAojOCAgMHhjMDhjMGI0
 ZCBpbiBuZDZfb3V0cHV0IChpZnA9MHhjNTU1MzQwMCwgb3JpZ2lmcD0weGM1NTUzNDAwLCAK
 ICAgIG0wPTB4YzVhYzllMDAsIGRzdD0weGM1NTk3YzVjLCBydDA9MHhjNTY0OTcwOCkKICAg
 IGF0IC91c3Ivc3JjL3N5cy9uZXRpbmV0Ni9uZDYuYzoyMTIzCiM5ICAweGMwOGJkZTEyIGlu
 IGlwNl9vdXRwdXQgKG0wPTB4YzVhYzllMDAsIG9wdD0weDAsIHJvPTB4ZThlZGRhMDgsIGZs
 YWdzPTAsIAogICAgaW02bz0weDAsIGlmcHA9MHgwLCBpbnA9MHhjNWU2M2JmNCkKICAgIGF0
 IC91c3Ivc3JjL3N5cy9uZXRpbmV0Ni9pcDZfb3V0cHV0LmM6OTI3CiMxMCAweGMwODlhMDEx
 IGluIHRjcF9vdXRwdXQgKHRwPTB4YzYxY2UzYTApCiAgICBhdCAvdXNyL3NyYy9zeXMvbmV0
 aW5ldC90Y3Bfb3V0cHV0LmM6MTExNAojMTEgMHhjMDhhNDM2YSBpbiB0Y3BfdXNyX3NlbmQg
 KHNvPTB4YzYxYzc5NDgsIGZsYWdzPVZhcmlhYmxlICJmbGFncyIgaXMgbm90IGF2YWlsYWJs
 ZS4KKQogICAgYXQgL3Vzci9zcmMvc3lzL25ldGluZXQvdGNwX3VzcnJlcS5jOjg0MwojMTIg
 MHhjMDdhOTBjNSBpbiBzb3NlbmRfZ2VuZXJpYyAoc289MHhjNjFjNzk0OCwgYWRkcj0weDAs
 IHVpbz0weGU4ZWRkYzYwLCAKICAgIHRvcD0weGM1NzEyMTAwLCBjb250cm9sPTB4MCwgZmxh
 Z3M9MCwgdGQ9MHhjNjE5NmFhMCkKICAgIGF0IC91c3Ivc3JjL3N5cy9rZXJuL3VpcGNfc29j
 a2V0LmM6MTI0MAojMTMgMHhjMDdhNTA4ZiBpbiBzb3NlbmQgKHNvPTB4YzYxYzc5NDgsIGFk
 ZHI9MHgwLCB1aW89MHhlOGVkZGM2MCwgdG9wPTB4MCwgCiAgICBjb250cm9sPTB4MCwgZmxh
 Z3M9MCwgdGQ9MHhjNjE5NmFhMCkKICAgIGF0IC91c3Ivc3JjL3N5cy9rZXJuL3VpcGNfc29j
 a2V0LmM6MTI4NgojMTQgMHhjMDc4ZjY4YiBpbiBzb29fd3JpdGUgKGZwPTB4YzVlODhiODgs
 IHVpbz0weGU4ZWRkYzYwLCAKICAgIGFjdGl2ZV9jcmVkPTB4YzVlMjU2MDAsIGZsYWdzPTAs
 IHRkPTB4YzYxOTZhYTApCiAgICBhdCAvdXNyL3NyYy9zeXMva2Vybi9zeXNfc29ja2V0LmM6
 MTAzCiMxNSAweGMwNzg4ZDM3IGluIGRvZmlsZXdyaXRlICh0ZD0weGM2MTk2YWEwLCBmZD05
 LCBmcD0weGM1ZTg4Yjg4LCAKICAgIGF1aW89MHhlOGVkZGM2MCwgb2Zmc2V0PS0xLCBmbGFn
 cz0wKSBhdCBmaWxlLmg6MjU0CiMxNiAweGMwNzg5MDE4IGluIGtlcm5fd3JpdGV2ICh0ZD0w
 eGM2MTk2YWEwLCBmZD05LCBhdWlvPTB4ZThlZGRjNjApCiAgICBhdCAvdXNyL3NyYy9zeXMv
 a2Vybi9zeXNfZ2VuZXJpYy5jOjQwMQojMTcgMHhjMDc4OTA4ZiBpbiB3cml0ZSAodGQ9MHhj
 NjE5NmFhMCwgdWFwPTB4ZThlZGRjZmMpCiAgICBhdCAvdXNyL3NyYy9zeXMva2Vybi9zeXNf
 Z2VuZXJpYy5jOjMxNwojMTggMHhjMGE1NjhlNSBpbiBzeXNjYWxsIChmcmFtZT0weGU4ZWRk
 ZDM4KQogICAgYXQgL3Vzci9zcmMvc3lzL2kzODYvaTM4Ni90cmFwLmM6MTAzNQojMTkgMHhj
 MGEzZDhmMCBpbiBYaW50MHg4MF9zeXNjYWxsICgpIGF0IC91c3Ivc3JjL3N5cy9pMzg2L2kz
 ODYvZXhjZXB0aW9uLnM6MTk2CiMyMCAweDAwMDAwMDMzIGluID8/ICgpClByZXZpb3VzIGZy
 YW1lIGlubmVyIHRvIHRoaXMgZnJhbWUgKGNvcnJ1cHQgc3RhY2s/KQooa2dkYikgMHhjMDgz
 YjRhYyBpcyBpbiBpcF9vdXRwdXQgKC91c3Ivc3JjL3N5cy9uZXRpbmV0L2lwX291dHB1dC5j
 OjE2OSkuCjE2NAkJICogY2FjaGUgd2l0aCBJUHY2LgoxNjUJCSAqLwoxNjYJCWlmIChyby0+
 cm9fcnQgJiYgKChyby0+cm9fcnQtPnJ0X2ZsYWdzICYgUlRGX1VQKSA9PSAwIHx8CjE2NwkJ
 CQkgIGRzdC0+c2luX2ZhbWlseSAhPSBBRl9JTkVUIHx8CjE2OAkJCQkgIGRzdC0+c2luX2Fk
 ZHIuc19hZGRyICE9IGlwLT5pcF9kc3Quc19hZGRyKSkgewoxNjkJCQlSVEZSRUUocm8tPnJv
 X3J0KTsKMTcwCQkJcm8tPnJvX3J0ID0gKHN0cnVjdCBydGVudHJ5ICopTlVMTDsKMTcxCQl9
 CjE3MgkjaWZkZWYgSVBGSVJFV0FMTF9GT1JXQVJECjE3MwkJaWYgKHJvLT5yb19ydCA9PSBO
 VUxMICYmIGZ3ZF90YWcgPT0gTlVMTCkgewooa2dkYikgMHhjNTc3MzczZCBpcyBpbiBzdGZf
 b3V0cHV0ICgvdXNyL3NyYy9zeXMvbW9kdWxlcy9pZl9zdGYvLi4vLi4vbmV0L2lmX3N0Zi5j
 OjUxOCkuCjUxMwkJCS8qIGNhY2hlIHJvdXRlIGRvZXNuJ3QgbWF0Y2ggKi8KNTE0CQkJZHN0
 NC0+c2luX2ZhbWlseSA9IEFGX0lORVQ7CjUxNQkJCWRzdDQtPnNpbl9sZW4gPSBzaXplb2Yo
 c3RydWN0IHNvY2thZGRyX2luKTsKNTE2CQkJYmNvcHkoJmlwLT5pcF9kc3QsICZkc3Q0LT5z
 aW5fYWRkciwgc2l6ZW9mKGRzdDQtPnNpbl9hZGRyKSk7CjUxNwkJCWlmIChzYy0+c2Nfcm8u
 cm9fcnQpIHsKNTE4CQkJCVJURlJFRShzYy0+c2Nfcm8ucm9fcnQpOwo1MTkJCQkJc2MtPnNj
 X3JvLnJvX3J0ID0gTlVMTDsKNTIwCQkJfQo1MjEJCX0KNTIyCQooa2dkYikgTm8gc291cmNl
 IGZpbGUgZm9yIGFkZHJlc3MgMHhjNTc2ZTczZC4KKGtnZGIpIA==
 --------------040406060501050806010706--

From: Volker Werth <vwe@freebsd.org>
To: Wouter Snels <nospam@ofloo.net>
Cc: bug-followup@freebsd.org
Subject: Re: kern/127699: [panic] Fatal trap 12: page fault while in kernel
 mode
Date: Sun, 05 Oct 2008 15:57:21 +0200

 This is a multi-part message in MIME format.
 --------------020602030903030602040709
 Content-Type: text/plain; charset=ISO-8859-1
 Content-Transfer-Encoding: 7bit
 
 On 10/05/08 01:18, Wouter Snels wrote:
 > I ran ./vmcore.sh  >/tmp/vmcore.log 2>&1 because it seems like there was
 > a lot of data which was still send to stdout and stderr, .. incase you
 > needed it, it should be in vmcore.log
 
 Wouter,
 
 you may also use the script(1) command which automatically stores stdout
 and stderr into a text output file. But redirecting stderr is also fine.
 
 I think we've gathered a lot of debugging info but we need to make one
 last step to find the cause of the panic. Can you please run the
 attached script and file the outcome to the PR?
 
 It will give us the values of some variables and I'm pretty sure a net
 maintainer will find what's causing your panic and can produce a fix for
 it. As soon as we've got the additional debugging information, I'll
 forward your PR to the appropriate maintainer(s).
 
 Thank you for your effort - I know it's been a pain for you to give me
 all the requested information, but we need that for analysis.
 
 Volker
 
 
 --------------020602030903030602040709
 Content-Type: text/plain;
  name="vmcore.sh"
 Content-Transfer-Encoding: 7bit
 Content-Disposition: attachment;
  filename="vmcore.sh"
 
 #!/bin/sh +x
 # automated inspection of vmcore.3, PR kern/127699
 
 cat << EOF | asf -s /boot/kernel.old /tmp/vmcore.txt
 1 4 0xc0400000 91d344 kernel
 2 1 0xc0d1e000 6a32c acpi.ko
 3 1 0xc5772000 3000 if_stf.ko
 EOF
 
 cat << EOF >> /tmp/vmcore.txt
 bt
 list *0xc577373d
 fr 7
 p sc
 p *sc
 p dst4
 p *dst4
 quit
 EOF
 
 kgdb -q /boot/kernel.old/kernel /var/crash/vmcore.3 < /tmp/vmcore.txt
 
 
 --------------020602030903030602040709--

From: Wouter Snels <nospam@ofloo.net>
To: Volker Werth <vwe@freebsd.org>, bug-followup@freebsd.org
Cc:  
Subject: Re: kern/127699: [panic] Fatal trap 12: page fault while in kernel
 mode
Date: Sun, 05 Oct 2008 16:45:09 +0200

 This is a multi-part message in MIME format.
 --------------030707000909090109050803
 Content-Type: text/plain; charset=ISO-8859-1
 Content-Transfer-Encoding: 7bit
 
 No, it's really no problem at all, .. I'm glad I am able to provide the
 info, if you need more information or whatever you want that can
 contribute to helping fix this problem feel free to ask me.
 
 Regards, WS
 
 Volker Werth schreef:
 > On 10/05/08 01:18, Wouter Snels wrote:
 >   
 >> I ran ./vmcore.sh  >/tmp/vmcore.log 2>&1 because it seems like there was
 >> a lot of data which was still send to stdout and stderr, .. incase you
 >> needed it, it should be in vmcore.log
 >>     
 >
 > Wouter,
 >
 > you may also use the script(1) command which automatically stores stdout
 > and stderr into a text output file. But redirecting stderr is also fine.
 >
 > I think we've gathered a lot of debugging info but we need to make one
 > last step to find the cause of the panic. Can you please run the
 > attached script and file the outcome to the PR?
 >
 > It will give us the values of some variables and I'm pretty sure a net
 > maintainer will find what's causing your panic and can produce a fix for
 > it. As soon as we've got the additional debugging information, I'll
 > forward your PR to the appropriate maintainer(s).
 >
 > Thank you for your effort - I know it's been a pain for you to give me
 > all the requested information, but we need that for analysis.
 >
 > Volker
 >
 >   
 
 
 --------------030707000909090109050803
 Content-Type: text/plain;
  name="vmcore1.txt"
 Content-Transfer-Encoding: 7bit
 Content-Disposition: inline;
  filename="vmcore1.txt"
 
 add-symbol-file /boot/kernel.old/acpi.ko.symbols 0xc0d30210 -s .data 0xc0d71100 -s .bss 0xc0d734a0
 add-symbol-file /boot/kernel.old/if_stf.ko.symbols 0xc5772e50 -s .data 0xc5774be0 -s .bss 0xc5774d94
 bt
 list *0xc577373d
 fr 7
 p sc
 p *sc
 p dst4
 p *dst4
 quit
 
 --------------030707000909090109050803
 Content-Type: text/plain;
  name="vmcore1.log"
 Content-Transfer-Encoding: base64
 Content-Disposition: inline;
  filename="vmcore1.log"
 
 W0dEQiB3aWxsIG5vdCBiZSBhYmxlIHRvIGRlYnVnIHVzZXItbW9kZSB0aHJlYWRzOiAvdXNy
 L2xpYi9saWJ0aHJlYWRfZGIuc286IFVuZGVmaW5lZCBzeW1ib2wgInBzX3BnbG9iYWxfbG9v
 a3VwIl0KClVucmVhZCBwb3J0aW9uIG9mIHRoZSBrZXJuZWwgbWVzc2FnZSBidWZmZXI6CgoK
 RmF0YWwgdHJhcCAxMjogcGFnZSBmYXVsdCB3aGlsZSBpbiBrZXJuZWwgbW9kZQpjcHVpZCA9
 IDM7IGFwaWMgaWQgPSAwMgpmYXVsdCB2aXJ0dWFsIGFkZHJlc3MJPSAweDRjCmZhdWx0IGNv
 ZGUJCT0gc3VwZXJ2aXNvciByZWFkLCBwYWdlIG5vdCBwcmVzZW50Cmluc3RydWN0aW9uIHBv
 aW50ZXIJPSAweDIwOjB4YzU3NzM3M2QKc3RhY2sgcG9pbnRlcgkgICAgICAgID0gMHgyODow
 eGU4ZWRkODA4CmZyYW1lIHBvaW50ZXIJICAgICAgICA9IDB4Mjg6MHhlOGVkZDg0Ywpjb2Rl
 IHNlZ21lbnQJCT0gYmFzZSAweDAsIGxpbWl0IDB4ZmZmZmYsIHR5cGUgMHgxYgoJCQk9IERQ
 TCAwLCBwcmVzIDEsIGRlZjMyIDEsIGdyYW4gMQpwcm9jZXNzb3IgZWZsYWdzCT0gaW50ZXJy
 dXB0IGVuYWJsZWQsIHJlc3VtZSwgSU9QTCA9IDAKY3VycmVudCBwcm9jZXNzCQk9IDc1Njkg
 KGlyc3NpKQp0cmFwIG51bWJlcgkJPSAxMgpwYW5pYzogcGFnZSBmYXVsdApjcHVpZCA9IDMK
 VXB0aW1lOiAxNGgzOW01M3MKUGh5c2ljYWwgbWVtb3J5OiAyMDM1IE1CCkR1bXBpbmcgMTgy
 IE1COiAxNjcgMTUxIDEzNSAxMTkgMTAzIDg3IDcxIDU1IDM5IDIzIDcKCiMwICBkb2FkdW1w
 ICgpIGF0IHBjcHUuaDoxOTUKMTk1CXBjcHUuaDogTm8gc3VjaCBmaWxlIG9yIGRpcmVjdG9y
 eS4KCWluIHBjcHUuaAooa2dkYikgYWRkIHN5bWJvbCB0YWJsZSBmcm9tIGZpbGUgIi9ib290
 L2tlcm5lbC5vbGQvYWNwaS5rby5zeW1ib2xzIiBhdAoJLnRleHRfYWRkciA9IDB4YzBkMzAy
 MTAKCS5kYXRhX2FkZHIgPSAweGMwZDcxMTAwCgkuYnNzX2FkZHIgPSAweGMwZDczNGEwClJl
 YWRpbmcgc3ltYm9scyBmcm9tIC9ib290L2tlcm5lbC5vbGQvYWNwaS5rby5zeW1ib2xzLi4u
 ZG9uZS4KKGtnZGIpIGFkZCBzeW1ib2wgdGFibGUgZnJvbSBmaWxlICIvYm9vdC9rZXJuZWwu
 b2xkL2lmX3N0Zi5rby5zeW1ib2xzIiBhdAoJLnRleHRfYWRkciA9IDB4YzU3NzJlNTAKCS5k
 YXRhX2FkZHIgPSAweGM1Nzc0YmUwCgkuYnNzX2FkZHIgPSAweGM1Nzc0ZDk0ClJlYWRpbmcg
 c3ltYm9scyBmcm9tIC9ib290L2tlcm5lbC5vbGQvaWZfc3RmLmtvLnN5bWJvbHMuLi5kb25l
 Lgooa2dkYikgIzAgIGRvYWR1bXAgKCkgYXQgcGNwdS5oOjE5NQojMSAgMHhjMDc1NDUwNyBp
 biBib290IChob3d0bz0yNjApIGF0IC91c3Ivc3JjL3N5cy9rZXJuL2tlcm5fc2h1dGRvd24u
 Yzo0MDkKIzIgIDB4YzA3NTQ3YzkgaW4gcGFuaWMgKGZtdD1WYXJpYWJsZSAiZm10IiBpcyBu
 b3QgYXZhaWxhYmxlLgopIGF0IC91c3Ivc3JjL3N5cy9rZXJuL2tlcm5fc2h1dGRvd24uYzo1
 NjMKIzMgIDB4YzBhNTYzMmMgaW4gdHJhcF9mYXRhbCAoZnJhbWU9MHhlOGVkZDdjOCwgZXZh
 PTc2KQogICAgYXQgL3Vzci9zcmMvc3lzL2kzODYvaTM4Ni90cmFwLmM6ODk5CiM0ICAweGMw
 YTU2NTkwIGluIHRyYXBfcGZhdWx0IChmcmFtZT0weGU4ZWRkN2M4LCB1c2VybW9kZT0wLCBl
 dmE9NzYpCiAgICBhdCAvdXNyL3NyYy9zeXMvaTM4Ni9pMzg2L3RyYXAuYzo4MTIKIzUgIDB4
 YzBhNTZmMTIgaW4gdHJhcCAoZnJhbWU9MHhlOGVkZDdjOCkgYXQgL3Vzci9zcmMvc3lzL2kz
 ODYvaTM4Ni90cmFwLmM6NDkwCiM2ICAweGMwYTNkODhiIGluIGNhbGx0cmFwICgpIGF0IC91
 c3Ivc3JjL3N5cy9pMzg2L2kzODYvZXhjZXB0aW9uLnM6MTM5CiM3ICAweGM1NzczNzNkIGlu
 IHN0Zl9vdXRwdXQgKGlmcD0weGM1NTUzNDAwLCBtPTB4YzU5MDg3MDAsIGRzdD0weGM1NTk3
 YzVjLCAKICAgIHJ0PTB4YzU2NDk3MDgpIGF0IC91c3Ivc3JjL3N5cy9tb2R1bGVzL2lmX3N0
 Zi8uLi8uLi9uZXQvaWZfc3RmLmM6NTE4CiM4ICAweGMwOGMwYjRkIGluIG5kNl9vdXRwdXQg
 KGlmcD0weGM1NTUzNDAwLCBvcmlnaWZwPTB4YzU1NTM0MDAsIAogICAgbTA9MHhjNWFjOWUw
 MCwgZHN0PTB4YzU1OTdjNWMsIHJ0MD0weGM1NjQ5NzA4KQogICAgYXQgL3Vzci9zcmMvc3lz
 L25ldGluZXQ2L25kNi5jOjIxMjMKIzkgIDB4YzA4YmRlMTIgaW4gaXA2X291dHB1dCAobTA9
 MHhjNWFjOWUwMCwgb3B0PTB4MCwgcm89MHhlOGVkZGEwOCwgZmxhZ3M9MCwgCiAgICBpbTZv
 PTB4MCwgaWZwcD0weDAsIGlucD0weGM1ZTYzYmY0KQogICAgYXQgL3Vzci9zcmMvc3lzL25l
 dGluZXQ2L2lwNl9vdXRwdXQuYzo5MjcKIzEwIDB4YzA4OWEwMTEgaW4gdGNwX291dHB1dCAo
 dHA9MHhjNjFjZTNhMCkKICAgIGF0IC91c3Ivc3JjL3N5cy9uZXRpbmV0L3RjcF9vdXRwdXQu
 YzoxMTE0CiMxMSAweGMwOGE0MzZhIGluIHRjcF91c3Jfc2VuZCAoc289MHhjNjFjNzk0OCwg
 ZmxhZ3M9VmFyaWFibGUgImZsYWdzIiBpcyBub3QgYXZhaWxhYmxlLgopCiAgICBhdCAvdXNy
 L3NyYy9zeXMvbmV0aW5ldC90Y3BfdXNycmVxLmM6ODQzCiMxMiAweGMwN2E5MGM1IGluIHNv
 c2VuZF9nZW5lcmljIChzbz0weGM2MWM3OTQ4LCBhZGRyPTB4MCwgdWlvPTB4ZThlZGRjNjAs
 IAogICAgdG9wPTB4YzU3MTIxMDAsIGNvbnRyb2w9MHgwLCBmbGFncz0wLCB0ZD0weGM2MTk2
 YWEwKQogICAgYXQgL3Vzci9zcmMvc3lzL2tlcm4vdWlwY19zb2NrZXQuYzoxMjQwCiMxMyAw
 eGMwN2E1MDhmIGluIHNvc2VuZCAoc289MHhjNjFjNzk0OCwgYWRkcj0weDAsIHVpbz0weGU4
 ZWRkYzYwLCB0b3A9MHgwLCAKICAgIGNvbnRyb2w9MHgwLCBmbGFncz0wLCB0ZD0weGM2MTk2
 YWEwKQogICAgYXQgL3Vzci9zcmMvc3lzL2tlcm4vdWlwY19zb2NrZXQuYzoxMjg2CiMxNCAw
 eGMwNzhmNjhiIGluIHNvb193cml0ZSAoZnA9MHhjNWU4OGI4OCwgdWlvPTB4ZThlZGRjNjAs
 IAogICAgYWN0aXZlX2NyZWQ9MHhjNWUyNTYwMCwgZmxhZ3M9MCwgdGQ9MHhjNjE5NmFhMCkK
 ICAgIGF0IC91c3Ivc3JjL3N5cy9rZXJuL3N5c19zb2NrZXQuYzoxMDMKIzE1IDB4YzA3ODhk
 MzcgaW4gZG9maWxld3JpdGUgKHRkPTB4YzYxOTZhYTAsIGZkPTksIGZwPTB4YzVlODhiODgs
 IAogICAgYXVpbz0weGU4ZWRkYzYwLCBvZmZzZXQ9LTEsIGZsYWdzPTApIGF0IGZpbGUuaDoy
 NTQKIzE2IDB4YzA3ODkwMTggaW4ga2Vybl93cml0ZXYgKHRkPTB4YzYxOTZhYTAsIGZkPTks
 IGF1aW89MHhlOGVkZGM2MCkKICAgIGF0IC91c3Ivc3JjL3N5cy9rZXJuL3N5c19nZW5lcmlj
 LmM6NDAxCiMxNyAweGMwNzg5MDhmIGluIHdyaXRlICh0ZD0weGM2MTk2YWEwLCB1YXA9MHhl
 OGVkZGNmYykKICAgIGF0IC91c3Ivc3JjL3N5cy9rZXJuL3N5c19nZW5lcmljLmM6MzE3CiMx
 OCAweGMwYTU2OGU1IGluIHN5c2NhbGwgKGZyYW1lPTB4ZThlZGRkMzgpCiAgICBhdCAvdXNy
 L3NyYy9zeXMvaTM4Ni9pMzg2L3RyYXAuYzoxMDM1CiMxOSAweGMwYTNkOGYwIGluIFhpbnQw
 eDgwX3N5c2NhbGwgKCkgYXQgL3Vzci9zcmMvc3lzL2kzODYvaTM4Ni9leGNlcHRpb24uczox
 OTYKIzIwIDB4MDAwMDAwMzMgaW4gPz8gKCkKUHJldmlvdXMgZnJhbWUgaW5uZXIgdG8gdGhp
 cyBmcmFtZSAoY29ycnVwdCBzdGFjaz8pCihrZ2RiKSAweGM1NzczNzNkIGlzIGluIHN0Zl9v
 dXRwdXQgKC91c3Ivc3JjL3N5cy9tb2R1bGVzL2lmX3N0Zi8uLi8uLi9uZXQvaWZfc3RmLmM6
 NTE4KS4KNTEzCQkJLyogY2FjaGUgcm91dGUgZG9lc24ndCBtYXRjaCAqLwo1MTQJCQlkc3Q0
 LT5zaW5fZmFtaWx5ID0gQUZfSU5FVDsKNTE1CQkJZHN0NC0+c2luX2xlbiA9IHNpemVvZihz
 dHJ1Y3Qgc29ja2FkZHJfaW4pOwo1MTYJCQliY29weSgmaXAtPmlwX2RzdCwgJmRzdDQtPnNp
 bl9hZGRyLCBzaXplb2YoZHN0NC0+c2luX2FkZHIpKTsKNTE3CQkJaWYgKHNjLT5zY19yby5y
 b19ydCkgewo1MTgJCQkJUlRGUkVFKHNjLT5zY19yby5yb19ydCk7CjUxOQkJCQlzYy0+c2Nf
 cm8ucm9fcnQgPSBOVUxMOwo1MjAJCQl9CjUyMQkJfQo1MjIJCihrZ2RiKSAjNyAgMHhjNTc3
 MzczZCBpbiBzdGZfb3V0cHV0IChpZnA9MHhjNTU1MzQwMCwgbT0weGM1OTA4NzAwLCBkc3Q9
 MHhjNTU5N2M1YywgCiAgICBydD0weGM1NjQ5NzA4KSBhdCAvdXNyL3NyYy9zeXMvbW9kdWxl
 cy9pZl9zdGYvLi4vLi4vbmV0L2lmX3N0Zi5jOjUxOAo1MTgJCQkJUlRGUkVFKHNjLT5zY19y
 by5yb19ydCk7CihrZ2RiKSAkMSA9IHt7byA9IHtzaXplID0gOTE4NCwgZ2VuID0gMCwgcG9z
 ID0gNjMwNiwgcHRyID0gMHhjMGJiZGY2OCwgCiAgICAgIGJ1ZiA9IDB4YzBiYmRmNzggIkNv
 cHlyaWdodCAoYykgMTk5Mi0yMDA4IFRoZSBGcmVlQlNEIFByb2plY3QuXHJcbkNvcHlyaWdo
 dCAoYykgMTk3OSwgMTk4MCwgMTk4MywgMTk4NiwgMTk4OCwgMTk4OSwgMTk5MSwgMTk5Miwg
 MTk5MywgMTk5NFxyXG5cdFRoZSBSZWdlbnRzIG9mIHRoZSBVbml2ZXJzaXR5IG9mIENhbGlm
 b3JuaWEuIEFsbCByaWdodHMgcmVzZXJ2ZWQuXHJcbkZyZWVCU0QgaXMgYSIuLi59LCAKICAg
 IGkgPSB7c2l6ZSA9IDMwNjIsIGdlbiA9IDAsIHBvcyA9IDAsIHB0ciA9IDB4YzBiYmRmNzAs
 IAogICAgICBidWYgPSAweGMwYmMwMzU4ICIifSwgYnJrX3N0YXRlID0gMCwgZmxhZ3MgPSAw
 LCBkZXYgPSAweGM1MTZmYzAwfSwge28gPSB7CiAgICAgIHNpemUgPSAzMDYxLCBnZW4gPSAw
 LCBwb3MgPSAwLCBwdHIgPSAweGMwYmJkZjZjLCBidWYgPSAweGMwYmMwZjRlICIifSwgCiAg
 ICBpID0ge3NpemUgPSAxMDIxLCBnZW4gPSAwLCBwb3MgPSAwLCBwdHIgPSAweGMwYmJkZjc0
 LCAKICAgICAgYnVmID0gMHhjMGJjMWI0MyAiIn0sIGJya19zdGF0ZSA9IDAsIGZsYWdzID0g
 MSwgZGV2ID0gMHhjNTE2ZmIwMH19CihrZ2RiKSAkMiA9IHtvID0ge3NpemUgPSA5MTg0LCBn
 ZW4gPSAwLCBwb3MgPSA2MzA2LCBwdHIgPSAweGMwYmJkZjY4LCAKICAgIGJ1ZiA9IDB4YzBi
 YmRmNzggIkNvcHlyaWdodCAoYykgMTk5Mi0yMDA4IFRoZSBGcmVlQlNEIFByb2plY3QuXHJc
 bkNvcHlyaWdodCAoYykgMTk3OSwgMTk4MCwgMTk4MywgMTk4NiwgMTk4OCwgMTk4OSwgMTk5
 MSwgMTk5MiwgMTk5MywgMTk5NFxyXG5cdFRoZSBSZWdlbnRzIG9mIHRoZSBVbml2ZXJzaXR5
 IG9mIENhbGlmb3JuaWEuIEFsbCByaWdodHMgcmVzZXJ2ZWQuXHJcbkZyZWVCU0QgaXMgYSIu
 Li59LCAKICBpID0ge3NpemUgPSAzMDYyLCBnZW4gPSAwLCBwb3MgPSAwLCBwdHIgPSAweGMw
 YmJkZjcwLCBidWYgPSAweGMwYmMwMzU4ICIifSwgCiAgYnJrX3N0YXRlID0gMCwgZmxhZ3Mg
 PSAwLCBkZXYgPSAweGM1MTZmYzAwfQooa2dkYikgTm8gc3ltYm9sICJkc3Q0IiBpbiBjdXJy
 ZW50IGNvbnRleHQuCihrZ2RiKSBObyBzeW1ib2wgImRzdDQiIGluIGN1cnJlbnQgY29udGV4
 dC4KKGtnZGIpIA==
 --------------030707000909090109050803--
State-Changed-From-To: feedback->analyzed 
State-Changed-By: vwe 
State-Changed-When: Sun Oct 5 15:47:09 UTC 2008 
State-Changed-Why:  

David, 
can you please check this issue? It seems to be related to PR 122283. 
You're already committed a fix to HEAD for this issue (MFC is 
outstanding). 
The call to RTFREE is causing the panic. It's believed to be the case 
whenever the gateway has gone (periodic disconnect some ISPs are doing). 


Responsible-Changed-From-To: freebsd-bugs->dwmalone 
Responsible-Changed-By: vwe 
Responsible-Changed-When: Sun Oct 5 15:47:09 UTC 2008 
Responsible-Changed-Why:  

David, 
can you please check this issue? It seems to be related to PR 122283. 
You're already committed a fix to HEAD for this issue (MFC is 
outstanding). 
The call to RTFREE is causing the panic. It's believed to be the case 
whenever the gateway has gone (periodic disconnect some ISPs are doing). 

http://www.freebsd.org/cgi/query-pr.cgi?pr=127699 

From: Volker Werth <vwe@freebsd.org>
To: bug-followup@FreeBSD.org, nospam@ofloo.net, dwmalone@FreeBSD.org
Cc: re@freebsd.org
Subject: Re: kern/127699: [panic][stf] stf causes panic in RTFREE
Date: Sun, 12 Oct 2008 20:26:35 +0200

 David,
 
 Wouter confirmed the patch fixes the 6to4 misbehavior with a 7-STABLE
 system. His box doesn't panic anymore for days.
 
 I'm wondering if you'd like to ask RE (cc'ed) for approval to fix this
 for the upcoming releases (6.4, 7.1)? IMHO this may be a showstopper for
 some people to use IPv6 at all (assuming few people are able to get
 native v6 from their providers) if we do not fix this issue earlier than
 7.2-RELEASE.
 
 Thanks for working out a patch for this issue.
 
 Volker

From: David Malone <dwmalone@maths.tcd.ie>
To: Volker Werth <vwe@freebsd.org>
Cc: bug-followup@freebsd.org, nospam@ofloo.net, re@freebsd.org
Subject: Re: kern/127699: [panic][stf] stf causes panic in RTFREE 
Date: Sun, 12 Oct 2008 20:35:59 +0100

 > Wouter confirmed the patch fixes the 6to4 misbehavior with a 7-STABLE
 > system. His box doesn't panic anymore for days.
 
 Great - I've just got permission to do the MFC. I should have it
 committed either tonight or tomorrow morning.
 
 	David.
State-Changed-From-To: analyzed->closed 
State-Changed-By: dwmalone 
State-Changed-When: Wed Oct 22 15:12:17 UTC 2008 
State-Changed-Why:  
Should be fixed in RELENG_7 now. 

David. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=127699 
Responsible-Changed-From-To: dwmalone->freebsd-bugs 
Responsible-Changed-By: eadler 
Responsible-Changed-When: Tue Jul 10 03:39:58 UTC 2012 
Responsible-Changed-Why:  
over to the pool (approved by bugmeister) 

http://www.freebsd.org/cgi/query-pr.cgi?pr=127699 
>Unformatted:
