From alexander.haderer@charite.de  Wed Oct 22 12:26:48 2003
Return-Path: <alexander.haderer@charite.de>
Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125])
	by hub.freebsd.org (Postfix) with ESMTP id 6BD0B16A4B3
	for <FreeBSD-gnats-submit@freebsd.org>; Wed, 22 Oct 2003 12:26:48 -0700 (PDT)
Received: from hauptpostamt.charite.de (hauptpostamt.charite.de [193.175.66.220])
	by mx1.FreeBSD.org (Postfix) with ESMTP id A906443FCB
	for <FreeBSD-gnats-submit@freebsd.org>; Wed, 22 Oct 2003 12:26:45 -0700 (PDT)
	(envelope-from alexander.haderer@charite.de)
Received: from postamt1.charite.de (postamt1.charite.de [193.175.66.246])
	by hauptpostamt.charite.de (Postfix) with ESMTP id A1A4515C058
	for <FreeBSD-gnats-submit@freebsd.org>; Wed, 22 Oct 2003 21:26:37 +0200 (CEST)
Received: from ogava.str.charite.de (ogava.str.charite.de [192.168.202.104])
	by postamt1.charite.de (Postfix) with ESMTP id 825C7633B4
	for <FreeBSD-gnats-submit@freebsd.org>; Wed, 22 Oct 2003 21:26:37 +0200 (CEST)
Received: from ogava.str.charite.de (localhost.str.charite.de [127.0.0.1])
	by ogava.str.charite.de (8.12.8p1/8.12.8) with ESMTP id h9MJQapl031201
	for <FreeBSD-gnats-submit@freebsd.org>; Wed, 22 Oct 2003 21:26:37 +0200 (CEST)
	(envelope-from alexander.haderer@charite.de)
Received: (from afrika@localhost)
	by ogava.str.charite.de (8.12.8p1/8.12.8/Submit) id h9MJQaFv031200;
	Wed, 22 Oct 2003 21:26:36 +0200 (CEST)
	(envelope-from alexander.haderer@charite.de)
Message-Id: <200310221926.h9MJQaFv031200@ogava.str.charite.de>
Date: Wed, 22 Oct 2003 21:26:36 +0200 (CEST)
From: Alexander Haderer <alexander.haderer@charite.de>
Reply-To: Alexander Haderer <alexander.haderer@charite.de>
To: FreeBSD-gnats-submit@freebsd.org
Cc:
Subject: Trap 12 with heavy disk load on ide vinum mirror
X-Send-Pr-Version: 3.113
X-GNATS-Notify:

>Number:         58391
>Category:       kern
>Synopsis:       [vinum] Trap 12 with heavy disk load on ide vinum mirror
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    le
>State:          closed
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Wed Oct 22 12:30:20 PDT 2003
>Closed-Date:    Fri Dec 01 13:37:42 GMT 2006
>Last-Modified:  Fri Dec 01 13:37:42 GMT 2006
>Originator:     Alexander Haderer
>Release:        FreeBSD 4.8-RELEASE i386
>Organization:
Charite Hospital Berlin - Germany
>Environment:
System: FreeBSD ogava.str.charite.de 4.8-RELEASE FreeBSD 4.8-RELEASE #0: Tue May 13 20:42:13 CEST 2003 root@ogava.str.charite.de:/usr/src/sys/compile/OGAVAD i386


>Description:
Setup: A single CPU x86 running 4.8R with GENERIC kernel, a SCSI disk 
holds OS and two 160G Maxtor disks (ad0, ad2) setup as vinum mirror 
to hold data (whole disk). Ata write cache is off as well as hw.ata.tags.

When doing high io load to the ide disks the kernel panics with trap 12:

Fatal trap 12: page fault while in kernel mode
fault virtual address   = 0x3f83c8c7
fault code              = supervisor read, page not present
instruction pointer     = 0x8:0xc0162d10
stack pointer           = 0x10:0xcd336cb4
frame pointer           = 0x10:0xcd336cc8
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, def32 1, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 273 (ls)
interrupt mask          = bio 
trap number             = 12
panic: page fault

We have seen this behaviour on P4 Systems with 845 chipset as well as on 
AMD CPU on Via chipset. Ask for details if necessary.

/var/log/messages and console are silent.

I have now 10 crashdumps,  'gdb -k ... where' gives differnent results. What 
is in common: all start with: 

...
#43 0xc023e41d in syscall2 ()
#44 0xc0232575 in Xint0x80_syscall ()

Please ask for more details if you are unable to reproduce this panic.

>How-To-Repeat:

- Setup a machine that boots 4.8R from SCSI disk (not tested if necessary).
- disable ata write cache (not tested if this really matters)
- attach two identical ide disks to ad0 and ad2 plus do dd/fdisk/disklabel
- setup a vinum mirror onto this disks that covers the whole ide disks

    drive disk0 device /dev/ad0s1e
    drive disk2 device /dev/ad2s1e

    volume mirror setupstate
      plex org concat
       sd len 0s drive disk0
      plex org concat
       sd len 0s drive disk2

- newfs -m 0 -b 16384 -f 2048 -i 131072 -g 300000 -h 200 /dev/vinum/mirror
  (not tested  if -migh options matter)
- mount /dev/vinum/mirror /mnt
- now start the disk stress, do the tasks below in parallel

  job 1
      cd /usr; find ports -depth -print | cpio -pdm /mnt
      (start once and wait a little bit)

  job 2
      ls -lRt /mnt (do it again when finished)

  job 3		(trash writer)
      dd if=/dev/zero of=/mnt/trash count=1000000

  job 4 	(diskreader 0): 
      dd if=/dev/ad0s1e of=/dev/null bs=1024k

  job 5 	(diskreader 2): 
      dd if=/dev/ad2s1e of=/dev/null bs=1024k

  do some variations: stop (^C) and restart job 3 - 5

  The final crash usually comes after these steps:
	stop job 3	(the trash writer)
	stop job 4 & 5  (the disk readers)
	start job 3 again and let it run for a few seconds, then stop
	start job 4 or 5 ----> trap 12

Although this all reads somewhat stupid this is the way I found to reproduce
the crash within a few  minutes.

Note: I was unable to reproduce the crashs when using the ide disks w/o vinum.

>Fix:
None.
>Release-Note:
>Audit-Trail:

From: Greg 'groggy' Lehey <grog@FreeBSD.org>
To: Alexander Haderer <alexander.haderer@charite.de>
Cc: FreeBSD-gnats-submit@FreeBSD.org
Subject: Re: kern/58391: Trap 12 with heavy disk load on ide vinum mirror
Date: Thu, 23 Oct 2003 11:43:36 +0930

 --cNdxnHkX5QqsyA0e
 Content-Type: text/plain; charset=us-ascii
 Content-Disposition: inline
 
 On Wednesday, 22 October 2003 at 21:26:36 +0200, Alexander Haderer wrote:
 >
 >> Description:
 > Setup: A single CPU x86 running 4.8R with GENERIC kernel, a SCSI disk
 > holds OS and two 160G Maxtor disks (ad0, ad2) setup as vinum mirror
 > to hold data (whole disk). Ata write cache is off as well as hw.ata.tags.
 >
 > When doing high io load to the ide disks the kernel panics with trap 12:
 >
 > Fatal trap 12: page fault while in kernel mode
 
 Please take a dump of the system and supply a back trace.  Ensure that
 you have debugging symbols in the kernel.  Don't delete the dump: I
 will need more information.
 
 Greg
 --
 See complete headers for address and phone numbers.
 
 --cNdxnHkX5QqsyA0e
 Content-Type: application/pgp-signature
 Content-Disposition: inline
 
 -----BEGIN PGP SIGNATURE-----
 Version: GnuPG v1.2.0 (FreeBSD)
 
 iD8DBQE/lzlQIubykFB6QiMRArjLAJ9vhcGF1SP8vX6sojXRM1Ot6L+GGgCgmIeg
 NaHaWKu53+oiO/b2WdlWSoI=
 =D1i9
 -----END PGP SIGNATURE-----
 
 --cNdxnHkX5QqsyA0e--

From: Alexander Haderer <alexander.haderer@charite.de>
To: Greg 'groggy' Lehey <grog@FreeBSD.org>
Cc: FreeBSD-gnats-submit@FreeBSD.org
Subject: Re: kern/58391: Trap 12 with heavy disk load on ide vinum
  mirror
Date: Thu, 23 Oct 2003 14:54:38 +0200

 At 11:43 23.10.2003 +0930, Greg 'groggy' Lehey wrote:
 >On Wednesday, 22 October 2003 at 21:26:36 +0200, Alexander Haderer wrote:
 >>
 >>> Description:
 >> Setup: A single CPU x86 running 4.8R with GENERIC kernel, a SCSI disk
 >> holds OS and two 160G Maxtor disks (ad0, ad2) setup as vinum mirror
 >> to hold data (whole disk). Ata write cache is off as well as hw.ata.tags.
 >>
 >> When doing high io load to the ide disks the kernel panics with trap 12:
 >>
 >> Fatal trap 12: page fault while in kernel mode
 >
 >Please take a dump of the system and supply a back trace.  Ensure that
 >you have debugging symbols in the kernel.  Don't delete the dump: I
 >will need more information.
 
 Here comes the backtrace. This time we get a trap 18 with div by zero.
 
 gdb -k -s kernel.debug -e /var/crash/kernel.11 -c /var/crash/vmcore.11=20
 gdb where full:
 
 GNU gdb 4.18 (FreeBSD)
 Copyright 1998 Free Software Foundation, Inc.
 GDB is free software, covered by the GNU General Public License, and you are
 welcome to change it and/or distribute copies of it under certain=
  conditions.
 Type "show copying" to see the conditions.
 There is absolutely no warranty for GDB.  Type "show warranty" for details.
 This GDB was configured as "i386-unknown-freebsd"...
 IdlePTD at phsyical address 0x00538000
 initial pcb at physical address 0x0046cec0
 panicstr: integer divide fault
 panic messages:
 ---
 Fatal trap 18: integer divide fault while in kernel mode
 instruction pointer     =3D 0x8:0xc039fe9a
 stack pointer           =3D 0x10:0xd1a37c5c
 frame pointer           =3D 0x10:0xd1a37cc8
 code segment            =3D base 0x0, limit 0xfffff, type 0x1b
                         =3D DPL 0, pres 1, def32 1, gran 1
 processor eflags        =3D interrupt enabled, resume, IOPL =3D 0
 current process         =3D 504 (vinum)
 interrupt mask          =3D none
 trap number             =3D 18
 panic: integer divide fault
 
 syncing disks... 76 72 67 64 62 62 56 56 52 51 51 46 46 41 41 36 36 31 31 26=
  26 22 21 21 16 16 12 11 11 7 7 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2=20
 giving up on 2 buffers
 Uptime: 1h12m5s
 
 dumping to dev #da/0x20001, offset 3670144
 dump 255 254 253 252 251 250 249 248 247 246 245 244 243 242 241 240 239 238=
  237 236 235 234 233 232 231 230 229 228 227 226 225 224 223 222 221 220 219=
  218 217 216 215 214 213 212 211 210 209 208 207 206 205 204 203 202 201 200=
  199 198 197 196 195 194 193 192 191 190 189 188 187 186 185 184 183 182 181=
  180 179 178 177 176 175 174 173 172 171 170 169 168 167 166 165 164 163 162=
  161 160 159 158 157 156 155 154 153 152 151 150 149 148 147 146 145 144 143=
  142 141 140 139 138 137 136 135 134 133 132 131 130 129 128 127 126 125 124=
  123 122 121 120 119 118 117 116 115 114 113 112 111 110 109 108 107 106 105=
  104 103 102 101 100 99 98 97 96 95 94 93 92 91 90 89 88 87 86 85 84 83 82=
  81 80 79 78 77 76 75 74 73 72 71 70 69 68 67 66 65 64 63 62 61 60 59 58 57=
  56 55 54 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32=
  31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5=
  4 3 2 1 0=20
 ---
 #0  dumpsys () at ../../kern/kern_shutdown.c:487
 487             if (dumping++) {
 #0  dumpsys () at ../../kern/kern_shutdown.c:487
         error =3D 0
 #1  0xc0216273 in boot (howto=3D256) at ../../kern/kern_shutdown.c:316
         howto =3D 256
 #2  0xc0216698 in poweroff_wait (junk=3D0xc040440c, howto=3D-1069531382)
     at ../../kern/kern_shutdown.c:595
         fmt =3D 0xc040440c "%s"
         bootopt =3D 256
         buf =3D "integer divide fault", '\000' <repeats 235 times>
 #3  0xc0389f0e in trap_fatal (frame=3D0xd1a37c1c, eva=3D0)
     at ../../i386/i386/trap.c:974
         frame =3D (struct trapframe *) 0x100
         code =3D -1069530100
         type =3D 18
         ss =3D -1069530100
         esp =3D 0
         softseg =3D {ssd_base =3D 0, ssd_limit =3D 1048575, ssd_type =3D 27,=
 =20
   ssd_dpl =3D 0, ssd_p =3D 1, ssd_xx =3D 11, ssd_xx1 =3D 3, ssd_def32 =3D 1,=
 =20
   ssd_gran =3D 1}
 #4  0xc03898eb in trap (frame=3D{tf_fs =3D 16, tf_es =3D 16, tf_ds =3D 16,=
  tf_edi =3D 0,=20
       tf_esi =3D 0, tf_ebp =3D -777814840, tf_isp =3D -777814968, tf_ebx =3D=
  4096,=20
       tf_edx =3D 0, tf_ecx =3D 0, tf_eax =3D 1, tf_trapno =3D 18, tf_err =3D=
  0,=20
       tf_eip =3D -1069941094, tf_cs =3D 8, tf_eflags =3D 66118, tf_esp =3D=
  0,=20
       tf_ss =3D 4096}) at ../../i386/i386/trap.c:636
         p =3D (struct proc *) 0xd19d85a0
         sticks =3D 10
         i =3D 0
         ucode =3D 0
         type =3D 18
         code =3D 0
         eva =3D 0
 #5  0xc039fe9a in __qdivrem (uq=3D4096, vq=3D0, arq=3D0x0)
     at ../../libkern/qdivrem.c:100
         zero =3D 0
         uq =3D 15106053227377852416
         vq =3D 0
         tmp =3D {q =3D -4601592171749737248, uq =3D -4601592171749737248, sl=
  =3D {
     -777814816, -1071391668}, ul =3D {3517152480, 3223575628}}
         u =3D (digit *) 0x0
         v =3D (digit *) 0x9
         q =3D (digit *) 0xd1a37cb0
         v1 =3D 0
         v2 =3D 0
         qhat =3D 3248239104
         rhat =3D 0
         t =3D 0
         m =3D -964404116
         n =3D 0
         d =3D 512
         j =3D 0
         i =3D 0
         uspace =3D {0, 0, 16384, 0, 512}
         vspace =3D {23660, 50820, 16384, 0, 512}
         qspace =3D {512, 0, 15648, 49219, 0}
 #6  0xc039fd7f in __divdi3 (a=3D4096, b=3D0) at ../../libkern/divdi3.c:61
         a =3D 0
         b =3D 0
         ua =3D 4096
         ub =3D 0
         uq =3D 0
         neg =3D 0
 #7  0xc17d0da7 in ?? ()
 No symbol table info available.
 #8  0xc17d15cd in ?? ()
 No symbol table info available.
 #9  0xc17cf69b in ?? ()
 No symbol table info available.
 #10 0xc17cf88e in ?? ()
 No symbol table info available.
 #11 0xc17d2461 in ?? ()
 No symbol table info available.
 #12 0xc024f0ce in spec_ioctl (ap=3D0xd1a37de4)
     at ../../miscfs/specfs/spec_vnops.c:306
         ap =3D (struct vop_ioctl_args *) 0xc6845c6c
         dev =3D 0x200
 #13 0xc024edf9 in spec_vnoperate (ap=3D0xd1a37de4)
     at ../../miscfs/specfs/spec_vnops.c:119
         ap =3D (struct vop_generic_args *) 0x0
 #14 0xc032b495 in ufs_vnoperatespec (ap=3D0xd1a37de4)
     at ../../ufs/ufs/ufs_vnops.c:2394
         ap =3D (struct vop_generic_args *) 0x0
 #15 0xc024b687 in vn_ioctl (fp=3D0xc17bbc40, com=3D18013, data=3D0xd1a37ea8=
  "",=20
     p=3D0xd19d85a0) at vnode_if.h:429
         a =3D {a_desc =3D 0xc040de20, a_vp =3D 0xd1a1fc00, a_command =3D=
  18013,=20
   a_data =3D 0xd1a37ea8 "", a_fflag =3D 3, a_cred =3D 0xc17b2600, a_p =3D=
  0xd19d85a0}
         vp =3D (struct vnode *) 0xd1a1fc00
         command =3D 18013
         data =3D 0xd1a37ea8 ""
         fflag =3D 0
         cred =3D (struct ucred *) 0x0
         p =3D (struct proc *) 0x200
         p =3D (struct proc *) 0x200
         vp =3D (struct vnode *) 0xd1a1fc00
         vattr =3D {va_type =3D 7331034, va_mode =3D 2668, va_nlink =3D=
  -11872,=20
   va_uid =3D 3231424796, va_gid =3D 3517152812, va_fsid =3D 3224921934,=20
   va_fileid =3D -1069001088, va_size =3D 3224922420, va_blocksize =3D=
  134926336,=20
   va_atime =3D {tv_sec =3D 77505573, tv_nsec =3D -778040724}, va_mtime =3D {
     tv_sec =3D 0, tv_nsec =3D -777814408}, va_ctime =3D {tv_sec =3D=
  -1070043292,=20
     tv_nsec =3D -778040724}, va_gen =3D 134926336, va_flags =3D 3231504836,=
 =20
   va_rdev =3D 3231424796, va_bytes =3D 0, va_filerev =3D 579504200489107456,=
 =20
   va_vaflags =3D 3231424796, va_spare =3D 0}
         error =3D 3
 #16 0xc02257fa in ioctl (p=3D0xd19d85a0, uap=3D0xd1a37f80) at=
  ../../sys/file.h:178
         error =3D 3
         fp =3D (struct file *) 0xc17bbc40
         com =3D 18013
         data =3D 0xd1a37ea8 ""
         p =3D (struct proc *) 0xd19d85a0
         fp =3D (struct file *) 0xc17bbc40
         fdp =3D (struct filedesc *) 0x0
         com =3D 18013
         error =3D 3
         size =3D 0
         data =3D 0xd1a37ea8 ""
         memp =3D 0x0
         tmp =3D 4
         ubuf =3D {
   stkbuf =3D=
  "\000\000\000\000\016\000\000\000\002\000\000\0000\n=D1\000\000\000\001\000=
 \000\000\000=E4~=A3=D1=D0\t!\003\000\000\000\000\034=A1\233=C0=
  =BA=D1\003\000\000\000\034=A1\233=C0=
  =BA=D1\003\000\000\000\000\n=D1\220\223\237=D1", '\000' <repeats 12 times>,=
  "\205\235=D1\205\235=D1\000\n=D1\000=D0\n\b(\177=A3=D1\001=B2=
  =C0\001\000\000\000\205\235=D1\000\000\000\000\001\000\000\000\200\177=A3=
 =D1\003\000\000", align =3D 0}
 #17 0xc038a1bd in syscall2 (frame=3D{tf_fs =3D 47, tf_es =3D 47, tf_ds =3D=
  47,=20
       tf_edi =3D -1077937056, tf_esi =3D -1077937064, tf_ebp =3D=
  -1077937280,=20
       tf_isp =3D -777814060, tf_ebx =3D 1, tf_edx =3D 1, tf_ecx =3D -7,=
  tf_eax =3D 54,=20
       tf_trapno =3D 12, tf_err =3D 2, tf_eip =3D 134675508, tf_cs =3D 31,=20
       tf_eflags =3D 659, tf_esp =3D -1077937324, tf_ss =3D 47})
     at ../../i386/i386/trap.c:1175
         params =3D 0xbfbffb58 "\004"
         i =3D 0
         callp =3D (struct sysent *) 0xc042d690
         p =3D (struct proc *) 0xd19d85a0
         orig_tf_eflags =3D 659
         sticks =3D 0
         error =3D 0
         narg =3D 3
         args =3D {4, 18013, 0, 0, 0, 0, 0, 0}
         have_mplock =3D 1
         code =3D 54
 #18 0xc037afd5 in Xint0x80_syscall ()
 No symbol table info available.
 #19 0x80483d9 in ?? ()
 No symbol table info available.
 #20 0x804813e in ?? ()
 No symbol table info available.
 
 
 Alexander
 

From: Alexander Haderer <alexander.haderer@charite.de>
To: Greg 'groggy' Lehey <grog@FreeBSD.org>
Cc: FreeBSD-gnats-submit@FreeBSD.org
Subject: Re: kern/58391: Trap 12 with heavy disk load on ide vinum
  mirror
Date: Thu, 23 Oct 2003 19:16:31 +0200

 At 11:43 23.10.2003 +0930, Greg 'groggy' Lehey wrote:
 >On Wednesday, 22 October 2003 at 21:26:36 +0200, Alexander Haderer wrote:
 >>
 >>> Description:
 >> Setup: A single CPU x86 running 4.8R with GENERIC kernel, a SCSI disk
 >> holds OS and two 160G Maxtor disks (ad0, ad2) setup as vinum mirror
 >> to hold data (whole disk). Ata write cache is off as well as hw.ata.tags.
 >>
 >> When doing high io load to the ide disks the kernel panics with trap 12:
 >>
 >> Fatal trap 12: page fault while in kernel mode
 >
 >Please take a dump of the system and supply a back trace.  Ensure that
 >you have debugging symbols in the kernel.  Don't delete the dump: I
 >will need more information.
 
 Sorry folks, when printing the last backtrace I just forgot to cp the .gdb* 
 stuff before doing the backtrace, so the vinum symbols were not printed.
 
 BTW: It now seems to be that I get trap 18 instead of 12, even when I repeat the
 crash. Is this the debug kernel?
 
 Here we go again:
 
 Kernel was build with config -g GENERIC; make install, and after the crash:
 
 gdb -k /usr/src/sys/compile/GENERIC/kernel.debug vmcore.11
 
 
 
 GNU gdb 4.18 (FreeBSD)
 Copyright 1998 Free Software Foundation, Inc.
 GDB is free software, covered by the GNU General Public License, and you are
 welcome to change it and/or distribute copies of it under certain conditions.
 Type "show copying" to see the conditions.
 There is absolutely no warranty for GDB.  Type "show warranty" for details.
 This GDB was configured as "i386-unknown-freebsd"...
 IdlePTD at phsyical address 0x00538000
 initial pcb at physical address 0x0046cec0
 panicstr: integer divide fault
 panic messages:
 ---
 Fatal trap 18: integer divide fault while in kernel mode
 instruction pointer     = 0x8:0xc039fe9a
 stack pointer           = 0x10:0xd1a37c5c
 frame pointer           = 0x10:0xd1a37cc8
 code segment            = base 0x0, limit 0xfffff, type 0x1b
                         = DPL 0, pres 1, def32 1, gran 1
 processor eflags        = interrupt enabled, resume, IOPL = 0
 current process         = 504 (vinum)
 interrupt mask          = none
 trap number             = 18
 panic: integer divide fault
 
 syncing disks... 76 72 67 64 62 62 56 56 52 51 51 46 46 41 41 36 36 31 31 26 26 22 21 21 16 16 12 11 11 7 7 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 
 giving up on 2 buffers
 Uptime: 1h12m5s
 
 dumping to dev #da/0x20001, offset 3670144
 dump 255 254 253 252 251 250 249 248 247 246 245 244 243 242 241 240 239 238 237 236 235 234 233 232 231 230 229 228 227 226 225 224 223 222 221 220 219 218 217 216 215 214 213 212 211 210 209 208 207 206 205 204 203 202 201 200 199 198 197 196 195 194 193 192 191 190 189 188 187 186 185 184 183 182 181 180 179 178 177 176 175 174 173 172 171 170 169 168 167 166 165 164 163 162 161 160 159 158 157 156 155 154 153 152 151 150 149 148 147 146 145 144 143 142 141 140 139 138 137 136 135 134 133 132 131 130 12 9 128 127 126 125 124 123 122 121 120 119 118 117 116 115 114 113 112 111 110 109 108 107 106 105 104 103 102 101 100 99 98 97 96 95 94 93 92 91 90 89 88 87 86 85 84 83 82 81 80 79 78 77 76 75 74 73 72 71 70 69 68 67 66 65 64 63 62 61 60 59 58 57 56 55 54 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0 
 ---
 #0  dumpsys () at ../../kern/kern_shutdown.c:487
 487             if (dumping++) {
 #0  dumpsys () at ../../kern/kern_shutdown.c:487
 #1  0xc0216273 in boot (howto=0x100) at ../../kern/kern_shutdown.c:316
 #2  0xc0216698 in poweroff_wait (junk=0xc040440c, howto=0xc0403f0a) at ../../kern/kern_shutdown.c:595
 #3  0xc0389f0e in trap_fatal (frame=0xd1a37c1c, eva=0x0) at ../../i386/i386/trap.c:974
 #4  0xc03898eb in trap (frame={tf_fs = 0x10, tf_es = 0x10, tf_ds = 0x10, tf_edi = 0x0, tf_esi = 0x0, 
       tf_ebp = 0xd1a37cc8, tf_isp = 0xd1a37c48, tf_ebx = 0x1000, tf_edx = 0x0, tf_ecx = 0x0, tf_eax = 0x1, 
       tf_trapno = 0x12, tf_err = 0x0, tf_eip = 0xc039fe9a, tf_cs = 0x8, tf_eflags = 0x10246, tf_esp = 0x0, 
       tf_ss = 0x1000}) at ../../i386/i386/trap.c:636
 #5  0xc039fe9a in __qdivrem (uq=0x1000, vq=0x0, arq=0x0) at ../../libkern/qdivrem.c:100
 #6  0xc039fd7f in __divdi3 (a=0x1000, b=0x0) at ../../libkern/divdi3.c:61
 #7  0xc17d0da7 in driveio (drive=0xc1657000, buf=0xc17b8800 "IN VINO", length=0x200, offset=0x1000, flag=0x0)
     at /usr/src/sys/modules/vinum/../../dev/vinum/vinumio.c:330
 #8  0xc17d15cd in daemon_save_config () at /usr/src/sys/modules/vinum/../../dev/vinum/vinumio.c:674
 #9  0xc17cf69b in vinum_daemon () at /usr/src/sys/modules/vinum/../../dev/vinum/vinumdaemon.c:138
 #10 0xc17cf88e in vinum_finddaemon () at /usr/src/sys/modules/vinum/../../dev/vinum/vinumdaemon.c:267
 #11 0xc17d2461 in vinumioctl (dev=0xc17b2280, cmd=0x465d, data=0xd1a37ea8 "", flag=0x3, p=0xd19d85a0)
     at /usr/src/sys/modules/vinum/../../dev/vinum/vinumioctl.c:292
 #12 0xc024f0ce in spec_ioctl (ap=0xd1a37de4) at ../../miscfs/specfs/spec_vnops.c:306
 #13 0xc024edf9 in spec_vnoperate (ap=0xd1a37de4) at ../../miscfs/specfs/spec_vnops.c:119
 #14 0xc032b495 in ufs_vnoperatespec (ap=0xd1a37de4) at ../../ufs/ufs/ufs_vnops.c:2394
 #15 0xc024b687 in vn_ioctl (fp=0xc17bbc40, com=0x465d, data=0xd1a37ea8 "", p=0xd19d85a0) at vnode_if.h:429
 #16 0xc02257fa in ioctl (p=0xd19d85a0, uap=0xd1a37f80) at ../../sys/file.h:178
 #17 0xc038a1bd in syscall2 (frame={tf_fs = 0x2f, tf_es = 0x2f, tf_ds = 0x2f, tf_edi = 0xbfbffc60, tf_esi = 0xbfbffc58, 
       tf_ebp = 0xbfbffb80, tf_isp = 0xd1a37fd4, tf_ebx = 0x1, tf_edx = 0x1, tf_ecx = 0xfffffff9, tf_eax = 0x36, 
       tf_trapno = 0xc, tf_err = 0x2, tf_eip = 0x806fc34, tf_cs = 0x1f, tf_eflags = 0x293, tf_esp = 0xbfbffb54, 
       tf_ss = 0x2f}) at ../../i386/i386/trap.c:1175
 #18 0xc037afd5 in Xint0x80_syscall ()
 #19 0x80483d9 in ?? ()
 #20 0x804813e in ?? ()
 
 -- 
 ------------------------------------------------------------------
 Alexander Haderer                     Charite
                                       Campus Virchow-Klinikum
 Tel.  +49 30 - 450 557 182            Strahlenklinik und Poliklinik  
 Fax.  +49 30 - 450 557 117            Sekr. Prof. Felix
 Email alexander.haderer@charite.de    Augustenburger Platz 1
 www   http://www.charite.de/rv/str/   13353 Berlin - Germany
 ------------------------------------------------------------------
 

From: Alexander Haderer <alexander.haderer@charite.de>
To: Greg 'groggy' Lehey <grog@FreeBSD.org>
Cc: FreeBSD-gnats-submit@FreeBSD.org
Subject: Re: kern/58391: Trap 12 with heavy disk load on ide vinum
  mirror
Date: Thu, 23 Oct 2003 21:20:52 +0200

 I don't know if this has something to do with the problem:
 
 When the vinum volume name ends with a digit (e.g. mirr0), the following 
 newfs needs no -v flag. When the name ends with a letter (e.g. mirr), newfs 
 stops with error:
 
     can't figure out file system partition
 
 newfs only works with -v flag (as mentioned in vinum(8) ).
 
 Nevertheless, the kernel crashes with div by zero (trap 18) with or without 
 a digit in the volume name, in any case the bt shows the same result.
 
 Alexander
 

From: Alexander Haderer <alexander.haderer@charite.de>
To: Greg 'groggy' Lehey <grog@FreeBSD.org>
Cc: FreeBSD-gnats-submit@FreeBSD.org
Subject: Re: kern/58391: Trap 12 with heavy disk load on ide vinum
  mirror
Date: Mon, 27 Oct 2003 18:26:44 +0100

 Update info:
 
 Meanwhile I did further tests, here are the results:
 
 1.
 To exclude some broken hardware issues I did the test on another machine 
 (Celeron 533/i81[05]) with a similar hw/sw setup (scsi to boot, ad0+ad2 for 
 vinum-mirror). Again the kernel crashes, here we have a double pagefault, 
 second one triggered by syncing disks as it seems to me. All dumps are save 
 for later use.
 
 2.
 Again I was unable to trigger a panic on the replacement hw without using 
 vinum. It seems to be that vinum at least helps to trigger a panic when 
 doing ide disk io.
 
 3.
 Further investigations of the trap 18 div-by-zero dump gdb shows that 
 (within a vinum function) parts of the drive->partinfo.disklab struct gets 
 overwritten with zeros and the hostname. As a result, dev/vinum/vinumio.c, 
 function driveio, computation of the block number bombs out because 
 d_secsize is zero.
 
      330:   bp->b_blkno = offset / drive->partinfo.disklab->d_secsize
 
 (All with 4.8R source from CD)
 
 In the hope this is some useful information,
 
 Alexander
 
Responsible-Changed-From-To: freebsd-bugs->grog 
Responsible-Changed-By: kris 
Responsible-Changed-When: Sat Nov 1 17:02:08 PST 2003 
Responsible-Changed-Why:  
Assign to vinum author 

http://www.freebsd.org/cgi/query-pr.cgi?pr=58391 

From: Greg 'groggy' Lehey <grog@FreeBSD.org>
To: Alexander Haderer <alexander.haderer@charite.de>
Cc: FreeBSD-gnats-submit@FreeBSD.org
Subject: Re: kern/58391: Trap 12 with heavy disk load on ide vinum mirror
Date: Thu, 27 Nov 2003 10:08:54 +1030

 --tkPG2DWCCn/ayeFV
 Content-Type: text/plain; charset=us-ascii
 Content-Disposition: inline
 
 On Thursday, 23 October 2003 at 21:20:52 +0200, Alexander Haderer wrote:
 >
 > I don't know if this has something to do with the problem:
 >
 > When the vinum volume name ends with a digit (e.g. mirr0), the following
 > newfs needs no -v flag. When the name ends with a letter (e.g. mirr), newfs
 > stops with error:
 >
 >    can't figure out file system partition
 >
 > newfs only works with -v flag (as mentioned in vinum(8) ).
 >
 > Nevertheless, the kernel crashes with div by zero (trap 18) with or without
 > a digit in the volume name, in any case the bt shows the same
 > result.
 
 Yes, it's possible that this is the problem.  Can you show me your
 configuration?
 
 Greg
 --
 See complete headers for address and phone numbers.
 
 --tkPG2DWCCn/ayeFV
 Content-Type: application/pgp-signature
 Content-Disposition: inline
 
 -----BEGIN PGP SIGNATURE-----
 Version: GnuPG v1.2.0 (FreeBSD)
 
 iD8DBQE/xTmOIubykFB6QiMRAqzdAJ4/VDYhS20SNq/hsivoslweWDzP7QCcCm2m
 KekgimcaUj1hQLd8V9n/5Gc=
 =Z3bN
 -----END PGP SIGNATURE-----
 
 --tkPG2DWCCn/ayeFV--

From: Alexander Haderer <alexander.haderer@charite.de>
To: Greg 'groggy' Lehey <grog@FreeBSD.org>
Cc: FreeBSD-gnats-submit@FreeBSD.org
Subject: Re: kern/58391: Trap 12 with heavy disk load on ide vinum
  mirror
Date: Thu, 27 Nov 2003 16:46:35 +0100

 At 10:08 27.11.2003 +1030, Greg 'groggy' Lehey wrote:
 >On Thursday, 23 October 2003 at 21:20:52 +0200, Alexander Haderer wrote:
 >>
 >> I don't know if this has something to do with the problem:
 >>
 >> When the vinum volume name ends with a digit (e.g. mirr0), the following
 >> newfs needs no -v flag. When the name ends with a letter (e.g. mirr), newfs
 >> stops with error:
 >>
 >>    can't figure out file system partition
 >>
 >> newfs only works with -v flag (as mentioned in vinum(8) ).
 >>
 >> Nevertheless, the kernel crashes with div by zero (trap 18) with or without
 >> a digit in the volume name, in any case the bt shows the same
 >> result.
 >
 >Yes, it's possible that this is the problem. 
 
 I think no. If you take a look at /usr/src/sbin/newfs/newfs.c:481++
 
                 if (vflag || isdigit(*cp))
                         pp = &lp->d_partitions[0];
                 else
                         pp = &lp->d_partitions[*cp - 'a'];
 
 newfs will do the same thing in both cases:
 
      newfs /dev/vinum/mirr0
      newfs -v /dev/vinum/mirr
 
 but will do the wrong thing when called with a..h in last char, like
 
      newfs /dev/vinum/blob
 
 (Still a bug in newfs?)
 
 > Can you show me your
 >configuration?
 
 Yes, of course.
 
 Please note: The vmcore mentioned in the PR was made on our production machine
 (marvin17.str.charite.de). To do further analyzis I renamed it to 
 greenaway.str.charite.de, and the two 160G IDE disks are replaced with 60G IDE 
 disks.
 
 Setup is like this:
    the host was part of a file server cluster (web access)
    SCSI disk for FreeBSD OS
    Two IDE disks as mirror (whole disk) for data
    two network cards ("cluster-internal" vs "client", no routing)
    VGA console, no X11
 
 
 
 
 uname -a
 FreeBSD greenaway.str.charite.de 4.8-RELEASE FreeBSD 4.8-RELEASE #0: 
         Thu Oct 23 13:15:35 CEST 2003     
         root@marvin17.str.charite.de:/usr/src/sys/compile/GENERIC  i386
 
 Kernel was (re)build via config -g GENERIC 
 
 
 ####################################################################################
 
 dmesg -M vmcore.11 -N kernel.11
 Copyright (c) 1992-2003 The FreeBSD Project.
 Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
         The Regents of the University of California. All rights reserved.
 FreeBSD 4.8-RELEASE #0: Thu Oct 23 13:15:35 CEST 2003
     root@marvin17.str.charite.de:/usr/src/sys/compile/GENERIC
 Timecounter "i8254"  frequency 1193182 Hz
 CPU: AMD Athlon(tm) processor (1000.04-MHz 686-class CPU)
   Origin = "AuthenticAMD"  Id = 0x642  Stepping = 2
   Features=0x183f9ff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR>
   AMD Features=0xc0440000<RSVD,AMIE,DSP,3DNow!>
 real memory  = 268369920 (262080K bytes)
 avail memory = 255918080 (249920K bytes)
 Preloaded elf kernel "kernel" at 0xc0519000.
 Pentium Pro MTRR support enabled
 md0: Malloc disk
 Using $PIR table, 9 entries at 0xc00fdee0
 npx0: <math processor> on motherboard
 npx0: INT 16 interface
 pcib0: <Host to PCI bridge> on motherboard
 pci0: <PCI bus> on pcib0
 agp0: <VIA 82C8363 (Apollo KT133A) host to PCI bridge> mem 0xe0000000-0xe3ffffff at device 0.0 on pci0
 pcib1: <VIA 8363 (Apollo KT133) PCI-PCI (AGP) bridge> at device 1.0 on pci0
 pci1: <PCI bus> on pcib1
 pci1: <NVidia Riva Ultra Vanta TNT2 graphics accelerator> at 0.0 irq 5
 isab0: <VIA 82C686 PCI-ISA bridge> at device 7.0 on pci0
 isa0: <ISA bus> on isab0
 atapci0: <VIA 82C686 ATA100 controller> port 0xd000-0xd00f at device 7.1 on pci0
 atapci0: Correcting VIA config for southbridge data corruption bug
 ata0: at 0x1f0 irq 14 on atapci0
 ata1: at 0x170 irq 15 on atapci0
 pci0: <unknown card> (vendor=0x1106, dev=0x3057) at 7.4
 xl0: <3Com 3c905C-TX Fast Etherlink XL> port 0xdc00-0xdc7f mem 0xe9000000-0xe900007f irq 12 at device 9.0 on pci0
 xl0: Ethernet address: 00:04:75:e4:7a:ee
 miibus0: <MII bus> on xl0
 ukphy0: <Generic IEEE 802.3u media interface> on miibus0
 ukphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
 xl1: <3Com 3c905C-TX Fast Etherlink XL> port 0xe000-0xe07f mem 0xe9001000-0xe900107f irq 10 at device 11.0 on pci0
 xl1: Ethernet address: 00:04:76:16:11:1d
 miibus1: <MII bus> on xl1
 xlphy0: <3c905C 10/100 internal PHY> on miibus1
 xlphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
 sym0: <895> port 0xe400-0xe4ff mem 0xe9003000-0xe9003fff,0xe9002000-0xe90020ff irq 11 at device 15.0 on pci0
 sym0: Tekram NVRAM, ID 7, Fast-40, SE, parity checking
 orm0: <Option ROMs> at iomem 0xc0000-0xcffff,0xd0000-0xd1fff,0xd2000-0xd27ff,0xd3000-0xd37ff on isa0
 fdc0: <NEC 72065B or clone> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0
 fdc0: FIFO enabled, 8 bytes threshold
 fd0: <1440-KB 3.5" drive> on fdc0 drive 0
 atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
 atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
 kbd0 at atkbd0
 vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
 sc0: <System console> at flags 0x100 on isa0
 sc0: VGA <16 virtual consoles, flags=0x300>
 sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
 sio0: type 16550A
 sio1 at port 0x2f8-0x2ff irq 3 on isa0
 sio1: type 16550A
 ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
 ppc0: Generic chipset (EPP/NIBBLE) in COMPATIBLE mode
 plip0: <PLIP network interface> on ppbus0
 lpt0: <Printer> on ppbus0
 lpt0: Interrupt-driven port
 ppi0: <Parallel I/O> on ppbus0
 ad0: 156334MB <Maxtor 4G160J8> [317632/16/63] at ata0-master UDMA100
 ad2: 156334MB <Maxtor 4G160J8> [317632/16/63] at ata1-master UDMA100
 Waiting 15 seconds for SCSI devices to settle
 (noperiph:sym0:0:-1:-1): SCSI BUS mode change from SE to SE.
 Mounting root from ufs:/dev/da0s1a
 da0 at sym0 bus 0 target 0 lun 0
 da0: <IBM IC35L036UWDY10-0 S25F> Fixed Direct Access SCSI-3 device
 da0: 40.000MB/s transfers (20.000MHz, offset 31, 16bit), Tagged Queueing Enabled
 da0: 35003MB (71687340 512 byte sectors: 255H 63S/T 4462C)
 
 [what follows is the raid setup with dd, fdisk, disklabel, vinum create -f, start]
 
 ad0: cannot find label (no disk label)
 ad0s1: cannot find label (no disk label)
 ad0: cannot find label (no disk label)
 ad0s1: cannot find label (no disk label)
 ad0: cannot find label (no disk label)
 ad0s1: cannot find label (no disk label)
 ad0: cannot find label (no disk label)
 ad0s1: cannot find label (no disk label)
 ad2: cannot find label (no disk label)
 ad2s1: cannot find label (no disk label)
 ad2: cannot find label (no disk label)
 ad2s1: cannot find label (no disk label)
 ad2: cannot find label (no disk label)
 ad2s1: cannot find label (no disk label)
 ad2: cannot find label (no disk label)
 ad2s1: cannot find label (no disk label)
 vinum: loaded
 vinum: drive disk0 is up
 vinum: drive disk2 is up
 vinum: mirror.p0.s0 is up
 vinum: mirror.p1.s0 is up
 vinum: mirror.p0 is up
 vinum: mirror is up
 
 [ here the stress-tests start..., 
   line above is also the last message in "/var/log/messages"  ]
 
 vinum: mirror.p0.s0 is stale by force
 vinum: mirror.p0 is faulty
 fatal :mirror.p0.s0 write error, block 12592137 for 2048 bytes
 mirror.p0.s0: user buffer block 12591872 for 2048 bytes
 
 
 Fatal trap 18: integer divide fault while in kernel mode
 instruction pointer     = 0x8:0xc039fe9a
 stack pointer           = 0x10:0xd1a37c5c
 frame pointer           = 0x10:0xd1a37cc8
 code segment            = base 0x0, limit 0xfffff, type 0x1b
                         = DPL 0, pres 1, def32 1, gran 1
 processor eflags        = interrupt enabled, resume, IOPL = 0
 current process         = 504 (vinum)
 interrupt mask          = none
 trap number             = 18
 panic: integer divide fault
 
 syncing disks... 76 72 67 64 62 62 56 56 52 51 51 46 46 41 41 36 36 31 31 26 26 22 21 21 16 16 12 11 11 7 7 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2
 giving up on 2 buffers
 Uptime: 1h12m5s
 
 dumping to dev #da/0x20001, offset 3670144
 dump 255 [...skipped...] 0
 
 
 ####################################################################################
 
 
 ps -waux -M vmcore.11 -N kernel.11
 USER     PID %CPU %MEM   VSZ  RSS  TT  STAT STARTED      TIME COMMAND
 root     504 52.9  0.0   616    0  ??  RLs   9:00PM   0:00.00  (vinum)
 root       1  0.0  0.0   548    0  ??  ILs   9:00PM   0:00.00  (init)
 root       2  0.0  0.0     0    0  ??  RL    9:00PM   0:00.01  (pagedaemon)
 root       3  0.0  0.0     0    0  ??  DL    9:00PM   0:00.00  (vmdaemon)
 root       4  0.0  0.0     0    0  ??  RL    9:00PM   0:00.04  (bufdaemon)
 root       5  0.0  0.0     0    0  ??  RL    9:00PM   0:00.02  (vnlru)
 root       6  0.0  0.0     0    0  ??  RL    9:00PM   0:00.14  (syncer)
 root      26  0.0  0.0   208    0  ??  Is    9:00PM   0:00.00  (adjkerntz)
 root      83  0.0  0.0   948    0  ??  Rs    9:00PM   0:00.04  (syslogd)
 root      88  0.0  0.0  1292    0  ??  Rs    9:00PM   0:00.09  (ntpd)
 daemon    90  0.0  0.0   956    0  ??  Is    9:00PM   0:00.00  (portmap)
 root      92  0.0  0.0   912    0  ??  Is    9:00PM   0:00.01  (ypbind)
 root      95  0.0  0.0   536    0  ??  Is    9:00PM   0:00.00  (mountd)
 root      99  0.0  0.0   356    0  ??  I     9:00PM   0:00.00  (nfsd)
 root     100  0.0  0.0   356    0  ??  I     9:00PM   0:00.00  (nfsd)
 root     101  0.0  0.0   356    0  ??  I     9:00PM   0:00.00  (nfsd)
 root     102  0.0  0.0   356    0  ??  I     9:00PM   0:00.00  (nfsd)
 root     103  0.0  0.0   356    0  ??  I     9:00PM   0:00.00  (nfsd)
 root     104  0.0  0.0   356    0  ??  I     9:00PM   0:00.00  (nfsd)
 root     105  0.0  0.0 263080    0  ??  Is    9:00PM   0:00.00  (rpc.statd)
 root     110  0.0  0.0   212    0  ??  I     9:00PM   0:00.00  (nfsiod)
 root     111  0.0  0.0   212    0  ??  I     9:00PM   0:00.00  (nfsiod)
 root     112  0.0  0.0   212    0  ??  I     9:00PM   0:00.00  (nfsiod)
 root     113  0.0  0.0   212    0  ??  I     9:00PM   0:00.00  (nfsiod)
 root     120  0.0  0.0  1204    0  ??  Is    9:00PM   0:00.04  (amd)
 root     123  0.0  0.0  1088    0  ??  Is    9:00PM   0:00.01  (inetd)
 root     125  0.0  0.0  1016    0  ??  Rs    9:00PM   0:00.01  (cron)
 root     128  0.0  0.0   960    0  ??  Is    9:00PM   0:00.01  (lpd)
 root     130  0.0  0.0  2588    0  ??  Is    9:00PM   0:00.00  (sshd)
 root     133  0.0  0.0  3048    0  ??  Rs    9:00PM   0:00.08  (sendmail)
 smmsp    136  0.0  0.0  2924    0  ??  Is    9:00PM   0:00.00  (sendmail)
 root     155  0.0  0.0  1276    0 #C1  Is    9:00PM   0:00.02  (login)
 root     156  0.0  0.0   944    0 #C2  Is+   9:00PM   0:00.00  (getty)
 root     157  0.0  0.0   944    0 #C2  Is+   9:00PM   0:00.00  (getty)
 root     158  0.0  0.0   944    0 #C2  Is+   9:00PM   0:00.00  (getty)
 root     159  0.0  0.0   944    0 #C2  Is+   9:00PM   0:00.00  (getty)
 root     160  0.0  0.0   944    0 #C2  Is+   9:00PM   0:00.00  (getty)
 root     161  0.0  0.0   944    0 #C2  Is+   9:00PM   0:00.00  (getty)
 root     162  0.0  0.0   944    0 #C2  Is+   9:00PM   0:00.00  (getty)
 root     163  0.0  0.0   948    0  ??  Ss    9:00PM   0:00.06  (rlogind)
 55556    164  0.0  0.0   632    0 #C1  Is    9:00PM   0:00.01  (sh)
 root     167  0.0  0.0   948    0  ??  Is    9:00PM   0:00.01  (rlogind)
 55556    168  0.0  0.0   632    0 #C2  Is    9:00PM   0:00.01  (sh)
 root     170  0.0  0.0   948    0  ??  Ss    9:00PM   0:00.04  (rlogind)
 55556    171  0.0  0.0   632    0 #C2  Is    9:00PM   0:00.01  (sh)
 root     173  0.0  0.0   948    0  ??  Is    9:00PM   0:00.05  (rlogind)
 55556    174  0.0  0.0   632    0 #C2  Is    9:00PM   0:00.01  (sh)
 root     176  0.0  0.0   948    0  ??  Ss    9:00PM   0:00.01  (rlogind)
 55556    177  0.0  0.0   632    0 #C2  Is    9:00PM   0:00.01  (sh)
 root     179  0.0  0.0  1348    0 #C1  S     9:00PM   0:00.06  (csh)
 root     181  0.0  0.0  1348    0 #C2  I+    9:00PM   0:00.03  (csh)
 55556    476  0.0  0.0  1344    0 #C2  I     9:00PM   0:00.03  (tcsh)
 55556    481  0.0  0.0  1344    0 #C2  S+    9:00PM   0:00.03  (tcsh)
 55556    486  0.0  0.0  1344    0 #C2  S+    9:00PM   0:00.03  (tcsh)
 root     606  0.0  0.0  1368    0 #C1  I+    9:00PM   0:00.03  (csh)
 55556    625  0.0  0.0   976    0 #C2  I+    9:00PM   0:00.03  (find)
 55556    626  0.0  0.0   940    0 #C2  R+    9:00PM   0:00.43  (cpio)
 root       0  0.0  0.0     0    0  ??  DLs   9:00PM   0:00.00  (swapper)
 root     631  0.0  0.0   220    0 #C1  R+    9:00PM   0:00.00  (dd)
 greenaway#
 
 ####################################################################################
 
 As noted in PR, I was able to crash a 4.8R kernel on a completly different hw using
 the setup mentioned above (SCSI disk for OS, 2 IDE as vinum-mirror). So, it doesn't
 seem to be a broken hw.
 
 
 ####################################################################################
 
 Looking around with gdb -k in the core, I can see, that in the global 
     * vinum_conf.drive[0].partinfo.disklab 
 
 the disklab struct for drive[0] gets overwritten with the hostname:
 
 gdb -k PR_58391_trap18_kernel.debug PR_58391_trap18_vmcore
 [...]
 (kgdb) frame 7
 #7  0xc17d0da7 in driveio (drive=0xc1657000, buf=0xc17b8800 "IN VINO", length=0x200, offset=0x1000, flag=0x0)
     at /usr/src/sys/modules/vinum/../../dev/vinum/vinumio.c:330
 330             bp->b_blkno = offset / drive->partinfo.disklab->d_secsize; /* block number */
 
 (kgdb) print *vinum_conf.drive[0].partinfo.disklab
 $1 = {
   d_magic = 0x56204e49,
   d_type = 0x4e49,
   d_subtype = 0x4f,
   d_typename = "\000\000\001\000marvin17.str",
   d_un = {
     un_d_packname = ".charite.de\000\000\000\000",
     un_b = {
       un_d_boot0 = 0x6168632e <Address 0x6168632e out of bounds>,
       un_d_boot1 = 0x65746972 <Address 0x65746972 out of bounds>
     }
   },
   d_secsize = 0x0,
   d_nsectors = 0x6b736964,
   d_ntracks = 0x30,
   d_ncylinders = 0x0,
   d_secpercyl = 0x0,
   d_secperunit = 0x0,
   d_sparespertrack = 0x0,
   d_sparespercyl = 0x0,
   d_acylinders = 0x0,
   d_rpm = 0x0,
   d_interleave = 0x0,
   d_trackskew = 0xbbce,
   d_cylskew = 0x3f97,
   d_headswitch = 0x408e9,
   d_trkseek = 0x3f97cb69,
   d_flags = 0x77dec,
   d_drivedata = {0x2ae78200, 0x26, 0x0, 0x0, 0x0},
   d_spare = {0x0, 0x0, 0x0, 0x0, 0x0},
   d_magic2 = 0x82564557,
   ...
   ...
 
 (kgdb) print *vinum_conf.drive[1].partinfo.disklab
 $2 = {
   d_magic = 0x82564557,
   d_type = 0x0,
   d_subtype = 0x0,
   d_typename = "amnesiac\000\000\000\000\000\000\000",
   d_un = {
     un_d_packname = '\000' <repeats 15 times>,
     un_b = {
       un_d_boot0 = 0x0,
       un_d_boot1 = 0x0
     }
   },
   d_secsize = 0x200,
   d_nsectors = 0x3f,
   d_ntracks = 0x10,
   d_ncylinders = 0x4d8bf,
   d_secpercyl = 0x3f0,
   d_secperunit = 0x131573c1,
   d_sparespertrack = 0x0,
   d_sparespercyl = 0x0,
   d_acylinders = 0x0,
   d_rpm = 0xe10,
   d_interleave = 0x1,
   d_trackskew = 0x0,
   d_cylskew = 0x0,
   d_headswitch = 0x0,
   d_trkseek = 0x0,
   d_flags = 0x0,
   d_drivedata = {0x0, 0x0, 0x0, 0x0, 0x0},
   d_spare = {0x0, 0x0, 0x0, 0x0, 0x0},
   d_magic2 = 0x82564557,
   ...
   ...
 
 
 the d_secsize=0 for drive 0 causes the div by zero crash in frame 7 .
 
 
 Note: sources from 4.8R CDROM
 
 
 hope that helps,
 
 Alexander
 -- 
 
 

From: Alexander Haderer <alexander.haderer@charite.de>
To: Greg 'groggy' Lehey <grog@FreeBSD.org>
Cc: FreeBSD-gnats-submit@FreeBSD.org
Subject: Re: kern/58391: Trap 12 with heavy disk load on ide vinum
  mirror
Date: Thu, 27 Nov 2003 21:22:22 +0100

 oops, I forgot to send the setup for the raid:
 
 X = 0,2
 
 1. dd if=/dev/zero of=/dev/radX bs=1k count=100
 2. fdisk -BI adX
 3. disklabel -Brw adXs1 auto
 4. disklabel -e adXs1: clone c: , name it e: type vinum
 
 vinum create -f vinum.conf with vinum.conf:
 
 drive disk0 device /dev/ad0s1e
 drive disk2 device /dev/ad2s1e
 
 volume mir setupstate
    plex org concat
     sd len 0s drive disk0
    plex org concat
     sd len 0s drive disk2
 
 newfs -m 0 -b 16384 -f 2048 -i 131072 -g 300000 -h 200 /dev/vinum/mir
 
 Note: fdisk and dd install useless bootcode here. This if for historical 
 reasons (known to work under all circumstances and then went into a script).
 
 
 Alexander
 -- 
 

From: Staniclav Sitar <sitar_vim@procaut.sk>
To: freebsd-gnats-submit@FreeBSD.org, alexander.haderer@charite.de
Cc:  
Subject: Re: kern/58391: Trap 12 with heavy disk load on ide vinum mirror
Date: Thu, 22 Jul 2004 12:39:51 +0200

 This is a multi-part message in MIME format.
 --------------020203040503070100080105
 Content-Type: text/plain; charset=us-ascii; format=flowed
 Content-Transfer-Encoding: 7bit
 
 Hi.
 
 I am having the same problem with FreeBSD 5.2.1
 
 here is a little piece of my messages file, and my vinum_history log.
 
 I have set up two disks in my machine.
 the first partition holds the system, second one holds two slices.
 I have created two mirrored disks (see vinum_history).
 When I start copying files from one mirrored disk to another
 crash happens.
 
 Stanislav.
 
 
 --------------020203040503070100080105
 Content-Type: text/plain;
  name="vinum_history"
 Content-Transfer-Encoding: 7bit
 Content-Disposition: inline;
  filename="vinum_history"
 
 18 Jul 2004 19:33:01.459885 *** vinum started ***
 18 Jul 2004 19:33:01.462241 create /root/vinum/vinum.conf.02 
 drive alpha device /dev/ad0s2d
 drive beta  device /dev/ad2s2d
 volume zrkadlo1 setupstate
     plex org concat
     sd length 25994m drive alpha
     plex org concat
     sd length 25994m drive beta
 18 Jul 2004 19:33:49.356227 *** vinum started ***
 18 Jul 2004 19:33:49.359835 create /root/vinum/vinum.conf.03 
 drive gama device /dev/ad0s2e
 drive delta device /dev/ad2s2e
 volume zrkadlo2 setupstate
     plex org concat
     sd length 10118m drive gama
     plex org concat
     sd length 10118m drive delta
 18 Jul 2004 19:39:15.216211 *** vinum started ***
 18 Jul 2004 19:39:15.230601 l 
 18 Jul 2004 20:22:20.129418 *** vinum started ***
 18 Jul 2004 20:22:20.132200 l 
 18 Jul 2004 20:27:00.207528 *** vinum started ***
 18 Jul 2004 20:27:00.222068 l 
 18 Jul 2004 20:27:25.869988 *** vinum started ***
 18 Jul 2004 20:27:25.872399 start zrkadlo2.p1.s0 
 18 Jul 2004 20:28:03.108934 *** vinum started ***
 18 Jul 2004 20:28:03.113046 l 
 18 Jul 2004 20:32:27.975397 *** vinum started ***
 18 Jul 2004 20:32:27.979231 l 
 18 Jul 2004 20:35:42.578015 *** vinum started ***
 18 Jul 2004 20:35:42.580429 l 
 18 Jul 2004 20:36:35.196062 *** vinum started ***
 18 Jul 2004 20:36:35.198737 l 
 18 Jul 2004 20:37:17.293309 *** vinum started ***
 18 Jul 2004 20:37:17.295746 l 
 18 Jul 2004 20:39:22.728893 *** vinum started ***
 18 Jul 2004 20:39:22.731340 l 
 18 Jul 2004 20:40:48.558709 *** vinum started ***
 18 Jul 2004 20:40:48.561132 l 
 18 Jul 2004 20:41:38.666998 *** vinum started ***
 18 Jul 2004 20:41:38.670930 l 
 18 Jul 2004 20:27:25.872399 start zrkadlo2.p1.s0 
 
 --------------020203040503070100080105
 Content-Type: text/plain;
  name="messages"
 Content-Transfer-Encoding: 7bit
 Content-Disposition: inline;
  filename="messages"
 
 Jul 18 19:45:31 fileserver shutdown: reboot by root: 
 Jul 18 19:45:33 fileserver syslogd: exiting on signal 15
 Jul 18 19:47:05 fileserver syslogd: kernel boot file is /boot/kernel/kernel
 Jul 18 19:47:05 fileserver kernel: Copyright (c) 1992-2004 The FreeBSD Project.
 Jul 18 19:47:05 fileserver kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
 Jul 18 19:47:05 fileserver kernel: The Regents of the University of California. All rights reserved.
 Jul 18 19:47:05 fileserver kernel: FreeBSD 5.2.1-RELEASE #0: Mon Feb 23 20:45:55 GMT 2004
 Jul 18 19:47:05 fileserver kernel: root@wv1u.btc.adaptec.com:/usr/obj/usr/src/sys/GENERIC
 Jul 18 19:47:05 fileserver kernel: Preloaded elf kernel "/boot/kernel/kernel" at 0xc0aac000.
 Jul 18 19:47:05 fileserver kernel: Preloaded elf module "/boot/kernel/vinum.ko" at 0xc0aac1f4.
 Jul 18 19:47:05 fileserver kernel: Timecounter "i8254" frequency 1193182 Hz quality 0
 Jul 18 19:47:05 fileserver kernel: CPU: Intel Pentium III (549.06-MHz 686-class CPU)
 Jul 18 19:47:05 fileserver kernel: Origin = "GenuineIntel"  Id = 0x681  Stepping = 1
 Jul 18 19:47:05 fileserver kernel: Features=0x383f9ff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
 Jul 18 19:47:05 fileserver kernel: real memory  = 134152192 (127 MB)
 Jul 18 19:47:05 fileserver kernel: avail memory = 120688640 (115 MB)
 Jul 18 19:47:05 fileserver kernel: Pentium Pro MTRR support enabled
 Jul 18 19:47:05 fileserver kernel: npx0: [FAST]
 Jul 18 19:47:05 fileserver kernel: npx0: <math processor> on motherboard
 Jul 18 19:47:05 fileserver kernel: npx0: INT 16 interface
 Jul 18 19:47:05 fileserver kernel: pcibios: BIOS version 2.10
 Jul 18 19:47:05 fileserver kernel: Using $PIR table, 7 entries at 0xc00fda30
 Jul 18 19:47:05 fileserver kernel: pcib0: <Intel 82443BX (440 BX) host to PCI bridge> at pcibus 0 on motherboard
 Jul 18 19:47:05 fileserver kernel: pci0: <PCI bus> on pcib0
 Jul 18 19:47:05 fileserver kernel: pci_cfgintr: 0:7 INTD BIOS irq 11
 Jul 18 19:47:05 fileserver kernel: pci_cfgintr: 0:12 INTA BIOS irq 10
 Jul 18 19:47:05 fileserver kernel: agp0: <Intel 82443BX (440 BX) host to PCI bridge> mem 0xe8000000-0xebffffff at device 0.0 on pci0
 Jul 18 19:47:05 fileserver kernel: pcib1: <PCI-PCI bridge> at device 1.0 on pci0
 Jul 18 19:47:05 fileserver kernel: pci1: <PCI bus> on pcib1
 Jul 18 19:47:05 fileserver kernel: pci1: <display, VGA> at device 0.0 (no driver attached)
 Jul 18 19:47:05 fileserver kernel: isab0: <PCI-ISA bridge> at device 7.0 on pci0
 Jul 18 19:47:05 fileserver kernel: isa0: <ISA bus> on isab0
 Jul 18 19:47:05 fileserver kernel: atapci0: <Intel PIIX4 UDMA33 controller> port 0xf000-0xf00f at device 7.1 on pci0
 Jul 18 19:47:05 fileserver kernel: ata0: at 0x1f0 irq 14 on atapci0
 Jul 18 19:47:05 fileserver kernel: ata0: [MPSAFE]
 Jul 18 19:47:05 fileserver kernel: ata1: at 0x170 irq 15 on atapci0
 Jul 18 19:47:05 fileserver kernel: ata1: [MPSAFE]
 Jul 18 19:47:05 fileserver kernel: uhci0: <Intel 82371AB/EB (PIIX4) USB controller> port 0xe000-0xe01f irq 11 at device 7.2 on pci0
 Jul 18 19:47:05 fileserver kernel: usb0: <Intel 82371AB/EB (PIIX4) USB controller> on uhci0
 Jul 18 19:47:05 fileserver kernel: usb0: USB revision 1.0
 Jul 18 19:47:05 fileserver kernel: uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
 Jul 18 19:47:05 fileserver kernel: uhub0: 2 ports with 2 removable, self powered
 Jul 18 19:47:05 fileserver kernel: piix0: <PIIX Timecounter> port 0x5000-0x500f at device 7.3 on pci0
 Jul 18 19:47:05 fileserver kernel: Timecounter "PIIX" frequency 3579545 Hz quality 0
 Jul 18 19:47:05 fileserver kernel: ahc0: <Adaptec aic7880 Ultra SCSI adapter> port 0xe400-0xe4ff mem 0xed000000-0xed000fff irq 10 at device 12.0 on pci0
 Jul 18 19:47:05 fileserver kernel: aic7880: Ultra Wide Channel A, SCSI Id=7, 16/253 SCBs
 Jul 18 19:47:05 fileserver kernel: orm0: <Option ROM> at iomem 0xc0000-0xc7fff on isa0
 Jul 18 19:47:05 fileserver kernel: pmtimer0 on isa0
 Jul 18 19:47:05 fileserver kernel: atkbdc0: <Keyboard controller (i8042)> at port 0x64,0x60 on isa0
 Jul 18 19:47:05 fileserver kernel: atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
 Jul 18 19:47:05 fileserver kernel: kbd0 at atkbd0
 Jul 18 19:47:05 fileserver kernel: fdc0: <Enhanced floppy controller (i82077, NE72065 or clone)> at port 0x3f7,0x3f0-0x3f5 irq 6 drq 2 on isa0
 Jul 18 19:47:05 fileserver kernel: fdc0: FIFO enabled, 8 bytes threshold
 Jul 18 19:47:05 fileserver kernel: fd0: <1440-KB 3.5" drive> on fdc0 drive 0
 Jul 18 19:47:05 fileserver kernel: ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
 Jul 18 19:47:05 fileserver kernel: ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode
 Jul 18 19:47:05 fileserver kernel: ppbus0: <Parallel port bus> on ppc0
 Jul 18 19:47:05 fileserver kernel: plip0: <PLIP network interface> on ppbus0
 Jul 18 19:47:05 fileserver kernel: lpt0: <Printer> on ppbus0
 Jul 18 19:47:05 fileserver kernel: lpt0: Interrupt-driven port
 Jul 18 19:47:05 fileserver kernel: ppi0: <Parallel I/O> on ppbus0
 Jul 18 19:47:05 fileserver kernel: sc0: <System console> at flags 0x100 on isa0
 Jul 18 19:47:05 fileserver kernel: sc0: VGA <16 virtual consoles, flags=0x300>
 Jul 18 19:47:05 fileserver kernel: sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
 Jul 18 19:47:05 fileserver kernel: sio0: type 16550A
 Jul 18 19:47:05 fileserver kernel: sio1 at port 0x2f8-0x2ff irq 3 on isa0
 Jul 18 19:47:05 fileserver kernel: sio1: type 16550A
 Jul 18 19:47:05 fileserver kernel: vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
 Jul 18 19:47:05 fileserver kernel: ep0: <3Com 3C509-TPC EtherLink III> at port 0x220-0x22f irq 5 on isa0
 Jul 18 19:47:05 fileserver kernel: ep0: Ethernet address 00:50:04:f9:b0:9a
 Jul 18 19:47:05 fileserver kernel: unknown: <PNP0303> can't assign resources (port)
 Jul 18 19:47:05 fileserver kernel: unknown: <PNP0a03> can't assign resources (port)
 Jul 18 19:47:05 fileserver kernel: unknown: <PNP0501> can't assign resources (port)
 Jul 18 19:47:05 fileserver kernel: unknown: <PNP0700> can't assign resources (port)
 Jul 18 19:47:05 fileserver kernel: unknown: <PNP0400> can't assign resources (port)
 Jul 18 19:47:05 fileserver kernel: unknown: <PNP0501> can't assign resources (port)
 Jul 18 19:47:05 fileserver kernel: Timecounter "TSC" frequency 549064738 Hz quality 800
 Jul 18 19:47:05 fileserver kernel: Timecounters tick every 10.000 msec
 Jul 18 19:47:05 fileserver kernel: GEOM: create disk ad0 dp=0xc2053960
 Jul 18 19:47:05 fileserver kernel: ad0: 38166MB <ST340014A> [77545/16/63] at ata0-master UDMA33
 Jul 18 19:47:05 fileserver kernel: GEOM: create disk ad1 dp=0xc2053b60
 Jul 18 19:47:05 fileserver kernel: ad1: 32253MB <ST380011A> [65531/16/63] at ata0-slave UDMA33
 Jul 18 19:47:05 fileserver kernel: GEOM: create disk ad2 dp=0xc20a4360
 Jul 18 19:47:05 fileserver kernel: ad2: 38166MB <ST340014A> [77545/16/63] at ata1-master UDMA33
 Jul 18 19:47:05 fileserver kernel: Waiting 15 seconds for SCSI devices to settle
 Jul 18 19:47:05 fileserver kernel: Mounting root from ufs:/dev/ad0s1a
 Jul 18 19:50:50 fileserver login: ROOT LOGIN (root) ON ttyv0
 Jul 18 19:50:56 fileserver login: ROOT LOGIN (root) ON ttyv1
 Jul 18 19:51:42 fileserver login: ROOT LOGIN (root) ON ttyv2
 Jul 18 19:52:00 fileserver kernel: WARNING: /mnt was not properly dismounted
 Jul 18 20:20:26 fileserver kernel: ad2: WARNING - READ_DMA UDMA ICRC error (retrying request) LBA=57808895
 Jul 18 20:20:26 fileserver kernel: ad2: WARNING - READ_DMA UDMA ICRC error (retrying request) LBA=57808895
 Jul 18 20:20:28 fileserver kernel: ad2: WARNING - READ_DMA UDMA ICRC error (retrying request) LBA=57812927
 Jul 18 20:20:28 fileserver kernel: ad2: WARNING - READ_DMA UDMA ICRC error (retrying request) LBA=57812927
 Jul 18 20:20:29 fileserver kernel: ad2: FAILURE - READ_DMA status=51<READY,DSC,ERROR> error=84<ICRC,ABORTED> LBA=57812927
 Jul 18 20:20:29 fileserver kernel: vinum: zrkadlo2.p1.s0 is crashed by force
 Jul 18 20:20:29 fileserver kernel: vinum: zrkadlo2.p1 is faulty
 Jul 18 20:20:29 fileserver kernel: fatal:zrkadlo2.p1.s0 read error, block 396617 for 49152 bytes
 Jul 18 20:20:29 fileserver kernel: zrkadlo2.p1.s0: user buffer block 396352 for 49152 bytes
 Jul 18 20:20:42 fileserver kernel: vinum: zrkadlo2.p1.s0 is stale by force
 Jul 18 20:24:09 fileserver shutdown: reboot by root: 
 Jul 18 20:24:12 fileserver syslogd: exiting on signal 15
 Jul 18 20:26:29 fileserver syslogd: kernel boot file is /boot/kernel/kernel
 Jul 18 20:26:29 fileserver kernel: Copyright (c) 1992-2004 The FreeBSD Project.
 Jul 18 20:26:29 fileserver kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
 Jul 18 20:26:29 fileserver kernel: The Regents of the University of California. All rights reserved.
 Jul 18 20:26:29 fileserver kernel: FreeBSD 5.2.1-RELEASE #0: Mon Feb 23 20:45:55 GMT 2004
 Jul 18 20:26:29 fileserver kernel: root@wv1u.btc.adaptec.com:/usr/obj/usr/src/sys/GENERIC
 Jul 18 20:26:29 fileserver kernel: Preloaded elf kernel "/boot/kernel/kernel" at 0xc0aac000.
 Jul 18 20:26:29 fileserver kernel: Preloaded elf module "/boot/kernel/vinum.ko" at 0xc0aac1f4.
 Jul 18 20:26:29 fileserver kernel: Timecounter "i8254" frequency 1193182 Hz quality 0
 Jul 18 20:26:29 fileserver kernel: CPU: Intel Pentium III (549.06-MHz 686-class CPU)
 Jul 18 20:26:29 fileserver kernel: Origin = "GenuineIntel"  Id = 0x681  Stepping = 1
 Jul 18 20:26:29 fileserver kernel: Features=0x383f9ff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
 Jul 18 20:26:29 fileserver kernel: real memory  = 134152192 (127 MB)
 Jul 18 20:26:29 fileserver kernel: avail memory = 120688640 (115 MB)
 Jul 18 20:26:29 fileserver kernel: Pentium Pro MTRR support enabled
 Jul 18 20:26:29 fileserver kernel: npx0: [FAST]
 Jul 18 20:26:29 fileserver kernel: npx0: <math processor> on motherboard
 Jul 18 20:26:29 fileserver kernel: npx0: INT 16 interface
 Jul 18 20:26:29 fileserver kernel: pcibios: BIOS version 2.10
 Jul 18 20:26:29 fileserver kernel: Using $PIR table, 7 entries at 0xc00fda30
 Jul 18 20:26:29 fileserver kernel: pcib0: <Intel 82443BX (440 BX) host to PCI bridge> at pcibus 0 on motherboard
 Jul 18 20:26:29 fileserver kernel: pci0: <PCI bus> on pcib0
 Jul 18 20:26:29 fileserver kernel: pci_cfgintr: 0:7 INTD BIOS irq 11
 Jul 18 20:26:29 fileserver kernel: pci_cfgintr: 0:12 INTA BIOS irq 10
 Jul 18 20:26:29 fileserver kernel: agp0: <Intel 82443BX (440 BX) host to PCI bridge> mem 0xe8000000-0xebffffff at device 0.0 on pci0
 Jul 18 20:26:29 fileserver kernel: pcib1: <PCI-PCI bridge> at device 1.0 on pci0
 Jul 18 20:26:29 fileserver kernel: pci1: <PCI bus> on pcib1
 Jul 18 20:26:29 fileserver kernel: pci1: <display, VGA> at device 0.0 (no driver attached)
 Jul 18 20:26:29 fileserver kernel: isab0: <PCI-ISA bridge> at device 7.0 on pci0
 Jul 18 20:26:29 fileserver kernel: isa0: <ISA bus> on isab0
 Jul 18 20:26:29 fileserver kernel: atapci0: <Intel PIIX4 UDMA33 controller> port 0xf000-0xf00f at device 7.1 on pci0
 Jul 18 20:26:29 fileserver kernel: ata0: at 0x1f0 irq 14 on atapci0
 Jul 18 20:26:29 fileserver kernel: ata0: [MPSAFE]
 Jul 18 20:26:29 fileserver kernel: ata1: at 0x170 irq 15 on atapci0
 Jul 18 20:26:29 fileserver kernel: ata1: [MPSAFE]
 Jul 18 20:26:29 fileserver kernel: uhci0: <Intel 82371AB/EB (PIIX4) USB controller> port 0xe000-0xe01f irq 11 at device 7.2 on pci0
 Jul 18 20:26:29 fileserver kernel: usb0: <Intel 82371AB/EB (PIIX4) USB controller> on uhci0
 Jul 18 20:26:29 fileserver kernel: usb0: USB revision 1.0
 Jul 18 20:26:29 fileserver kernel: uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
 Jul 18 20:26:29 fileserver kernel: uhub0: 2 ports with 2 removable, self powered
 Jul 18 20:26:29 fileserver kernel: piix0: <PIIX Timecounter> port 0x5000-0x500f at device 7.3 on pci0
 Jul 18 20:26:29 fileserver kernel: Timecounter "PIIX" frequency 3579545 Hz quality 0
 Jul 18 20:26:29 fileserver kernel: ahc0: <Adaptec aic7880 Ultra SCSI adapter> port 0xe400-0xe4ff mem 0xed000000-0xed000fff irq 10 at device 12.0 on pci0
 Jul 18 20:26:29 fileserver kernel: aic7880: Ultra Wide Channel A, SCSI Id=7, 16/253 SCBs
 Jul 18 20:26:29 fileserver kernel: orm0: <Option ROM> at iomem 0xc0000-0xc7fff on isa0
 Jul 18 20:26:29 fileserver kernel: pmtimer0 on isa0
 Jul 18 20:26:29 fileserver kernel: atkbdc0: <Keyboard controller (i8042)> at port 0x64,0x60 on isa0
 Jul 18 20:26:29 fileserver kernel: atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
 Jul 18 20:26:29 fileserver kernel: kbd0 at atkbd0
 Jul 18 20:26:29 fileserver kernel: fdc0: <Enhanced floppy controller (i82077, NE72065 or clone)> at port 0x3f7,0x3f0-0x3f5 irq 6 drq 2 on isa0
 Jul 18 20:26:29 fileserver kernel: fdc0: FIFO enabled, 8 bytes threshold
 Jul 18 20:26:29 fileserver kernel: fd0: <1440-KB 3.5" drive> on fdc0 drive 0
 Jul 18 20:26:29 fileserver kernel: ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
 Jul 18 20:26:29 fileserver kernel: ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode
 Jul 18 20:26:29 fileserver kernel: ppbus0: <Parallel port bus> on ppc0
 Jul 18 20:26:29 fileserver kernel: plip0: <PLIP network interface> on ppbus0
 Jul 18 20:26:29 fileserver kernel: lpt0: <Printer> on ppbus0
 Jul 18 20:26:29 fileserver kernel: lpt0: Interrupt-driven port
 Jul 18 20:26:29 fileserver kernel: ppi0: <Parallel I/O> on ppbus0
 Jul 18 20:26:29 fileserver kernel: sc0: <System console> at flags 0x100 on isa0
 Jul 18 20:26:29 fileserver kernel: sc0: VGA <16 virtual consoles, flags=0x300>
 Jul 18 20:26:29 fileserver kernel: sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
 Jul 18 20:26:29 fileserver kernel: sio0: type 16550A
 Jul 18 20:26:29 fileserver kernel: sio1 at port 0x2f8-0x2ff irq 3 on isa0
 Jul 18 20:26:29 fileserver kernel: sio1: type 16550A
 Jul 18 20:26:29 fileserver kernel: vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
 Jul 18 20:26:29 fileserver kernel: ep0: <3Com 3C509-TPC EtherLink III> at port 0x220-0x22f irq 5 on isa0
 Jul 18 20:26:29 fileserver kernel: ep0: Ethernet address 00:50:04:f9:b0:9a
 Jul 18 20:26:29 fileserver kernel: unknown: <PNP0303> can't assign resources (port)
 Jul 18 20:26:29 fileserver kernel: unknown: <PNP0a03> can't assign resources (port)
 Jul 18 20:26:29 fileserver kernel: unknown: <PNP0501> can't assign resources (port)
 Jul 18 20:26:29 fileserver kernel: unknown: <PNP0700> can't assign resources (port)
 Jul 18 20:26:29 fileserver kernel: unknown: <PNP0400> can't assign resources (port)
 Jul 18 20:26:29 fileserver kernel: unknown: <PNP0501> can't assign resources (port)
 Jul 18 20:26:29 fileserver kernel: Timecounter "TSC" frequency 549064309 Hz quality 800
 Jul 18 20:26:29 fileserver kernel: Timecounters tick every 10.000 msec
 Jul 18 20:26:29 fileserver kernel: GEOM: create disk ad0 dp=0xc2053960
 Jul 18 20:26:29 fileserver kernel: ad0: 38166MB <ST340014A> [77545/16/63] at ata0-master UDMA33
 Jul 18 20:26:29 fileserver kernel: GEOM: create disk ad1 dp=0xc2053b60
 Jul 18 20:26:29 fileserver kernel: ad1: 32253MB <ST380011A> [65531/16/63] at ata0-slave UDMA33
 Jul 18 20:26:29 fileserver kernel: GEOM: create disk ad2 dp=0xc20a4360
 Jul 18 20:26:29 fileserver kernel: ad2: 38166MB <ST340014A> [77545/16/63] at ata1-master UDMA33
 Jul 18 20:26:29 fileserver kernel: Waiting 15 seconds for SCSI devices to settle
 Jul 18 20:26:29 fileserver kernel: Mounting root from ufs:/dev/ad0s1a
 Jul 18 20:26:50 fileserver login: ROOT LOGIN (root) ON ttyv0
 Jul 18 20:26:56 fileserver login: ROOT LOGIN (root) ON ttyv1
 Jul 18 20:47:37 fileserver kernel: vinum: zrkadlo2.p1.s0 is up by force
 Jul 18 20:47:37 fileserver kernel: vinum: zrkadlo2.p1 is up
 Jul 18 20:47:37 fileserver kernel: vinum: zrkadlo2.p1.s0 is up
 Jul 18 20:50:44 fileserver login: ROOT LOGIN (root) ON ttyv2
 Jul 18 20:51:53 fileserver kernel: WARNING: /mnt was not properly dismounted
 Jul 18 21:04:00 fileserver login: ROOT LOGIN (root) ON ttyv3
 
 --------------020203040503070100080105--
Responsible-Changed-From-To: grog->le 
Responsible-Changed-By: linimon 
Responsible-Changed-When: Thu Sep 9 19:03:06 GMT 2004 
Responsible-Changed-Why:  
With permission of both, reassign from grog to le. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=58391 
State-Changed-From-To: open->feedback 
State-Changed-By: ceri 
State-Changed-When: Fri Nov 4 20:04:40 GMT 2005 
State-Changed-Why:  
If this bug only exists in vinum as it exists in 4.x and early 5.x then  
it basically isn't going to get fixed.  Can it be reproduced under the  
gvinum currently in use? 

http://www.freebsd.org/cgi/query-pr.cgi?pr=58391 
State-Changed-From-To: feedback->closed 
State-Changed-By: ceri 
State-Changed-When: Fri Dec 1 13:37:29 UTC 2006 
State-Changed-Why:  
Feedback timeout. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=58391 
>Unformatted:
