From bw@exodus.desync.com  Sun Apr 18 11:42:59 2010
Return-Path: <bw@exodus.desync.com>
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 5E89C106566C
	for <FreeBSD-gnats-submit@freebsd.org>; Sun, 18 Apr 2010 11:42:59 +0000 (UTC)
	(envelope-from bw@exodus.desync.com)
Received: from exodus.desync.com (desync.com [IPv6:2607:f178::165])
	by mx1.freebsd.org (Postfix) with ESMTP id 0D33F8FC23
	for <FreeBSD-gnats-submit@freebsd.org>; Sun, 18 Apr 2010 11:42:58 +0000 (UTC)
Received: from exodus.desync.com (localhost [127.0.0.1])
	by exodus.desync.com (8.14.4/8.14.4) with ESMTP id o3IBghYV005940
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO)
	for <FreeBSD-gnats-submit@freebsd.org>; Sun, 18 Apr 2010 07:42:43 -0400 (EDT)
	(envelope-from bw@exodus.desync.com)
Received: (from bw@localhost)
	by exodus.desync.com (8.14.4/8.14.4/Submit) id o3IBghVJ005939;
	Sun, 18 Apr 2010 07:42:43 -0400 (EDT)
	(envelope-from bw)
Message-Id: <201004181142.o3IBghVJ005939@exodus.desync.com>
Date: Sun, 18 Apr 2010 07:42:43 -0400 (EDT)
From: Ben Wilber <bw@exodus.desync.com>
Reply-To: Ben Wilber <bw@exodus.desync.com>
To: FreeBSD-gnats-submit@freebsd.org
Cc:
Subject: [zfs] page fault under load
X-Send-Pr-Version: 3.113
X-GNATS-Notify:

>Number:         145802
>Category:       kern
>Synopsis:       [zfs] page fault under load
>Confidential:   no
>Severity:       serious
>Priority:       high
>Responsible:    pjd
>State:          feedback
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Sun Apr 18 11:50:01 UTC 2010
>Closed-Date:    
>Last-Modified:  Thu May 13 22:04:22 UTC 2010
>Originator:     Ben Wilber
>Release:        FreeBSD 9.0-CURRENT amd64
>Organization:
>Environment:
System: FreeBSD exodus 9.0-CURRENT FreeBSD 9.0-CURRENT #0: Thu Apr 15 14:30:10 EDT 2010 bw@exodus:/usr/obj/usr/src/sys/GENERIC amd64

% zpool status -v
  pool: int
 state: ONLINE
 scrub: none requested
config:

        NAME        STATE     READ WRITE CKSUM
        int         ONLINE       0     0     0
          mfid0s1d  ONLINE       0     0     0
        logs        ONLINE       0     0     0
          ad6s1     ONLINE       0     0     0
        cache
          ad6s3     ONLINE       0     0     0

errors: No known data errors

  pool: tank
 state: ONLINE
 scrub: none requested
config:

        NAME        STATE     READ WRITE CKSUM
        tank        ONLINE       0     0     0
          raidz1    ONLINE       0     0     0
            mfid1   ONLINE       0     0     0
            mfid2   ONLINE       0     0     0
            mfid3   ONLINE       0     0     0
            mfid4   ONLINE       0     0     0
          raidz1    ONLINE       0     0     0
            mfid5   ONLINE       0     0     0
            mfid6   ONLINE       0     0     0
            mfid7   ONLINE       0     0     0
            mfid8   ONLINE       0     0     0
          raidz1    ONLINE       0     0     0
            mfid9   ONLINE       0     0     0
            mfid10  ONLINE       0     0     0
            mfid11  ONLINE       0     0     0
            mfid12  ONLINE       0     0     0
          raidz1    ONLINE       0     0     0
            mfid13  ONLINE       0     0     0
            mfid14  ONLINE       0     0     0
            mfid15  ONLINE       0     0     0
            mfid16  ONLINE       0     0     0
          raidz1    ONLINE       0     0     0
            mfid17  ONLINE       0     0     0
            mfid18  ONLINE       0     0     0
            mfid19  ONLINE       0     0     0
            mfid20  ONLINE       0     0     0
        logs        ONLINE       0     0     0
          ad6s2     ONLINE       0     0     0
        cache
          ad6s4     ONLINE       0     0     0
        spares
          mfid21    AVAIL   
          mfid22    AVAIL   
          mfid23    AVAIL   

errors: No known data errors

>Description:

Fatal trap 12: page fault while in kernel mode
cpuid = 1; apic id = 11
fault virtual address   = 0xffffff81b2f59000
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff808538f6
stack pointer           = 0x28:0xffffff83997a4a80
frame pointer           = 0x28:0xffffff83997a4b00
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 0 (spa_zio)

db:0:kdb.enter.default>  bt
Tracing pid 0 tid 100156 td 0xffffff000cc63000
bcopy() at bcopy+0x16
vdev_queue_io_done() at vdev_queue_io_done+0x99
zio_vdev_io_done() at zio_vdev_io_done+0xd0
zio_execute() at zio_execute+0x70
taskq_run() at taskq_run+0x13
taskqueue_run() at taskqueue_run+0xeb
taskqueue_thread_loop() at taskqueue_thread_loop+0x50
fork_exit() at fork_exit+0x147
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff83997a4d30, rbp = 0 ---

>How-To-Repeat:

Unknown.  Started after adding more disks to "tank".
    
>Fix:

	


>Release-Note:
>Audit-Trail:
Responsible-Changed-From-To: freebsd-bugs->freebsd-fs 
Responsible-Changed-By: linimon 
Responsible-Changed-When: Mon Apr 19 05:42:22 UTC 2010 
Responsible-Changed-Why:  
Over to maintainer(s). 

http://www.freebsd.org/cgi/query-pr.cgi?pr=145802 
State-Changed-From-To: open->feedback 
State-Changed-By: pjd 
State-Changed-When: czw 13 maj 2010 22:03:07 UTC 
State-Changed-Why:  
Could you verify if the following patch fixes the problem: 

http://people.freebsd.org/~pjd/patches/vdev_geom.c.3.patch 


Responsible-Changed-From-To: freebsd-fs->pjd 
Responsible-Changed-By: pjd 
Responsible-Changed-When: czw 13 maj 2010 22:03:07 UTC 
Responsible-Changed-Why:  
I'll take this one. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=145802 
>Unformatted:
