From nobody@FreeBSD.org  Sun Oct 18 01:14:55 2009
Return-Path: <nobody@FreeBSD.org>
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 965D4106566C
	for <freebsd-gnats-submit@FreeBSD.org>; Sun, 18 Oct 2009 01:14:55 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (www.freebsd.org [IPv6:2001:4f8:fff6::21])
	by mx1.freebsd.org (Postfix) with ESMTP id 85D238FC0A
	for <freebsd-gnats-submit@FreeBSD.org>; Sun, 18 Oct 2009 01:14:55 +0000 (UTC)
Received: from www.freebsd.org (localhost [127.0.0.1])
	by www.freebsd.org (8.14.3/8.14.3) with ESMTP id n9I1EsAU045436
	for <freebsd-gnats-submit@FreeBSD.org>; Sun, 18 Oct 2009 01:14:54 GMT
	(envelope-from nobody@www.freebsd.org)
Received: (from nobody@localhost)
	by www.freebsd.org (8.14.3/8.14.3/Submit) id n9I1Es21045435;
	Sun, 18 Oct 2009 01:14:54 GMT
	(envelope-from nobody)
Message-Id: <200910180114.n9I1Es21045435@www.freebsd.org>
Date: Sun, 18 Oct 2009 01:14:54 GMT
From: kickbsd <kickbsd@ya.ru>
To: freebsd-gnats-submit@FreeBSD.org
Subject: vfs.numvnodes leak on bussy zfs
X-Send-Pr-Version: www-3.1
X-GNATS-Notify:

>Number:         139715
>Category:       kern
>Synopsis:       [zfs] vfs.numvnodes leak on busy zfs
>Confidential:   no
>Severity:       serious
>Priority:       low
>Responsible:    freebsd-fs
>State:          open
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Sun Oct 18 01:20:01 UTC 2009
>Closed-Date:    
>Last-Modified:  Tue Nov 24 18:50:01 UTC 2009
>Originator:     kickbsd
>Release:        8.0-RC1
>Organization:
none
>Environment:
FreeBSD lab-backup012.local 8.0-RC1 FreeBSD 8.0-RC1 #3: Tue Oct 13 08:44:45 UTC 2009     root@lab-backup012.local:/usr/obj/usr/src/sys/GENERIC  amd64

>Description:

I have a reproducible hangs on busy zfs file system.
Just run rsync to zfs server from other data source.
vfs.numvnodes tends to leak and when reach kern.maxvnodes no new files can be created or modified. There is no kernel panic and already existing shell sessions works  but system can not rebutted safely after vfs.numvnodes reached kern.maxvnodes.
After rsync complated vfs.numvnodes never goes back to normal.
I have increased kern.maxvnodes to kern.maxvnodes: 1.800.000 but vfs.numvnodes  slowly grows for about 10.000 vnodes per 4 hours rsync session.
Same behavior observed with relatively bussy server with ~1k rrd databases which updated every 5 min.

>How-To-Repeat:
Run long rsync session to zfs filesystem or run update on 1k+ rrd databases.
>Fix:
N/A

>Release-Note:
>Audit-Trail:
Responsible-Changed-From-To: freebsd-bugs->freebsd-fs 
Responsible-Changed-By: linimon 
Responsible-Changed-When: Sun Oct 18 02:45:27 UTC 2009 
Responsible-Changed-Why:  
Over to maintainer(s). 

http://www.freebsd.org/cgi/query-pr.cgi?pr=139715 

From: Mark Linimon <linimon@lonesome.com>
To: bug-followup@FreeBSD.org
Cc:  
Subject: Re: kern/139715: [zfs] vfs.numvnodes leak on busy zfs
Date: Sun, 18 Oct 2009 11:33:33 -0500

 ----- Forwarded message from kickbsd kickbsd <kickbsd@ya.ru> -----
 
 From: kickbsd kickbsd <kickbsd@ya.ru>
 To: linimon@freebsd.org
 Cc: freebsd-bugs@freebsd.org, freebsd-fs@freebsd.org
 Subject: Re: kern/139715: [zfs] vfs.numvnodes leak on busy zfs
 
 There is the link to leaking vnodes grpaph 
 http://xs.to/xs.php?h=xs1144&d=09420&f=vnodes-leak215.jpg
  
 ----- End forwarded message -----

From: Mark Linimon <linimon@lonesome.com>
To: bug-followup@FreeBSD.org
Cc:  
Subject: Re: kern/139715: [zfs] vfs.numvnodes leak on busy zfs
Date: Tue, 20 Oct 2009 10:13:05 -0500

 ----- Forwarded message from kickbsd kickbsd <kickbsd@ya.ru> -----
 
 From: kickbsd kickbsd <kickbsd@ya.ru>
 To: linimon@freebsd.org
 Subject: Re: kern/139715: [zfs] vfs.numvnodes leak on busy zfs
 
 There is newer graph to show tendency
 http://www.freeimagehosting.net/image.php?e5f0195542.jpg
 
 
 ----- End forwarded message -----

From: kickbsd kickbsd <kickbsd@ya.ru>
To: bug-followup@freebsd.org
Cc:  
Subject: Re: kern/139715: [zfs]  vfs.numvnodes leak on busy zfs
Date: Thu, 12 Nov 2009 00:16:04 +0300

 Same issue observed on RC3
 
 [root@testzfs /tmp]# sysctl vfs.numvnodes ; i=1 ; while [ $i -le 10000 ] ; do echo "sdfsdfsdf" > `mktemp -t ABC` ; i=$(($i+1)) ; done ; sysctl vfs.numvnodes
 vfs.numvnodes: 860
 vfs.numvnodes: 10861
 
 [root@testzfs /tmp]#  sysctl vfs.numvnodes ; i=1 ; while [ $i -le 10000 ] ; do echo "sdfsdfsdf" > `mktemp -t ABC` ; i=$(($i+1)) ; done ; sysctl vfs.numvnodes
 vfs.numvnodes: 10863
 vfs.numvnodes: 20863

From: Baginski Darren <kickbsd@ya.ru>
To: bug-followup@freebsd.org
Cc:  
Subject: Re: kern/139715: [zfs] vfs.numvnodes leak on busy zfs
Date: Tue, 24 Nov 2009 21:48:06 +0300

 Same issue on
 FreeBSD zfs-tsts073 8.0-PRERELEASE FreeBSD 8.0-PRERELEASE #8: Mon Nov 23 16:04:14 UTC 2009     root@zfs-tsts073:/usr/obj/usr/src/sys/GENERIC  amd64
>Unformatted:
