From mstowe@baddomain.com  Fri Mar 14 18:39:18 2008
Return-Path: <mstowe@baddomain.com>
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 9FA261065676
	for <FreeBSD-gnats-submit@freebsd.org>; Fri, 14 Mar 2008 18:39:18 +0000 (UTC)
	(envelope-from mstowe@baddomain.com)
Received: from password.michaelstowe.com (dsl081-139-164.chi1.dsl.speakeasy.net [64.81.139.164])
	by mx1.freebsd.org (Postfix) with ESMTP id 3A7C88FC16
	for <FreeBSD-gnats-submit@freebsd.org>; Fri, 14 Mar 2008 18:39:17 +0000 (UTC)
	(envelope-from mstowe@baddomain.com)
Received: from password.michaelstowe.com (localhost [127.0.0.1])
	by password.michaelstowe.com (8.14.2/8.14.2) with ESMTP id m2EId67N001681
	for <FreeBSD-gnats-submit@freebsd.org>; Fri, 14 Mar 2008 13:39:07 -0500 (CDT)
	(envelope-from mstowe@baddomain.com)
Received: (from mstowe@localhost)
	by password.michaelstowe.com (8.14.2/8.14.2/Submit) id m2EId55I001680;
	Fri, 14 Mar 2008 13:39:05 -0500 (CDT)
	(envelope-from mstowe)
Message-Id: <200803141839.m2EId55I001680@password.michaelstowe.com>
Date: Fri, 14 Mar 2008 13:39:05 -0500 (CDT)
From: Michael Stowe <mstowe@chicago.us.mensa.org>
Reply-To: Michael Stowe <mstowe@chicago.us.mensa.org>
To: FreeBSD-gnats-submit@freebsd.org
Cc:
Subject: "rtfree: 0xc4383870 has 1 refs" emitted repeatedly
X-Send-Pr-Version: 3.113
X-GNATS-Notify:

>Number:         121706
>Category:       kern
>Synopsis:       [netinet] [patch] "rtfree: 0xc4383870 has 1 refs" emitted repeatedly
>Confidential:   no
>Severity:       non-critical
>Priority:       medium
>Responsible:    freebsd-net
>State:          closed
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Fri Mar 14 18:40:01 UTC 2008
>Closed-Date:    Sun Nov 14 21:04:44 UTC 2010
>Last-Modified:  Sun Nov 14 21:04:44 UTC 2010
>Originator:     Michael Stowe
>Release:        FreeBSD 7.0-STABLE i386
>Organization:
>Environment:
System: FreeBSD baddomain.com 7.0-STABLE FreeBSD 7.0-STABLE #0: Fri Mar 14 12:54:41 CDT 2008 root@baddomain.com:/usr/obj/usr/src/sys/STOWEDEBUG i386

Standard generic kernel except that altq is compiled in and used (I am
not sure if this is relevant.)

>Description:
At irregular intervals, messages such as the following will be emitted:

messages:Mar 14 13:09:28 baddomain kernel: rtfree: 0xc4383528 has 1 refs
messages:Mar 14 13:10:01 baddomain kernel: rtfree: 0xc4383708 has 1 refs
messages:Mar 14 13:10:03 baddomain kernel: rtfree: 0xc4383528 has 1 refs
messages:Mar 14 13:10:08 baddomain kernel: rtfree: 0xc4383870 has 1 refs
messages:Mar 14 13:11:08 baddomain kernel: rtfree: 0xc4383870 has 1 refs
messages:Mar 14 13:11:42 baddomain kernel: rtfree: 0xc4384bb8 has 1 refs
messages:Mar 14 13:12:08 baddomain kernel: rtfree: 0xc4383870 has 1 refs
messages:Mar 14 13:12:13 baddomain kernel: rtfree: 0xc4383528 has 1 refs
messages:Mar 14 13:13:10 baddomain kernel: rtfree: 0xc4383870 has 1 refs
messages:Mar 14 13:13:14 baddomain kernel: rtfree: 0xc4383708 has 1 refs
messages:Mar 14 13:13:31 baddomain kernel: rtfree: 0xc43840f0 has 1 refs
messages:Mar 14 13:13:45 baddomain kernel: rtfree: 0xc4383528 has 1 refs

With backtrace:
Mar 14 13:35:01 baddomain kernel: rtfree: 0xc4383870 has 1 refs
Mar 14 13:35:01 baddomain kernel: KDB: stack backtrace:
Mar 14 13:35:01 baddomain kernel: db_trace_self_wrapper(c0b2582f,e471cb2c,c0841ed4,c0b2b407,c0ac1b51,...) at db_trace_self_wrapper+0x26
Mar 14 13:35:01 baddomain kernel: kdb_backtrace(c0b2b407,c0ac1b51,c4383870,1,c4383870,...) at kdb_backtrace+0x29
Mar 14 13:35:01 baddomain kernel: rtfree(c4383870,0,0,c43837f8,e471cb4c,...) at rtfree+0x4b
Mar 14 13:35:01 baddomain kernel: arpintr(c427e300,c06845cf,806,c40bec00,806,...) at arpintr+0x9ce
Mar 14 13:35:01 baddomain kernel: netisr_dispatch(12,c427e300,0,c0a8b44f,c40bec00,...) at netisr_dispatch+0x57
Mar 14 13:35:01 baddomain kernel: ether_demux(c40bec00,c427e300,3,0,3,...) at ether_demux+0x1b3
Mar 14 13:35:01 baddomain kernel: ether_input(c40bec00,c427e300,0,c40bec00,0,...) at ether_input+0x313
Mar 14 13:35:01 baddomain kernel: rl_rxeof(c07aaa84,c4051630,0,1,1000000,...) at rl_rxeof+0x22d
Mar 14 13:35:01 baddomain kernel: rl_intr(c3ffd000,0,c0b21726,46b,0,...) at rl_intr+0xb6
Mar 14 13:35:01 baddomain kernel: ithread_loop(c40c03c0,e471cd38,0,0,0,...) at ithread_loop+0x19d
Mar 14 13:35:01 baddomain kernel: fork_exit(c07869fb,c40c03c0,e471cd38) at fork_exit+0x99
Mar 14 13:35:01 baddomain kernel: fork_trampoline() at fork_trampoline+0x8
Mar 14 13:35:01 baddomain kernel: --- trap 0, eip = 0, esp = 0xe471cd70, ebp = 0 ---
Mar 14 13:35:15 baddomain kernel: rtfree: 0xc4383618 has 1 refs
Mar 14 13:35:15 baddomain kernel: KDB: stack backtrace:
Mar 14 13:35:15 baddomain kernel: db_trace_self_wrapper(c0b2582f,e471cb2c,c0841ed4,c0b2b407,c0ac1b51,...) at db_trace_self_wrapper+0x26
Mar 14 13:35:15 baddomain kernel: kdb_backtrace(c0b2b407,c0ac1b51,c4383618,1,c4383618,...) at kdb_backtrace+0x29
Mar 14 13:35:15 baddomain kernel: rtfree(c4383618,0,0,0,e471cb54,...) at rtfree+0x4b
Mar 14 13:35:15 baddomain kernel: arpintr(c4078d00,c06845cf,806,c40bec00,806,...) at arpintr+0x9ce
Mar 14 13:35:15 baddomain kernel: netisr_dispatch(12,c4078d00,3e,3c,c40bec00,...) at netisr_dispatch+0x57
Mar 14 13:35:15 baddomain kernel: ether_demux(c40bec00,c4078d00,3,0,3,...) at ether_demux+0x1b3
Mar 14 13:35:15 baddomain kernel: ether_input(c40bec00,c4078d00,0,c40bec00,0,...) at ether_input+0x313
Mar 14 13:35:15 baddomain kernel: rl_rxeof(c07aaa84,c4051630,0,1,1000000,...) at rl_rxeof+0x22d
Mar 14 13:35:15 baddomain kernel: rl_intr(c3ffd000,0,c0b21726,46b,0,...) at rl_intr+0xb6
Mar 14 13:35:15 baddomain kernel: ithread_loop(c40c03c0,e471cd38,0,0,0,...) at ithread_loop+0x19d
Mar 14 13:35:15 baddomain kernel: fork_exit(c07869fb,c40c03c0,e471cd38) at fork_exit+0x99
Mar 14 13:35:15 baddomain kernel: fork_trampoline() at fork_trampoline+0x8
Mar 14 13:35:15 baddomain kernel: --- trap 0, eip = 0, esp = 0xe471cd70, ebp = 0 ---
Mar 14 13:35:24 baddomain kernel: rtfree: 0xc43838e8 has 1 refs
Mar 14 13:35:24 baddomain kernel: KDB: stack backtrace:
Mar 14 13:35:24 baddomain kernel: db_trace_self_wrapper(c0b2582f,e471cb2c,c0841ed4,c0b2b407,c0ac1b51,...) at db_trace_self_wrapper+0x26
Mar 14 13:35:24 baddomain kernel: kdb_backtrace(c0b2b407,c0ac1b51,c43838e8,1,c43838e8,...) at kdb_backtrace+0x29
Mar 14 13:35:24 baddomain kernel: rtfree(c43838e8,0,0,c4383690,0,...) at rtfree+0x4b
Mar 14 13:35:24 baddomain kernel: arpintr(c4282300,c06845cf,806,c40bec00,806,...) at arpintr+0x9ce
Mar 14 13:35:24 baddomain kernel: netisr_dispatch(12,c4282300,3e,3c,c40bec00,...) at netisr_dispatch+0x57
Mar 14 13:35:24 baddomain kernel: ether_demux(c40bec00,c4282300,3,0,3,...) at ether_demux+0x1b3
Mar 14 13:35:24 baddomain kernel: ether_input(c40bec00,c4282300,0,c40bec00,0,...) at ether_input+0x313
Mar 14 13:35:24 baddomain kernel: rl_rxeof(c07aaa84,c4051630,0,1,1000000,...) at rl_rxeof+0x22d
Mar 14 13:35:24 baddomain kernel: rl_intr(c3ffd000,0,c0b21726,46b,0,...) at rl_intr+0xb6
Mar 14 13:35:24 baddomain kernel: ithread_loop(c40c03c0,e471cd38,0,0,0,...) at ithread_loop+0x19d
Mar 14 13:35:24 baddomain kernel: fork_exit(c07869fb,c40c03c0,e471cd38) at fork_exit+0x99
Mar 14 13:35:24 baddomain kernel: fork_trampoline() at fork_trampoline+0x8
Mar 14 13:35:24 baddomain kernel: --- trap 0, eip = 0, esp = 0xe471cd70, ebp = 0 ---
Mar 14 13:35:42 baddomain kernel: rtfree: 0xc43835a0 has 1 refs
Mar 14 13:35:42 baddomain kernel: KDB: stack backtrace:
Mar 14 13:35:42 baddomain kernel: db_trace_self_wrapper(c0b2582f,e4708b04,c0841ed4,c0b2b407,c0ac1b51,...) at db_trace_self_wrapper+0x26
Mar 14 13:35:42 baddomain kernel: kdb_backtrace(c0b2b407,c0ac1b51,c43835a0,1,c43835a0,...) at kdb_backtrace+0x29
Mar 14 13:35:42 baddomain kernel: rtfree(c43835a0,0,0,c43832d0,0,...) at rtfree+0x4b
Mar 14 13:35:42 baddomain kernel: arpintr(c4074100,c06845cf,806,c40be400,806,...) at arpintr+0x9ce
Mar 14 13:35:42 baddomain kernel: netisr_dispatch(12,c4074100,c4070e00,100,c40be400,...) at netisr_dispatch+0x57
Mar 14 13:35:42 baddomain kernel: ether_demux(c40be400,c4074100,3,0,3,...) at ether_demux+0x1b3
Mar 14 13:35:42 baddomain kernel: ether_input(c40be400,c4074100,1,0,e4708c5c,...) at ether_input+0x313
Mar 14 13:35:42 baddomain kernel: tulip_rx_intr(82118,ffc00014,c4051840,c3ff9000,c3f4b480,...) at tulip_rx_intr+0x2e6
Mar 14 13:35:42 baddomain kernel: tulip_intr_handler(1,1000000,c4051840,e4708cbc,246,...) at tulip_intr_handler+0x18c
Mar 14 13:35:42 baddomain kernel: tulip_intr_normal(c3ff9000,0,c0b21726,46b,0,...) at tulip_intr_normal+0x56
Mar 14 13:35:42 baddomain kernel: ithread_loop(c40c04f0,e4708d38,0,0,0,...) at ithread_loop+0x19d
Mar 14 13:35:42 baddomain kernel: fork_exit(c07869fb,c40c04f0,e4708d38) at fork_exit+0x99
Mar 14 13:35:42 baddomain kernel: fork_trampoline() at fork_trampoline+0x8
Mar 14 13:35:42 baddomain kernel: --- trap 0, eip = 0, esp = 0xe4708d70, ebp = 0 ---
Mar 14 13:35:54 baddomain kernel: rtfree: 0xc43834b0 has 1 refs
Mar 14 13:35:54 baddomain kernel: KDB: stack backtrace:
Mar 14 13:35:54 baddomain kernel: db_trace_self_wrapper(c0b2582f,e471cb2c,c0841ed4,c0b2b407,c0ac1b51,...) at db_trace_self_wrapper+0x26
Mar 14 13:35:54 baddomain kernel: kdb_backtrace(c0b2b407,c0ac1b51,c43834b0,1,c43834b0,...) at kdb_backtrace+0x29
Mar 14 13:35:54 baddomain kernel: rtfree(c43834b0,0,0,c4383690,0,...) at rtfree+0x4b
Mar 14 13:35:54 baddomain kernel: arpintr(c427be00,c06845cf,806,c40bec00,806,...) at arpintr+0x9ce
Mar 14 13:35:54 baddomain kernel: netisr_dispatch(12,c427be00,3e,3c,c40bec00,...) at netisr_dispatch+0x57
Mar 14 13:35:54 baddomain kernel: ether_demux(c40bec00,c427be00,3,0,3,...) at ether_demux+0x1b3
Mar 14 13:35:54 baddomain kernel: ether_input(c40bec00,c427be00,0,c40bec00,0,...) at ether_input+0x313
Mar 14 13:35:54 baddomain kernel: rl_rxeof(c07aaa84,c4051630,0,1,1000000,...) at rl_rxeof+0x22d
Mar 14 13:35:54 baddomain kernel: rl_intr(c3ffd000,0,c0b21726,46b,0,...) at rl_intr+0xb6
Mar 14 13:35:54 baddomain kernel: ithread_loop(c40c03c0,e471cd38,0,0,0,...) at ithread_loop+0x19d
Mar 14 13:35:54 baddomain kernel: fork_exit(c07869fb,c40c03c0,e471cd38) at fork_exit+0x99
Mar 14 13:35:54 baddomain kernel: fork_trampoline() at fork_trampoline+0x8
Mar 14 13:35:54 baddomain kernel: --- trap 0, eip = 0, esp = 0xe471cd70, ebp = 0 ---
Mar 14 13:36:16 baddomain kernel: rtfree: 0xc4383618 has 1 refs
Mar 14 13:36:16 baddomain kernel: KDB: stack backtrace:
Mar 14 13:36:16 baddomain kernel: db_trace_self_wrapper(c0b2582f,e471cb2c,c0841ed4,c0b2b407,c0ac1b51,...) at db_trace_self_wrapper+0x26
Mar 14 13:36:16 baddomain kernel: kdb_backtrace(c0b2b407,c0ac1b51,c4383618,1,c4383618,...) at kdb_backtrace+0x29
Mar 14 13:36:16 baddomain kernel: rtfree(c4383618,0,0,34,0,...) at rtfree+0x4b
Mar 14 13:36:16 baddomain kernel: arpintr(c427d100,c06845cf,806,c40bec00,806,...) at arpintr+0x9ce
Mar 14 13:36:16 baddomain kernel: netisr_dispatch(12,c427d100,3e,3c,c40bec00,...) at netisr_dispatch+0x57
Mar 14 13:36:16 baddomain kernel: ether_demux(c40bec00,c427d100,3,0,3,...) at ether_demux+0x1b3
Mar 14 13:36:16 baddomain kernel: ether_input(c40bec00,c427d100,0,c40bec00,0,...) at ether_input+0x313
Mar 14 13:36:16 baddomain kernel: rl_rxeof(c07aaa84,c4051630,0,1,1000000,...) at rl_rxeof+0x22d
Mar 14 13:36:16 baddomain kernel: rl_intr(c3ffd000,0,c0b21726,46b,0,...) at rl_intr+0xb6
Mar 14 13:36:16 baddomain kernel: ithread_loop(c40c03c0,e471cd38,0,0,0,...) at ithread_loop+0x19d
Mar 14 13:36:16 baddomain kernel: fork_exit(c07869fb,c40c03c0,e471cd38) at fork_exit+0x99
Mar 14 13:36:16 baddomain kernel: fork_trampoline() at fork_trampoline+0x8
Mar 14 13:36:16 baddomain kernel: --- trap 0, eip = 0, esp = 0xe471cd70, ebp = 0 ---

>How-To-Repeat:
Add altq to the generic kernel, and run the system as a nat gateway.
>Fix:

	


>Release-Note:
>Audit-Trail:

From: "Michael Stowe" <mstowe@chicago.us.mensa.org>
To: bug-followup@FreeBSD.org, mstowe@chicago.us.mensa.org
Cc:  
Subject: Re: kern/121706: "rtfree: 0xc4383870 has 1 refs" emitted repeatedly
Date: Fri, 14 Mar 2008 14:52:00 -0500 (CDT)

 Well, after looking at the backtrace, the solution is (almost) obvious. 
 After applying the patch below, the problem goes away.
 
 --- netinet/if_ether.c	2007-10-07 15:44:22.000000000 -0500
 +++ netinet/if_ether.c.new	2008-03-14 14:49:15.000000000 -0500
 @@ -805,7 +805,7 @@
  			 * over who claims what Ether address.
  			 */
  			if (rt->rt_ifp == ifp) {
 -				rtfree(rt);
 +				RTFREE_LOCKED(rt);
  				goto drop;
  			}
  			(void)memcpy(ar_tha(ah), ar_sha(ah), ah->ar_hln);
 

From: Bruce Cran <bruce@cran.org.uk>
To: bug-followup@FreeBSD.org, mstowe@chicago.us.mensa.org, 
 freebsd-net@freebsd.org
Cc:  
Subject: Re: kern/121706: "rtfree: 0xc4383870 has 1 refs" emitted repeatedly
Date: Fri, 14 Mar 2008 23:58:37 +0000

 The same change was made in net/route.c rev 1.120.2.3.
 I don't know if all calls to rtfree(rt) should be converted to 
 RTFREE_LOCKED(rt), but those remaining are in:
 
 net/route.c:367
 net/route.c:399
 netinet/if_ether.c:808
 netinet/if_ether.c:813
 netinet/if_ether.c:831
 netinet/if_ether.c:834
 netinet6/in6_gif.c:373
 netinet6/in6_gif.c:376
 netinet6/in6_ifattach.c:768
 netinet6/nd6_nbr.c:219
 
 --
 Bruce
Responsible-Changed-From-To: freebsd-bugs->freebsd-net 
Responsible-Changed-By: linimon 
Responsible-Changed-When: Sat Mar 15 08:18:04 UTC 2008 
Responsible-Changed-Why:  
Over to maintainer(s). 

http://www.freebsd.org/cgi/query-pr.cgi?pr=121706 
State-Changed-From-To: open->closed 
State-Changed-By: brucec 
State-Changed-When: Sun Nov 14 21:04:03 UTC 2010 
State-Changed-Why:  
Fixed in r186363. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=121706 
>Unformatted:
