From nobody@FreeBSD.org  Wed Nov 10 00:34:48 2010
Return-Path: <nobody@FreeBSD.org>
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 35DB41065670
	for <freebsd-gnats-submit@FreeBSD.org>; Wed, 10 Nov 2010 00:34:48 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (www.freebsd.org [IPv6:2001:4f8:fff6::21])
	by mx1.freebsd.org (Postfix) with ESMTP id 098BE8FC0A
	for <freebsd-gnats-submit@FreeBSD.org>; Wed, 10 Nov 2010 00:34:48 +0000 (UTC)
Received: from www.freebsd.org (localhost [127.0.0.1])
	by www.freebsd.org (8.14.3/8.14.3) with ESMTP id oAA0Yl9G099932
	for <freebsd-gnats-submit@FreeBSD.org>; Wed, 10 Nov 2010 00:34:47 GMT
	(envelope-from nobody@www.freebsd.org)
Received: (from nobody@localhost)
	by www.freebsd.org (8.14.3/8.14.3/Submit) id oAA0Yl4v099931;
	Wed, 10 Nov 2010 00:34:47 GMT
	(envelope-from nobody)
Message-Id: <201011100034.oAA0Yl4v099931@www.freebsd.org>
Date: Wed, 10 Nov 2010 00:34:47 GMT
From: Mike Carlson <carlson39@llnl.gov>
To: freebsd-gnats-submit@FreeBSD.org
Subject: 8-STABLE gmultipath error 'Unknown verb add'
X-Send-Pr-Version: www-3.1
X-GNATS-Notify:

>Number:         152087
>Category:       bin
>Synopsis:       [geom] 8-STABLE gmultipath(8) error 'Unknown verb add'
>Confidential:   no
>Severity:       non-critical
>Priority:       low
>Responsible:    mjacob
>State:          closed
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Wed Nov 10 00:40:07 UTC 2010
>Closed-Date:    Sat Nov 27 05:08:22 UTC 2010
>Last-Modified:  Sat Nov 27 05:08:22 UTC 2010
>Originator:     Mike Carlson
>Release:        8-STABLE
>Organization:
LLNL
>Environment:
FreeBSD write.llnl.gov 8.1-STABLE FreeBSD 8.1-STABLE #0: Mon Nov  8 16:38:06 PST 2010     root@write.llnl.gov:/usr/obj/usr/src/sys/GENERIC  amd64

>Description:
I just built 8-STABLE today.

Previously, gmultipath seemed to work by specifying the device handles per label. However, now gmultipath doesn't seem to add any other components besides the first one (da2 in this case):

write# camcontrol inquiry da2 -S
085E8C000000006B38CC76
write# camcontrol inquiry da9 -S
085E8C000000006B38CC76

write# gmultipath label -v WINSYS-V001 /dev/da2 /dev/da9
gmultipath: Unknown verb add
write# gmultipath status
                 Name  Status  Components
multipath/WINSYS-V001     N/A  da2
write# dmesg | tail -2
GEOM_MULTIPATH: adding da2 to WINSYS-V001/cbaa6887-ec4f-11df-bb7a-1cc1dee9fbae
GEOM_MULTIPATH: da2 now active path in WINSYS-V001

I have trick GEOM into recognizing the other disk:

write# echo 1 > /dev/da9 
write# dmesg| tail -1
GEOM_MULTIPATH: adding da9 to WINSYS-V001/bd0f1f20-ec50-11df-bb7a-1cc1dee9fbae

write# gmultipath status
                 Name  Status  Components
multipath/WINSYS-V001     N/A  da2
                               da9


Otherwise, the interaction with the device label works fine. I know the SVN commit 207384 changed the behavior of gmultipath, so I'm assuming it is related.
>How-To-Repeat:
see 'gmultipath woes' http://docs.freebsd.org/cgi/getmsg.cgi?fetch=40337+0+archive/2010/freebsd-geom/20100801.freebsd-geom :

[root@ostracod /mnt]# mdconfig -a -t vnode -f /scratch/test.dsk -u 12
[root@ostracod /mnt]# mdconfig -a -t vnode -f /scratch/test.dsk -u 13
[root@ostracod /mnt]# sysctl kern.geom.multipath.debug=1
kern.geom.multipath.debug: 1 -> 1
[root@ostracod /mnt]# gmultipath label -v TEST /dev/md12 /dev/md13
gmultipath: Unknown verb add
[root@ostracod /mnt]# gmultipath list
Geom name: TEST
Providers:
1. Name: multipath/TEST
   Mediasize: 52428288 (50M)
   Sectorsize: 512
   Mode: r0w0e0
Consumers:
1. Name: md12
   Mediasize: 52428800 (50M)
   Sectorsize: 512
   Mode: r0w0e0

[root@ostracod /mnt]# gmultipath status
          Name  Status  Components
multipath/TEST     N/A  md12

However doing
echo 1 > /dev/md13 made geom re-taste the device so I get
[root@ostracod /mnt]# gmultipath list
Geom name: TEST
Providers:
1. Name: multipath/TEST
   Mediasize: 52428288 (50M)
   Sectorsize: 512
   Mode: r0w0e0
Consumers:
1. Name: md12
   Mediasize: 52428800 (50M)
   Sectorsize: 512
   Mode: r0w0e0
2. Name: md13
   Mediasize: 52428800 (50M)
   Sectorsize: 512
   Mode: r0w0e0

>Fix:


>Release-Note:
>Audit-Trail:
Responsible-Changed-From-To: freebsd-bugs->freebsd-geom 
Responsible-Changed-By: linimon 
Responsible-Changed-When: Sat Nov 20 09:21:12 UTC 2010 
Responsible-Changed-Why:  
Over to maintainer(s). 

http://www.freebsd.org/cgi/query-pr.cgi?pr=152087 
Responsible-Changed-From-To: freebsd-geom->mjacob 
Responsible-Changed-By: mjacob 
Responsible-Changed-When: Sat Nov 20 17:22:51 UTC 2010 
Responsible-Changed-Why:  
my resp 

http://www.freebsd.org/cgi/query-pr.cgi?pr=152087 
State-Changed-From-To: open->closed 
State-Changed-By: mjacob 
State-Changed-When: Sat Nov 27 05:07:17 UTC 2010 
State-Changed-Why:  
Fixed as of 215932 

http://www.freebsd.org/cgi/query-pr.cgi?pr=152087 
>Unformatted:
