From nobody@FreeBSD.org  Tue Aug 10 13:00:10 2010
Return-Path: <nobody@FreeBSD.org>
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 804041065672
	for <freebsd-gnats-submit@FreeBSD.org>; Tue, 10 Aug 2010 13:00:10 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (www.freebsd.org [IPv6:2001:4f8:fff6::21])
	by mx1.freebsd.org (Postfix) with ESMTP id 491BE8FC1D
	for <freebsd-gnats-submit@FreeBSD.org>; Tue, 10 Aug 2010 13:00:10 +0000 (UTC)
Received: from www.freebsd.org (localhost [127.0.0.1])
	by www.freebsd.org (8.14.3/8.14.3) with ESMTP id o7AD099I086933
	for <freebsd-gnats-submit@FreeBSD.org>; Tue, 10 Aug 2010 13:00:09 GMT
	(envelope-from nobody@www.freebsd.org)
Received: (from nobody@localhost)
	by www.freebsd.org (8.14.3/8.14.3/Submit) id o7AD09Tk086932;
	Tue, 10 Aug 2010 13:00:09 GMT
	(envelope-from nobody)
Message-Id: <201008101300.o7AD09Tk086932@www.freebsd.org>
Date: Tue, 10 Aug 2010 13:00:09 GMT
From: Hung-te Liang <danielliang@gmail.com>
To: freebsd-gnats-submit@FreeBSD.org
Subject: gmultipath label failded
X-Send-Pr-Version: www-3.1
X-GNATS-Notify:

>Number:         149499
>Category:       kern
>Synopsis:       [gmultipath] gmultipath label failed
>Confidential:   no
>Severity:       serious
>Priority:       high
>Responsible:    mjacob
>State:          closed
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Tue Aug 10 13:10:04 UTC 2010
>Closed-Date:    Sat Nov 27 05:09:24 UTC 2010
>Last-Modified:  Sat Nov 27 05:09:24 UTC 2010
>Originator:     Hung-te Liang
>Release:        8.1 Release amd64
>Organization:
>Environment:
FreeBSD newwww.nutn.edu.tw 8.1-RELEASE FreeBSD 8.1-RELEASE #0: Mon Jul 19 02:36:49 UTC 2010     root@mason.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC  amd64
>Description:
I want to use a SAN volumn mapping to two ports of a fibre from the HBA card.
And I want to use gmultipath with it, but it failed.

And I notice that someone had the similar problem:
http://forum.nginx.org/read.php?23,113752

The information of the volumn in dmesg:
da1 at isp0 bus 0 scbus2 target 0 lun 0
da1: <HP MSA2012fc J200> Fixed Direct Access SCSI-5 device
da1: 400.000MB/s transfers
da1: Command Queueing enabled
da1: 292969MB (600000512 512 byte sectors: 255H 63S/T 37348C)
da2 at isp0 bus 0 scbus2 target 1 lun 0
da2: <HP MSA2012fc J200> Fixed Direct Access SCSI-5 device
da2: 400.000MB/s transfers WWNN 0x207000c0ffd7908d WWPN 0x207000c0ffd7908d PortID 0x111ef
da2: Command Queueing enabled
da2: 292969MB (600000512 512 byte sectors: 255H 63S/T 37348C)
>How-To-Repeat:
# camcontrol inquiry da1 -S
00c0ffd793f50000108cfe4b01000000
# camcontrol inquiry da2 -S
00c0ffd793f50000108cfe4b01000000
# gmultipath label -v WEBDISK da1 da2
gmultipath: Unknown verb add
# gmultipath list
Geom name: WEBDISK
Providers:
1. Name: multipath/WEBDISK
   Mediasize: 307200261632 (286G)
   Sectorsize: 512
   Mode: r0w0e0
Consumers:
1. Name: da1
   Mediasize: 307200262144 (286G)
   Sectorsize: 512
   Mode: r0w0e0

# gmultipath status
             Name  Status  Components
multipath/WEBDISK     N/A  da1
# tail /var/log/messages
..
Aug 10 20:37:57 newwww kernel: da1 is not MULTIPATH
Aug 10 20:37:57 newwww kernel: da1s1 is not MULTIPATH
Aug 10 20:37:57 newwww kernel: MULTIPATH: WEBDISK/1a74fcb6-a47c-11df-81e7-00265523a384
Aug 10 20:37:57 newwww kernel: GEOM_MULTIPATH: adding da1 to WEBDISK/1a74fcb6-a47c-11df-81e7-00265523a384
Aug 10 20:37:57 newwww kernel: GEOM_MULTIPATH: da1 now active path in WEBDISK
Aug 10 20:37:57 newwww kernel: multipath/WEBDISK is not MULTIPATH
Aug 10 20:37:57 newwww kernel: da1s1 is not MULTIPATH
Aug 10 20:37:57 newwww kernel: multipath/WEBDISKs1 is not MULTIPATH
>Fix:


>Release-Note:
>Audit-Trail:
Responsible-Changed-From-To: freebsd-amd64->freebsd-fs 
Responsible-Changed-By: linimon 
Responsible-Changed-When: Fri Aug 13 00:14:05 UTC 2010 
Responsible-Changed-Why:  
Reclassify. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=149499 
Responsible-Changed-From-To: freebsd-fs->mjacob 
Responsible-Changed-By: mjacob 
Responsible-Changed-When: Fri Aug 13 02:53:11 UTC 2010 
Responsible-Changed-Why:  
I do gmultipath maintenance 

http://www.freebsd.org/cgi/query-pr.cgi?pr=149499 

From: =?UTF-8?B?0J3QsNGC0YDQvtCyINCS0LvQsNC00LjQvNC40YA=?=
 <fmhstar@mail.ru>
To: bug-followup@FreeBSD.org, danielliang@gmail.com
Cc:  
Subject: Re: kern/149499: [gmultipath] gmultipath label failed
Date: Fri, 13 Aug 2010 15:14:14 +0400

 I bad know english so try all messages to write.
 Has Found similar problem: http://www.freebsd.org/cgi/query-pr.cgi?pr=149499
 
 
 
 Hardware & Software:
 1) FreeBSD 8.1 i386
 2) IBM x346 eServer 
 (http://www.b2net.co.uk/ibm/ibm_xseries_346_server.htm) - 1
 3) FiberChannel adapter Qlogic ISP 2312 - 2
 4) IBM RAID storage FAStT600 - 1
 
 # dmesg | grep isp
 Jul 28 14:22:13 stalker-volgd kernel: isp0: <Qlogic ISP 2312 PCI FC-AL 
 Adapter> port 0x4000-0x40ff mem 0xdefff000-0xdeffffff irq 72 at device 
 3.0 on pci3
 Jul 28 14:22:13 stalker-volgd kernel: isp0: [ITHREAD]
 Jul 28 14:22:13 stalker-volgd kernel: isp1: <Qlogic ISP 2312 PCI FC-AL 
 Adapter> port 0x5000-0x50ff mem 0xdcfff000-0xdcffffff irq 96 at device 
 4.0 on pci4
 Jul 28 14:22:13 stalker-volgd kernel: isp1: [ITHREAD]
 Jul 28 14:22:13 stalker-volgd kernel: da0 at isp0 bus 0 scbus0 target 0 
 lun 0
 Jul 28 14:22:13 stalker-volgd kernel: da1 at isp1 bus 0 scbus1 target 0 
 lun 0
 Jul 28 14:22:13 stalker-volgd kernel: (da1:isp1:0:0:0): READ(10). CDB: 
 28 0 19 73 21 ff 0 0 1 0
 Jul 28 14:22:13 stalker-volgd kernel: (da1:isp1:0:0:0): CAM status: SCSI 
 Status Error
 Jul 28 14:22:13 stalker-volgd kernel: (da1:isp1:0:0:0): SCSI status: 
 Check Condition
 Jul 28 14:22:13 stalker-volgd kernel: (da1:isp1:0:0:0): SCSI sense: 
 ILLEGAL REQUEST asc:94,1 (Vendor Specific ASC)
 Jul 28 14:22:13 stalker-volgd kernel: (da1:isp1:0:0:0): READ(10). CDB: 
 28 0 19 73 21 ff 0 0 1 0
 Jul 28 14:22:13 stalker-volgd kernel: (da1:isp1:0:0:0): CAM status: SCSI 
 Status Error
 Jul 28 14:22:13 stalker-volgd kernel: (da1:isp1:0:0:0): SCSI status: 
 Check Condition
 Jul 28 14:22:13 stalker-volgd kernel: (da1:isp1:0:0:0): SCSI sense: 
 ILLEGAL REQUEST asc:94,1 (Vendor Specific ASC)
 
 # camcontrol devlist
 <IBM 1722-600 0520>                at scbus0 target 1 lun 0 (da0,pass0)
 <IBM 1722-600 0520>                at scbus1 target 0 lun 0 (da1,pass1)
 
 # camcontrol inquiry da0 -S
 1T42463875
 # camcontrol inquiry da1 -S
 1T41950130
 
 Why do not coincide the number?
 
 
 
 If /dev/da0 /dev/da1 :
 
 # gmultipath label -v rdst0 /dev/da0 /dev/da1
 gmultipath: Unknown verb add
 
 # gmultipath list
 Geom name: rdst0
 Providers:
 1. Name: multipath/rdst0
     Mediasize: 218611580416 (204G)
     Sectorsize: 512
     Mode: r0w0e0
 Consumers:
 1. Name: da0
     Mediasize: 218611580928 (204G)
     Sectorsize: 512
     Mode: r0w0e0
 
 
 
 Or /dev/da1 /dev/da0 :
 
 # gmultipath label -v rdst0 /dev/da1 /dev/da0
 gmultipath: cannot clear metadata on /dev/da1: Invalid argument.

From: Matthew Jacob <mj@feral.com>
To: bug-followup@FreeBSD.org, danielliang@gmail.com
Cc:  
Subject: Re: kern/149499: [gmultipath] gmultipath label failed
Date: Fri, 13 Aug 2010 06:27:40 -0700

 The underlying problem here is that storage paths are not each fully 
 active paths. The real storage is a Santricity from LSI.
 You need to set it's type to Linux AVT with exclusion zones to even have 
 a hope of it working, and frankly, I would
 not declare it supported even then. The '94,1' error is "you don't own 
 this path", and FreeBSD doesn't have an RDAC
 driver to get over that.
 

From: Matthew Jacob <mj@feral.com>
To: bug-followup@FreeBSD.org, danielliang@gmail.com
Cc:  
Subject: Re: kern/149499: [gmultipath] gmultipath label failed
Date: Fri, 13 Aug 2010 07:43:00 -0700

 Sorry, the LSI Santricity issue isn't the only problem. The 'add' error 
 looks like an incomplete MFC which I will address.
 

From: David Brodin <brodin@durd.net>
To: bug-followup@freebsd.org, danielliang@gmail.com
Cc:  
Subject: Re: kern/149499: [gmultipath] gmultipath label failed
Date: Mon, 1 Nov 2010 10:51:57 +0100

 --0016e6d6418875866f0493fac308
 Content-Type: text/plain; charset=UTF-8
 
 Hi,
 
 I was wondering if this bug is being worked on? Im also experiencing this
 problem on , we're currently running on one path, which isnt great.
 
 FreeBSD 8.1-RELEASE amd64
 
 #dmesg | grep isp
 isp0: <Qlogic ISP 2432 PCI FC-AL Adapter> port 0xe800-0xe8ff mem
 0xdf2f8000-0xdf2fbfff irq 34 at device 0.0 on pci4
 isp0: [ITHREAD]
 isp1: <Qlogic ISP 2432 PCI FC-AL Adapter> port 0xec00-0xecff mem
 0xdf2fc000-0xdf2fffff irq 44 at device 0.1 on pci4
 isp1: [ITHREAD]
 isp0: Chan 0 PLOGX PortID 0x640413 to N-Port handle 0x1: LS_RJT = 0x32900
 isp0: Chan 0 PLOGI 0x640413 failed
 isp0: Chan 0 PLOGX PortID 0x640513 to N-Port handle 0x1: handle already used
 for PortID 0x640413
 isp0: Chan 0 PLOGX PortID 0x640513 to N-Port handle 0x2: LS_RJT = 0x32900
 isp0: Chan 0 PLOGI 0x640513 failed
 isp1: Chan 0 PLOGX PortID 0x640513 to N-Port handle 0x1: LS_RJT = 0x32900
 isp1: Chan 0 PLOGI 0x640513 failed
 isp1: Chan 0 PLOGX PortID 0x640413 to N-Port handle 0x1: handle already used
 for PortID 0x640513
 isp1: Chan 0 PLOGX PortID 0x640413 to N-Port handle 0x2: LS_RJT = 0x32900
 isp1: Chan 0 PLOGI 0x640413 failed
 da2 at isp1 bus 0 scbus1 target 0 lun 0
 da1 at isp1 bus 0 scbus1 target 1 lun 0
 da3 at isp0 bus 0 scbus0 target 1 lun 0
 da4 at isp0 bus 0 scbus0 target 0 lun 0
 
 #camcontrol devlist
 <HITACHI DF600F 0000>              at scbus0 target 0 lun 0 (pass4,da4)
 <HITACHI DF600F 0000>              at scbus0 target 1 lun 0 (pass3,da3)
 <HITACHI DF600F 0000>              at scbus1 target 0 lun 0 (pass2,da2)
 <HITACHI DF600F 0000>              at scbus1 target 1 lun 0 (pass1,da1)
 
 --0016e6d6418875866f0493fac308
 Content-Type: text/html; charset=UTF-8
 Content-Transfer-Encoding: quoted-printable
 
 Hi,<div><br></div><div>I was wondering if this bug is being worked on? Im a=
 lso experiencing this problem on , we&#39;re currently running on one path,=
  which isnt great.</div><div><br></div><div>FreeBSD 8.1-RELEASE amd64</div>
 
 <div><br></div><div>#dmesg | grep isp</div><div><div>isp0: &lt;Qlogic ISP 2=
 432 PCI FC-AL Adapter&gt; port 0xe800-0xe8ff mem 0xdf2f8000-0xdf2fbfff irq =
 34 at device 0.0 on pci4</div><div>isp0: [ITHREAD]</div><div>isp1: &lt;Qlog=
 ic ISP 2432 PCI FC-AL Adapter&gt; port 0xec00-0xecff mem 0xdf2fc000-0xdf2ff=
 fff irq 44 at device 0.1 on pci4</div>
 
 <div>isp1: [ITHREAD]</div><div>isp0: Chan 0 PLOGX PortID 0x640413 to N-Port=
  handle 0x1: LS_RJT =3D 0x32900</div><div>isp0: Chan 0 PLOGI 0x640413 faile=
 d</div><div>isp0: Chan 0 PLOGX PortID 0x640513 to N-Port handle 0x1: handle=
  already used for PortID 0x640413</div>
 
 <div>isp0: Chan 0 PLOGX PortID 0x640513 to N-Port handle 0x2: LS_RJT =3D 0x=
 32900</div><div>isp0: Chan 0 PLOGI 0x640513 failed</div><div>isp1: Chan 0 P=
 LOGX PortID 0x640513 to N-Port handle 0x1: LS_RJT =3D 0x32900</div><div>isp=
 1: Chan 0 PLOGI 0x640513 failed</div>
 
 <div>isp1: Chan 0 PLOGX PortID 0x640413 to N-Port handle 0x1: handle alread=
 y used for PortID 0x640513</div><div>isp1: Chan 0 PLOGX PortID 0x640413 to =
 N-Port handle 0x2: LS_RJT =3D 0x32900</div><div>isp1: Chan 0 PLOGI 0x640413=
  failed</div>
 
 <div>da2 at isp1 bus 0 scbus1 target 0 lun 0</div><div>da1 at isp1 bus 0 sc=
 bus1 target 1 lun 0</div><div>da3 at isp0 bus 0 scbus0 target 1 lun 0</div>=
 <div>da4 at isp0 bus 0 scbus0 target 0 lun 0</div></div><div><br></div>
 
 <div>#camcontrol devlist</div><div><div>&lt;HITACHI DF600F 0000&gt; =C2=A0 =
 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0at scbus0 target 0 lun 0 (pass4,da=
 4)</div><div>&lt;HITACHI DF600F 0000&gt; =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=
  =C2=A0 =C2=A0at scbus0 target 1 lun 0 (pass3,da3)</div><div>&lt;HITACHI DF=
 600F 0000&gt; =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0at scbus1 tar=
 get 0 lun 0 (pass2,da2)</div>
 
 <div>&lt;HITACHI DF600F 0000&gt; =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =
 =C2=A0at scbus1 target 1 lun 0 (pass1,da1)</div></div>
 
 --0016e6d6418875866f0493fac308--
State-Changed-From-To: open->closed 
State-Changed-By: mjacob 
State-Changed-When: Sat Nov 27 05:09:09 UTC 2010 
State-Changed-Why:  
Fixed as of 215932 

http://www.freebsd.org/cgi/query-pr.cgi?pr=149499 
>Unformatted:
