From nobody@FreeBSD.org  Mon Jul 25 13:31:10 2011
Return-Path: <nobody@FreeBSD.org>
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id AA664106564A
	for <freebsd-gnats-submit@FreeBSD.org>; Mon, 25 Jul 2011 13:31:10 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from red.freebsd.org (red.freebsd.org [IPv6:2001:4f8:fff6::22])
	by mx1.freebsd.org (Postfix) with ESMTP id 80FF08FC16
	for <freebsd-gnats-submit@FreeBSD.org>; Mon, 25 Jul 2011 13:31:10 +0000 (UTC)
Received: from red.freebsd.org (localhost [127.0.0.1])
	by red.freebsd.org (8.14.4/8.14.4) with ESMTP id p6PDVAqY018648
	for <freebsd-gnats-submit@FreeBSD.org>; Mon, 25 Jul 2011 13:31:10 GMT
	(envelope-from nobody@red.freebsd.org)
Received: (from nobody@localhost)
	by red.freebsd.org (8.14.4/8.14.4/Submit) id p6PDV9PW018647;
	Mon, 25 Jul 2011 13:31:09 GMT
	(envelope-from nobody)
Message-Id: <201107251331.p6PDV9PW018647@red.freebsd.org>
Date: Mon, 25 Jul 2011 13:31:09 GMT
From: Christoph Hoffmann <christoph.hoffmann@biff.ch>
To: freebsd-gnats-submit@FreeBSD.org
Subject: ZFS boot disk limitaion
X-Send-Pr-Version: www-3.1
X-GNATS-Notify:

>Number:         159181
>Category:       i386
>Synopsis:       ZFS boot disk limitaion
>Confidential:   no
>Severity:       non-critical
>Priority:       low
>Responsible:    freebsd-i386
>State:          closed
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Mon Jul 25 13:40:07 UTC 2011
>Closed-Date:    Tue Jul 26 15:40:43 UTC 2011
>Last-Modified:  Tue Jul 26 15:50:03 UTC 2011
>Originator:     Christoph Hoffmann
>Release:        FreeBSD 8.2
>Organization:
>Environment:
FreeBSD bsdtst.work 8.2-STABLE FreeBSD 8.2-STABLE #1: Sun Jul 24 18:42:18 MEST 2011     root@bsdtst.work:/usr/obj/usr/src/sys/BSDTST  i386

>Description:
Installing FreeBSD 8.2 (i386) system with ZFS on 4191 GB disk:

da0 at ciss0 bus 0 scbus0 target 0 lun 0
da0: <COMPAQ RAID 1(1VOLUME OK> Fixed Direct Access SCSI-4 device 
da0: 135.168MB/s transfers
da0: Command Queueing enabled
da0: 69459MB (142253280 512 byte sectors: 255H 32S/T 17433C)

will fail during initial reboot with the error:

error 1 lba 32
error 1 lba 1
No ZFS pools located, can't boot

but will finish successfuly on 67GB disk:

da0 at ciss0 bus 0 scbus0 target 0 lun 0
da0: <COMPAQ RAID 5  VOLUME OK> Fixed Direct Access SCSI-5 device 
da0: 135.168MB/s transfers
da0: Command Queueing enabled
da0: 4292258MB (8790545968 512 byte sectors: 255H 32S/T 65535C) .


>How-To-Repeat:
The installation sequence:

sysctl kern.geom.debugflags=16

mount -o rw /dev/md0 /

dhclient bce0

gpart destroy -F /dev/da0

gpart create -s GPT /dev/da0
gpart add -b 34 -s 128 -t freebsd-boot /dev/da0
gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 /dev/da0
gpart add -b 162 -s 4G -t freebsd-swap /dev/da0
gpart add -s 50G -t freebsd-zfs /dev/da0

zpool destroy -f zroot
zpool create -f zroot /dev/da0p3
zpool set bootfs=zroot zroot
zpool export zroot
zpool import -f zroot

zfs create zroot/tmp
zfs create zroot/usr
zfs create zroot/var

mkdir /dist
mount -t nfs 172.16.19.32:/usr/local/BSD.8.2.i386 /dist
export DESTDIR=/zroot
    
    >---install base src kernels proflibs manpages dict<---

cp -R /zroot/boot/GENERIC/* /zroot/boot/kernel/

cp /zroot/usr/share/zoneinfo/MET /zroot/etc/localtime

cat <<EOF > /zroot/etc/rc.conf
hostname="bsdtst.work"
ifconfig_bce0="SYNCDHCP"
zfs_enable="YES"
ntpdate_enable="YES"
ntpdate_flags="pool.ntp.org"
sendmail_enable="NO"
sshd_enable="YES"
EOF

echo 'zfs_load="YES"' >> /zroot/boot/loader.conf
echo "vfs.root.mountfrom="zfs:zroot"' >>  /zroot/boot/loader.conf

cp /boot/zfs/zpool.cache /zroot/boot/zfs/zpool.cache

cat << EOF > /zroot/etc/fstab
/dev/da0p2	none	swap	sw	0 0
EOF

zfs umount -a

zfs set mountpoint=legacy zroot
zfs set mountpoint=/tmp zroot/tmp
zfs set mountpoint=/usr zroot/usr
zfs set mountpoint=/var zroot/var

reboot

>Fix:
use small disk.

>Release-Note:
>Audit-Trail:
State-Changed-From-To: open->closed 
State-Changed-By: remko 
State-Changed-When: Tue Jul 26 15:40:42 UTC 2011 
State-Changed-Why:  
I believe this cannot be resolved with i386, and the user should use 
amd64 mode instead. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=159181 

From: Remko Lodder <remko@elvandar.org>
To: Christoph Hoffmann <christoph.hoffmann@biff.ch>
Cc: freebsd-gnats-submit@FreeBSD.org
Subject: Re: i386/159181: ZFS boot disk limitaion
Date: Tue, 26 Jul 2011 17:40:08 +0200

 --Apple-Mail=_5265EBB3-6C10-4166-B545-D8AFAF4E0676
 Content-Transfer-Encoding: quoted-printable
 Content-Type: text/plain;
 	charset=us-ascii
 
 
 Hello,
 
 Your example is put in reversed.
 
 As you might be aware, the i386 platform has a 4gb limitation because of =
 32bit mode. So I think you are hitting
 this with ZFS as well. Is the machine capable of running AMD64 mode? =
 Then it should just work fine (if the rest
 of the hardware is sufficient ofcourse).
 
 I also believe this PR cannot be resolved, since the mentioned 32bit =
 addressing limit prevents anything like
 this.
 
 --=20
 /"\   Best regards,				| remko@FreeBSD.org
 \ /   Remko Lodder			|
 X    http://www.evilcoder.org/	| Quis custodiet ipsos custodes
 / \   ASCII Ribbon Campaign	| Against HTML Mail and News
 
 
 
 
 
 
 --Apple-Mail=_5265EBB3-6C10-4166-B545-D8AFAF4E0676
 Content-Disposition: attachment;
 	filename=smime.p7s
 Content-Type: application/pkcs7-signature;
 	name=smime.p7s
 Content-Transfer-Encoding: base64
 
 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIPBTCCBxsw
 ggYDoAMCAQICAwLGOjANBgkqhkiG9w0BAQUFADCBjDELMAkGA1UEBhMCSUwxFjAUBgNVBAoTDVN0
 YXJ0Q29tIEx0ZC4xKzApBgNVBAsTIlNlY3VyZSBEaWdpdGFsIENlcnRpZmljYXRlIFNpZ25pbmcx
 ODA2BgNVBAMTL1N0YXJ0Q29tIENsYXNzIDEgUHJpbWFyeSBJbnRlcm1lZGlhdGUgQ2xpZW50IENB
 MB4XDTExMDcyNTE2MzIwN1oXDTEyMDcyNjExMjkyOVowYjEgMB4GA1UEDRMXNDcxMzQzLTJJMTdF
 OGdKMDE0Z2lLZncxGzAZBgNVBAMMEnJlbWtvQGVsdmFuZGFyLm9yZzEhMB8GCSqGSIb3DQEJARYS
 cmVta29AZWx2YW5kYXIub3JnMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEApFNmVDbW
 gmPWxGMxUB5qpVnFHJW+3k3ISZ1VKPADkGd1OCETTskqfnSV6ohlWlDoE6NQWeENKmfhlEeIkec+
 6eaYrUQzCen/pcvAs7MeAEs8HNyGiJKBNibCtwvLVUn+gvFTlfqEhceOMTU0PL8Ua5x0TOHommTG
 zuyilS6dGkM808E+QDZNLIad0lc3xJnPIrA+LircOcyd2JQJDjbSwr5sQ51KEXPOalUaDUYQqUOw
 A2WLhcq1oLPkRRLVmwBS0wD/gkqcvoDSDXxcxFM5irc+Z4IWRD5J1Xvv794iToi+fOqFsyahBC6m
 lbATAUNkkcR4I0XPdPSZ7GV0z9UyyQIDAQABo4IDrTCCA6kwCQYDVR0TBAIwADALBgNVHQ8EBAMC
 BLAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMB0GA1UdDgQWBBQYRenk2mJr02xQk8TB
 2IQLve9SRDAfBgNVHSMEGDAWgBRTcu2SnODaywFcfH6WNU7y1LhRgjAdBgNVHREEFjAUgRJyZW1r
 b0BlbHZhbmRhci5vcmcwggIhBgNVHSAEggIYMIICFDCCAhAGCysGAQQBgbU3AQICMIIB/zAuBggr
 BgEFBQcCARYiaHR0cDovL3d3dy5zdGFydHNzbC5jb20vcG9saWN5LnBkZjA0BggrBgEFBQcCARYo
 aHR0cDovL3d3dy5zdGFydHNzbC5jb20vaW50ZXJtZWRpYXRlLnBkZjCB9wYIKwYBBQUHAgIwgeow
 JxYgU3RhcnRDb20gQ2VydGlmaWNhdGlvbiBBdXRob3JpdHkwAwIBARqBvlRoaXMgY2VydGlmaWNh
 dGUgd2FzIGlzc3VlZCBhY2NvcmRpbmcgdG8gdGhlIENsYXNzIDEgVmFsaWRhdGlvbiByZXF1aXJl
 bWVudHMgb2YgdGhlIFN0YXJ0Q29tIENBIHBvbGljeSwgcmVsaWFuY2Ugb25seSBmb3IgdGhlIGlu
 dGVuZGVkIHB1cnBvc2UgaW4gY29tcGxpYW5jZSBvZiB0aGUgcmVseWluZyBwYXJ0eSBvYmxpZ2F0
 aW9ucy4wgZwGCCsGAQUFBwICMIGPMCcWIFN0YXJ0Q29tIENlcnRpZmljYXRpb24gQXV0aG9yaXR5
 MAMCAQIaZExpYWJpbGl0eSBhbmQgd2FycmFudGllcyBhcmUgbGltaXRlZCEgU2VlIHNlY3Rpb24g
 IkxlZ2FsIGFuZCBMaW1pdGF0aW9ucyIgb2YgdGhlIFN0YXJ0Q29tIENBIHBvbGljeS4wNgYDVR0f
 BC8wLTAroCmgJ4YlaHR0cDovL2NybC5zdGFydHNzbC5jb20vY3J0dTEtY3JsLmNybDCBjgYIKwYB
 BQUHAQEEgYEwfzA5BggrBgEFBQcwAYYtaHR0cDovL29jc3Auc3RhcnRzc2wuY29tL3N1Yi9jbGFz
 czEvY2xpZW50L2NhMEIGCCsGAQUFBzAChjZodHRwOi8vYWlhLnN0YXJ0c3NsLmNvbS9jZXJ0cy9z
 dWIuY2xhc3MxLmNsaWVudC5jYS5jcnQwIwYDVR0SBBwwGoYYaHR0cDovL3d3dy5zdGFydHNzbC5j
 b20vMA0GCSqGSIb3DQEBBQUAA4IBAQAg/GN5dZAMpW2NsteYyPfyxwngbRZB0t0mBGOltTMh6Opz
 ULCJPxW/uEPclV9W8IEk+OQen5hoMT/yKXa69zbLRXxnIBI6Trum5Wz6QBtgqwtFuVIEsdmv4YhL
 0wDZWsVmEG7VNQ8932sBQrk0BvYugsaHKAlDwZqLFd4jflO9H19TK3pf2YDrCNRSBB6SIGkDo1WV
 FRj1B+6NmsgE3OcP7GsGqf+sduMdL/htgfRWuLBOFSeCvhGHL3xg9mMq6JhEp0OPCFJE2yaNXfrE
 sDtxv7OncZC01S+qw3w6lwOBgifU1ONy3mqjr7DKyXiDvWo4lpXOgw8Q8vqkNr9jIbW5MIIH4jCC
 BcqgAwIBAgIBDTANBgkqhkiG9w0BAQUFADB9MQswCQYDVQQGEwJJTDEWMBQGA1UEChMNU3RhcnRD
 b20gTHRkLjErMCkGA1UECxMiU2VjdXJlIERpZ2l0YWwgQ2VydGlmaWNhdGUgU2lnbmluZzEpMCcG
 A1UEAxMgU3RhcnRDb20gQ2VydGlmaWNhdGlvbiBBdXRob3JpdHkwHhcNMDcxMDI0MjEwMTU0WhcN
 MTIxMDIyMjEwMTU0WjCBjDELMAkGA1UEBhMCSUwxFjAUBgNVBAoTDVN0YXJ0Q29tIEx0ZC4xKzAp
 BgNVBAsTIlNlY3VyZSBEaWdpdGFsIENlcnRpZmljYXRlIFNpZ25pbmcxODA2BgNVBAMTL1N0YXJ0
 Q29tIENsYXNzIDEgUHJpbWFyeSBJbnRlcm1lZGlhdGUgQ2xpZW50IENBMIIBIjANBgkqhkiG9w0B
 AQEFAAOCAQ8AMIIBCgKCAQEAxwmDzM4t2BqxKaQuE6uWvooyg4ymiEGWVUet1G8SD+rqvyNH4Qrv
 nEIaFHxOhESip7vMz39ScLpNLbL1QpOlPW/tFIzNHS3qd2XRNYG5Sv9RcGE+T4qbLtsjjJbi6sL7
 Ls/f/X9ftTyhxvxWkf8KW37iKrueKsxw2HqolH7GM6FX5UfNAwAu4ZifkpmZzU1slBhyWwaQPEPP
 ZRsWoTb7q8hmgv6Nv3Hg9rmA1/VPBIOQ6SKRkHXG0Hhmq1dOFoAFI411+a/9nWm5rcVjGcIWZ2v/
 43Yksq60jExipA4l5uv9/+Hm33mbgmCszdj/Dthf13tgAv2O83hLJ0exTqfrlwIDAQABo4IDWzCC
 A1cwDAYDVR0TBAUwAwEB/zALBgNVHQ8EBAMCAaYwHQYDVR0OBBYEFFNy7ZKc4NrLAVx8fpY1TvLU
 uFGCMIGoBgNVHSMEgaAwgZ2AFE4L7xqkQFulF2mHMMo0aEPQQa7yoYGBpH8wfTELMAkGA1UEBhMC
 SUwxFjAUBgNVBAoTDVN0YXJ0Q29tIEx0ZC4xKzApBgNVBAsTIlNlY3VyZSBEaWdpdGFsIENlcnRp
 ZmljYXRlIFNpZ25pbmcxKTAnBgNVBAMTIFN0YXJ0Q29tIENlcnRpZmljYXRpb24gQXV0aG9yaXR5
 ggEBMAkGA1UdEgQCMAAwPQYIKwYBBQUHAQEEMTAvMC0GCCsGAQUFBzAChiFodHRwOi8vd3d3LnN0
 YXJ0c3NsLmNvbS9zZnNjYS5jcnQwYAYDVR0fBFkwVzAsoCqgKIYmaHR0cDovL2NlcnQuc3RhcnRj
 b20ub3JnL3Nmc2NhLWNybC5jcmwwJ6AloCOGIWh0dHA6Ly9jcmwuc3RhcnRzc2wuY29tL3Nmc2Nh
 LmNybDCCAV0GA1UdIASCAVQwggFQMIIBTAYLKwYBBAGBtTcBAQQwggE7MC8GCCsGAQUFBwIBFiNo
 dHRwOi8vY2VydC5zdGFydGNvbS5vcmcvcG9saWN5LnBkZjA1BggrBgEFBQcCARYpaHR0cDovL2Nl
 cnQuc3RhcnRjb20ub3JnL2ludGVybWVkaWF0ZS5wZGYwgdAGCCsGAQUFBwICMIHDMCcWIFN0YXJ0
 IENvbW1lcmNpYWwgKFN0YXJ0Q29tKSBMdGQuMAMCAQEagZdMaW1pdGVkIExpYWJpbGl0eSwgcmVh
 ZCB0aGUgc2VjdGlvbiAqTGVnYWwgTGltaXRhdGlvbnMqIG9mIHRoZSBTdGFydENvbSBDZXJ0aWZp
 Y2F0aW9uIEF1dGhvcml0eSBQb2xpY3kgYXZhaWxhYmxlIGF0IGh0dHA6Ly9jZXJ0LnN0YXJ0Y29t
 Lm9yZy9wb2xpY3kucGRmMBEGCWCGSAGG+EIBAQQEAwIABzBQBglghkgBhvhCAQ0EQxZBU3RhcnRD
 b20gQ2xhc3MgMSBQcmltYXJ5IEludGVybWVkaWF0ZSBGcmVlIFNTTCBFbWFpbCBDZXJ0aWZpY2F0
 ZXMwDQYJKoZIhvcNAQEFBQADggIBAKqa4eBbjM4dG/wdxiwwIKC3kyb98QK2zREovyn/xzDP/4H/
 Bc8FFDTgoJR+nX2Li0EP3U7TsjG+CaIi90+8YlShADpkPrfm/8SzjGtJtfM6EaluJOhpcqMr3Oyz
 K3aYGJP5RIeZ6vLT3fQaDZsIooXl6YSFR/0HpU4FJDc0wuyFaZmFbCrjTp8RNYyRWTTX6mWSv+Tr
 aOwuj3zrrddSpgUEi2WqwM9G/5o4IXQbGHx7oXTvL6zrw9IOYO3QOKZDgFNhHeKUgqMAUiLcg/+W
 hcGe+Y4umKuxghtwaYsgD/bLfIfop3NC/u5JqwDCWizAJruhmbOV4LG859MFCb2w/YeY55zDPVGm
 Q3MZdriwdOKrhlFjOjYihmm28UHOvND2G3kK0LvnuieLqjQMc6GuUcZAQOWv96pW4BfbiQXpAqib
 MMeb0PZISa7PFEzGiBc2xAuVRkM4kB9/+iieA1D/OTiRJwsf6rkoVgOsN9fCw522tzOmuVfiqDS4
 bFYv00sX/dFGwasHUUf3DsLhpDSYdejb74SKjtuqLDIOuAm2bA1axA6+7kjFeNIngSU6OPSMre+x
 Ajoc/6coaMGthFD+mimr/i/8F8wDwdyzas7oxkdCtaW8hVir8mJnbp4CbckllDMPkeQ6qQNmxSDh
 OeqX1jyx2cTi/vPq+/TyxV/stlehMYIDbzCCA2sCAQEwgZQwgYwxCzAJBgNVBAYTAklMMRYwFAYD
 VQQKEw1TdGFydENvbSBMdGQuMSswKQYDVQQLEyJTZWN1cmUgRGlnaXRhbCBDZXJ0aWZpY2F0ZSBT
 aWduaW5nMTgwNgYDVQQDEy9TdGFydENvbSBDbGFzcyAxIFByaW1hcnkgSW50ZXJtZWRpYXRlIENs
 aWVudCBDQQIDAsY6MAkGBSsOAwIaBQCgggGvMBgGCSqGSIb3DQEJAzELBgkqhkiG9w0BBwEwHAYJ
 KoZIhvcNAQkFMQ8XDTExMDcyNjE1NDAwOVowIwYJKoZIhvcNAQkEMRYEFLlJmf6/IngRLOcCY3La
 4VyJ9i+5MIGlBgkrBgEEAYI3EAQxgZcwgZQwgYwxCzAJBgNVBAYTAklMMRYwFAYDVQQKEw1TdGFy
 dENvbSBMdGQuMSswKQYDVQQLEyJTZWN1cmUgRGlnaXRhbCBDZXJ0aWZpY2F0ZSBTaWduaW5nMTgw
 NgYDVQQDEy9TdGFydENvbSBDbGFzcyAxIFByaW1hcnkgSW50ZXJtZWRpYXRlIENsaWVudCBDQQID
 AsY6MIGnBgsqhkiG9w0BCRACCzGBl6CBlDCBjDELMAkGA1UEBhMCSUwxFjAUBgNVBAoTDVN0YXJ0
 Q29tIEx0ZC4xKzApBgNVBAsTIlNlY3VyZSBEaWdpdGFsIENlcnRpZmljYXRlIFNpZ25pbmcxODA2
 BgNVBAMTL1N0YXJ0Q29tIENsYXNzIDEgUHJpbWFyeSBJbnRlcm1lZGlhdGUgQ2xpZW50IENBAgMC
 xjowDQYJKoZIhvcNAQEBBQAEggEAcJ+khmVJoCPlLe7B6Rm2y2d6C2+AJCdfHxgC6q0x4sDTOzH3
 QDj8xNOKTOPxuNfnbAvbk9ZabvXj11PZyd2dVCyOrDPkdKv5rlOWmOEsYEYEjaSkfP7808gjM/TZ
 FQMdOoIwtwjGhczNHYfdJcNL9KIhAGO3yaPK8Tv3ulSHRuC/KvMLwfgvJaITLSmzcmIK5QoSdcZd
 hpZouXgN9cpo6CedSOehdMb2TKlxfs3KdqdHjDUJqTyj1FP8XpkwLSpY3JugtD6FRSmS8/5HHjat
 kOv95mnKanU9jzb5JThi/r9gIHjrcSveIGgcNzdmatm1v53wj4iNJ37gD2Z2DkVOmgAAAAAAAA==
 
 --Apple-Mail=_5265EBB3-6C10-4166-B545-D8AFAF4E0676--
>Unformatted:
