From nobody@FreeBSD.org  Sat Apr 10 17:29:47 2010
Return-Path: <nobody@FreeBSD.org>
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id E48011065672
	for <freebsd-gnats-submit@FreeBSD.org>; Sat, 10 Apr 2010 17:29:47 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (www.freebsd.org [IPv6:2001:4f8:fff6::21])
	by mx1.freebsd.org (Postfix) with ESMTP id D33958FC15
	for <freebsd-gnats-submit@FreeBSD.org>; Sat, 10 Apr 2010 17:29:47 +0000 (UTC)
Received: from www.freebsd.org (localhost [127.0.0.1])
	by www.freebsd.org (8.14.3/8.14.3) with ESMTP id o3AHTlcF096448
	for <freebsd-gnats-submit@FreeBSD.org>; Sat, 10 Apr 2010 17:29:47 GMT
	(envelope-from nobody@www.freebsd.org)
Received: (from nobody@localhost)
	by www.freebsd.org (8.14.3/8.14.3/Submit) id o3AHTlEd096447;
	Sat, 10 Apr 2010 17:29:47 GMT
	(envelope-from nobody)
Message-Id: <201004101729.o3AHTlEd096447@www.freebsd.org>
Date: Sat, 10 Apr 2010 17:29:47 GMT
From: Frank Bartels <freebsd@knarf.de>
To: freebsd-gnats-submit@FreeBSD.org
Subject: booting from zfs root not working
X-Send-Pr-Version: www-3.1
X-GNATS-Notify:

>Number:         145613
>Category:       kern
>Synopsis:       [boot] booting from zfs root not working
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    freebsd-bugs
>State:          open
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Sat Apr 10 17:30:03 UTC 2010
>Closed-Date:    
>Last-Modified:  Mon Apr 12 22:40:01 UTC 2010
>Originator:     Frank Bartels
>Release:        7.3-RELEASE
>Organization:
>Environment:
FreeBSD glas 7.3-RELEASE FreeBSD 7.3-RELEASE #2: Wed Apr  7 02:59:36 CEST 2010     knarf@glas:/usr/obj/usr/src/sys/GLAS  i386
>Description:
I've used http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot to install FreeBSD 8.0 on zfs root before successfully (more than once, i386 and amd64).

Because I've seen FreeBSD 7.3-RELEASE now supports gptzfsboot without the need to recompile the loader (LOADER_ZFS_SUPPORT=YES is now the default), I'm trying to migrate an existing 7.3-RELEASE machine to zfs root.

After spending one day on trying the second advertised feature in the 7.3 announcement ("new boot loader gptzfsboot supports GPT and ZFS") I found the little note in ERRATA that zfsloader is not zfs aware.

So I've added the patch from http://svn.freebsd.org/changeset/base/205539 and tried again. But without success.

I see the BTX loader, then the ZFS aware loader (which again tells me "BIOS drive C: is disk0" - this does not happen under 8.0) and then it scrolls very fast and the screen is full of

forth not found
builtin not found
only not found

Because this machine is more or less production, I've set up four different FreeBSDs in VirtualBox.

8.0-RELEASE amd64: zfs root works fine
8.0-STABLE amd64: zfs root works fine
7.3-RELEASE amd64: zfsloader fails with "FATAL: int13_harddisk: function 42. Can't use 64bits lba" 
7.3-STABLE amd64: zfsloader fails with "FATAL: int13_harddisk: function 42. Can't use 64bits lba"

So I'm not able to reproduce the same error with VirtualBox but a new one that also does not occur under 8.

[I'd like to upgrade to 8, too, but this machine is using vlan+lagg+em which is broken in 8].
>How-To-Repeat:
Install 7.3-RELEASE using http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot (7.3's gpart works a bit "different" - you'll need a calculator for the -b and -s parameters).

In step 2.7. apply the patch for sys/boot/i386/loader/Makefile and follow the compile/install steps.

Try to boot from the new hard disk. It will fail.
>Fix:


>Release-Note:
>Audit-Trail:

From: Garrett Cooper <yanefbsd@gmail.com>
To: Frank Bartels <freebsd@knarf.de>
Cc: bug-followup@freebsd.org
Subject: Re: conf/145613: booting from zfs root not working
Date: Sat, 10 Apr 2010 15:08:37 -0700

 Hi Frank,
     1. What variables have you defined in your src.conf before you ran
 installworld?
     2. The errors that you're seeing appear to be emanating from the
 ficl interpreter. I'd need to dig more, but this may just be a symptom
 of the bootloader being unable to read your disk.
 Thanks,
 -Garrett

From: Frank Bartels <freebsd@knarf.de>
To: Garrett Cooper <yanefbsd@gmail.com>
Cc: Frank Bartels <freebsd@knarf.de>, bug-followup@freebsd.org
Subject: Re: conf/145613: booting from zfs root not working
Date: Sun, 11 Apr 2010 16:02:49 +0200

 --+xNpyl7Qekk2NvDX
 Content-Type: text/plain; charset=iso-8859-15
 Content-Disposition: inline
 
 Hi Garrett,
 
 On Sat, Apr 10, 2010 at 15:08:37 -0700, Garrett Cooper wrote:
 > Hi Frank,
 >     1. What variables have you defined in your src.conf before you ran
 > installworld?
 
 none for 7.3-RELEASE, LOADER_ZFS_SUPPORT="YES" for 8.0-RELEASE.
 
 >     2. The errors that you're seeing appear to be emanating from the
 > ficl interpreter. I'd need to dig more, but this may just be a symptom
 > of the bootloader being unable to read your disk.
 
 I think you're right. I was told by Alexander Zagrebin <alexz@visp.ru>,
 the submitter of
 http://svn.freebsd.org/viewvc/base?view=revision&revision=205539:
 "lsdev command doesn't show any zfs devices. :(" - I did not see
 the prompt, so I did not try to type commands.
 
 Thanks,
 Frank
 
 --+xNpyl7Qekk2NvDX
 Content-Type: application/x-pkcs7-signature
 Content-Disposition: attachment; filename="smime.p7s"
 Content-Transfer-Encoding: base64
 
 MIIRuQYJKoZIhvcNAQcCoIIRqjCCEaYCAQExCzAJBgUrDgMCGgUAMAsGCSqGSIb3DQEHAaCC
 DxIwggcoMIIGEKADAgECAgIBVjANBgkqhkiG9w0BAQUFADCBjDELMAkGA1UEBhMCSUwxFjAU
 BgNVBAoTDVN0YXJ0Q29tIEx0ZC4xKzApBgNVBAsTIlNlY3VyZSBEaWdpdGFsIENlcnRpZmlj
 YXRlIFNpZ25pbmcxODA2BgNVBAMTL1N0YXJ0Q29tIENsYXNzIDIgUHJpbWFyeSBJbnRlcm1l
 ZGlhdGUgQ2xpZW50IENBMB4XDTA5MDcyODAwMDAwMVoXDTEwMDcyODIzNTk1OVowgZYxCzAJ
 BgNVBAYTAkRFMQ8wDQYDVQQIEwZCYXllcm4xEDAOBgNVBAcTB011bmNoZW4xLTArBgNVBAsT
 JFN0YXJ0Q29tIFZlcmlmaWVkIENlcnRpZmljYXRlIE1lbWJlcjEWMBQGA1UEAxMNRnJhbmsg
 QmFydGVsczEdMBsGCSqGSIb3DQEJARYOa25hcmZAa25hcmYuZGUwggEiMA0GCSqGSIb3DQEB
 AQUAA4IBDwAwggEKAoIBAQDLWCmP9KDwAsUohjL8tYwuvEVu3pnXZBit+oNuqBTzxC9vcR1C
 TZau0JZdOl/PTr94TClr0c6a1RntmRv8TFthge51No/zY6gImSe6TDhgvBzj3YTaHDm1Kes2
 zZKzvKCW+sbodAGn6KreAbhb9IiJ2QuL3d7yXcbMjfMsRjfFCH/TOuRurjTPNUeEBbxMX0nJ
 Dpee9GPEbeIYBewjOyNviSfIm4Hy3OQ5GFeyEpo4QQvi4oA2ZJpwfrzTParnRHI34CR8JDQQ
 WqaFhd/uFOv2SKrFP6d6+BmcPy7pJSk8ItQ0ujQiPo2N4TOn9aT7Qr0kxIi7nzHTKjM7epnA
 rtFvAgMBAAGjggOGMIIDgjAJBgNVHRMEAjAAMAsGA1UdDwQEAwIEsDAdBgNVHSUEFjAUBggr
 BgEFBQcDAgYIKwYBBQUHAwQwHQYDVR0OBBYEFHimQ7xUVCq3zdFNCNHFIhmhY5WJMBkGA1Ud
 EQQSMBCBDmtuYXJmQGtuYXJmLmRlMIGoBgNVHSMEgaAwgZ2AFK5Vg2/sMcq59x36r2sx88gd
 46y7oYGBpH8wfTELMAkGA1UEBhMCSUwxFjAUBgNVBAoTDVN0YXJ0Q29tIEx0ZC4xKzApBgNV
 BAsTIlNlY3VyZSBEaWdpdGFsIENlcnRpZmljYXRlIFNpZ25pbmcxKTAnBgNVBAMTIFN0YXJ0
 Q29tIENlcnRpZmljYXRpb24gQXV0aG9yaXR5ggEOMIIBRwYDVR0gBIIBPjCCATowggE2Bgsr
 BgEEAYG1NwECADCCASUwLgYIKwYBBQUHAgEWImh0dHA6Ly93d3cuc3RhcnRzc2wuY29tL3Bv
 bGljeS5wZGYwNAYIKwYBBQUHAgEWKGh0dHA6Ly93d3cuc3RhcnRzc2wuY29tL2ludGVybWVk
 aWF0ZS5wZGYwgbwGCCsGAQUFBwICMIGvMBQWDVN0YXJ0Q29tIEx0ZC4wAwIBARqBlkxpbWl0
 ZWQgTGlhYmlsaXR5LCByZWFkIHRoZSBzZWN0aW9uICpMZWdhbCBMaW1pdGF0aW9ucyogb2Yg
 dGhlIFN0YXJ0Q29tIENlcnRpZmljYXRpb24gQXV0aG9yaXR5IFBvbGljeSBhdmFpbGFibGUg
 YXQgaHR0cDovL3d3dy5zdGFydHNzbC5jb20vcG9saWN5LnBkZjBjBgNVHR8EXDBaMCugKaAn
 hiVodHRwOi8vd3d3LnN0YXJ0c3NsLmNvbS9jcnR1Mi1jcmwuY3JsMCugKaAnhiVodHRwOi8v
 Y3JsLnN0YXJ0c3NsLmNvbS9jcnR1Mi1jcmwuY3JsMIGOBggrBgEFBQcBAQSBgTB/MDkGCCsG
 AQUFBzABhi1odHRwOi8vb2NzcC5zdGFydHNzbC5jb20vc3ViL2NsYXNzMi9jbGllbnQvY2Ew
 QgYIKwYBBQUHMAKGNmh0dHA6Ly93d3cuc3RhcnRzc2wuY29tL2NlcnRzL3N1Yi5jbGFzczIu
 Y2xpZW50LmNhLmNydDAjBgNVHRIEHDAahhhodHRwOi8vd3d3LnN0YXJ0c3NsLmNvbS8wDQYJ
 KoZIhvcNAQEFBQADggEBAIVekIt/VS99FXJlHosC30Dlv473hPN3TmCgsIUT43YW41sLUihk
 EaUgSl8YsRA2yR34hePf60W+zws0r/AuPTXRp/1rxwvvov7DeCRaU27QkWNfc0VZ3S8b6Zbm
 fHjRyPAApwLG4hPnQeIBASnc2HBGTLOWtWRkPKM9dkV46h9j6nOMHSkLZlGqVtlqXJU1rhWX
 TRww3WFYwRUC7uLqFyXdKjas7OEROiNKzTd5pY3KRz0weBXskU5fFcvw/vG6hm8FILyYR0gS
 QyRYQV/4GitN36R3/29crCkRZMJxhNI0h2/+L1rfczn69fq4gnPeYYJmlTe0JMcawT6jvayq
 bP0wggfiMIIFyqADAgECAgEOMA0GCSqGSIb3DQEBBQUAMH0xCzAJBgNVBAYTAklMMRYwFAYD
 VQQKEw1TdGFydENvbSBMdGQuMSswKQYDVQQLEyJTZWN1cmUgRGlnaXRhbCBDZXJ0aWZpY2F0
 ZSBTaWduaW5nMSkwJwYDVQQDEyBTdGFydENvbSBDZXJ0aWZpY2F0aW9uIEF1dGhvcml0eTAe
 Fw0wNzEwMjQyMTAyNTRaFw0xMjEwMjIyMTAyNTRaMIGMMQswCQYDVQQGEwJJTDEWMBQGA1UE
 ChMNU3RhcnRDb20gTHRkLjErMCkGA1UECxMiU2VjdXJlIERpZ2l0YWwgQ2VydGlmaWNhdGUg
 U2lnbmluZzE4MDYGA1UEAxMvU3RhcnRDb20gQ2xhc3MgMiBQcmltYXJ5IEludGVybWVkaWF0
 ZSBDbGllbnQgQ0EwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDLKIVFnAEs+xny
 q6UzjCqgDcvQVe1dIoFnRsQPCFO+y92k8RK0Pn3MbQ2Gd+mehh9GBZ+36uUQA7Xj9AGM6wgP
 hEE34vKtfpAN5tJ8LcFxveDObCKrL7O5UT9WsnAZHv7OYPYSR68mdmnEnJ83M4wQgKO19b+R
 t8sPDAz9ptkQsntCn4GeJzg3q2SVc4QJTg/WHo7wF2ah5LMOeh8xJVSKGEmd6uPkSbj113yK
 Mm8vmNptRPmM1+YgmVwcdOYJOjCgFtb2sOP79jji8uhWR91xx7TpM1K3hv/wrBZwffrmmEpU
 euXHRs07JqCCvFh9coKF4UQZvfEg+x3/69xRCzb1AgMBAAGjggNbMIIDVzAMBgNVHRMEBTAD
 AQH/MAsGA1UdDwQEAwIBpjAdBgNVHQ4EFgQUrlWDb+wxyrn3HfqvazHzyB3jrLswgagGA1Ud
 IwSBoDCBnYAUTgvvGqRAW6UXaYcwyjRoQ9BBrvKhgYGkfzB9MQswCQYDVQQGEwJJTDEWMBQG
 A1UEChMNU3RhcnRDb20gTHRkLjErMCkGA1UECxMiU2VjdXJlIERpZ2l0YWwgQ2VydGlmaWNh
 dGUgU2lnbmluZzEpMCcGA1UEAxMgU3RhcnRDb20gQ2VydGlmaWNhdGlvbiBBdXRob3JpdHmC
 AQEwCQYDVR0SBAIwADA9BggrBgEFBQcBAQQxMC8wLQYIKwYBBQUHMAKGIWh0dHA6Ly93d3cu
 c3RhcnRzc2wuY29tL3Nmc2NhLmNydDBgBgNVHR8EWTBXMCygKqAohiZodHRwOi8vY2VydC5z
 dGFydGNvbS5vcmcvc2ZzY2EtY3JsLmNybDAnoCWgI4YhaHR0cDovL2NybC5zdGFydHNzbC5j
 b20vc2ZzY2EuY3JsMIIBXQYDVR0gBIIBVDCCAVAwggFMBgsrBgEEAYG1NwEBBDCCATswLwYI
 KwYBBQUHAgEWI2h0dHA6Ly9jZXJ0LnN0YXJ0Y29tLm9yZy9wb2xpY3kucGRmMDUGCCsGAQUF
 BwIBFilodHRwOi8vY2VydC5zdGFydGNvbS5vcmcvaW50ZXJtZWRpYXRlLnBkZjCB0AYIKwYB
 BQUHAgIwgcMwJxYgU3RhcnQgQ29tbWVyY2lhbCAoU3RhcnRDb20pIEx0ZC4wAwIBARqBl0xp
 bWl0ZWQgTGlhYmlsaXR5LCByZWFkIHRoZSBzZWN0aW9uICpMZWdhbCBMaW1pdGF0aW9ucyog
 b2YgdGhlIFN0YXJ0Q29tIENlcnRpZmljYXRpb24gQXV0aG9yaXR5IFBvbGljeSBhdmFpbGFi
 bGUgYXQgaHR0cDovL2NlcnQuc3RhcnRjb20ub3JnL3BvbGljeS5wZGYwEQYJYIZIAYb4QgEB
 BAQDAgAHMFAGCWCGSAGG+EIBDQRDFkFTdGFydENvbSBDbGFzcyAyIFByaW1hcnkgSW50ZXJt
 ZWRpYXRlIEZyZWUgU1NMIEVtYWlsIENlcnRpZmljYXRlczANBgkqhkiG9w0BAQUFAAOCAgEA
 HvcQF/726YR5L5A3Ta7JV1nTu3w9yWqp00945pg7uea+1KVtR/7/yeNFAV7MPQylPE8pROEc
 GU+RwwDFuNn9cePfAMzOBTpy/6VE076+gYkZa4n8uWaL5A2FVo8tRmEyfoT4gRL9B5h5w8Y4
 ZySCJBLyfp4jByyxHaTTIWZ8TIkxUQLSBeFnmHKYFwYwMbBA0Sgb8ONCvq9zeJcpMkkDadhJ
 SCfB9c9gZocbaaVHVqTlSeENRr5/Y31dapzIRQg2Pl9V/A65Cq03KQxMXBpXn8HkLO/g2FCt
 7KYkJCaTe6qT2JX8thmB3nb+5RmtWQIITCP+PPNkFQCts6ujOtJx6TlDLWA+tV7QLN2Q+S98
 p/SwnXito+GW0N7kXcL8QDBVsF8lCvwCz+JQrvUIcW5xEzpAVk9xSbpePxVIMzNEUQhBobkF
 ojhUqGt+VyU3GH/+BP2brzl4StOJ1KXuw2EzFs0ai9OMsqCUFRyhykm6MrbnsnSrqhWSnSQP
 YIu+zpzwWC/8sZFxoJCwvbbIu+6E+AIGa8tP+pYF+empPn/7pkIoTT4LSkkEIxGKvUvDJTh8
 6VDNL8bIIQE2LHVDwcOq+mcQx416FAA9Nw1DBGyrFr6hQe5yTVXrJ4G7vJosNRGCwPnx302g
 onaFdwi++YyqjPyhPO6q4fRarYvWyqp5L6UxggJvMIICawIBATCBkzCBjDELMAkGA1UEBhMC
 SUwxFjAUBgNVBAoTDVN0YXJ0Q29tIEx0ZC4xKzApBgNVBAsTIlNlY3VyZSBEaWdpdGFsIENl
 cnRpZmljYXRlIFNpZ25pbmcxODA2BgNVBAMTL1N0YXJ0Q29tIENsYXNzIDIgUHJpbWFyeSBJ
 bnRlcm1lZGlhdGUgQ2xpZW50IENBAgIBVjAJBgUrDgMCGgUAoIGxMBgGCSqGSIb3DQEJAzEL
 BgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTEwMDQxMTE0MDI0OVowIwYJKoZIhvcNAQkE
 MRYEFBC40zetC13280XDf28rPiXovSerMFIGCSqGSIb3DQEJDzFFMEMwCgYIKoZIhvcNAwcw
 DgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEo
 MA0GCSqGSIb3DQEBAQUABIIBAA6mUznM3KJoAOiU/ApSLTYZYR1rSATbXm4Mjm+cTV4myBJX
 QOxtwggzA5zoJDo4/+/EcRON7fJHlVq4jK55HUfSrmvNeAWh27nZ1JgW62iLE7hh6p7Z5rSc
 qG0OYKaIiDH9k9fS3Q33M9AJlG/iPIdYprbVqgnZ4cflHVjsQ1+SLotZyzKjwJzElJ3aBPzI
 m45SojiNmu3uP2v1GuAwuBzd18lFJTp3Sv8vg0xZ3uRoeQzv06XHwvau0g3eSgwaR8vXO5+F
 fmV/1UroYl1z3MsOeww+x/KSAifBiJaaS/TpNR1C1ERiwKdXswOfNKFMcRH4UC4Px1IgERuK
 0VpVmdQ=
 
 --+xNpyl7Qekk2NvDX--

From: Frank Bartels <freebsd@knarf.de>
To: Garrett Cooper <yanefbsd@gmail.com>, bug-followup@freebsd.org
Cc:  
Subject: Re: conf/145613: booting from zfs root not working
Date: Tue, 13 Apr 2010 00:35:58 +0200

 On Sun, Apr 11, 2010 at 16:02:49 +0200, Frank Bartels wrote:
 
 > >     2. The errors that you're seeing appear to be emanating from the
 > > ficl interpreter. I'd need to dig more, but this may just be a symptom
 > > of the bootloader being unable to read your disk.
 > 
 > I think you're right. I was told by Alexander Zagrebin <alexz@visp.ru>,
 > the submitter of
 > http://svn.freebsd.org/viewvc/base?view=revision&revision=205539:
 > "lsdev command doesn't show any zfs devices. :(" - I did not see
 > the prompt, so I did not try to type commands.
 
 I've installed 7.3-STABLE/amd64 under VMWare server now. This VM
 dows not show the 'FATAL: int13_harddisk: function 42. Can't use
 64bits lba' issue and seems to behave exactly like my hardware this
 pr is referring to.
 
 After a screen full of
 
 builtin not found
 forth not found
 
 I see
 
 only not found
 
 can't load 'kernel'
 
 Type '?' for a list of commands. 'help' for more detailed help.
 OK ls
 open '/' failed: input/output error
 OS lsdev
 cd devices:
 disk devices:
     disk0:   BIOS drive A:
     disk1:   BIOS drive C:
     disk2:   BIOS drive D:
 pxe devices:
 zfs devices:
 OK
 
 So the systems was able to load zfsloader from my zfsroot and forgot
 where to load the kernel from. Correct?
 
 Thanks,
 Knarf
 
 P.S.: This time without annoying S/MIME signature, displayed under
 http://www.freebsd.org/cgi/query-pr.cgi?pr=145613&cat= , but it's
 still me. :)
>Unformatted:
