From nobody@FreeBSD.org  Wed Jan 14 04:23:23 2009
Return-Path: <nobody@FreeBSD.org>
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id D5421106564A
	for <freebsd-gnats-submit@FreeBSD.org>; Wed, 14 Jan 2009 04:23:23 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (www.freebsd.org [IPv6:2001:4f8:fff6::21])
	by mx1.freebsd.org (Postfix) with ESMTP id B914E8FC14
	for <freebsd-gnats-submit@FreeBSD.org>; Wed, 14 Jan 2009 04:23:23 +0000 (UTC)
	(envelope-from nobody@FreeBSD.org)
Received: from www.freebsd.org (localhost [127.0.0.1])
	by www.freebsd.org (8.14.3/8.14.3) with ESMTP id n0E4NMlM015806
	for <freebsd-gnats-submit@FreeBSD.org>; Wed, 14 Jan 2009 04:23:22 GMT
	(envelope-from nobody@www.freebsd.org)
Received: (from nobody@localhost)
	by www.freebsd.org (8.14.3/8.14.3/Submit) id n0E4NMPV015805;
	Wed, 14 Jan 2009 04:23:22 GMT
	(envelope-from nobody)
Message-Id: <200901140423.n0E4NMPV015805@www.freebsd.org>
Date: Wed, 14 Jan 2009 04:23:22 GMT
From: Oleg Gawriloff <barzog@telecom.by>
To: freebsd-gnats-submit@FreeBSD.org
Subject: gjournal fsck during boot
X-Send-Pr-Version: www-3.1
X-GNATS-Notify:

>Number:         130528
>Category:       kern
>Synopsis:       gjournal fsck during boot
>Confidential:   no
>Severity:       non-critical
>Priority:       low
>Responsible:    freebsd-geom
>State:          closed
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Wed Jan 14 04:30:01 UTC 2009
>Closed-Date:    Mon Aug 10 13:14:52 UTC 2009
>Last-Modified:  Mon Aug 10 13:14:52 UTC 2009
>Originator:     Oleg Gawriloff
>Release:        7.1
>Organization:
Atlant Telecom
>Environment:
FreeBSD albatros2.telecom.by 7.1-RELEASE-p1 FreeBSD 7.1-RELEASE-p1 #0: Sat Jan 10 00:35:09 EET 2009     root@albatros2.telecom.by:/usr/obj/usr/src/sys/ALBATROS2  amd64
>Description:
On server we have 2 data providers. First which is mounted on / is gmirror. Second which is mounted on /mnt in gjournal. During power failure we have following situation (with background_fsck="NO" & fsck_y_enable="YES"):
System starting and detects consisten journal:
GEOM_JOURNAL: Journal 3800228672: da0 contains data.
GEOM_JOURNAL: Journal 3800228672: da0 contains journal.
GEOM_JOURNAL: Journal da0 clean.
Then it detects inconsistent gmirror:
Trying to mount root from ufs:/dev/mirror/gm0s1a
WARNING: / was not properly dismounted

Then it checks gmirror systems in automatic mode (fsck_y_enable):
Jan 14 04:37:52 albatros2 kernel: Starting file system checks:
Jan 14 04:37:52 albatros2 kernel: /dev/mirror/gm0s1a: 2202 files, 61779 used, 2476740 free (932 frags,
309476 blocks, 0.0% fragmentation)
Jan 14 04:37:52 albatros2 kernel: /dev/mirror/gm0s1d: 41 files, 621 used, 1012394 free (74 frags, 126540 blocks, 0.0% fragmentation)
Jan 14 04:37:52 albatros2 kernel: /dev/mirror/gm0s1e: 273770 files, 2521741 used, 7632458 free (114082 frags, 939797 blocks, 1.1% fragmentation)
Jan 14 04:37:52 albatros2 kernel: /dev/mirror/gm0s1f: 155596 files, 1427128 used, 21690718 free (17030 frags, 2709211 blocks, 0.1% fragmentation)

But when it comes to checking gjournal it need user intervention:
Jan 14 04:37:52 albatros2 kernel: Mounting local file systems:
Jan 14 04:37:52 albatros2 kernel: WARNING: R/W mount of /mnt/StorageB denied.  Filesystem is not clean - run fsck
Jan 14 04:37:52 albatros2 kernel: mount:
Jan 14 04:37:52 albatros2 kernel: /dev/da1.journal
Jan 14 04:37:52 albatros2 kernel: :
Jan 14 04:37:52 albatros2 kernel: Operation not permitted
Jan 14 04:37:52 albatros2 kernel: .
Jan 14 04:37:52 albatros2 kernel: Mounting /etc/fstab filesystems failed,  startup aborted
Jan 14 04:37:52 albatros2 kernel: ERROR: ABORTING BOOT (sending SIGTERM to parent)!
Jan 14 04:37:52 albatros2 kernel: Jan 14 06:18:06 init: /bin/sh on /etc/rc terminated abnormally, going to single user mode

fsck on gjournal never finds any problems (its 3 disk hardware RAID on disk-shelf): 
Jan 14 04:37:52 albatros2 kernel: ** /dev/da1.journal
Jan 14 04:37:52 albatros2 kernel: ** Last Mounted on /mnt/StorageB
Jan 14 04:37:52 albatros2 kernel: ** Phase 1 - Check Blocks and Sizes
Jan 14 04:37:52 albatros2 kernel: ** Phase 2 - Check Pathnames
Jan 14 04:37:52 albatros2 kernel: ** Phase 3 - Check Connectivity
Jan 14 04:37:52 albatros2 kernel: ** Phase 4 - Check Reference Counts
Jan 14 04:37:52 albatros2 kernel: ** Phase 5 - Check Cyl groups
Jan 14 04:37:52 albatros2 kernel: 232786 files, 392353426 used, 80122488 free (67704 frags, 10006848 blocks, 0.0% fragmentation)
Jan 14 04:37:52 albatros2 kernel:
Jan 14 04:37:52 albatros2 kernel: ***** FILE SYSTEM MARKED CLEAN *****
Jan 14 04:37:52 albatros2 kernel: #

Why? On the same systems without gjournal it checks all file systems withour user intervention.


>How-To-Repeat:

>Fix:


>Release-Note:
>Audit-Trail:
Responsible-Changed-From-To: freebsd-bugs->freebsd-geom 
Responsible-Changed-By: gavin 
Responsible-Changed-When: Fri Jan 16 09:26:06 UTC 2009 
Responsible-Changed-Why:  
Over to maintainer(s).  I don't know if this could be a simple config 
error, could you show us what your fstab and rc.conf look like? 


http://www.freebsd.org/cgi/query-pr.cgi?pr=130528 

From: Yoshihiro Ota <ota@j.email.ne.jp>
To: bug-followup@FreeBSD.org
Cc: barzog@telecom.by
Subject: Re: kern/130528: gjournal fsck during boot
Date: Thu, 19 Feb 2009 01:18:02 -0500

 Hi, Oleg.
 
 Can you run "cat /etc/fstab" and "tunefs -p /dev/da0.journal" to
 get more information?
 
 I think I had similar issues like this due to inappropriate fstab entry.
 
 Thanks,
 Hiro

From: Oleg Gawriloff <barzog@telecom.by>
To: bug-followup@FreeBSD.org, ota@j.email.ne.jp
Cc:  
Subject: Re: kern/130528: gjournal fsck during boot
Date: Thu, 19 Feb 2009 09:50:13 +0200

 This is a cryptographically signed message in MIME format.
 
 --------------ms070400070203000509010903
 Content-Type: text/plain; charset=UTF-8; format=flowed
 Content-Transfer-Encoding: 7bit
 
 [barzog@albatros2 ~]$ cat /etc/fstab
 # Device                Mountpoint      FStype  Options         Dump    
 Pass#
 /dev/mirror/gm0s1b              none            swap    sw              
 0       0
 /dev/mirror/gm0s1a              /               ufs     rw              
 1       1
 /dev/mirror/gm0s1d              /tmp            ufs     rw              
 2       2
 /dev/mirror/gm0s1e              /usr            ufs     rw              
 2       2
 /dev/mirror/gm0s1f              /var            ufs     rw              
 2       2
 /dev/da0.journal                /mnt/StorageA   ufs     rw,async        
 0       0
 /dev/da1.journal                /mnt/StorageB   ufs     rw,async        
 0       0
 
 /dev/acd0               /cdrom          cd9660  ro,noauto       0       0
 
 martin:/usr/ports       /usr/ports              nfs     rw,noauto       
 0       0
 172.16.2.1:/var/tmp/backup2     /mnt/backup2    nfs     rw,noauto       
 0       0
 
 [barzog@albatros2 ~]$ sudo tunefs -p /dev/da0.journal
 tunefs: ACLs: (-a)                                         disabled
 tunefs: MAC multilabel: (-l)                               disabled
 tunefs: soft updates: (-n)                                 disabled
 tunefs: gjournal: (-J)                                     enabled
 tunefs: maximum blocks per file in a cylinder group: (-e)  2048
 tunefs: average file size: (-f)                            16384
 tunefs: average number of files in a directory: (-s)       64
 tunefs: minimum percentage of free space: (-m)             8%
 tunefs: optimization preference: (-o)                      time
 tunefs: volume label: (-L)
 
 [barzog@albatros2 ~]$ sudo tunefs -p /dev/da1.journal
 tunefs: ACLs: (-a)                                         disabled
 tunefs: MAC multilabel: (-l)                               disabled
 tunefs: soft updates: (-n)                                 disabled
 tunefs: gjournal: (-J)                                     enabled
 tunefs: maximum blocks per file in a cylinder group: (-e)  2048
 tunefs: average file size: (-f)                            16384
 tunefs: average number of files in a directory: (-s)       64
 tunefs: minimum percentage of free space: (-m)             8%
 tunefs: optimization preference: (-o)                      time
 tunefs: volume label: (-L)
 
 
 --------------ms070400070203000509010903
 Content-Type: application/x-pkcs7-signature; name="smime.p7s"
 Content-Transfer-Encoding: base64
 Content-Disposition: attachment; filename="smime.p7s"
 Content-Description: S/MIME Cryptographic Signature
 
 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIHtDCC
 A9YwggM/oAMCAQICAgJSMA0GCSqGSIb3DQEBBAUAMIGYMQswCQYDVQQGEwJCWTEQMA4GA1UE
 CBMHQmVsYXJ1czEOMAwGA1UEBxMFTWluc2sxFzAVBgNVBAoTDkF0bGFudC1UZWxlY29tMRcw
 FQYDVQQLEw5BdGxhbnQtVGVsZWNvbTETMBEGA1UEAxMKdGVsZWNvbS5ieTEgMB4GCSqGSIb3
 DQEJARYRYmFyem9nQHRlbGVjb20uYnkwHhcNMDgwNzMwMTIxMjQzWhcNMDkwNzMwMTIxMjQz
 WjCBnzELMAkGA1UEBhMCQlkxEDAOBgNVBAgTB0JlbGFydXMxDjAMBgNVBAcTBU1pbnNrMRcw
 FQYDVQQKEw5BdGxhbnQtVGVsZWNvbTEXMBUGA1UECxMOQXRsYW50LVRlbGVjb20xGjAYBgNV
 BAMUEWJhcnpvZ0B0ZWxlY29tLmJ5MSAwHgYJKoZIhvcNAQkBFhFiYXJ6b2dAdGVsZWNvbS5i
 eTCBnzANBgkqhkiG9w0BAQEFAAOBjQAwgYkCgYEAuFEB0E3OhT/9NkCYZLGgM3PQfiJfTO2b
 kLfqnAneaC1+/U9WY9c5dleB3KpMxAl/Y9HWo3ClaVZ2Z56V3nj0f9KUTd1Up9G5LgGvP8VJ
 s5NLiiRqJ9isPx44yEuHTwEhGl/zotlTD0rRLVHfqof1cqDe3TobsaevJv0uX1MORRUCAwEA
 AaOCASQwggEgMAkGA1UdEwQCMAAwLAYJYIZIAYb4QgENBB8WHU9wZW5TU0wgR2VuZXJhdGVk
 IENlcnRpZmljYXRlMB0GA1UdDgQWBBSGPX6kqHA5V5oSbuhmF4Nzx9GNjjCBxQYDVR0jBIG9
 MIG6gBQ1Q0N4+R+9Wg0AAlfWqtErWCUf9aGBnqSBmzCBmDELMAkGA1UEBhMCQlkxEDAOBgNV
 BAgTB0JlbGFydXMxDjAMBgNVBAcTBU1pbnNrMRcwFQYDVQQKEw5BdGxhbnQtVGVsZWNvbTEX
 MBUGA1UECxMOQXRsYW50LVRlbGVjb20xEzARBgNVBAMTCnRlbGVjb20uYnkxIDAeBgkqhkiG
 9w0BCQEWEWJhcnpvZ0B0ZWxlY29tLmJ5ggEAMA0GCSqGSIb3DQEBBAUAA4GBACyUjVy0C0C7
 6Wt9w5dAfxLtFXLPIn+dxRWK0r6G/F4a7mLmSHy2fDzn/PSNEDLh+KUpNQNfvXwVdY3ftLVS
 L6gkSNNnbgkiXH2MxlvGHFH+NWbLkNE+t16/OUSIh2iRu1paEKZPtA7f6VviSZ10dTsuKszC
 a85hdq+9cP8Ph3EuMIID1jCCAz+gAwIBAgICAlIwDQYJKoZIhvcNAQEEBQAwgZgxCzAJBgNV
 BAYTAkJZMRAwDgYDVQQIEwdCZWxhcnVzMQ4wDAYDVQQHEwVNaW5zazEXMBUGA1UEChMOQXRs
 YW50LVRlbGVjb20xFzAVBgNVBAsTDkF0bGFudC1UZWxlY29tMRMwEQYDVQQDEwp0ZWxlY29t
 LmJ5MSAwHgYJKoZIhvcNAQkBFhFiYXJ6b2dAdGVsZWNvbS5ieTAeFw0wODA3MzAxMjEyNDNa
 Fw0wOTA3MzAxMjEyNDNaMIGfMQswCQYDVQQGEwJCWTEQMA4GA1UECBMHQmVsYXJ1czEOMAwG
 A1UEBxMFTWluc2sxFzAVBgNVBAoTDkF0bGFudC1UZWxlY29tMRcwFQYDVQQLEw5BdGxhbnQt
 VGVsZWNvbTEaMBgGA1UEAxQRYmFyem9nQHRlbGVjb20uYnkxIDAeBgkqhkiG9w0BCQEWEWJh
 cnpvZ0B0ZWxlY29tLmJ5MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQC4UQHQTc6FP/02
 QJhksaAzc9B+Il9M7ZuQt+qcCd5oLX79T1Zj1zl2V4HcqkzECX9j0dajcKVpVnZnnpXeePR/
 0pRN3VSn0bkuAa8/xUmzk0uKJGon2Kw/HjjIS4dPASEaX/Oi2VMPStEtUd+qh/VyoN7dOhux
 p68m/S5fUw5FFQIDAQABo4IBJDCCASAwCQYDVR0TBAIwADAsBglghkgBhvhCAQ0EHxYdT3Bl
 blNTTCBHZW5lcmF0ZWQgQ2VydGlmaWNhdGUwHQYDVR0OBBYEFIY9fqSocDlXmhJu6GYXg3PH
 0Y2OMIHFBgNVHSMEgb0wgbqAFDVDQ3j5H71aDQACV9aq0StYJR/1oYGepIGbMIGYMQswCQYD
 VQQGEwJCWTEQMA4GA1UECBMHQmVsYXJ1czEOMAwGA1UEBxMFTWluc2sxFzAVBgNVBAoTDkF0
 bGFudC1UZWxlY29tMRcwFQYDVQQLEw5BdGxhbnQtVGVsZWNvbTETMBEGA1UEAxMKdGVsZWNv
 bS5ieTEgMB4GCSqGSIb3DQEJARYRYmFyem9nQHRlbGVjb20uYnmCAQAwDQYJKoZIhvcNAQEE
 BQADgYEALJSNXLQLQLvpa33Dl0B/Eu0Vcs8if53FFYrSvob8XhruYuZIfLZ8POf89I0QMuH4
 pSk1A1+9fBV1jd+0tVIvqCRI02duCSJcfYzGW8YcUf41ZsuQ0T63Xr85RIiHaJG7WloQpk+0
 Dt/pW+JJnXR1Oy4qzMJrzmF2r71w/w+HcS4xggNjMIIDXwIBATCBnzCBmDELMAkGA1UEBhMC
 QlkxEDAOBgNVBAgTB0JlbGFydXMxDjAMBgNVBAcTBU1pbnNrMRcwFQYDVQQKEw5BdGxhbnQt
 VGVsZWNvbTEXMBUGA1UECxMOQXRsYW50LVRlbGVjb20xEzARBgNVBAMTCnRlbGVjb20uYnkx
 IDAeBgkqhkiG9w0BCQEWEWJhcnpvZ0B0ZWxlY29tLmJ5AgICUjAJBgUrDgMCGgUAoIICGTAY
 BgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcBMBwGCSqGSIb3DQEJBTEPFw0wOTAyMTkwNzUwMTNa
 MCMGCSqGSIb3DQEJBDEWBBQ9krIA8stZsySWj9jzaawBn6XxETBSBgkqhkiG9w0BCQ8xRTBD
 MAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIAgDANBggqhkiG9w0DAgIBQDAHBgUrDgMCBzAN
 BggqhkiG9w0DAgIBKDCBsAYJKwYBBAGCNxAEMYGiMIGfMIGYMQswCQYDVQQGEwJCWTEQMA4G
 A1UECBMHQmVsYXJ1czEOMAwGA1UEBxMFTWluc2sxFzAVBgNVBAoTDkF0bGFudC1UZWxlY29t
 MRcwFQYDVQQLEw5BdGxhbnQtVGVsZWNvbTETMBEGA1UEAxMKdGVsZWNvbS5ieTEgMB4GCSqG
 SIb3DQEJARYRYmFyem9nQHRlbGVjb20uYnkCAgJSMIGyBgsqhkiG9w0BCRACCzGBoqCBnzCB
 mDELMAkGA1UEBhMCQlkxEDAOBgNVBAgTB0JlbGFydXMxDjAMBgNVBAcTBU1pbnNrMRcwFQYD
 VQQKEw5BdGxhbnQtVGVsZWNvbTEXMBUGA1UECxMOQXRsYW50LVRlbGVjb20xEzARBgNVBAMT
 CnRlbGVjb20uYnkxIDAeBgkqhkiG9w0BCQEWEWJhcnpvZ0B0ZWxlY29tLmJ5AgICUjANBgkq
 hkiG9w0BAQEFAASBgLYZJ7X0bZ6fJj2/L6MDv6l2SaunuM4dlLJfeaQ/ul89uavMToeQQb3X
 dkcTLxMvAkdvO+qXExXXsCAETqq5Dc4dC1LDmMdZYCey4gYSEg+9Mg1ZiPpRIwe7rvPm+/V9
 tTs69Y5Rw5TfSeS+s0TD+XdN2yu6zKsiyhqGvjnlWrMkAAAAAAAA
 --------------ms070400070203000509010903--

From: Yoshihiro Ota <ota@j.email.ne.jp>
To: bug-followup@FreeBSD.org
Cc: barzog@telecom.by
Subject: Re: kern/130528: gjournal fsck during boot
Date: Thu, 19 Feb 2009 22:46:37 -0500

 Hi, Oleg.
 
 Pass# being set to 0 is the cause of the problem.
 Set them to 2 and try.
 
 /dev/da0.journal                /mnt/StorageA   ufs     rw,async        
 0       =>0<=
 /dev/da1.journal                /mnt/StorageB   ufs     rw,async        
 0       =>0<=
 
 Even with journaled-fs, fs needs to be verified that if it is clean,
 or if is consistent in case of crash.  Setting them to 2 will enable
 this.
 
 Check this one first; this explains what is going on very well:
 http://docs.freebsd.org/cgi/getmsg.cgi?fetch=59690+0+archive/2008/freebsd-geom/20080831.freebsd-geom
 
 Then, related posts in the following page.
 http://docs.freebsd.org/mail/archive/2008/freebsd-geom/20080831.freebsd-geom.html
 
 I think these will help you to understand gjournal.
 
 Regards,
 Hiro
State-Changed-From-To: open->closed 
State-Changed-By: pjd 
State-Changed-When: pon 10 sie 2009 13:14:21 UTC 
State-Changed-Why:  
As stated by Yoshihiro Ota, this is configuration error, not a bug. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=130528 
>Unformatted:
