Date: Fri, 21 Jul 2006 17:15:52 +0400 From: Anton Nikiforov <anton@nikiforov.ru> To: freebsd-stable@freebsd.org Subject: gmirror problems Message-ID: <44C0D388.3040205@nikiforov.ru>
next in thread | raw e-mail | index | archive | help
This is a cryptographically signed message in MIME format.
--------------ms030309030809070603000709
Content-Type: text/plain; charset=KOI8-R; format=flowed
Content-Transfer-Encoding: 7bit
Dear All,
I have the following gmirror configuration:
server1
ggated
ggatec create -u 10 -o rw 192.168.100.110 /dev/da1s1d
gmirror label -v -b split -s 2048 geom1 /dev/da1s1d /dev/ggate10d
ggatec create -u 11 -o rw 192.168.100.110 /dev/da1s1e
gmirror label -v -b split -s 2048 geom2 /dev/da1s1e /dev/ggate11
ggatec create -u 12 -o rw 192.168.100.110 /dev/da1s1f
gmirror label -v -b split -s 2048 geom3 /dev/da1s1f /dev/ggate12
ggatec create -u 13 -o rw 192.168.100.110 /dev/da1s1g
gmirror label -v -b split -s 2048 geom4 /dev/da1s1g /dev/ggate13
ggatec create -u 14 -o rw 192.168.100.110 /dev/da1s1h
gmirror label -v -b split -s 2048 geom5 /dev/da1s1h /dev/ggate14
server 2
ggated
When I'm starting from scratch. (currently by manually running all
commands/daemons)
Everything is fine, until I'm trying to mount gmirrored device from
server2. What I'm doing listed below
1. Unmounting all file systems
2. stooping all devices (all, but i need only one to start it on another
host)
3. stopping daemons
4. Starting daemon on server1
5. Trying to create ggatec device on server2 with the same command, but
with IP of server1
getting error: ggatec: ggatec: ioctl(/dev/ggctl): Invalid argument.
ggatec: Exiting.
6. looking into gmirror status device list i have all devices in
DEGRADED state on server 2 (there was no devices in the list while
everything was up)
7. longing into gmirror status device list i have all devices in
COMPLETE state and next time gmirror hangs forever.
Could you please help me or direct to the right manual?
I have found a lot of sources of how to setup (and I'm done with this). But what should i do with failure? How to mount disk on another node or start it after failure?
And one more question: is there any way to get gmirror to re mirror devices before carp interfaces become up? I want to get data mirrored before moving services from backup firewall to main one (in case main was failed)
And one more thing..... after some manipulations with gmirror devices i have server crushed while booting kernel. At the moment it initialize GEOM_MIRROR device - kernel panics.
When i remove the disk that was containing gmirror devices - server just booted normally. But insertion of that disk back and running camcontol rescan all - bring it back to panic... so, i cannot use this disk anymore (i know, that i can rewrite it's last sector on machine without GEOM compiled into the kernel)
--
Best regards,
Anton Nikiforov
--------------ms030309030809070603000709
Content-Type: application/x-pkcs7-signature; name="smime.p7s"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="smime.p7s"
Content-Description: S/MIME Cryptographic Signature
MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIJBzCC
At4wggJHoAMCAQICED5iPRHTm8oxoqEN/9ixjGgwDQYJKoZIhvcNAQEFBQAwYjELMAkGA1UE
BhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMT
I1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMB4XDTA2MDcyMDA1NTEzM1oX
DTA3MDcyMDA1NTEzM1owRDEfMB0GA1UEAxMWVGhhd3RlIEZyZWVtYWlsIE1lbWJlcjEhMB8G
CSqGSIb3DQEJARYSYW50b25AbmlraWZvcm92LnJ1MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8A
MIIBCgKCAQEAzi4dy65s7w6qdSSOecwDqfaU2CVDXGShsD4l89gadJAiIWSSH7kjo8wJIJEK
WGRsPfM8zJk5V7EBxNFM3X89g3phBbA+sLYc4+dRJoLLPLAKgsDUWQ3iXUvihNYLwnaLBCiZ
1of+AVIdlZ0A/XN5ZWX9iHqkwFTxfOXG5LGSlBMgeWQQXwz9aDhlSPfgnhjSAMKNI+XxFV/a
sVAGfv3YUNDqwRno4HQI7YcSHJh3ozA+m8sWLm5mW8D2wKb0XGKD8Ldm1Mz4sH/mAj+PvsSi
bryaq/Se3XuOnvO5IhZGUcLMqfW+bpzgyUsjBPGkKbyOs9ujQZUoFXS71ozQ3sDRaQIDAQAB
oy8wLTAdBgNVHREEFjAUgRJhbnRvbkBuaWtpZm9yb3YucnUwDAYDVR0TAQH/BAIwADANBgkq
hkiG9w0BAQUFAAOBgQCTvdT0nAzuDCmAa37GaUKw41Ywlp2yxc4wN9g2/CXut9140xMZTfCm
Hzsks7pGVZUiGzfZrXx2byVW3uA4r/LFPcGv19dWVx/j3OHBGagfFDVtSkfC/vdGiCG6/Kh/
3o/0Jf+0TOzBiQv1FznkVN6StXOs7dIQ8ZZIspbcuJzhhTCCAt4wggJHoAMCAQICED5iPRHT
m8oxoqEN/9ixjGgwDQYJKoZIhvcNAQEFBQAwYjELMAkGA1UEBhMCWkExJTAjBgNVBAoTHFRo
YXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQZXJzb25hbCBG
cmVlbWFpbCBJc3N1aW5nIENBMB4XDTA2MDcyMDA1NTEzM1oXDTA3MDcyMDA1NTEzM1owRDEf
MB0GA1UEAxMWVGhhd3RlIEZyZWVtYWlsIE1lbWJlcjEhMB8GCSqGSIb3DQEJARYSYW50b25A
bmlraWZvcm92LnJ1MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAzi4dy65s7w6q
dSSOecwDqfaU2CVDXGShsD4l89gadJAiIWSSH7kjo8wJIJEKWGRsPfM8zJk5V7EBxNFM3X89
g3phBbA+sLYc4+dRJoLLPLAKgsDUWQ3iXUvihNYLwnaLBCiZ1of+AVIdlZ0A/XN5ZWX9iHqk
wFTxfOXG5LGSlBMgeWQQXwz9aDhlSPfgnhjSAMKNI+XxFV/asVAGfv3YUNDqwRno4HQI7YcS
HJh3ozA+m8sWLm5mW8D2wKb0XGKD8Ldm1Mz4sH/mAj+PvsSibryaq/Se3XuOnvO5IhZGUcLM
qfW+bpzgyUsjBPGkKbyOs9ujQZUoFXS71ozQ3sDRaQIDAQABoy8wLTAdBgNVHREEFjAUgRJh
bnRvbkBuaWtpZm9yb3YucnUwDAYDVR0TAQH/BAIwADANBgkqhkiG9w0BAQUFAAOBgQCTvdT0
nAzuDCmAa37GaUKw41Ywlp2yxc4wN9g2/CXut9140xMZTfCmHzsks7pGVZUiGzfZrXx2byVW
3uA4r/LFPcGv19dWVx/j3OHBGagfFDVtSkfC/vdGiCG6/Kh/3o/0Jf+0TOzBiQv1FznkVN6S
tXOs7dIQ8ZZIspbcuJzhhTCCAz8wggKooAMCAQICAQ0wDQYJKoZIhvcNAQEFBQAwgdExCzAJ
BgNVBAYTAlpBMRUwEwYDVQQIEwxXZXN0ZXJuIENhcGUxEjAQBgNVBAcTCUNhcGUgVG93bjEa
MBgGA1UEChMRVGhhd3RlIENvbnN1bHRpbmcxKDAmBgNVBAsTH0NlcnRpZmljYXRpb24gU2Vy
dmljZXMgRGl2aXNpb24xJDAiBgNVBAMTG1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBDQTEr
MCkGCSqGSIb3DQEJARYccGVyc29uYWwtZnJlZW1haWxAdGhhd3RlLmNvbTAeFw0wMzA3MTcw
MDAwMDBaFw0xMzA3MTYyMzU5NTlaMGIxCzAJBgNVBAYTAlpBMSUwIwYDVQQKExxUaGF3dGUg
Q29uc3VsdGluZyAoUHR5KSBMdGQuMSwwKgYDVQQDEyNUaGF3dGUgUGVyc29uYWwgRnJlZW1h
aWwgSXNzdWluZyBDQTCBnzANBgkqhkiG9w0BAQEFAAOBjQAwgYkCgYEAxKY8VXNV+065ypla
HmjAdQRwnd/p/6Me7L3N9VvyGna9fww6YfK/Uc4B1OVQCjDXAmNaLIkVcI7dyfArhVqqP3FW
y688Cwfn8R+RNiQqE88r1fOCdz0Dviv+uxg+B79AgAJk16emu59l0cUqVIUPSAR/p7bRPGEE
QB5kGXJgt/sCAwEAAaOBlDCBkTASBgNVHRMBAf8ECDAGAQH/AgEAMEMGA1UdHwQ8MDowOKA2
oDSGMmh0dHA6Ly9jcmwudGhhd3RlLmNvbS9UaGF3dGVQZXJzb25hbEZyZWVtYWlsQ0EuY3Js
MAsGA1UdDwQEAwIBBjApBgNVHREEIjAgpB4wHDEaMBgGA1UEAxMRUHJpdmF0ZUxhYmVsMi0x
MzgwDQYJKoZIhvcNAQEFBQADgYEASIzRUIPqCy7MDaNmrGcPf6+svsIXoUOWlJ1/TCG4+DYf
qi2fNi/A9BxQIJNwPP2t4WFiw9k6GX6EsZkbAMUaC4J0niVQlGLH2ydxVyWN3amcOY6MIE9l
X5Xa9/eH1sYITq726jTlEBpbNU1341YheILcIRk13iSx0x1G/11fZU8xggNkMIIDYAIBATB2
MGIxCzAJBgNVBAYTAlpBMSUwIwYDVQQKExxUaGF3dGUgQ29uc3VsdGluZyAoUHR5KSBMdGQu
MSwwKgYDVQQDEyNUaGF3dGUgUGVyc29uYWwgRnJlZW1haWwgSXNzdWluZyBDQQIQPmI9EdOb
yjGioQ3/2LGMaDAJBgUrDgMCGgUAoIIBwzAYBgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcBMBwG
CSqGSIb3DQEJBTEPFw0wNjA3MjExMzE1NTJaMCMGCSqGSIb3DQEJBDEWBBT9sSmXVTiPPhMl
1ITf6kNGg5slFzBSBgkqhkiG9w0BCQ8xRTBDMAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIA
gDANBggqhkiG9w0DAgIBQDAHBgUrDgMCBzANBggqhkiG9w0DAgIBKDCBhQYJKwYBBAGCNxAE
MXgwdjBiMQswCQYDVQQGEwJaQTElMCMGA1UEChMcVGhhd3RlIENvbnN1bHRpbmcgKFB0eSkg
THRkLjEsMCoGA1UEAxMjVGhhd3RlIFBlcnNvbmFsIEZyZWVtYWlsIElzc3VpbmcgQ0ECED5i
PRHTm8oxoqEN/9ixjGgwgYcGCyqGSIb3DQEJEAILMXigdjBiMQswCQYDVQQGEwJaQTElMCMG
A1UEChMcVGhhd3RlIENvbnN1bHRpbmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3RlIFBl
cnNvbmFsIEZyZWVtYWlsIElzc3VpbmcgQ0ECED5iPRHTm8oxoqEN/9ixjGgwDQYJKoZIhvcN
AQEBBQAEggEAFRrKyB8HDvI8fzlUlfCwBqZ5ZC+JqDk5jQfLXhfDvvSLUfGWxJglZx2YSr6O
TbseMVMe0gkCiSCgH0tv52BEKpqe9Z+JBJZRBW8LIhqM5EE06RHmcUO2xrDl8hz7VRA4bj5k
Ot2dEUo3k1cIz4Hrx1crt+FGjNoyKMCM4jRvN0r+IqGxfoxwAzgDsViPmBeVle0YS6kFOExa
zn9k3FrmCH4dndglECxnC/y+RQUu2jjh9nNga4bxwPPgTGA8+DxdJxpysw6mOqyUOBLywOYt
teDZ/DUNdBfkOkO1K/F2ESIvywLieE7td5xx4UeUv9+WJHzrIlasdM7XBBVoKfoE8AAAAAAA
AA==
--------------ms030309030809070603000709--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?44C0D388.3040205>