Date: Thu, 08 Sep 2016 17:42:06 +0000 From: bugzilla-noreply@freebsd.org To: freebsd-bugs@FreeBSD.org Subject: [Bug 211964] CTL HA interconnect issue - unknown oid 'kern.cam.ctl.ha_peer' Message-ID: <bug-211964-8-sW1oBl4NYc@https.bugs.freebsd.org/bugzilla/> In-Reply-To: <bug-211964-8@https.bugs.freebsd.org/bugzilla/> References: <bug-211964-8@https.bugs.freebsd.org/bugzilla/>
next in thread | previous in thread | raw e-mail | index | archive | help
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D211964 James StewartNewman <james.stewartnewman@sas.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|New |Closed --- Comment #1 from James StewartNewman <james.stewartnewman@sas.com> --- ok after applying r304737 and editing the /boot/loader.conf and /etc/sysctl.conf I now get the cluster interconnect connection to establish=20 Server 1 config (Primary Node)=20 # cat /boot/loader.conf geom_mirror_load=3D"YES" geom_label_load=3D"YES" hw.memtest.tests=3D0 geom_multipath_load=3D"YES" kern.geom.label.disk_ident.enable=3D0 kern.cam.ctl.ha_id=3D1 kern.cam.ctl.ha_mode=3D2 # cat /etc/sysctl.conf # $FreeBSD: releng/10.3/etc/sysctl.conf 112200 2003-03-13 18:43:50Z mux $ kern.cam.ctl.debug=3D2 kern.cam.ctl.ha_peer=3D"connect 172.16.1.3:7940" #directly connected cable = no switch between the nodes=20 kern.cam.ctl.ha_role=3D0 # 0 is primary; 1 is secondary # sysctl -a | grep ctl.ha kern.cam.ctl.ha_peer: connect 172.16.1.3:7940 kern.cam.ctl.ha_role: 0 kern.cam.ctl.ha_link: 2 kern.cam.ctl.ha_id: 1 kern.cam.ctl.ha_mode: 2 Server 2 config (Secondary Node)=20 # cat /boot/loader.conf geom_mirror_load=3D"YES" geom_label_load=3D"YES" kern.geom.label.disk_ident.enable=3D0 hw.memtest.tests=3D0 geom_multipath_load=3D"YES" kern.cam.ctl.ha_id=3D2 kern.cam.ctl.ha_mode=3D2 # cat /etc/sysctl.conf kern.cam.ctl.debug=3D2 kern.cam.ctl.ha_peer=3D"listen 172.16.1.3:7940" kern.cam.ctl.ha_role=3D1 # 0 is primary; 1 is secondary # sysctl -a | grep ctl.ha kern.cam.ctl.ha_peer: listen 172.16.1.3:7940 kern.cam.ctl.ha_role: 1 kern.cam.ctl.ha_link: 2 kern.cam.ctl.ha_id: 2 kern.cam.ctl.ha_mode: 2 So its connection is established in active/active proxy mode=20 (netstat -a on both nodes also shows established connections)=20 Server 1=20 ctladm shows the ha ports=20 # ctladm portlist Port Online Frontend Name pp vp 0 YES tpc tpc 0 0 1 NO camsim camsim 0 0 naa.5000000acfe0eb02 2 YES ioctl ioctl 0 0 3 YES camtgt isp0 0 0 naa.2100000e1ecb9ed0 4 YES camtgt isp1 0 0 naa.2100000e1ecb9ed1 5 YES camtgt isp2 0 0 naa.2100000e1ecbafc0 6 YES camtgt isp3 0 0 naa.2100000e1ecbafc1 128 YES ha 2:tpc 0 0 129 YES ha 2:camsim 0 0 naa.5000000acfe0eb82 130 YES ha 2:ioctl 0 0 131 YES ha 2:isp0 0 0 naa.2100000e1ecb99b0 132 YES ha 2:isp1 0 0 naa.2100000e1ecb99b1 133 YES ha 2:isp2 0 0 naa.2100000e1ecbad40 134 YES ha 2:isp3 0 0 naa.2100000e1ecbad41 ctladm shows the initiatiors are logging into the ports on the other node=20 # ctladm portlist -i Port Online Frontend Name pp vp 0 YES tpc tpc 0 0 1 NO camsim camsim 0 0 naa.5000000acfe0eb02 Target: naa.5000000acfe0eb00 2 YES ioctl ioctl 0 0 3 YES camtgt isp0 0 0 naa.2100000e1ecb9ed0 Target: naa.2000000e1ecbafc1 Initiator 1: naa.10000090faa9eb37 4 YES camtgt isp1 0 0 naa.2100000e1ecb9ed1 Target: naa.2000000e1ecbafc1 Initiator 1: naa.10000090faa9e93b 5 YES camtgt isp2 0 0 naa.2100000e1ecbafc0 Target: naa.2000000e1ecbafc1 Initiator 1: naa.10000090faa9eb37 6 YES camtgt isp3 0 0 naa.2100000e1ecbafc1 Target: naa.2000000e1ecbafc1 Initiator 1: naa.10000090faa9e93b 128 YES ha 2:tpc 0 0 129 YES ha 2:camsim 0 0 naa.5000000acfe0eb82 Target: naa.5000000acfe0eb00 130 YES ha 2:ioctl 0 0 131 YES ha 2:isp0 0 0 naa.2100000e1ecb99b0 Target: naa.2000000e1ecb99b0 Initiator 1: naa.10000090faa9eb37 132 YES ha 2:isp1 0 0 naa.2100000e1ecb99b1 Target: naa.2000000e1ecb99b1 Initiator 1: naa.10000090faa9e93b 133 YES ha 2:isp2 0 0 naa.2100000e1ecbad40 Target: naa.2000000e1ecbad40 Initiator 1: naa.10000090faa9eb37 134 YES ha 2:isp3 0 0 naa.2100000e1ecbad41 Target: naa.2000000e1ecbad41 Initiator 1: naa.10000090faa9e93b # ctladm portlist -l Port Online Frontend Name pp vp 0 YES tpc tpc 0 0 All LUNs mapped 1 NO camsim camsim 0 0 naa.5000000acfe0eb02 All LUNs mapped 2 YES ioctl ioctl 0 0 All LUNs mapped 3 YES camtgt isp0 0 0 naa.2100000e1ecb9ed0 LUN 0: 0 LUN 1: 1 LUN 2: 2 LUN 3: 3 4 YES camtgt isp1 0 0 naa.2100000e1ecb9ed1 LUN 0: 0 LUN 1: 1 LUN 2: 2 LUN 3: 3 5 YES camtgt isp2 0 0 naa.2100000e1ecbafc0 LUN 0: 0 LUN 1: 1 LUN 2: 2 LUN 3: 3 6 YES camtgt isp3 0 0 naa.2100000e1ecbafc1 LUN 0: 0 LUN 1: 1 LUN 2: 2 LUN 3: 3 128 YES ha 2:tpc 0 0 All LUNs mapped 129 YES ha 2:camsim 0 0 naa.5000000acfe0eb82 All LUNs mapped 130 YES ha 2:ioctl 0 0 All LUNs mapped 131 YES ha 2:isp0 0 0 naa.2100000e1ecb99b0 All LUNs mapped 132 YES ha 2:isp1 0 0 naa.2100000e1ecb99b1 All LUNs mapped 133 YES ha 2:isp2 0 0 naa.2100000e1ecbad40 All LUNs mapped 134 YES ha 2:isp3 0 0 naa.2100000e1ecbad41 All LUNs mapped So everything looks good ... but when I unplug the SAN connections on the primary node server 1 What I expect to happen is that it will continue to function by its connections to the secondary server and data move across the cluster interconnect. What happens is that the client server loses all connectivity to the LUNS. Tried this with same results on my FreeBSD array = that uses iSCSI as well.=20 Ideas? --=20 You are receiving this mail because: You are the assignee for the bug.=
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?bug-211964-8-sW1oBl4NYc>