From owner-freebsd-scsi@FreeBSD.ORG Tue Feb 16 10:02:58 2010 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 58229106566B for ; Tue, 16 Feb 2010 10:02:58 +0000 (UTC) (envelope-from osharoiko@gmail.com) Received: from ey-out-2122.google.com (ey-out-2122.google.com [74.125.78.26]) by mx1.freebsd.org (Postfix) with ESMTP id B69ED8FC13 for ; Tue, 16 Feb 2010 10:02:57 +0000 (UTC) Received: by ey-out-2122.google.com with SMTP id 9so730726eyd.9 for ; Tue, 16 Feb 2010 02:02:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:subject:from:to:content-type :date:message-id:mime-version:x-mailer:content-transfer-encoding; bh=Ainzcc6JLQBH+3gCC5vVsbc5GFblWncUAzgBo4B5IZ0=; b=i5IAOk6N4t5SaZLDrxIVC9eQwNTe1VH+R6cYC6ez5CtFyrp4d4sc5MVJeN6+/G0+Zn 5gMHa4lDsh8NzKKjGk6q//6e7nIvhnNAuf1yEX4cfVSpXdHom1B9EGPDzfq5943FQ9lb tVIcJRQ9kyQZ0KtuK9ykKSZyIIGyAAREI4Ogs= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=subject:from:to:content-type:date:message-id:mime-version:x-mailer :content-transfer-encoding; b=i+WgAoGRExWPSBCtAOUnQFNHaqeUCTDZPI46E6tOE7KPcLKUkmwyuCEqtEgBWiFfWt Y2XYphjAFEpu3huE5dAUX61pW9YZBIbJmUFr2rGIo7H9XFOAukyaqcjVdq+7px6bX33o Y9s4ubcQHVBr7YAcheruP3g+TWyCjW+tekJPA= Received: by 10.213.0.212 with SMTP id 20mr3861804ebc.41.1266314576487; Tue, 16 Feb 2010 02:02:56 -0800 (PST) Received: from ?195.208.252.154? (brain.cc.rsu.ru [195.208.252.154]) by mx.google.com with ESMTPS id 5sm10505207eyf.0.2010.02.16.02.02.55 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 16 Feb 2010 02:02:55 -0800 (PST) From: Oleg Sharoyko To: freebsd-scsi@freebsd.org, freebsd-hackers@freebsd.org Content-Type: text/plain; charset="UTF-8" Date: Tue, 16 Feb 2010 13:02:50 +0300 Message-ID: <1266314570.73716.42.camel@brain.cc.rsu.ru> Mime-Version: 1.0 X-Mailer: Evolution 2.28.2 FreeBSD GNOME Team Port Content-Transfer-Encoding: 7bit Cc: Subject: Qlogic (isp) cannot login into fabric after link loss X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Feb 2010 10:02:58 -0000 Hi! I'm sorry for cross-posting, but I'm in trouble with isp driver and I really need your help. Here we have IBM blade with Qlogic (seems to be 2462s card) and EMC CX3-40 both connected to Brocade DS4900. Everything seems to be ok, until FC link between switch and server fails. When it later restores isp cannot anymore log into fabric. I have a complete debug log of isp output. Here is small excerpt from it which I think is relevant to my problem: isp0: Chan 0 got 3 ports back from name server isp0: Chan 0 skip ourselves on @ PortID 0x011500 isp0: Chan 0 Checking Fabric Port 0x010e00 isp0: IN mbox 0 = 0x0064 isp0: IN mbox 1 = 0x0003 isp0: IN mbox 2 = 0x05e8 isp0: IN mbox 3 = 0xd000 isp0: IN mbox 6 = 0x0000 isp0: IN mbox 7 = 0x0000 isp0: IN mbox 9 = 0x0000 isp0: IN mbox 10 = 0x0000 isp0: RISC2HOST ISR 0x40000010 isp0: RISC2HOST ISR 0x40068011 isp0: OUT mbox 0 = 0x4006 isp0: IOCB LOGX: isp0: 0x00000000: 52 01 00 00 ff ff ff ff 00 00 03 00 00 00 00 00 isp0: 0x00000010: 00 0e 01 00 00 00 00 00 00 00 00 00 00 00 00 00 isp0: 0x00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 isp0: 0x00000030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 isp0: IN mbox 0 = 0x0054 isp0: IN mbox 1 = 0x0040 isp0: IN mbox 2 = 0x05e8 isp0: IN mbox 3 = 0xd000 isp0: IN mbox 6 = 0x0000 isp0: IN mbox 7 = 0x0000 isp0: RISC2HOST ISR 0x40060011 isp0: RISC2HOST ISR 0x40060011 isp0: RISC2HOST ISR 0x40060011 isp0: RISC2HOST ISR 0x40008010 isp0: OUT mbox 0 = 0x4000 isp0: IOCB LOGX response: isp0: 0x00000000: 52 01 00 00 ff ff ff ff 31 00 03 00 00 00 00 00 isp0: 0x00000010: 00 0e 01 02 1a 00 00 00 01 00 00 00 00 00 00 00 isp0: 0x00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 isp0: 0x00000030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 isp0: Chan 0 PLOGX PortID 0x010e00 to N-Port handle 0x3: already logged in with N-Port handle 0x1 isp0: IN mbox 0 = 0x0064 isp0: IN mbox 1 = 0x0001 isp0: IN mbox 2 = 0x05e8 isp0: IN mbox 3 = 0xd000 isp0: IN mbox 6 = 0x0000 isp0: IN mbox 7 = 0x0000 isp0: IN mbox 9 = 0x0000 isp0: IN mbox 10 = 0x0000 isp0: RISC2HOST ISR 0x40000010 isp0: RISC2HOST ISR 0x40008010 isp0: OUT mbox 0 = 0x4000 isp0: Chan 0 Port 0x010e00 flags 0x0 curstate 7 isp0: Chan 0 new device 0x010e00@0x1 disappeared As far as I can tell from this log and isp.c things are happening in the following order: 1. Get the list of devices on fabric 2. Try to log into each device (excluding self) 3. The result is failure with code "already logged in" and old login handle 4. Try to login with that handle and expect that to work, but it fails with code PDB2400_STATE_PORT_UNAVAIL. Bear in mind, that I'm not anywhere close to FC expert, so I may be totally wrong here. So who is wrong and would it be possible to do resolve this issue? I have an access to all the components (blade, fc switch and storage system) and can provide additional information if it's needed. I'm really stuck and would greatly appreciate any help! Thanks in advance. -- Oleg Sharoyko