From owner-freebsd-scsi@freebsd.org Sun Nov 5 21:01:02 2017 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 56C2FE51B2D for ; Sun, 5 Nov 2017 21:01:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 44AF26B2E3 for ; Sun, 5 Nov 2017 21:01:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id vA5L12nu024192 for ; Sun, 5 Nov 2017 21:01:02 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-scsi@FreeBSD.org Subject: [Bug 174072] [patch] mptutil(8): capture cam related errors Date: Sun, 05 Nov 2017 21:01:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ngie@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-scsi@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Nov 2017 21:01:02 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D174072 Ngie Cooper changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|ngie@FreeBSD.org |freebsd-scsi@FreeBSD.org Status|In Progress |Open --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-scsi@freebsd.org Mon Nov 6 10:18:21 2017 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1A44FE58A7B; Mon, 6 Nov 2017 10:18:21 +0000 (UTC) (envelope-from vvelox@vvelox.net) Received: from vulpes.vvelox.net (vulpes.vvelox.net [96.95.67.25]) by mx1.freebsd.org (Postfix) with ESMTP id F0160685A1; Mon, 6 Nov 2017 10:18:20 +0000 (UTC) (envelope-from vvelox@vvelox.net) Received: from vvelox.net (vulpes.vvelox.net [192.168.14.42]) (Authenticated sender: kitsune) by vulpes.vvelox.net (Postfix) with ESMTPA id 49BD0224A9A2; Mon, 6 Nov 2017 04:09:29 -0600 (CST) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Mon, 06 Nov 2017 04:09:28 -0600 From: "Zane C. B-H." To: Alan Somers Cc: "Mikhail T." , FreeBSD-scsi , freebsd-hardware@freebsd.org, owner-freebsd-hardware@freebsd.org Subject: Re: Do I need SAS drives?.. In-Reply-To: References: <4DFBCE11-913A-4FC9-937D-463B4D49816C@aldan.algebra.com> Message-ID: X-Sender: vvelox@vvelox.net User-Agent: Roundcube Webmail/1.3-beta X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Nov 2017 10:18:21 -0000 On 2017-08-09 10:59, Alan Somers wrote: > On Wed, Aug 9, 2017 at 8:27 AM, Mikhail T. > wrote: > 1) When a SATA drive goes into error recovery, it can lock up the bus > indefinitely. This won't matter if your drives are directly connected > to a SAS HBA. But if you have an expander with say, 4 SAS lanes going > to the HBA, then a flaky SATA drive can reduce the bandwidth available > to the good drives. In my years of doing decade plus of DC work, I've seen both SAS and SATA drives flake and render systems in operable till the offending drive is removed. > 4) The SAS activity LED is the opposite of SATA's. With SATA, the LED > is off for an idle drive or blinking for a busy drive. With SAS, it's > on for an idle drive or blinking for a busy drive. This makes it > easier to see at a glance how many SAS drives you have installed. I > think some SATA drives have a way to change the LEDs behavior, though. HPs and Dells will show on by default, regardless of if it is SATA or SAS. For Supermicro it will vary between backplanes. > I'm guessing that you don't have an expander (since you only have 8 > slots), so item 1 doesn't matter to you. I'll guess that item 3 > doesn't matter either, or you wouldn't have asked this question. Item > 5 can be dealt with simply by buying the higher end SATA drives. So > item 6 is really the most important. If this system needs to have > very high uptime and consistent bandwidth, or if it will be difficult > to access for maintenance, then you probably want to use SAS drives. > If not, then you can save some money by using SATA. Hope that helps. Actually most boxes with more than 4 slots tend to be use multipliers. As to uptime, that is trivial to achieve with both. With both it is of importance of drive monitoring and regular self tests. From owner-freebsd-scsi@freebsd.org Mon Nov 6 22:37:45 2017 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2834DE68AFD for ; Mon, 6 Nov 2017 22:37:45 +0000 (UTC) (envelope-from avv314@gmail.com) Received: from mail-yw0-x22d.google.com (mail-yw0-x22d.google.com [IPv6:2607:f8b0:4002:c05::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D479663452 for ; Mon, 6 Nov 2017 22:37:44 +0000 (UTC) (envelope-from avv314@gmail.com) Received: by mail-yw0-x22d.google.com with SMTP id t71so9288845ywc.3 for ; Mon, 06 Nov 2017 14:37:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=Q5AY71yVfZ+Uzja0DIzQPbVZI7O3IYPGY/Wr1dM5n2E=; b=NoJFCQhgQ9UjUZuy2sYOM+aCwZlJ19UGPq0xTKFhGiua9ZvWEXgWsa6QJik/SJTe4M chsKwo6A28bV3ROpMsF0hA5VLhrnFUcjVtgvyw0/F+xPVdfBcKB9F+H0u0dX/sX8Gope Nes5jypd6ZiU4IPA7N2T5FbzsI7cGQg2GHkLcmv7qSunp/715hikZ/esoNElmVGWj/19 tn3GOE3xVpFcHB6iIYouVvb9O5Hx0gynbNSLAEOd328Mp9wcPQ9UZ5+cFbFKbI106eFf 2S9AxOypOdjgn64lS/YMsuKMW0Wwa62g36RJzMeGRcRUsVIk8DTgquS7WMuvrbRTHR1S D8GQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=Q5AY71yVfZ+Uzja0DIzQPbVZI7O3IYPGY/Wr1dM5n2E=; b=K1psJf8YTbVAm7LlksGrfsRhBrq2+P4bs5PshJlPb+fdGxjGrhbntxRcvfDeRAftn4 uS6eYUwPw1doRFXVDaEadeCDWi3hsEGoFQTj3U4wq6IGOgCOCZ5y/FWC4T8NcOQLSlKq tPijYHBkq+dTCq9CiaxlYWzURGmQ2qgj8LIJ63ui95CJc8bteh7tSLUl5Q3W//UXk2PC nq+asYDl+YuS2dYQLo3jhPqRiVfq6mv+7DmqpUMtFW4gaDQEn+3CMSStIlaJuc11UuQM qBTHrziv1wPeoEswCcQVhYJ380sCuzNDUN7NAkMEQ3Dg/bBwHij7ozb334RZIS5vmWUG fWEQ== X-Gm-Message-State: AMCzsaWgjstmI2IdHpNLIcCHk3BHLUDAfJ5Gr5SB21pP/6bMBksUXCSd DElA29d06rTE95iHAW2DmQraJJ4sFmOrWBm1F176ZQ== X-Google-Smtp-Source: ABhQp+RMvSaMfod2FKZXCqKFJPxn4VHEaCroRkBj7wUb33LKxEW90AKsTlwoYjCth2Gd1WTBekLXnkWwkHbHaKyn/Rs= X-Received: by 10.37.174.159 with SMTP id b31mr10721281ybj.285.1510007863671; Mon, 06 Nov 2017 14:37:43 -0800 (PST) MIME-Version: 1.0 Received: by 10.129.12.215 with HTTP; Mon, 6 Nov 2017 14:37:43 -0800 (PST) From: Andrew Vylegzhanin Date: Tue, 7 Nov 2017 01:37:43 +0300 Message-ID: Subject: LSI2008 and SAS3 backplane To: freebsd-scsi@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Nov 2017 22:37:45 -0000 Hi! I have a problem with low transfer speed (150MB/sec instead of 600Mb/sec) on SAS2 controller to SAS3 drive via SAS3 backplane. Hardware config is follows: Dell R720 box with Dell SAS HBA 6Gbps connected with Supermicro 45-bay JBOD with two SAS-3 expanders (LSI SAS3x40 and LSI SAS3x36). All drives (20 pcs) are SEAGATE ST6000NM0095 E002. So, partial dmesg out: ... mps1: port 0x9c00-0x9cff mem 0xd0ff0000-0xd0ffffff,0xd0f80000-0xd0fbffff irq 66 at device 0.0 numa-domain 1 on pci16 mps1: Firmware: 07.15.08.00, Driver: 21.02.00.00-fbsd mps1: IOCCapabilities: 185c .... ses1 at mps1 bus 0 scbus8 target 81 lun 0 ses1: Fixed Enclosure Services SPC-3 SCSI device ses1: 150.000MB/s transfers ses1: Command Queueing enabled ses1: SCSI-3 ENC Device ses2 at mps1 bus 0 scbus8 target 82 lun 0 ses2: Fixed Enclosure Services SPC-3 SCSI device ses2: 150.000MB/s transfers ses2: Command Queueing enabled ses2: SCSI-3 ENC Device ses1: da0: Element descriptor: 'Slot00' .... da0 at mps1 bus 0 scbus8 target 61 lun 0 da3 at mps1 bus 0 scbus8 target 64 lun 0 ... da0: Fixed Direct Access SPC-4 SCSI device da0: Serial Number ZAD119P20000C730KZK3 da0: 150.000MB/s transfers da0: Command Queueing enabled da0: 5723166MB (11721045168 512 byte sectors) Some additional info. There is two identical system with same problem. System is under load now, and there is no erros, timeouts on disk i/o, so it seems to be not cable/hardware problem. I've tried other vendor SATA3 drive, got same 150MB/s. This server works on full speed (600MB/s transfers) with SAS2 JBOD (Dell MD1220) w/o problems. Any ideas? -- Andrew From owner-freebsd-scsi@freebsd.org Tue Nov 7 00:26:35 2017 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 56C97E6A7FC for ; Tue, 7 Nov 2017 00:26:35 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 17D6267E8C for ; Tue, 7 Nov 2017 00:26:34 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from compute6.internal (compute6.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id A960320A17; Mon, 6 Nov 2017 19:26:33 -0500 (EST) Received: from frontend2 ([10.202.2.161]) by compute6.internal (MEProxy); Mon, 06 Nov 2017 19:26:33 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=samsco.org; h=cc :content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-sender :x-me-sender:x-sasl-enc; s=fm1; bh=39ejr39QW5iJY02/7zDYGxMvSV0N5 NK95eQutuQhHaY=; b=dRyCj4JaQuibqyNbhDW5edPitYBy8HbW9/SmkNxsW5b7u JXft9Wmshg4aY1mQgagyJapuyYGe8mxYerikjh17wFCtWWDLoe4W2WhmT/xycI/i db3ykhuekNNTh533WNAWxpL1yQrTGkEfVkjdmPMHOWBRLB2WMfKHVEb+oNaLNflz la7KFGikJ675YowKBZwLxWJNfzdGafYQ3tluOcRMoj4M8gNSpagdw3890wMDwOuf RaawRld4Gkc3yu2Fv0WWTZA4ZncTHT69HHkPF33jrQOy/kOhFTp/dlfYcmT7OXJL oDWfCOGkXxm8NC32HEI6lzDT2+R+/Wh7db87TPh2Q== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=39ejr3 9QW5iJY02/7zDYGxMvSV0N5NK95eQutuQhHaY=; b=p7x8w6OodOTx4GHtqOW7Um dd8s4QEHiedSTJitMkKnkbgImf0FoXlm5rQs2LB0nqcgN3kcw3yjNWhPPm6Gt6nN G+TFrzqXy61AS6vZTIPg7PslEC9TUtGlyjE1MG0HHHAHySqAPhLmUciIfUewFJDg rBJaQX637GoFu43DOutzp00r8SCtGbPe0e/KEZoS9j8CF1aJtjBHiDpR9sPICh8y 6hKCEqEN6hBBD9XpwXii3X4SCdAH/fp1gH76de37QwKArhDCG9jyfbni5mhh/pFv 7aV/CjfANmNeXnpFURyi3z25YKF1K+Nq4cFen260iWucDGfTa+PACge7HCcaCfVg == X-ME-Sender: Received: from [192.168.100.21] (50-253-109-65-static.hfc.comcastbusiness.net [50.253.109.65]) by mail.messagingengine.com (Postfix) with ESMTPA id B6F0C241BE; Mon, 6 Nov 2017 19:26:32 -0500 (EST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: LSI2008 and SAS3 backplane From: Scott Long In-Reply-To: Date: Mon, 6 Nov 2017 17:26:30 -0700 Cc: freebsd-scsi@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <24CF75B3-D75C-41B2-952A-77E94152F3D8@samsco.org> References: To: Andrew Vylegzhanin X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Nov 2017 00:26:35 -0000 Hi, If you=E2=80=99re using FreeBSD 11 or later, try running the following: mpsutil show devices That will show what speed the drives are actually negotiated to. This = might shed some light on the problem. Scott > On Nov 6, 2017, at 3:37 PM, Andrew Vylegzhanin = wrote: >=20 > Hi! >=20 > I have a problem with low transfer speed (150MB/sec instead of = 600Mb/sec) > on SAS2 controller to SAS3 drive via SAS3 backplane. >=20 > Hardware config is follows: >=20 > Dell R720 box with Dell SAS HBA 6Gbps connected with Supermicro 45-bay = JBOD > with two SAS-3 expanders (LSI SAS3x40 and LSI SAS3x36). All drives (20 = pcs) > are SEAGATE ST6000NM0095 E002. >=20 > So, partial dmesg out: > ... > mps1: port 0x9c00-0x9cff mem > 0xd0ff0000-0xd0ffffff,0xd0f80000-0xd0fbffff irq 66 at device 0.0 > numa-domain 1 on pci16 > mps1: Firmware: 07.15.08.00, Driver: 21.02.00.00-fbsd > mps1: IOCCapabilities: > 185c > .... > ses1 at mps1 bus 0 scbus8 target 81 lun 0 > ses1: Fixed Enclosure Services SPC-3 SCSI device > ses1: 150.000MB/s transfers > ses1: Command Queueing enabled > ses1: SCSI-3 ENC Device > ses2 at mps1 bus 0 scbus8 target 82 lun 0 > ses2: Fixed Enclosure Services SPC-3 SCSI device > ses2: 150.000MB/s transfers > ses2: Command Queueing enabled > ses2: SCSI-3 ENC Device > ses1: da0: Element descriptor: 'Slot00' > .... > da0 at mps1 bus 0 scbus8 target 61 lun 0 > da3 at mps1 bus 0 scbus8 target 64 lun 0 > ... > da0: Fixed Direct Access SPC-4 SCSI device > da0: Serial Number ZAD119P20000C730KZK3 > da0: 150.000MB/s transfers > da0: Command Queueing enabled > da0: 5723166MB (11721045168 512 byte sectors) >=20 > Some additional info. > There is two identical system with same problem. > System is under load now, and there is no erros, timeouts on disk i/o, = so > it seems to be not cable/hardware problem. > I've tried other vendor SATA3 drive, got same 150MB/s. > This server works on full speed (600MB/s transfers) with SAS2 JBOD = (Dell > MD1220) w/o problems. >=20 > Any ideas? >=20 > -- > Andrew > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to = "freebsd-scsi-unsubscribe@freebsd.org" From owner-freebsd-scsi@freebsd.org Tue Nov 7 03:43:08 2017 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 41DB9E71054 for ; Tue, 7 Nov 2017 03:43:08 +0000 (UTC) (envelope-from avv314@gmail.com) Received: from mail-yw0-x22e.google.com (mail-yw0-x22e.google.com [IPv6:2607:f8b0:4002:c05::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F05FA75B9C for ; Tue, 7 Nov 2017 03:43:07 +0000 (UTC) (envelope-from avv314@gmail.com) Received: by mail-yw0-x22e.google.com with SMTP id k11so9794043ywh.1 for ; Mon, 06 Nov 2017 19:43:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=mGBhVGsNMvM7QUV5gHaU57TWiSNx0EHlz2VqBfGkErc=; b=CrMoHMCUHEo7cRXlyOCrgPI8nX9NNdWs3H52ODFavpUWrzmiShxjHnANByDprsU5O6 lozv7hWEfoIMbpcGRiaYjLPogw7+ziJpkvRhf7WOFKaW9DztAWQ5yE8+3SKxTng3Nao+ Zr2+72xFQcztGuhaRo2ZvgnlB+7bLdgBaJCW9TAjKqOnCyfGnoj4QxxXGM0s90XUaov5 Kg2Wc99uFnMs7ZaNRBqeBaZWmOIE6TrUMW6YcPM5miCUzMgM2RTSlCwRd2PBYmHelLfZ QKEhrVkxJJ7EP/B3QPi60FvzdEgGDJ7Dos4kaHsQjJlsYBqW6XgNgNbcrMftpBYCqNbI sDKA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=mGBhVGsNMvM7QUV5gHaU57TWiSNx0EHlz2VqBfGkErc=; b=l6wJlQ2u1SP/RXHjhOmdazVUW7g1jCp4saU4vplLVacKRyXo9PBaI9SOhcg7ptIvlS 6cszTI/GviC3BR/l6EgGeoDvhWb/RpNXd4bR1w1ZG8WfJOSJpE8h4CdaiYiujwWKvScz kmacw86QQDAAGgBaL6jI1GVZmAt+TfE81CzFCjgw8AOLb+U7TaNtDiun9GMQIvP1Ay8s bUhx9vFqjvHuhZeU++WWyq1KpkW1scnKHg3IyaK3eSKSJRhpJUsI8zzuVkJ49sKwr6PD y3TVD2+UBVBL5xe6piP1csICzw1pSQomxMDTHBgtaFQfLa2jHvFVedN8TOqq/HGLV4Kq tBfQ== X-Gm-Message-State: AJaThX7jTiicRYMZXFaUUjvXJB1vGfVlJHJfkvuFuh1ljd7L6Ou0Qaqa qQUm4hskBr1WSuRcouSlutA8XDunoF7IjqhcXuE0MQ== X-Google-Smtp-Source: ABhQp+SSTYgt+emPWnZebG2QbRzxdZlymmkM6Xq64sWVUWos4u57ZZU+1ZypRcOtzRjdv13afAvDWgIo8V//8yslcok= X-Received: by 10.37.162.67 with SMTP id b61mr5356928ybi.455.1510026186840; Mon, 06 Nov 2017 19:43:06 -0800 (PST) MIME-Version: 1.0 Received: by 10.129.12.215 with HTTP; Mon, 6 Nov 2017 19:43:06 -0800 (PST) In-Reply-To: <24CF75B3-D75C-41B2-952A-77E94152F3D8@samsco.org> References: <24CF75B3-D75C-41B2-952A-77E94152F3D8@samsco.org> From: Andrew Vylegzhanin Date: Tue, 7 Nov 2017 06:43:06 +0300 Message-ID: Subject: Re: LSI2008 and SAS3 backplane To: Scott Long Cc: freebsd-scsi@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Nov 2017 03:43:08 -0000 2017-11-07 3:26 GMT+03:00 Scott Long : > Hi, > > Hi, If you=E2=80=99re using FreeBSD 11 or later, try running the following: > mpsutil show devices > It's empty: [root@zc-dtrs-s1 ~]# freebsd-version 11.1-RELEASE-p2 [root@zc-dtrs-s1 ~]# mpsutil show devices B____T SAS Address Handle Parent Device Speed Enc Slot Wdt [root@zc-dtrs-s1 ~]# -- Andrew > > That will show what speed the drives are actually negotiated to. This > might shed some > light on the problem. > > Scott > > > On Nov 6, 2017, at 3:37 PM, Andrew Vylegzhanin wrote= : > > > > Hi! > > > > I have a problem with low transfer speed (150MB/sec instead of 600Mb/se= c) > > on SAS2 controller to SAS3 drive via SAS3 backplane. > > > > Hardware config is follows: > > > > Dell R720 box with Dell SAS HBA 6Gbps connected with Supermicro 45-bay > JBOD > > with two SAS-3 expanders (LSI SAS3x40 and LSI SAS3x36). All drives (20 > pcs) > > are SEAGATE ST6000NM0095 E002. > > > > So, partial dmesg out: > > ... > > mps1: port 0x9c00-0x9cff mem > > 0xd0ff0000-0xd0ffffff,0xd0f80000-0xd0fbffff irq 66 at device 0.0 > > numa-domain 1 on pci16 > > mps1: Firmware: 07.15.08.00, Driver: 21.02.00.00-fbsd > > mps1: IOCCapabilities: > > 185c > > .... > > ses1 at mps1 bus 0 scbus8 target 81 lun 0 > > ses1: Fixed Enclosure Services SPC-3 SCSI device > > ses1: 150.000MB/s transfers > > ses1: Command Queueing enabled > > ses1: SCSI-3 ENC Device > > ses2 at mps1 bus 0 scbus8 target 82 lun 0 > > ses2: Fixed Enclosure Services SPC-3 SCSI device > > ses2: 150.000MB/s transfers > > ses2: Command Queueing enabled > > ses2: SCSI-3 ENC Device > > ses1: da0: Element descriptor: 'Slot00' > > .... > > da0 at mps1 bus 0 scbus8 target 61 lun 0 > > da3 at mps1 bus 0 scbus8 target 64 lun 0 > > ... > > da0: Fixed Direct Access SPC-4 SCSI device > > da0: Serial Number ZAD119P20000C730KZK3 > > da0: 150.000MB/s transfers > > da0: Command Queueing enabled > > da0: 5723166MB (11721045168 512 byte sectors) > > > > Some additional info. > > There is two identical system with same problem. > > System is under load now, and there is no erros, timeouts on disk i/o, = so > > it seems to be not cable/hardware problem. > > I've tried other vendor SATA3 drive, got same 150MB/s. > > This server works on full speed (600MB/s transfers) with SAS2 JBOD (Del= l > > MD1220) w/o problems. > > > > Any ideas? > > > > -- > > Andrew > > _______________________________________________ > > freebsd-scsi@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi > > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" > > From owner-freebsd-scsi@freebsd.org Tue Nov 7 03:44:38 2017 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4CE2AE710FE for ; Tue, 7 Nov 2017 03:44:38 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1AC6175EAD for ; Tue, 7 Nov 2017 03:44:37 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from compute6.internal (compute6.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id 1166320B53; Mon, 6 Nov 2017 22:44:36 -0500 (EST) Received: from frontend1 ([10.202.2.160]) by compute6.internal (MEProxy); Mon, 06 Nov 2017 22:44:36 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=samsco.org; h=cc :content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-sender :x-me-sender:x-sasl-enc; s=fm1; bh=Hcvh8rWUxlLHXlU8pZgINNB7KEExZ XcioZyeCZa47Wo=; b=vJ48DrkU0bQO0/RLIxMM5zEp4e9+JaHKU9J0vWFWjsCTm sujCTHZPuuyFo44y7aJNnOaNIPV6/wO8A2NkJSSRDI86No6/DDxH62s3Ls8Wfias JviUqtmqNM0fwCI11d+VahpHWUQqllxuaLuFpgzXJ22PuKjhP9DzGO4TamcsaYY2 VyYr7Nutvbiz+5vqVmAVL7iRWyQE/tt3H51A9rJMGtw80n1dEAoAx5ua2pZ3hrkL qNu7SGo5ydr35Umy98uKK4nX6PmM7m1y33dt4H8tnRAZsX9MCPk31cywTT7wwbPy Eyfw12cNUu7qTA6Zr4UwjNiDF9SAFk/dB3e8EwdBQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=Hcvh8r WUxlLHXlU8pZgINNB7KEExZXcioZyeCZa47Wo=; b=iypEWnQMGyVr17oBxYuhTY 1xKJcJhwAS0Swb4JdAVM8nsmk//f9F+QY1h7vhRtgJX1+to+70RU3O0hRQXsYTCi 3UfLZgKlX9Z09/yBNDXDUwZdOWEIxJWCR0+2VNPhTGe8HV3tFgT5Bvour+nDnKrI ztv5zRy31fy7xV8Qok8uNoFeW0VhoqQRzfpSS2So/rDzpRTz7HDc0NTdKUlWbtHZ qApBIfG9k846p/2JD7VuwUvtIhfQIaoVZw/3/8SUgvsqWj1RLnJolOVRRvZAA7BM LBYFOkdM9Q8XXsBwCshKyWDFs23JVWK6eaISIpnjvSuUa3gYd89zeq3nNEiz9vKQ == X-ME-Sender: Received: from [100.125.173.177] (131.sub-174-209-6.myvzw.com [174.209.6.131]) by mail.messagingengine.com (Postfix) with ESMTPA id 884857FAA7; Mon, 6 Nov 2017 22:44:35 -0500 (EST) Mime-Version: 1.0 (1.0) Subject: Re: LSI2008 and SAS3 backplane From: Scott Long X-Mailer: iPhone Mail (15A432) In-Reply-To: Date: Mon, 6 Nov 2017 20:44:33 -0700 Cc: freebsd-scsi@freebsd.org Message-Id: <6CDCDC5D-457F-47A2-86BB-2716934F4F63@samsco.org> References: <24CF75B3-D75C-41B2-952A-77E94152F3D8@samsco.org> To: Andrew Vylegzhanin Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Nov 2017 03:44:38 -0000 Sorry, you need mpsutil -u 1 show devices Scott Sent from my iPhone > On Nov 6, 2017, at 8:43 PM, Andrew Vylegzhanin wrote: >=20 >=20 >=20 > 2017-11-07 3:26 GMT+03:00 Scott Long : >> Hi, >>=20 >=20 > Hi, >=20 >> If you=E2=80=99re using FreeBSD 11 or later, try running the following: >>=20 >> mpsutil show devices >=20 >=20 > It's empty: >=20 > [root@zc-dtrs-s1 ~]# freebsd-version=20 > 11.1-RELEASE-p2 > [root@zc-dtrs-s1 ~]# mpsutil show devices > B____T SAS Address Handle Parent Device Speed Enc Slot= Wdt >=20 > [root@zc-dtrs-s1 ~]#=20 >=20 > -- > Andrew >=20 > =20 >>=20 >> That will show what speed the drives are actually negotiated to. This mi= ght shed some >> light on the problem. >>=20 >> Scott >>=20 >> > On Nov 6, 2017, at 3:37 PM, Andrew Vylegzhanin wrote= : >> > >> > Hi! >> > >> > I have a problem with low transfer speed (150MB/sec instead of 600Mb/se= c) >> > on SAS2 controller to SAS3 drive via SAS3 backplane. >> > >> > Hardware config is follows: >> > >> > Dell R720 box with Dell SAS HBA 6Gbps connected with Supermicro 45-bay J= BOD >> > with two SAS-3 expanders (LSI SAS3x40 and LSI SAS3x36). All drives (20 p= cs) >> > are SEAGATE ST6000NM0095 E002. >> > >> > So, partial dmesg out: >> > ... >> > mps1: port 0x9c00-0x9cff mem >> > 0xd0ff0000-0xd0ffffff,0xd0f80000-0xd0fbffff irq 66 at device 0.0 >> > numa-domain 1 on pci16 >> > mps1: Firmware: 07.15.08.00, Driver: 21.02.00.00-fbsd >> > mps1: IOCCapabilities: >> > 185c >> > .... >> > ses1 at mps1 bus 0 scbus8 target 81 lun 0 >> > ses1: Fixed Enclosure Services SPC-3 SCSI device >> > ses1: 150.000MB/s transfers >> > ses1: Command Queueing enabled >> > ses1: SCSI-3 ENC Device >> > ses2 at mps1 bus 0 scbus8 target 82 lun 0 >> > ses2: Fixed Enclosure Services SPC-3 SCSI device >> > ses2: 150.000MB/s transfers >> > ses2: Command Queueing enabled >> > ses2: SCSI-3 ENC Device >> > ses1: da0: Element descriptor: 'Slot00' >> > .... >> > da0 at mps1 bus 0 scbus8 target 61 lun 0 >> > da3 at mps1 bus 0 scbus8 target 64 lun 0 >> > ... >> > da0: Fixed Direct Access SPC-4 SCSI device >> > da0: Serial Number ZAD119P20000C730KZK3 >> > da0: 150.000MB/s transfers >> > da0: Command Queueing enabled >> > da0: 5723166MB (11721045168 512 byte sectors) >> > >> > Some additional info. >> > There is two identical system with same problem. >> > System is under load now, and there is no erros, timeouts on disk i/o, s= o >> > it seems to be not cable/hardware problem. >> > I've tried other vendor SATA3 drive, got same 150MB/s. >> > This server works on full speed (600MB/s transfers) with SAS2 JBOD (Del= l >> > MD1220) w/o problems. >> > >> > Any ideas? >> > >> > -- >> > Andrew >> > _______________________________________________ >> > freebsd-scsi@freebsd.org mailing list >> > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi >> > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org"= >>=20 >=20 From owner-freebsd-scsi@freebsd.org Tue Nov 7 03:57:32 2017 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2BE17E71425 for ; Tue, 7 Nov 2017 03:57:32 +0000 (UTC) (envelope-from avv314@gmail.com) Received: from mail-yw0-x236.google.com (mail-yw0-x236.google.com [IPv6:2607:f8b0:4002:c05::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D703276BCD for ; Tue, 7 Nov 2017 03:57:31 +0000 (UTC) (envelope-from avv314@gmail.com) Received: by mail-yw0-x236.google.com with SMTP id w5so9782237ywg.11 for ; Mon, 06 Nov 2017 19:57:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=N/Pcp5Sutr7I8b9w8MNHfMwv4amK6zKHY6BUSA7di+c=; b=V4Eck3elUAHL9PWd+QlGLI1etRYG2l7WtDwPSjagggJx6FWV7+IiXwXU3atanUPzfv MG8WeHeRn41jP44ZVe06EBKqUE2batNyZMIqLXuwtsdt9lNr6nY+1ozgKGmcvx9y6TGZ 3DCdjfv2gjikJbS5wf8/RQSks2ACVewR4iYiKZKIzICPI1goxDGNXRPwzCq8fR/MrGmw Vutl2XXKbRNvPxBWf1SSE7gDr+osldpH9XbC+ZyJHUKWDfxqemoIvnESS6Fd7Nnr7top puHUqWaXsPmUAZ8g6LuEoXPYz4dfv0fjoEkSMcZE8m85kv+QeA2qs/JXJd701AdET2nF 2Tzw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=N/Pcp5Sutr7I8b9w8MNHfMwv4amK6zKHY6BUSA7di+c=; b=cFf53VWyr3J+/bJ2bgi6ZM7x0OikA+02SOpCIwZiteEclGqDZWf9l62Zh2g4wjEN/u QsgOfUiJPEZiKNZPLqsd0TMT/HUUImR60yD/SIriR1VGYIroqo52DmJFGltSxb4W1nTu bos6ksXst0hxjjQxpMi5QxCSWOPhtM0mMmZFtYHccNhhEPWbJU+/4jA73VnvUzW5cerI /SWylVDOnOjasoHxiuqmlNuRK6ybQTX5NcLc2XyKdoKGZH5enb6Mq9N31tqNkI3QVVl3 utC/pUrUaDB8fTkQK0bpDSXt9Az2GnLhO5qn3y/iRfdiae7WCCUENSfgSz3QY37PPkJc OkwA== X-Gm-Message-State: AMCzsaWVfqJUIb4FcRoXqzMwYIYf1GkjhVmWqzgL/KVRGUG3mZeVdIgz Q23sqZOxGbKdUhYoT077ZQLVy3SOd1sLS+2zD90= X-Google-Smtp-Source: ABhQp+TW+PBk88vxfMOeXMF+SMBYDWbAtuh21KxgdVgNuribX2Xaq4iW26GJ1EchpouNi4+dj8cbz2AC8mmi7xC9gJk= X-Received: by 10.129.232.9 with SMTP id a9mr10728039ywm.461.1510027050906; Mon, 06 Nov 2017 19:57:30 -0800 (PST) MIME-Version: 1.0 Received: by 10.129.12.215 with HTTP; Mon, 6 Nov 2017 19:57:30 -0800 (PST) In-Reply-To: <6CDCDC5D-457F-47A2-86BB-2716934F4F63@samsco.org> References: <24CF75B3-D75C-41B2-952A-77E94152F3D8@samsco.org> <6CDCDC5D-457F-47A2-86BB-2716934F4F63@samsco.org> From: Andrew Vylegzhanin Date: Tue, 7 Nov 2017 06:57:30 +0300 Message-ID: Subject: Re: LSI2008 and SAS3 backplane To: Scott Long Cc: freebsd-scsi@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Nov 2017 03:57:32 -0000 This is another matter! B____T SAS Address Handle Parent Device Speed Enc Slot Wdt 500304801ebe58bf 0009 0001 SMP Target 6.0 0002 00 4 500304801ea4db3f 000a 0009 SMP Target 12 0003 00 0 500304801ebe58bd 000b 0009 SEP Target 12 0002 20 0 5000c50093bb2775 000c 000a SAS Target 6.0 0003 00 0 5000c50093bb2291 000d 000a SAS Target 6.0 0003 01 0 5000c50093bb3209 000e 000a SAS Target 6.0 0003 02 0 5000c50093bb24ed 000f 000a SAS Target 6.0 0003 03 0 5000c50093bb3721 0010 000a SAS Target 6.0 0003 04 0 5000c50093bb3159 0011 000a SAS Target 6.0 0003 05 0 5000c50093bb345d 0012 000a SAS Target 6.0 0003 06 0 5000c50093b33e05 0013 000a SAS Target 6.0 0003 07 0 5000c50093bb2489 0014 000a SAS Target 12 0003 08 0 5000c50093bb3105 0015 000a SAS Target 12 0003 09 0 5000c50093bb31f1 0016 000a SAS Target 12 0003 10 0 5000c50093b0b049 0017 000a SAS Target 12 0003 11 0 5c81f660f99a8d01 0018 000a SAS Initiator 6.0 0 5000c50093bb1ff5 0019 000a SAS Target 12 0003 12 0 5000c50093bb3301 001a 000a SAS Target 12 0003 13 0 5000c50093bb271d 001b 000a SAS Target 12 0003 14 0 5000c50093bb33a9 001c 000a SAS Target 12 0003 15 0 5000c50093bb1fb5 001d 000a SAS Target 12 0003 16 0 5000c50093bb3411 001e 000a SAS Target 12 0003 17 0 5000c50093b31d65 001f 000a SAS Target 12 0003 18 0 5000c50093bb27c5 0020 000a SAS Target 12 0003 19 0 500304801ea4db3d 0022 000a SEP Target 12 0003 24 0 500304801ea4db3f 0023 0002 SMP Target 6.0 0004 00 4 00 61 5000c50093bb2775 0024 0023 SAS Target 6.0 0004 00 0 00 62 5000c50093bb2291 0025 0023 SAS Target 6.0 0004 01 0 00 63 5000c50093bb3209 0026 0023 SAS Target 6.0 0004 02 0 00 64 5000c50093bb24ed 0027 0023 SAS Target 6.0 0004 03 0 00 65 5000c50093bb3721 0028 0023 SAS Target 6.0 0004 04 0 00 66 5000c50093bb3159 0029 0023 SAS Target 6.0 0004 05 0 00 67 5000c50093bb345d 002a 0023 SAS Target 6.0 0004 06 0 00 68 5000c50093b33e05 002b 0023 SAS Target 6.0 0004 07 0 00 69 5000c50093bb2489 002c 0023 SAS Target 12 0004 08 0 00 70 5000c50093bb3105 002d 0023 SAS Target 12 0004 09 0 00 71 5000c50093bb31f1 002e 0023 SAS Target 12 0004 10 0 00 72 5000c50093b0b049 002f 0023 SAS Target 12 0004 11 0 500304801ebe58bf 0030 0023 SMP Target 12 0005 00 0 00 73 5000c50093bb1ff5 0031 0023 SAS Target 12 0004 12 0 00 74 5000c50093bb3301 0032 0023 SAS Target 12 0004 13 0 00 75 5000c50093bb271d 0033 0023 SAS Target 12 0004 14 0 00 76 5000c50093bb33a9 0034 0023 SAS Target 12 0004 15 0 00 77 5000c50093bb1fb5 0035 0023 SAS Target 12 0004 16 0 00 78 5000c50093bb3411 0036 0023 SAS Target 12 0004 17 0 00 79 5000c50093b31d65 0037 0023 SAS Target 12 0004 18 0 00 80 5000c50093bb27c5 0038 0023 SAS Target 12 0004 19 0 00 83 500304801ea4db24 0039 0023 SATA Target 0004 20 0 00 81 500304801ea4db3d 003a 0023 SEP Target 12 0004 24 0 5c81f660f99a8d00 003b 0030 SAS Initiator 6.0 0 00 82 500304801ebe58bd 003c 0030 SEP Target 12 0005 20 0 How to interpret this? Not many docs :( -- Andrew 2017-11-07 6:44 GMT+03:00 Scott Long : > Sorry, you need > > mpsutil -u 1 show devices > > Scott > > Sent from my iPhone > > On Nov 6, 2017, at 8:43 PM, Andrew Vylegzhanin wrote: > > > > 2017-11-07 3:26 GMT+03:00 Scott Long : > >> Hi, >> >> > Hi, > > If you=E2=80=99re using FreeBSD 11 or later, try running the following: > > >> mpsutil show devices >> > > > It's empty: > > [root@zc-dtrs-s1 ~]# freebsd-version > 11.1-RELEASE-p2 > [root@zc-dtrs-s1 ~]# mpsutil show devices > B____T SAS Address Handle Parent Device Speed Enc Slo= t > Wdt > > [root@zc-dtrs-s1 ~]# > > -- > Andrew > > > >> >> That will show what speed the drives are actually negotiated to. This >> might shed some >> light on the problem. >> >> Scott >> >> > On Nov 6, 2017, at 3:37 PM, Andrew Vylegzhanin >> wrote: >> > >> > Hi! >> > >> > I have a problem with low transfer speed (150MB/sec instead of >> 600Mb/sec) >> > on SAS2 controller to SAS3 drive via SAS3 backplane. >> > >> > Hardware config is follows: >> > >> > Dell R720 box with Dell SAS HBA 6Gbps connected with Supermicro 45-bay >> JBOD >> > with two SAS-3 expanders (LSI SAS3x40 and LSI SAS3x36). All drives (20 >> pcs) >> > are SEAGATE ST6000NM0095 E002. >> > >> > So, partial dmesg out: >> > ... >> > mps1: port 0x9c00-0x9cff mem >> > 0xd0ff0000-0xd0ffffff,0xd0f80000-0xd0fbffff irq 66 at device 0.0 >> > numa-domain 1 on pci16 >> > mps1: Firmware: 07.15.08.00, Driver: 21.02.00.00-fbsd >> > mps1: IOCCapabilities: >> > 185c >> > .... >> > ses1 at mps1 bus 0 scbus8 target 81 lun 0 >> > ses1: Fixed Enclosure Services SPC-3 SCSI device >> > ses1: 150.000MB/s transfers >> > ses1: Command Queueing enabled >> > ses1: SCSI-3 ENC Device >> > ses2 at mps1 bus 0 scbus8 target 82 lun 0 >> > ses2: Fixed Enclosure Services SPC-3 SCSI device >> > ses2: 150.000MB/s transfers >> > ses2: Command Queueing enabled >> > ses2: SCSI-3 ENC Device >> > ses1: da0: Element descriptor: 'Slot00' >> > .... >> > da0 at mps1 bus 0 scbus8 target 61 lun 0 >> > da3 at mps1 bus 0 scbus8 target 64 lun 0 >> > ... >> > da0: Fixed Direct Access SPC-4 SCSI device >> > da0: Serial Number ZAD119P20000C730KZK3 >> > da0: 150.000MB/s transfers >> > da0: Command Queueing enabled >> > da0: 5723166MB (11721045168 512 byte sectors) >> > >> > Some additional info. >> > There is two identical system with same problem. >> > System is under load now, and there is no erros, timeouts on disk i/o, >> so >> > it seems to be not cable/hardware problem. >> > I've tried other vendor SATA3 drive, got same 150MB/s. >> > This server works on full speed (600MB/s transfers) with SAS2 JBOD (De= ll >> > MD1220) w/o problems. >> > >> > Any ideas? >> > >> > -- >> > Andrew >> > _______________________________________________ >> > freebsd-scsi@freebsd.org mailing list >> > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi >> > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org= " >> >> > From owner-freebsd-scsi@freebsd.org Tue Nov 7 09:30:54 2017 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A88F7E539CE for ; Tue, 7 Nov 2017 09:30:54 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from mail-wr0-x232.google.com (mail-wr0-x232.google.com [IPv6:2a00:1450:400c:c0c::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5B6577319B for ; Tue, 7 Nov 2017 09:30:54 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: by mail-wr0-x232.google.com with SMTP id 4so6968530wrt.0 for ; Tue, 07 Nov 2017 01:30:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay-co-uk.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-language; bh=bQd2/Tb8DJsg58O3fZv/ntJtnoO5tbFZyZraGzel3Qk=; b=ipEin5BQnO7rpujoYaqiy4vcROzELZd+HJxM/0dXF8cGIMSOgHojgbJ0OiSDj/kVg+ efEqfYHLlJ7vMdUaflMOE437obQCt7E+Cpo9IYXQN5LmA3Ze48DhNdY0HOov5E/JOwfI 2H/aXvbjUNW0HQ1pG5fdHCpnEstvLyztNK0IC6jXAAadRLmAbMZni59cyWad/QU4rY+x M6WEaI8SEFP2AzwMNDIgGVLZBRSHNMo0oEKk98F1nLHCjkuFRDskAYb5VnEnM1HGdkPJ BEr4lfS/Ws74pyR2o33LUX+Rh20DxIlft0de65L1CmM51LkKqUkCtB3q269r4uDKafXf /+Hg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language; bh=bQd2/Tb8DJsg58O3fZv/ntJtnoO5tbFZyZraGzel3Qk=; b=P1+B0QIEON1GsHt7GLbDDRmV1SZh4U4305PhVh5OdTO9TTEeFMVoYRrae+Vj18lMN/ sH0zmMqlvgadn2992V6XG+cjY3ytVNYO71gGsbjmfNYTxoGTuCWDYqaZgNHU/+teht0q NtBslKlwFzACu1lAtSD2rEWz82Tt3Gew+jDLoBs7JNUWEwOM9avxFvpHcD/j2+rV04yw o4+h4daaxAjug0YptZXvrWIYIPeoFFRdyMxvBmoAV/rLo7U4Fut9gamx1TNLbdfjn1FB Bn7zgrGFrkCkjXX5TsSKz3fdphFgxcNZgXvbrC9ZxLLo47tEnzCA5yy21kcW4TA580G0 Q8Fw== X-Gm-Message-State: AMCzsaUvhZTJhm5yHepGa3Qnes0wJfjb+2+wOckt24d4j5Dxe2DDypYL AC4PXh6kN6A5551haiq30a3JfKMm1Dg= X-Google-Smtp-Source: ABhQp+Rf67e1DgZqpRpbEMqEqNzwCoXWS5zQUeGA8oWVwq7l0M02hwO2Wxtl0JqPYXCCIITQIw7vBQ== X-Received: by 10.223.196.156 with SMTP id m28mr16169183wrf.67.1510047051589; Tue, 07 Nov 2017 01:30:51 -0800 (PST) Received: from [10.10.1.111] ([185.97.61.1]) by smtp.gmail.com with ESMTPSA id k69sm1493902wmg.45.2017.11.07.01.30.50 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 07 Nov 2017 01:30:50 -0800 (PST) Subject: Re: LSI2008 and SAS3 backplane To: freebsd-scsi@freebsd.org References: From: Steven Hartland Message-ID: <93b6dbd4-4328-b55a-4c3b-3abe920fd440@multiplay.co.uk> Date: Tue, 7 Nov 2017 09:30:51 +0000 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.4.0 MIME-Version: 1.0 In-Reply-To: Content-Language: en-US Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Nov 2017 09:30:54 -0000 Where you're drives supplied by Dell? If so you may find that they have custom firmware which lowers their max transfer speed, we've seen that before. Also your firmware looks very old firmware, 07.15.08.00, we're running 20.00.04.00 which is still old, so you might want try updating.     Regards     Steve On 06/11/2017 22:37, Andrew Vylegzhanin wrote: > Hi! > > I have a problem with low transfer speed (150MB/sec instead of 600Mb/sec) > on SAS2 controller to SAS3 drive via SAS3 backplane. > > Hardware config is follows: > > Dell R720 box with Dell SAS HBA 6Gbps connected with Supermicro 45-bay JBOD > with two SAS-3 expanders (LSI SAS3x40 and LSI SAS3x36). All drives (20 pcs) > are SEAGATE ST6000NM0095 E002. > > So, partial dmesg out: > ... > mps1: port 0x9c00-0x9cff mem > 0xd0ff0000-0xd0ffffff,0xd0f80000-0xd0fbffff irq 66 at device 0.0 > numa-domain 1 on pci16 > mps1: Firmware: 07.15.08.00, Driver: 21.02.00.00-fbsd > mps1: IOCCapabilities: > 185c > .... > ses1 at mps1 bus 0 scbus8 target 81 lun 0 > ses1: Fixed Enclosure Services SPC-3 SCSI device > ses1: 150.000MB/s transfers > ses1: Command Queueing enabled > ses1: SCSI-3 ENC Device > ses2 at mps1 bus 0 scbus8 target 82 lun 0 > ses2: Fixed Enclosure Services SPC-3 SCSI device > ses2: 150.000MB/s transfers > ses2: Command Queueing enabled > ses2: SCSI-3 ENC Device > ses1: da0: Element descriptor: 'Slot00' > .... > da0 at mps1 bus 0 scbus8 target 61 lun 0 > da3 at mps1 bus 0 scbus8 target 64 lun 0 > ... > da0: Fixed Direct Access SPC-4 SCSI device > da0: Serial Number ZAD119P20000C730KZK3 > da0: 150.000MB/s transfers > da0: Command Queueing enabled > da0: 5723166MB (11721045168 512 byte sectors) > > Some additional info. > There is two identical system with same problem. > System is under load now, and there is no erros, timeouts on disk i/o, so > it seems to be not cable/hardware problem. > I've tried other vendor SATA3 drive, got same 150MB/s. > This server works on full speed (600MB/s transfers) with SAS2 JBOD (Dell > MD1220) w/o problems. > > Any ideas? > > -- > Andrew > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" From owner-freebsd-scsi@freebsd.org Fri Nov 10 02:29:07 2017 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3F89BE62BA8 for ; Fri, 10 Nov 2017 02:29:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 25AC228A6 for ; Fri, 10 Nov 2017 02:29:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id vAA2T6Dd088406 for ; Fri, 10 Nov 2017 02:29:07 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-scsi@FreeBSD.org Subject: [Bug 223381] mpt driver hangs with iscsi devices and scsi drives defined in VBOX FBSD guest Date: Fri, 10 Nov 2017 02:29:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: randomnoise058@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-scsi@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Nov 2017 02:29:07 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D223381 --- Comment #2 from Jim D. --- I am not sure about the Zabbix connection. Now that I have completed one project development cycle, I will try adding a VirtualBox SCSI drive to the FreeBSD-11 guest and see what happens with and without the Zabbix client active. --=20 You are receiving this mail because: You are the assignee for the bug.=