From owner-freebsd-net@FreeBSD.ORG Fri Mar 22 19:53:32 2013 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 53A07996 for ; Fri, 22 Mar 2013 19:53:32 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: from mail-da0-x231.google.com (mail-da0-x231.google.com [IPv6:2607:f8b0:400e:c00::231]) by mx1.freebsd.org (Postfix) with ESMTP id 2EF9F10C for ; Fri, 22 Mar 2013 19:53:32 +0000 (UTC) Received: by mail-da0-f49.google.com with SMTP id t11so2456721daj.36 for ; Fri, 22 Mar 2013 12:53:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:sender:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-type :content-transfer-encoding; bh=uY14WYZIc5jis+NAUlpavRuczryPbPawD2dS8pyIDAc=; b=pQjBkTsK1d2m+eQk4SQ5gfEKfnNljkgoxuw8cxzlbDPKFVDkum5HmS5SsvFTaU9YEc hEPkpJPTsAS05SMlZK4LWlI4SOUXYWyCsFIsrmLPghLKywI1htjAs6wXSYuKZXXCGcMY EvhZyt0J9g/wQW6/yZNHY3fpO9WVryAjiZ0Yhxze7MNVIXlo9hH+TneA9M4HOUlIKcFw egOE8FcgPLa/0d6BqgpTAiFBKVWgGknlMP2WffUR8w8bkNexTm6BZXRiXdFMpXRc7sea Wyita3HZdl04POuYh4dqNDdS9Jb/fVbQ6tgCXp2iE5YKxkknxx/Dw3uZ+ZF22nCSQTLi SjMg== X-Received: by 10.68.134.38 with SMTP id ph6mr4417023pbb.205.1363982012005; Fri, 22 Mar 2013 12:53:32 -0700 (PDT) Received: from [10.192.166.0] (stargate.chelsio.com. [67.207.112.58]) by mx.google.com with ESMTPS id wi7sm4110873pac.9.2013.03.22.12.53.29 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 22 Mar 2013 12:53:30 -0700 (PDT) Sender: Navdeep Parhar Message-ID: <514CB6B8.3050207@FreeBSD.org> Date: Fri, 22 Mar 2013 12:53:28 -0700 From: Navdeep Parhar User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130220 Thunderbird/17.0.3 MIME-Version: 1.0 To: Garrett Cooper Subject: Re: panic: 'Sleeping on "t4slptst" with the following non-sleepable locks held' when using cxgbe+lagg References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: hhash@isilon.com, freebsd-net@FreeBSD.org X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Mar 2013 19:53:32 -0000 Thanks for the bug report. I added this "t4 sleep test" sleep exactly for this purpose -- to catch cases where cxgbe(4) thinks it can sleep but it really can't. There is no need for a core, the stack has all the info I need. Regards, Navdeep On 03/22/13 12:43, Garrett Cooper wrote: > Unfortunately I don't have swap setup on this machine (not sure > why... I'll remedy that soon). Basically I was tcpdump'ing the > interface that was doing intense NFS I/O at the same time, and I ran > into this crash with cxgbe+lagg. Sources are a bit stale (~1.5 months > old). > Thanks, > -Garrett > > PS Please CC me as I don't receive emails from -net@. > > db> x/s version > version: FreeBSD 10.0-CURRENT #2 r+0db561c: Wed Feb 6 22:21:51 > PST 2013\012 > root@wf158.west.isilon.com:/usr/obj/usr/src/sys/ISI-GENERIC\012 > db> show msgbuf > msgbufp = 0xfffffe01bfffffb8 > magic = 63062, size = 98232, r= 290850, w = 293687, ptr = > 0xfffffe01bffe8000, cksum= 8071666 > Sleeping on "t4slptst" with the following non-sleepable locks held: > exclusive rw if_lagg rwlock (if_lagg rwlock) r = 0 > (0xfffffe01a66b3608) locked @ > /usr/src/sys/modules/if_lagg/../../net/if_lagg.c:1065 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff8498e26490 > kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff8498e26540 > witness_warn() at witness_warn+0x4a8/frame 0xffffff8498e26600 > _sleep() at _sleep+0x6c/frame 0xffffff8498e26690 > begin_synchronized_op() at begin_synchronized_op+0x38/frame 0xffffff8498e266f0 > cxgbe_ioctl() at cxgbe_ioctl+0x77/frame 0xffffff8498e26740 > if_setflag() at if_setflag+0xe1/frame 0xffffff8498e267b0 > ifpromisc() at ifpromisc+0x2c/frame 0xffffff8498e267e0 > lagg_setflags() at lagg_setflags+0x65/frame 0xffffff8498e26820 > lagg_ioctl() at lagg_ioctl+0x3d0/frame 0xffffff8498e268c0 > if_setflag() at if_setflag+0xe1/frame 0xffffff8498e26930 > ifpromisc() at ifpromisc+0x2c/frame 0xffffff8498e26960 > bpfioctl() at bpfioctl+0x84c/frame 0xffffff8498e269e0 > devfs_ioctl_f() at devfs_ioctl_f+0xf0/frame 0xffffff8498e26a40 > kern_ioctl() at kern_ioctl+0x1ce/frame 0xffffff8498e26a90 > sys_ioctl() at sys_ioctl+0x11f/frame 0xffffff8498e26ae0 > amd64_syscall() at amd64_syscall+0x265/frame 0xffffff8498e26bf0 > Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8498e26bf0 > --- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x800fffeca, rsp = > 0x7fffffffd3a8, rbp = 0x7fffffffd980 --- > Sleeping thread (tid 100775, pid 64749) owns a non-sleepable lock > KDB: stack backtrace of thread 100775: > sched_switch() at sched_switch+0x481/frame 0xffffff8498e26550 > mi_switch() at mi_switch+0x179/frame 0xffffff8498e26590 > sleepq_switch() at sleepq_switch+0x18a/frame 0xffffff8498e265d0 > sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff8498e26600 > _sleep() at _sleep+0x32c/frame 0xffffff8498e26690 > begin_synchronized_op() at begin_synchronized_op+0x38/frame 0xffffff8498e266f0 > cxgbe_ioctl() at cxgbe_ioctl+0x77/frame 0xffffff8498e26740 > if_setflag() at if_setflag+0xe1/frame 0xffffff8498e267b0 > ifpromisc() at ifpromisc+0x2c/frame 0xffffff8498e267e0 > lagg_setflags() at lagg_setflags+0x65/frame 0xffffff8498e26820 > lagg_ioctl() at lagg_ioctl+0x3d0/frame 0xffffff8498e268c0 > if_setflag() at if_setflag+0xe1/frame 0xffffff8498e26930 > ifpromisc() at ifpromisc+0x2c/frame 0xffffff8498e26960 > bpfioctl() at bpfioctl+0x84c/frame 0xffffff8498e269e0 > devfs_ioctl_f() at devfs_ioctl_f+0xf0/frame 0xffffff8498e26a40 > kern_ioctl() at kern_ioctl+0x1ce/frame 0xffffff8498e26a90 > sys_ioctl() at sys_ioctl+0x11f/frame 0xffffff8498e26ae0 > amd64_syscall() at amd64_syscall+0x265/frame 0xffffff8498e26bf0 > Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8498e26bf0 > --- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x800fffeca, rsp = > 0x7fffffffd3a8, rbp = 0x7fffffffd980 --- > panic: sleeping thread > cpuid = 2 >