From owner-freebsd-virtualization@FreeBSD.ORG Mon Nov 25 11:06:59 2013 Return-Path: Delivered-To: freebsd-virtualization@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 58F07621 for ; Mon, 25 Nov 2013 11:06:59 +0000 (UTC) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 47F272F61 for ; Mon, 25 Nov 2013 11:06:59 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.7/8.14.7) with ESMTP id rAPB6xCV090049 for ; Mon, 25 Nov 2013 11:06:59 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.7/8.14.7/Submit) id rAPB6wlY090047 for freebsd-virtualization@FreeBSD.org; Mon, 25 Nov 2013 11:06:58 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 25 Nov 2013 11:06:58 GMT Message-Id: <201311251106.rAPB6wlY090047@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-virtualization@FreeBSD.org Subject: Current problem reports assigned to freebsd-virtualization@FreeBSD.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Nov 2013 11:06:59 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/165252 virtualization[vimage] [pf] [panic] kernel panics with VIMAGE and PF o kern/161094 virtualization[vimage] [pf] [panic] kernel panic with pf + VIMAGE wh o kern/160541 virtualization[vimage][pf][patch] panic: userret: Returning on td 0x o kern/160496 virtualization[vimage] [pf] [patch] kernel panic with pf + VIMAGE o kern/148155 virtualization[vimage] [pf] Kernel panic with PF + VIMAGE kernel opt a kern/147950 virtualization[vimage] [carp] VIMAGE + CARP = kernel crash s kern/143808 virtualization[pf] pf does not work inside jail 7 problems total. From owner-freebsd-virtualization@FreeBSD.ORG Wed Nov 27 04:01:09 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7374DE39; Wed, 27 Nov 2013 04:01:09 +0000 (UTC) Received: from mail-lb0-x236.google.com (mail-lb0-x236.google.com [IPv6:2a00:1450:4010:c04::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id CBBD72473; Wed, 27 Nov 2013 04:01:08 +0000 (UTC) Received: by mail-lb0-f182.google.com with SMTP id u14so5023160lbd.41 for ; Tue, 26 Nov 2013 20:01:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:cc:content-type; bh=kDKCZQRjX3T0jKB6SL7waCMfdz6kQ79rzCGA9JfzpDY=; b=qU6M+F8THgCU1JhqZyaWwFurihh7ySh3WXWl6SGDPZj2GBJ/HiN/NOe6PCdC4+yg+c No7lGcw/M1xfAzyvvC9/xYPSCJCVziHieqOHqAsgJtRWO4vJ522q2QRYRwuTjK3Ne0bg SSo+wcKnaiqIYhmO++NfBRjqZWdIDjLnQQsriC9DyES4wzQzRGyYZHDVQr76HM00LGDR sRXn4k5WrCfYAu5fggfWqhCccDfxOSMeTQTdJrG1Sx4Okuyrsv0BOzM7iSjpA923vZMJ qrFt4Kascu3oqdYZyiW7rXdCy15DA8b8bBZ7YUKefw05NHJZx2uQJt5G4/sRBqKUxIPz Q9Iw== MIME-Version: 1.0 X-Received: by 10.152.87.142 with SMTP id ay14mr21925346lab.7.1385524866904; Tue, 26 Nov 2013 20:01:06 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.120.232 with HTTP; Tue, 26 Nov 2013 20:01:06 -0800 (PST) Date: Tue, 26 Nov 2013 20:01:06 -0800 X-Google-Sender-Auth: u0WropekiSswkL6V5kE8kG3OBKw Message-ID: Subject: VIMAGE: Freed UMA keg was not empty From: Craig Rodrigues To: "freebsd-virtualization@freebsd.org" , Adrian Chadd Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.16 Cc: thierry.herbelot@free.fr X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Nov 2013 04:01:09 -0000 Adrian, As part of looking at this bug in FreeNAS: "Panic on new jail with vnet" https://bugs.freenas.org/issues/3102 I started looking at this thread: http://lists.freebsd.org/pipermail/freebsd-current/2010-November/021280.html Based on this clue from Thiery: http://lists.freebsd.org/pipermail/freebsd-current/2010-November/021291.html I fixed some VIMAGE related memory leaks related to routetbl. I also fixed some VIMAGE related kernel panics when I tried creating and deleting lots of jails: http://lists.freebsd.org/pipermail/svn-src-all/2013-November/077178.html http://lists.freebsd.org/pipermail/svn-src-all/2013-November/077192.html http://lists.freebsd.org/pipermail/svn-src-all/2013-November/077195.html I haven't eliminated all the "Freed UMA keg was not empty" error messages. Do you have any recommendations for how I can track down the last few UMA related memory leaks? I am new to debugging UMA so would appreciate any pointers that you may have. -- Craig From owner-freebsd-virtualization@FreeBSD.ORG Wed Nov 27 04:25:55 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E253F25E for ; Wed, 27 Nov 2013 04:25:55 +0000 (UTC) Received: from ims7bld2.solarus.net (smtp2.solarus.net [209.94.171.122]) by mx1.freebsd.org (Postfix) with ESMTP id B5127254D for ; Wed, 27 Nov 2013 04:25:54 +0000 (UTC) Received: from mail.solarus.net (mail.tznet.com [209.94.172.150]) by ims7bld2.solarus.net with ESMTP id rAR44VqS020586 for ; Tue, 26 Nov 2013 22:04:31 -0600 (CST) Date: Tue, 26 Nov 2013 22:04:31 -0600 (CST) From: Scott Pilz To: freebsd-virtualization@freebsd.org Subject: bhyve - non *bsd guests Message-ID: User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; format=flowed; charset=US-ASCII X-Solarus-VirusScanner: Clean X-Spam-Status: No X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Nov 2013 04:25:55 -0000 Firstly I'd like to say thank you for those involved in the bhyve project. It has come a long way in a short amount of time, and I'm staying on top of the changes as much as possible. I've been running jails since forever and this new VM, native to FreeBSD, has impressed me. I've been testing out bhyve on a dual X5570/50GB memory. I have no problem running FreeBSD 9.2, 10.0-BETA2, 11.0-CURRENT and FreeNAS (during my testing I've run 6 in total, with load on each guest and I've had no problems). The host machine is 10.0-BETA3, standard install and no changes to the BSD installation. I'm trying to run guests outside of the BSD spectrum (grub installed, everything needed should be installed). I've tried OpenBSD as well as Ubuntu thus far - the results are the same. The error I'm getting is: VM unrestricted guest capability required Error in initializing VM I'm using the bhyve-script.tar scripts and following the instructions for each host. I've been in and out of BIOS many times and I can't seem to find any setting that would cause this. According to ark.intel.com, the processor supports VT-x, EPT, etc (http://ark.intel.com/products/spec/SLBF3). I'm open to suggestions, the only thing I can think of is a) I'm doing something wrong, b) the CPU does not support what I'm trying to do or c) this is an unknown problem that there may be a fix for in the future. Thanks Scott From owner-freebsd-virtualization@FreeBSD.ORG Wed Nov 27 04:41:22 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id F2726787 for ; Wed, 27 Nov 2013 04:41:22 +0000 (UTC) Received: from mail-pb0-f49.google.com (mail-pb0-f49.google.com [209.85.160.49]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id CC3222638 for ; Wed, 27 Nov 2013 04:41:22 +0000 (UTC) Received: by mail-pb0-f49.google.com with SMTP id jt11so9396874pbb.8 for ; Tue, 26 Nov 2013 20:41:16 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :subject:references:in-reply-to:content-type :content-transfer-encoding; bh=f9421Mja+OX3qetxcLynbaIB1SGDASxfv6dUro75pPw=; b=bg3dwXfJMYqJMviHsOv5Q3WVhokbGmSBW2CAXhBuvnPGSGgZyx5pdlk2HNk4+uhukI wpwA5lgHZGJJraf25/hKbupXflenyIaU9P3QF192OUiH0vHg0kM4Am7jRnTz5cvDaFP+ eT81/iKnnZDKxm4plIrdievHOpBJREFTAHfAXRK9PU6t8Xim4KauW4ZVFSchR2bzln3i brtYTwd5n41Ce2lAN5WMnbG8bcRZW2+IuuCGqD1WS2EMFh1KmoLju49z7YJElCaJcvli U4EOv0uVChodUxZlDbvrCbyMwxPvsZdOFowO6vd59Zy2vCdXuG1XEnpMYYd8oaO9ALYa VmtA== X-Gm-Message-State: ALoCoQkZIiqFgY8MXx1U2DcRswPoOPDwOHUAoMr0+hMZ3fi1u6F1YfRzFCRUfnqEXTNfgb7y/B7U X-Received: by 10.68.130.72 with SMTP id oc8mr149207pbb.200.1385526793662; Tue, 26 Nov 2013 20:33:13 -0800 (PST) Received: from Michaels-MacBook-Pro.local (c-98-246-202-204.hsd1.or.comcast.net. [98.246.202.204]) by mx.google.com with ESMTPSA id yh1sm84565276pbc.21.2013.11.26.20.33.12 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 26 Nov 2013 20:33:12 -0800 (PST) Message-ID: <52957607.4010505@callfortesting.org> Date: Tue, 26 Nov 2013 20:33:11 -0800 From: Michael Dexter User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:17.0) Gecko/20130801 Thunderbird/17.0.8 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: bhyve - non *bsd guests References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Nov 2013 04:41:23 -0000 On 11/26/13 8:04 PM, Scott Pilz wrote: > Firstly I'd like to say thank you for those involved in the bhyve > project. You're welcome! It has indeed come a long way and things are accelerating quickly. Hurah Neel and Peter. > The error I'm getting is: > > VM unrestricted guest capability required > Error in initializing VM That is a new one to me and given that you have FreeBSD VMs working, I personally don't know what might trigger this. I trust this is bare-metal and not under say, VMware nested VT-x? Hopefully the developers will chime in. Michael From owner-freebsd-virtualization@FreeBSD.ORG Wed Nov 27 04:49:13 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 24B5B80B for ; Wed, 27 Nov 2013 04:49:13 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id DE8F32656 for ; Wed, 27 Nov 2013 04:49:12 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id 1FAAB12179; Wed, 27 Nov 2013 14:49:11 +1000 (EST) Received: from Peters-MacBook-Pro.local (c-67-161-27-37.hsd1.ca.comcast.net [67.161.27.37]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BQJ17537 (AUTH peterg@ptree32.com.au); Wed, 27 Nov 2013 14:49:10 +1000 Message-ID: <529579CD.9010509@freebsd.org> Date: Tue, 26 Nov 2013 20:49:17 -0800 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:17.0) Gecko/20130801 Thunderbird/17.0.8 MIME-Version: 1.0 To: Scott Pilz Subject: Re: bhyve - non *bsd guests References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Nov 2013 04:49:13 -0000 Hi Scott, > The error I'm getting is: > > VM unrestricted guest capability required > Error in initializing VM It's this one: > b) the CPU does not support what I'm trying to do Your 5570 CPU is a first-gen Nehalem. These models don't have 'unrestricted-guest' VT-x support which is required to run code in 16/32-bit mode with paging disabled. This feature arrived with Westmere and successors. grub-bhyve boots Linux and OpenBSD in 32-bit "flat" mode - protected mode with paging disabled. This can only work if unrestricted-guest is supported by the CPU. Other hypervisors work around this by using s/w instruction emulation until paging is enabled. You'll find the same error if you start up a FreeBSD VM with > 1 vCPU since the AP spinup code is started in 16-bit real mode. This doesn't show up with a single-vCPU FreeBSD guest since bhyveload sets up a 64-bit execution environment for the kernel. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Wed Nov 27 04:54:24 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A70E7966 for ; Wed, 27 Nov 2013 04:54:24 +0000 (UTC) Received: from ims7bld1.solarus.net (smtp1.solarus.net [209.94.172.158]) by mx1.freebsd.org (Postfix) with ESMTP id 78CD926A0 for ; Wed, 27 Nov 2013 04:54:23 +0000 (UTC) Received: from mail.solarus.net (mail.tznet.com [209.94.172.150]) by ims7bld1.solarus.net with ESMTP id rAR4q6Mc019038; Tue, 26 Nov 2013 22:52:14 -0600 (CST) Date: Tue, 26 Nov 2013 22:52:06 -0600 (CST) From: Scott Pilz To: Michael Dexter Subject: Re: bhyve - non *bsd guests In-Reply-To: <52957607.4010505@callfortesting.org> Message-ID: References: <52957607.4010505@callfortesting.org> User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; format=flowed; charset=US-ASCII X-Solarus-VirusScanner: Clean X-Spam-Status: No Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Nov 2013 04:54:24 -0000 Correct, the hardware itself is a blade off of an Intel Modular Server. These blades act and perform (and basically are) like any normal server. igb interfaces, SCSI direct access drives, nuttin special about the setup. I'll throw the dmesg.boot out here if anyone wants it (but I don't think it will help in this case). The *BSD guests running (including the various versions of FreeBSD and FreeNAS) are running great (limited to one processor, various memory for each ranging from 512MB to 2GB). I ubench'd each system as well and they perform nearly as well as the host (the numbers in the end were so close it didn't count, in fact). I'm very impressed, and excited, on where this project is going. Despite the higher security compared to jails, the idea of not having to use dozens of fwds and complicated ipfw statements has me truly excited. Scott On Tue, 26 Nov 2013, Michael Dexter wrote: > On 11/26/13 8:04 PM, Scott Pilz wrote: >> Firstly I'd like to say thank you for those involved in the bhyve >> project. > > You're welcome! It has indeed come a long way and things are > accelerating quickly. Hurah Neel and Peter. > >> The error I'm getting is: >> >> VM unrestricted guest capability required >> Error in initializing VM > > That is a new one to me and given that you have FreeBSD VMs working, I > personally don't know what might trigger this. > > I trust this is bare-metal and not under say, VMware nested VT-x? > > Hopefully the developers will chime in. > > Michael > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@FreeBSD.ORG Wed Nov 27 04:56:19 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 74EFFAE6; Wed, 27 Nov 2013 04:56:19 +0000 (UTC) Received: from ims7bld2.solarus.net (smtp2.solarus.net [209.94.171.122]) by mx1.freebsd.org (Postfix) with ESMTP id 45D8826AA; Wed, 27 Nov 2013 04:56:18 +0000 (UTC) Received: from mail.solarus.net (mail.tznet.com [209.94.172.150]) by ims7bld2.solarus.net with ESMTP id rAR4uBLH063204; Tue, 26 Nov 2013 22:56:11 -0600 (CST) Date: Tue, 26 Nov 2013 22:56:11 -0600 (CST) From: Scott Pilz To: Peter Grehan Subject: Re: bhyve - non *bsd guests In-Reply-To: <529579CD.9010509@freebsd.org> Message-ID: References: <529579CD.9010509@freebsd.org> User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Solarus-VirusScanner: Clean X-Spam-Status: No Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Nov 2013 04:56:19 -0000 Thank you for your quick answer, and I'm not surprised by this. Makes perfect sense. I ran into the 1-CPU issue when I first started my testing. I'll ensure that the new IX blade system we're going with as supported processors. Keep up the great work. I'll be happy to do some extensive testing under various environments on this project if needed. Scott On Tue, 26 Nov 2013, Peter Grehan wrote: > Hi Scott, > >> The error I'm getting is: >> >> VM unrestricted guest capability required >> Error in initializing VM > > It's this one: > >> b) the CPU does not support what I'm trying to do > > Your 5570 CPU is a first-gen Nehalem. These models don't have > 'unrestricted-guest' VT-x support which is required to run code in 16/32-bit > mode with paging disabled. This feature arrived with Westmere and successors. > > grub-bhyve boots Linux and OpenBSD in 32-bit "flat" mode - protected mode > with paging disabled. This can only work if unrestricted-guest is supported > by the CPU. Other hypervisors work around this by using s/w instruction > emulation until paging is enabled. > > You'll find the same error if you start up a FreeBSD VM with > 1 vCPU since > the AP spinup code is started in 16-bit real mode. > > This doesn't show up with a single-vCPU FreeBSD guest since bhyveload sets > up a 64-bit execution environment for the kernel. > > later, > > Peter. > > From owner-freebsd-virtualization@FreeBSD.ORG Wed Nov 27 10:05:55 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8D12A55F; Wed, 27 Nov 2013 10:05:55 +0000 (UTC) Received: from mail-qa0-x235.google.com (mail-qa0-x235.google.com [IPv6:2607:f8b0:400d:c00::235]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 40CEB253D; Wed, 27 Nov 2013 10:05:55 +0000 (UTC) Received: by mail-qa0-f53.google.com with SMTP id j5so9155144qaq.19 for ; Wed, 27 Nov 2013 02:05:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=lWsY0yqB7Syq1+GztCapUw48HO61MgjmfN0maurMgkY=; b=WbpriJRv9BzOam6xx45be+ABHiZK9S85wFWgoxZJ0fpAIRdjystoTsYe3c2K0IQuU2 7T6apjFnyWPmYJZi7rnX7rIKXNsb+PGQzGQ6SkXlMmaYjjnPwemVrctYN1r6gPhnsusk d+BzbJUcODk3mgo6eugRhp4mJieLDDaEDoK7nUX3RbsvPUQQskWk13d7MoaoJjJWhEX+ IL5VGYZrOSGLBV9IBVX1Di1XMuYmX1BXFZhv4kyi365DCSilvxHLjuLYuSY2sJRi4T6F qltMEHPxe2DbaYZcXEZJJ74a4t2eXBmr7SWjlHRJpanV2e9AyFHjBNcF418wdH61x4j2 3YIQ== MIME-Version: 1.0 X-Received: by 10.224.111.197 with SMTP id t5mr64952345qap.49.1385546754318; Wed, 27 Nov 2013 02:05:54 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.224.207.66 with HTTP; Wed, 27 Nov 2013 02:05:54 -0800 (PST) In-Reply-To: References: Date: Wed, 27 Nov 2013 02:05:54 -0800 X-Google-Sender-Auth: zpbEid4-QWvLaztpDl3CWSFwN7A Message-ID: Subject: Re: VIMAGE: Freed UMA keg was not empty From: Adrian Chadd To: Craig Rodrigues Content-Type: text/plain; charset=ISO-8859-1 Cc: thierry.herbelot@free.fr, "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Nov 2013 10:05:55 -0000 Well, the first step is figuring out which UMA zones are actually problematic. Isn't it logging which zones aren't empty? -a On 26 November 2013 20:01, Craig Rodrigues wrote: > Adrian, > > As part of looking at this bug in FreeNAS: > > "Panic on new jail with vnet" > https://bugs.freenas.org/issues/3102 > > I started looking at this thread: > > http://lists.freebsd.org/pipermail/freebsd-current/2010-November/021280.html > > Based on this clue from Thiery: > > http://lists.freebsd.org/pipermail/freebsd-current/2010-November/021291.html > > I fixed some VIMAGE related memory leaks related to routetbl. > I also fixed some VIMAGE related kernel panics when > I tried creating and deleting lots of jails: > > http://lists.freebsd.org/pipermail/svn-src-all/2013-November/077178.html > http://lists.freebsd.org/pipermail/svn-src-all/2013-November/077192.html > http://lists.freebsd.org/pipermail/svn-src-all/2013-November/077195.html > > I haven't eliminated all the "Freed UMA keg was not empty" > error messages. > > Do you have any recommendations for how I can track down the last > few UMA related memory leaks? I am new to debugging UMA so > would appreciate any pointers that you may have. > -- > Craig From owner-freebsd-virtualization@FreeBSD.ORG Wed Nov 27 14:13:00 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 56E64F7 for ; Wed, 27 Nov 2013 14:13:00 +0000 (UTC) Received: from mail-forward5.uio.no (mail-forward5.uio.no [IPv6:2001:700:100:10::37]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id D078622C0 for ; Wed, 27 Nov 2013 14:12:59 +0000 (UTC) Received: from exim by mail-out5.uio.no with local-bsmtp (Exim 4.80.1) (envelope-from ) id 1VlfrM-0001tt-02 for freebsd-virtualization@freebsd.org; Wed, 27 Nov 2013 15:12:56 +0100 Received: from mail-mx3.uio.no ([129.240.10.44]) by mail-out5.uio.no with esmtp (Exim 4.80.1) (envelope-from ) id 1VlfrL-0001tp-V8; Wed, 27 Nov 2013 15:12:55 +0100 Received: from shiva.uio.no ([129.240.203.14]) by mail-mx3.uio.no with esmtp (Exim 4.80) (envelope-from ) id 1VlfrL-0000Ku-Gt; Wed, 27 Nov 2013 15:12:55 +0100 Message-ID: <5295FDE6.4060307@thanelange.no> Date: Wed, 27 Nov 2013 15:12:54 +0100 From: Gyrd Thane Lange User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20131028 Thunderbird/17.0.10 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: Running bhyve on a AMD 1075T Phenom References: <5256D59A.20904@digiware.nl> <5256DD29.6090007@freebsd.org> <14A565E7-7D26-4C32-B73A-F5FAA16BC837@digiware.nl> <9A4BF6B0-91F1-43C5-B5D5-90486123336D@digiware.nl> <525738CE.9000708@freebsd.org> <525C837E.7060302@freebsd.org> <525CF0A1.6060600@digiware.nl> In-Reply-To: <525CF0A1.6060600@digiware.nl> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-UiO-Spam-info: not spam, SpamAssassin (score=-5.0, required=5.0, autolearn=disabled, UIO_MAIL_IS_INTERNAL=-5, uiobl=NO, uiouri=NO) X-UiO-Scanned: 8EB866751F52E03CD7EE21271BBDF51905712CE7 X-UiO-SPAM-Test: remote_host: 129.240.203.14 spam_score: -49 maxlevel 80 minaction 2 bait 0 mail/h: 1 total 49 max/h 6 blacklist 0 greylist 0 ratelimit 0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Nov 2013 14:13:00 -0000 Den 15. okt. 2013 09:37, skrev Willem Jan Withagen: > On 2013-10-15 1:51, Peter Grehan wrote: >> Hi Craig, >> >>> There was a lot of non-trivial stuff done in the amd64 pmap code and the >>> BHyve intel module >>> for bhyve_npt_pmap, and these changes have not been made for the amd svm >>> code. > > Right, I looked at it, and decided it was way easier to just run the svm > tree > >> Yes, that's right. >> >>> Does anyone have patches for the svm code? >> >> Not yet - Anish is working on it. > > looking forward to test. Hi, I too would like to test. I have an AMD FX-8150 and am running 11-CURRENT. FreeBSD 11.0-CURRENT #0 r258495: Sat Nov 23 15:25:54 CET 2013 root@onyx.thanelange.no:/usr/src/sys/ONYX amd64 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 CPU: AMD FX(tm)-8150 Eight-Core Processor (3624.28-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x600f12 Family = 0x15 Model = 0x1 Stepping = 2 Features=0x178bfbff Features2=0x1e98220b AMDFeatures=0x2e500800 AMDFeatures2=0x1c9bfff # kldload vmm amd_iommu_init: not implemented amdv_init: not implemented amdv_cleanup: not implemented module_register_init: MOD_LOAD (vmm, 0xffffffff81abcbb0, 0) error 6 I appears the AMD patches for the vmm module have not made it to CURRENT yet. Would it be easy to prepare a patch-set? Or give me some hints on how to do it myself? I have earlier tried to merge (locally) the changes to vmm from the bhyve project branch, but I got stuck on some dependencies (headers and functions) that are probably defined else where in the source tree. (Can't give the exact error message as this was on previous installation.) Regards, Gyrd ^_^ > > --WjW From owner-freebsd-virtualization@FreeBSD.ORG Wed Nov 27 20:46:10 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 0A9F7A86; Wed, 27 Nov 2013 20:46:10 +0000 (UTC) Received: from mail-lb0-x235.google.com (mail-lb0-x235.google.com [IPv6:2a00:1450:4010:c04::235]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id C9E992723; Wed, 27 Nov 2013 20:45:24 +0000 (UTC) Received: by mail-lb0-f181.google.com with SMTP id q8so5552617lbi.26 for ; Wed, 27 Nov 2013 12:45:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=vSFmaNO2nqArQYqtiHd8AMgdgDD0uSiK2eSTXpHwtK8=; b=iPau9u2rPYEG/o0r23YKBq82B4aCgRdJDqpZnnixKtSlwBR8WZtFLBQQ7Ge57t3nnE 9rKZah6M5+YNYUuDvNwb+X9JHeKnKfGWkFIewN1ND6/CutdavqgTlWVck0d8dCp0+aQ7 60vomK+CkKnYhGvBAxk/HULq1Kt0ySVZc0LABkYnn0Zo2Usv32e/bZKLQqkNUBeYPIHk xm36YIFv/ypMVbnkHhtcRAFsWAGw+My+oGVxLPzSJKU9EYc4CoB0OzbHbI8CMdOOX9uu qE+gtw/w3admvDsnHj0xWo4GmoywFmAhCWRgBmMg3NDYAmDz4f1fAilJRbVRfaX8g3pd rSNQ== MIME-Version: 1.0 X-Received: by 10.152.26.131 with SMTP id l3mr2654771lag.29.1385585119662; Wed, 27 Nov 2013 12:45:19 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.120.232 with HTTP; Wed, 27 Nov 2013 12:45:19 -0800 (PST) In-Reply-To: References: Date: Wed, 27 Nov 2013 12:45:19 -0800 X-Google-Sender-Auth: mxJVFwM22M8_T11jtZOaY08zCRk Message-ID: Subject: Re: VIMAGE: Freed UMA keg was not empty From: Craig Rodrigues To: Adrian Chadd Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.16 Cc: thierry.herbelot@free.fr, "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Nov 2013 20:46:10 -0000 On Wed, Nov 27, 2013 at 2:05 AM, Adrian Chadd wrote: > > Well, the first step is figuring out which UMA zones are actually > problematic. Isn't it logging which zones aren't empty? The error messages on the console look like this: Freed UMA keg was not empty (203 items). Lost 1 pages of memory. Freed UMA keg was not empty (36 items). Lost 2 pages of memory. That doesn't really tell which UMA zone isn't empty. Is there some technqiue to figure this out? I tried "vmstat -z" and "vmstat -m", but while those gave clues, it didn't point to which UMA zone was leaking. Is there some other technique or tool that I can use? -- Craig From owner-freebsd-virtualization@FreeBSD.ORG Wed Nov 27 20:51:01 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 0B31CCBE for ; Wed, 27 Nov 2013 20:51:01 +0000 (UTC) Received: from mail-pd0-f182.google.com (mail-pd0-f182.google.com [209.85.192.182]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id D5851278A for ; Wed, 27 Nov 2013 20:50:36 +0000 (UTC) Received: by mail-pd0-f182.google.com with SMTP id v10so10608548pde.41 for ; Wed, 27 Nov 2013 12:50:17 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :subject:references:in-reply-to:content-type :content-transfer-encoding; bh=YKs7od0FyVbiBMpOhbN9wHt32P2WCeD1DOudSiyCytM=; b=mt9TUSB9PiTO7FR+Rt9aHoEefdxT8UBeYmnkyJPMfQ9b3XRPGSIsYPH7EXYjhVT5A6 Gs7dIfjCwvkQounPqcohZtiBL4mcdhz+zWCa5c1+8INKj55IIUj6LV53XaNr+A0omxEv kWWFNqx1bhp8a5suHZHBLRgmqxRQsqK0B3Re8teNxFmP6mnofhPA6ssJ50u9Sm6pe1g3 wzT3vNFfIuiAMx3zi/HgeGuzHoj1VYCMweA8JQr5fnn+93oU21Ph1iMm3fTF8ooDA0De 0bRxaWntgBZz/KfiLgQQUj4Wgddaavnyi/+VPSJl2xbMVNHnnm/IUFb7J0RhntmF7M1o BLuw== X-Gm-Message-State: ALoCoQmdJHxcxviy2PiErykrdd7VIU8vfdUESoX9v54pc635ra4NWrq5NyMqZ7hjDNYZgwe65Ty3 X-Received: by 10.69.31.1 with SMTP id ki1mr7113901pbd.124.1385585417694; Wed, 27 Nov 2013 12:50:17 -0800 (PST) Received: from Michaels-MacBook-Pro.local (c-98-246-202-204.hsd1.or.comcast.net. [98.246.202.204]) by mx.google.com with ESMTPSA id gh3sm90099377pbb.2.2013.11.27.12.50.16 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 27 Nov 2013 12:50:16 -0800 (PST) Message-ID: <52965B07.7060307@callfortesting.org> Date: Wed, 27 Nov 2013 12:50:15 -0800 From: Michael Dexter User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:17.0) Gecko/20130801 Thunderbird/17.0.8 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: Running bhyve on a AMD 1075T Phenom References: <5256D59A.20904@digiware.nl> <5256DD29.6090007@freebsd.org> <14A565E7-7D26-4C32-B73A-F5FAA16BC837@digiware.nl> <9A4BF6B0-91F1-43C5-B5D5-90486123336D@digiware.nl> <525738CE.9000708@freebsd.org> <525C837E.7060302@freebsd.org> <525CF0A1.6060600@digiware.nl> <5295FDE6.4060307@thanelange.no> In-Reply-To: <5295FDE6.4060307@thanelange.no> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Nov 2013 20:51:01 -0000 On 11/27/13 6:12 AM, Gyrd Thane Lange wrote: > I appears the AMD patches for the vmm module have not made it to CURRENT > yet. Would it be easy to prepare a patch-set? Or give me some hints on > how to do it myself? Correct. Did you try one of the SVM snapshots linked at bhyve.org or build a bhyve-svm project branch yourself? Michael From owner-freebsd-virtualization@FreeBSD.ORG Wed Nov 27 21:11:35 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 524C63A7; Wed, 27 Nov 2013 21:11:35 +0000 (UTC) Received: from mail-qa0-x236.google.com (mail-qa0-x236.google.com [IPv6:2607:f8b0:400d:c00::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 05B6C2945; Wed, 27 Nov 2013 21:11:34 +0000 (UTC) Received: by mail-qa0-f54.google.com with SMTP id f11so10856786qae.13 for ; Wed, 27 Nov 2013 13:11:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=QJ6LGlbFVmLygxkBMyZLH6vEh1JVqoKkdMO0PGorKzc=; b=t7q089PruzeFVtJQyLbBFtr75zV92zR8ncL93X4jBDUDfN50shhyM7fMY4pnX7ErHy Wd5MBpa9b7NMgmTpsDG0HWwMs7KixxVNOOq1ocMoyZBcCMzFtu8TdBMAqN6maW6hxZZx vM+buuyAbE8BxtqNH15hcz46U3K2DXxlY0NOcv1vmZ+KYTsgWVsgqzraLzcLyWFcHRYn JdK9UVk7ugaU7cGoTzn1ZVdHH3h+F4pbAX6EyzEffaYHa8naG4APv27pp3kyxyT0uQie Oex0dUoMayycvS37133huk0tgYeaCXxAIAYblWJcILmtgmAfQos7xWq5JTQ9GKiJGlIg h9hw== MIME-Version: 1.0 X-Received: by 10.49.59.70 with SMTP id x6mr70242964qeq.17.1385586694077; Wed, 27 Nov 2013 13:11:34 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.224.53.200 with HTTP; Wed, 27 Nov 2013 13:11:34 -0800 (PST) In-Reply-To: References: Date: Wed, 27 Nov 2013 13:11:34 -0800 X-Google-Sender-Auth: yedOozHeIZMRG1FUsRDc87ibZyQ Message-ID: Subject: Re: VIMAGE: Freed UMA keg was not empty From: Adrian Chadd To: Craig Rodrigues Content-Type: text/plain; charset=ISO-8859-1 Cc: thierry.herbelot@free.fr, "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Nov 2013 21:11:35 -0000 Modify that function to print out keg->uk_name as well. -a On 27 November 2013 12:45, Craig Rodrigues wrote: > > > > On Wed, Nov 27, 2013 at 2:05 AM, Adrian Chadd wrote: >> >> Well, the first step is figuring out which UMA zones are actually >> problematic. Isn't it logging which zones aren't empty? > > > > The error messages on the console look like this: > > Freed UMA keg was not empty (203 items). Lost 1 pages of memory. > Freed UMA keg was not empty (36 items). Lost 2 pages of memory. > > > > That doesn't really tell which UMA zone isn't empty. > > Is there some technqiue to figure this out? I tried "vmstat -z" and > > "vmstat -m", but while those gave clues, it didn't point to which UMA zone > was leaking. > > > Is there some other technique or tool that I can use? > > -- > > Craig From owner-freebsd-virtualization@FreeBSD.ORG Thu Nov 28 15:32:36 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 786F7644 for ; Thu, 28 Nov 2013 15:32:36 +0000 (UTC) Received: from mail-forward2.uio.no (mail-forward2.uio.no [IPv6:2001:700:100:10::71]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id F04F714CE for ; Thu, 28 Nov 2013 15:32:35 +0000 (UTC) Received: from exim by mail-out2.uio.no with local-bsmtp (Exim 4.75) (envelope-from ) id 1Vm3Zx-0003DF-0K for freebsd-virtualization@freebsd.org; Thu, 28 Nov 2013 16:32:33 +0100 Received: from mail-mx6.uio.no ([129.240.10.40]) by mail-out2.uio.no with esmtp (Exim 4.75) (envelope-from ) id 1Vm3Zw-0003DC-Vn for freebsd-virtualization@freebsd.org; Thu, 28 Nov 2013 16:32:32 +0100 Received: from shiva.uio.no ([129.240.203.14]) by mail-mx6.uio.no with esmtp (Exim 4.80.1) (envelope-from ) id 1Vm3Zw-0007lR-G9 for freebsd-virtualization@freebsd.org; Thu, 28 Nov 2013 16:32:32 +0100 Message-ID: <52976210.7040709@thanelange.no> Date: Thu, 28 Nov 2013 16:32:32 +0100 From: Gyrd Thane Lange User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20131028 Thunderbird/17.0.10 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: Running bhyve on a AMD 1075T Phenom References: <5256D59A.20904@digiware.nl> <5256DD29.6090007@freebsd.org> <14A565E7-7D26-4C32-B73A-F5FAA16BC837@digiware.nl> <9A4BF6B0-91F1-43C5-B5D5-90486123336D@digiware.nl> <525738CE.9000708@freebsd.org> <525C837E.7060302@freebsd.org> <525CF0A1.6060600@digiware.nl> <5295FDE6.4060307@thanelange.no> <52965B07.7060307@callfortesting.org> In-Reply-To: <52965B07.7060307@callfortesting.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-UiO-Spam-info: not spam, SpamAssassin (score=-5.0, required=5.0, autolearn=disabled, UIO_MAIL_IS_INTERNAL=-5, uiobl=NO, uiouri=NO) X-UiO-Scanned: 1AD8DBBB19BB77B2980E84BC29F9FE347AA76062 X-UiO-SPAM-Test: remote_host: 129.240.203.14 spam_score: -49 maxlevel 80 minaction 2 bait 0 mail/h: 1 total 52 max/h 6 blacklist 0 greylist 0 ratelimit 0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Nov 2013 15:32:36 -0000 Den 27. nov. 2013 21:50, skrev Michael Dexter: > On 11/27/13 6:12 AM, Gyrd Thane Lange wrote: >> I appears the AMD patches for the vmm module have not made it to CURRENT >> yet. Would it be easy to prepare a patch-set? Or give me some hints on >> how to do it myself? > > Correct. Did you try one of the SVM snapshots linked at bhyve.org or > build a bhyve-svm project branch yourself? This is my main machine at home that is in continual use for everything, so I'm hoping to avoid changing to a different branch. But I can briefly try dual booting with a spare disk containing the project branch to find out if my machine supports bhyve at all. To clarify: I'm already aware of the bhyve-svm project branch, but rather than run the full branch I'm hoping for some insight into which commits (in the branch) are essential in running bhyve on AMD. Gyrd ^_^ > > Michael > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@FreeBSD.ORG Thu Nov 28 15:52:26 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id F21EEB46 for ; Thu, 28 Nov 2013 15:52:26 +0000 (UTC) Received: from mail-ve0-x22b.google.com (mail-ve0-x22b.google.com [IPv6:2607:f8b0:400c:c01::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id A8535160A for ; Thu, 28 Nov 2013 15:52:26 +0000 (UTC) Received: by mail-ve0-f171.google.com with SMTP id pa12so6243899veb.16 for ; Thu, 28 Nov 2013 07:52:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=sqAfcqLQRbvkYiWR9SRVIZOKTkBkVw4OBfSkbngcBE0=; b=NNyTEPnJnXT9mpDA9xRwEmcr/L5LOYQ0lER6ZbKz34z+iwg9SGDEegQwN3F62USYeh Sy5eYLZAVAnqNLy2heze5wA5tunAPzoffwOK2YMzmP3MWPybZOdIbHZ+SaUwQTVDIY3I M7GONLOHNtJ3BMW2pOeaj4ZUwT72nDFmURhty0xWE1VZAj7m4B1uOXGeMuLdBQbNXcXv hw1hZHs7kI2Iufps8nzdpJaTBSV82i9SAkADfHMZ20x+4RQI71CLy2Sjz04X4Bp3yq5b Afc5VRgNVNjFmSpfK/Vzq7CogZra8WBzrNBhvD1h+NB2JBaLj+ooG9UoRWH6P9UjEPe6 Kq1A== MIME-Version: 1.0 X-Received: by 10.220.144.80 with SMTP id y16mr38971377vcu.4.1385653945004; Thu, 28 Nov 2013 07:52:25 -0800 (PST) Received: by 10.221.59.135 with HTTP; Thu, 28 Nov 2013 07:52:24 -0800 (PST) In-Reply-To: <52976210.7040709@thanelange.no> References: <5256D59A.20904@digiware.nl> <5256DD29.6090007@freebsd.org> <14A565E7-7D26-4C32-B73A-F5FAA16BC837@digiware.nl> <9A4BF6B0-91F1-43C5-B5D5-90486123336D@digiware.nl> <525738CE.9000708@freebsd.org> <525C837E.7060302@freebsd.org> <525CF0A1.6060600@digiware.nl> <5295FDE6.4060307@thanelange.no> <52965B07.7060307@callfortesting.org> <52976210.7040709@thanelange.no> Date: Thu, 28 Nov 2013 09:52:24 -0600 Message-ID: Subject: Re: Running bhyve on a AMD 1075T Phenom From: "Sam Fourman Jr." To: Gyrd Thane Lange Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.16 Cc: FreeBSD virtualization mailing list X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Nov 2013 15:52:27 -0000 On Thu, Nov 28, 2013 at 9:32 AM, Gyrd Thane Lange wrote: > Den 27. nov. 2013 21:50, skrev Michael Dexter: > > On 11/27/13 6:12 AM, Gyrd Thane Lange wrote: >> >>> I appears the AMD patches for the vmm module have not made it to CURRENT >>> yet. Would it be easy to prepare a patch-set? Or give me some hints on >>> how to do it myself? >>> >> >> Correct. Did you try one of the SVM snapshots linked at bhyve.org or >> build a bhyve-svm project branch yourself? >> > > This is my main machine at home that is in continual use for everything, > so I'm hoping to avoid changing to a different branch. But I can briefly > try dual booting with a spare disk containing the project branch to find > out if my machine supports bhyve at all. > > To clarify: I'm already aware of the bhyve-svm project branch, but rather > than run the full branch I'm hoping for some insight into which commits (in > the branch) are essential in running bhyve on AMD. > > Gyrd ^_^ > > For what it is worth, I have many AMD cpu's and I am waiting to do more testing when amd-svm hits the HEAD branch... I test so many patches, that running a separate project branch is complex. are we close to merging svm to HEAD? -- Sam Fourman Jr. From owner-freebsd-virtualization@FreeBSD.ORG Thu Nov 28 17:55:07 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2090A702 for ; Thu, 28 Nov 2013 17:55:07 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id CC3571BE0 for ; Thu, 28 Nov 2013 17:55:06 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id 2C55A125C8; Fri, 29 Nov 2013 03:54:59 +1000 (EST) Received: from Peter-Grehans-MacBook-Pro-2.local (24-180-1-150.static.snlo.ca.charter.com [24.180.1.150]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BQJ98169 (AUTH peterg@ptree32.com.au); Fri, 29 Nov 2013 03:54:57 +1000 Message-ID: <5297836F.9020102@freebsd.org> Date: Thu, 28 Nov 2013 09:54:55 -0800 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:24.0) Gecko/20100101 Thunderbird/24.1.0 MIME-Version: 1.0 To: "Sam Fourman Jr." Subject: Re: Running bhyve on a AMD 1075T Phenom References: <5256D59A.20904@digiware.nl> <5256DD29.6090007@freebsd.org> <14A565E7-7D26-4C32-B73A-F5FAA16BC837@digiware.nl> <9A4BF6B0-91F1-43C5-B5D5-90486123336D@digiware.nl> <525738CE.9000708@freebsd.org> <525C837E.7060302@freebsd.org> <525CF0A1.6060600@digiware.nl> <5295FDE6.4060307@thanelange.no> <52965B07.7060307@callfortesting.org> <52976210.7040709@thanelange.no> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: FreeBSD virtualization mailing list , Gyrd Thane Lange X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Nov 2013 17:55:07 -0000 Hi Sam, > are we close to merging svm to HEAD? Almost there - Anish is chasing down a hard-to-find bug. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Fri Nov 29 08:47:06 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CE860351; Fri, 29 Nov 2013 08:47:06 +0000 (UTC) Received: from mail-la0-x22a.google.com (mail-la0-x22a.google.com [IPv6:2a00:1450:4010:c03::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 16A70177B; Fri, 29 Nov 2013 08:47:05 +0000 (UTC) Received: by mail-la0-f42.google.com with SMTP id ec20so6757849lab.29 for ; Fri, 29 Nov 2013 00:47:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=DQeI1yh/EQ7xGGKK+33TwPsLOBT8AFh17a/HkV9lkAw=; b=mBxNCswbl/phDL/PSjN+sW/GGFmhTahV14/lEQbW2FjqsNHuolTB4UqoUPjnuN1mkJ McOQuFeG+l0C4WQCTIAyRbN1gJ2t8Ta332RrW0BSHDdKP4e8O3UgVtMhOCrDknFjop8v 5o7UIiWLEa3aCcROMWtqKVGvn9CB1SGssJaR3h8DFuPbaSZq+2GYviRBu9vyia+xAtFN e95aBpRBumURksCclANJYUNW2QlqJuGKy450X6W97lCfjzNBAi4Ja8L51Fi4hONLa8Bz 0J4xEcDBSJqq6A1bBhBJnjf1qtIpIKECQ/T+KoKRUwuDUSyFXWa+GDpNnpt+agXsOJI9 e1Fw== MIME-Version: 1.0 X-Received: by 10.152.44.225 with SMTP id h1mr19153462lam.22.1385714824140; Fri, 29 Nov 2013 00:47:04 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.120.232 with HTTP; Fri, 29 Nov 2013 00:47:04 -0800 (PST) In-Reply-To: References: Date: Fri, 29 Nov 2013 00:47:04 -0800 X-Google-Sender-Auth: GXGpOD2vjCPAcvAoMXyObYHVySI Message-ID: Subject: Re: VIMAGE: Freed UMA keg was not empty From: Craig Rodrigues To: Adrian Chadd Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.16 Cc: thierry.herbelot@free.fr, "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Nov 2013 08:47:07 -0000 On Wed, Nov 27, 2013 at 1:11 PM, Adrian Chadd wrote: > Modify that function to print out keg->uk_name as well. > Done. See: http://lists.freebsd.org/pipermail/svn-src-all/2013-November/077349.html Now if I run a kernel with VIMAGE enabled, and run the testcase mentioned here: http://lists.freebsd.org/pipermail/freebsd-current/2010-November/021280.html I get this on the console: Freed UMA keg (udp_inpcb) was not empty (30 items). Lost 3 pages of memory. Freed UMA keg (udpcb) was not empty (249 items). Lost 1 pages of memory. ifa_del_loopback_route: deletion failed: 48 This certainly helps narrow down where to look for problems. I'll see if I can post more fixes to eliminate these error messages. Thanks for your suggestion! -- Craig From owner-freebsd-virtualization@FreeBSD.ORG Fri Nov 29 20:31:34 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5D2AD5F5; Fri, 29 Nov 2013 20:31:34 +0000 (UTC) Received: from mail-qe0-x22c.google.com (mail-qe0-x22c.google.com [IPv6:2607:f8b0:400d:c02::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 060BB1E21; Fri, 29 Nov 2013 20:31:33 +0000 (UTC) Received: by mail-qe0-f44.google.com with SMTP id nd7so10160584qeb.17 for ; Fri, 29 Nov 2013 12:31:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=VlrXKSibTWb6/9t7pZhWH8Ygmd1Vg5917/tMvjtNe7o=; b=S4nAzpBvzNsmw6gZ7l5z7aZwCdkNiA/lrPlckYE5q25VtvxZdqy8hK/4uM59UG3e2w 2Ibiakqhk2PbCQknrzmfNRxEDPtm+3SFt+2a2Lm+8/2eZM3DWv1etct6crThOPQKhLZG 3HOIZG8KDP7ye1vHVTGuWGbe3c2iZ8xLxfH0LMRRe2Qdb5dVj4sqwifJao670sMY8ewn 4FzB0y31Nrfih5o6e/BYc6/GZl5xGQuTD22GOFCiADr22IsIiPz53WVZpHZxPUaIiP6S k+lLNFDlhGUkNsQZObS70AiFXYtf3DuYEZ9vUNOnvG3Q5ljVGGVsHoBrOO5OXNTPnXMA cWAA== MIME-Version: 1.0 X-Received: by 10.224.111.197 with SMTP id t5mr90889274qap.49.1385757093184; Fri, 29 Nov 2013 12:31:33 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.224.53.200 with HTTP; Fri, 29 Nov 2013 12:31:33 -0800 (PST) In-Reply-To: References: Date: Fri, 29 Nov 2013 12:31:33 -0800 X-Google-Sender-Auth: AmOoodnKEw5FstWcbZ2GuS4Z2kw Message-ID: Subject: Re: VIMAGE: Freed UMA keg was not empty From: Adrian Chadd To: Craig Rodrigues Content-Type: text/plain; charset=ISO-8859-1 Cc: thierry.herbelot@free.fr, "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Nov 2013 20:31:34 -0000 Cool! Glad to have helped! -a On 29 November 2013 00:47, Craig Rodrigues wrote: > > > > On Wed, Nov 27, 2013 at 1:11 PM, Adrian Chadd wrote: >> >> Modify that function to print out keg->uk_name as well. > > > > Done. See: > http://lists.freebsd.org/pipermail/svn-src-all/2013-November/077349.html > > Now if I run a kernel with VIMAGE enabled, and run the testcase mentioned > here: > > http://lists.freebsd.org/pipermail/freebsd-current/2010-November/021280.html > > I get this on the console: > > Freed UMA keg (udp_inpcb) was not empty (30 items). Lost 3 pages of memory. > Freed UMA keg (udpcb) was not empty (249 items). Lost 1 pages of memory. > ifa_del_loopback_route: deletion failed: 48 > > > This certainly helps narrow down where to look for problems. > I'll see if I can post more fixes to eliminate these error messages. > Thanks for your suggestion! > > -- > Craig