From owner-freebsd-virtualization@freebsd.org Sun Dec 20 04:58:24 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D9ACCA4D254 for ; Sun, 20 Dec 2015 04:58:24 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: from mail-ig0-x22a.google.com (mail-ig0-x22a.google.com [IPv6:2607:f8b0:4001:c05::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AE0C11A31 for ; Sun, 20 Dec 2015 04:58:24 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: by mail-ig0-x22a.google.com with SMTP id to18so17066829igc.0 for ; Sat, 19 Dec 2015 20:58:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ara-ler-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:subject:message-id:mime-version:content-type :content-disposition:user-agent; bh=z0zjNKOhRJxqlw8RkbxuSmwD2blry7FgKVyuyf6aIFA=; b=Shk0HpVBV1iTWB0EmR8eGtHYH36BFc2CdRgKu/Q3XV399Pe9Y/xPGjN0n2nhhjCih1 aftt9xcVzXSz7A8jMrmd+N1oDy9zUf9RT8dnFidjUqdzdko/EfnE/WpAfXmkRb5Tnljw y7OAN2MfYPHldMub6dx3SiLCOhh5F79sUSGupCqc3n8CE8lJF4OENoLRm2mL6qoUJJKt hvec7Qf4OcVvlgB7y/neB56lF1KvhTJrHWcJhmfMqbH5HfIydb8sMPqtb6/l3GEkPDW6 RgtDPn8kzdMb0EYKZNeQQFyNBGpbl85bZgXk1LKmz6fAZDs4hmr0nueTKwzWYQm1PVXs w/Rw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:subject:message-id:mime-version :content-type:content-disposition:user-agent; bh=z0zjNKOhRJxqlw8RkbxuSmwD2blry7FgKVyuyf6aIFA=; b=G7xxs3o+dhHpJkXOdwOgO77bWBYgolLaGj6T02E4rx3eXTF0MEoYVw48psqKzAaL73 2fqIjDgrHZb1ilFGFuhSowIHxM5jdXpt+Pbl0mTp42y/FQwKoSSYplQTbe26gv335Vvi uqwyj9MlEdSdEpnLkuZIQXnMCIdKLUMFfmadtM296jbx7Hn1xFKxiiYm03mwB/d57ZTr Hi+yNRkSsL4iy9TbjoZdX5uTAX2hPUHQiITFu0RybBJEAmUBAZt5tED4A2JBND8WAXy5 BdhnEkPOcHt5CAvrbdSe8DpVNz7vcaCya9BgDPBvrySeo4bOO6ry1TJEIs9uE431mNzl IC4w== X-Gm-Message-State: ALoCoQnK1Lpnh99PAP91wE1JHFoxnjmOyMGln/wPeUGB+rjptLKUiB1uoyliTNWpB5ihJfH81WeJYdoVAfO0FkTfX/A06ARv2Q== X-Received: by 10.50.50.228 with SMTP id f4mr11678074igo.6.1450587504120; Sat, 19 Dec 2015 20:58:24 -0800 (PST) Received: from dendrobates.araler.com (70-59-19-232.hlrn.qwest.net. [70.59.19.232]) by smtp.gmail.com with ESMTPSA id p5sm5728920igj.10.2015.12.19.20.58.23 for (version=TLSv1/SSLv3 cipher=OTHER); Sat, 19 Dec 2015 20:58:23 -0800 (PST) Date: Sat, 19 Dec 2015 21:58:21 -0700 From: Sergey Manucharian To: FreeBSD virtualization Subject: bhyve PCI pass-through to Linux guest Message-ID: <20151220045821.GG22018@dendrobates.araler.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Dec 2015 04:58:24 -0000 Hello, I have a working Linux guest in bhyve (Debian). Trying to pass through a PCI device (USB controller) by adding a couple of options: # bhyve -S ... -s 7,passthru,0/20/0 ... That causes bhyve termination right away with error: Unable to setup memory (17) Exactly the same option with passing the same USB controller to Windows 2012 guest works perfectly. The only difference (by my understanding) is that I load UEFI for Windows and use grub-bhyve for Linux. What should I check? Thanks, Sergey From owner-freebsd-virtualization@freebsd.org Sun Dec 20 05:02:54 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1EAEFA4D619 for ; Sun, 20 Dec 2015 05:02:54 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id D709C1F18 for ; Sun, 20 Dec 2015 05:02:53 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id EF3B52011495 for ; Sun, 20 Dec 2015 15:02:45 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id E9248282027 for ; Sun, 20 Dec 2015 15:02:45 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id DkRZDO_BT7-E for ; Sun, 20 Dec 2015 15:02:45 +1000 (AEST) Received: from Peters-MacBook-Pro.local (CPE-60-226-3-158.wrcz1.cha.bigpond.net.au [60.226.3.158]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 3BD97280F5D; Sun, 20 Dec 2015 15:02:44 +1000 (AEST) Subject: Re: bhyve PCI pass-through to Linux guest To: Sergey Manucharian References: <20151220045821.GG22018@dendrobates.araler.com> Cc: FreeBSD virtualization From: Peter Grehan Message-ID: <56763672.3090207@freebsd.org> Date: Sun, 20 Dec 2015 15:02:42 +1000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:38.0) Gecko/20100101 Thunderbird/38.4.0 MIME-Version: 1.0 In-Reply-To: <20151220045821.GG22018@dendrobates.araler.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.1 cv=B9IZqLZM c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=OIgypsHbAvIw1X5S2PUfDQ==:17 a=3FMX7HLxAAAA:8 a=6I5d2MoRAAAA:8 a=Sv2sojjTAAAA:8 a=N659UExz7-8A:10 a=wUQvQvOEmiQA:10 a=z4wj_cxgjH_bDn9okDMA:9 a=pILNOxqGKmIA:10 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Dec 2015 05:02:54 -0000 Hi Sergey, > I have a working Linux guest in bhyve (Debian). Trying to pass through a > PCI device (USB controller) by adding a couple of options: > > # bhyve -S ... -s 7,passthru,0/20/0 ... > > That causes bhyve termination right away with error: > Unable to setup memory (17) > > Exactly the same option with passing the same USB controller to Windows 2012 > guest works perfectly. > > The only difference (by my understanding) is that I load UEFI for Windows > and use grub-bhyve for Linux. > > What should I check? Make sure you are also passing the '-S' option to grub-bhyve to force wiring of memory. later, Peter. From owner-freebsd-virtualization@freebsd.org Sun Dec 20 05:10:18 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C53D0A4D922 for ; Sun, 20 Dec 2015 05:10:18 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: from mail-io0-x22a.google.com (mail-io0-x22a.google.com [IPv6:2607:f8b0:4001:c06::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 97C431217 for ; Sun, 20 Dec 2015 05:10:18 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: by mail-io0-x22a.google.com with SMTP id o67so127001539iof.3 for ; Sat, 19 Dec 2015 21:10:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ara-ler-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=2fFNVwl+Ooyg2eh2j989ZOGElpifqrYJ7OsiuM7B1kA=; b=JbYNjFiDEj59ZqJTOS/hrdGI5+516XXs/NYTKXZZPyf4RM0tUM0lCopF3fAL6nruPx MYLbGUPTeXAcCaHcBKVDRM62ZAsh9TTSXOtFnTVwXDizue2oTIND0ggZJb1TvDayMQCF hhZOWA4WtHAenh/10BAPU8T+IVu42t47t7gBrw3ggnlwTISSZ3ERMx8bRAPSFvT1B9Nt 5vFoCZusxHArp2ho16BsLBUcejlg31kX/COMpHYyvOKMlCLgR/q2CuOIjNBlbmaBGdQW CC0B/uetmQZrWpLe4NYCfF2qdphbt5VDdhlaS6fi4K6ySPhUQ6hjbzbdiwMJkN/TEl9b tuBg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=2fFNVwl+Ooyg2eh2j989ZOGElpifqrYJ7OsiuM7B1kA=; b=SVGDoVooHiGLHghKVAImsEMgrLyzN0GrBHYIcrGLOCPtjRAX+rpPhlqn+t5SGWkizc Izki7xZ6x9R0S1arkV2kL6TeSB1ZSwcAFtkUfcBFo8LPsvYzQv54QTBUj3nba+vhpKA1 2QsZyqGi3aB/MwWy4vyOkK1hEEDSnT2Q2/29HHYYqndz93LvhmjGL5FOpCzJcCa2Oo+G 7vlNzNmOj/ZAJJ3ZHrfTvm5POMMUGhbmOwq12Bxh428KXt/cWiNrU5Km8VegdsWesji5 y4HVyR5CiYHAACLLE0RzhB3/VLifM12tJFIaBQ5ZUwCSrr1dmTLEzzwmSFXEgYYtgopJ Yg5w== X-Gm-Message-State: ALoCoQneN9AhjVfHd4mCooqHHKOH1UTpc8EBv35yjyKNFqDOEe4Cgq+/g2THMgKeh6vocLA1M42/Qu5Xjs8IAeftK/MTfyCjdg== X-Received: by 10.107.7.212 with SMTP id g81mr13061188ioi.81.1450588217944; Sat, 19 Dec 2015 21:10:17 -0800 (PST) Received: from dendrobates.araler.com (70-59-19-232.hlrn.qwest.net. [70.59.19.232]) by smtp.gmail.com with ESMTPSA id il4sm5762936igb.6.2015.12.19.21.10.17 (version=TLSv1/SSLv3 cipher=OTHER); Sat, 19 Dec 2015 21:10:17 -0800 (PST) Date: Sat, 19 Dec 2015 22:10:15 -0700 From: Sergey Manucharian To: Peter Grehan Cc: FreeBSD virtualization Subject: Re: bhyve PCI pass-through to Linux guest Message-ID: <20151220051015.GH22018@dendrobates.araler.com> References: <20151220045821.GG22018@dendrobates.araler.com> <56763672.3090207@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <56763672.3090207@freebsd.org> User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Dec 2015 05:10:18 -0000 Excerpts from Peter Grehan's message from Sun 20-Dec-15 15:02: > > > > # bhyve -S ... -s 7,passthru,0/20/0 ... > > > Make sure you are also passing the '-S' option to grub-bhyve to force > wiring of memory. Sure! I showed it in the command line above. Without that bhyve says: "passthru requires guest memory to be wired" S. From owner-freebsd-virtualization@freebsd.org Sun Dec 20 05:18:09 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1E653A4DDDB for ; Sun, 20 Dec 2015 05:18:09 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id D46901564 for ; Sun, 20 Dec 2015 05:18:07 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id 130B92011495 for ; Sun, 20 Dec 2015 15:18:06 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 0D659282026 for ; Sun, 20 Dec 2015 15:18:06 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id n2Tp5WYP1taW for ; Sun, 20 Dec 2015 15:18:05 +1000 (AEST) Received: from Peters-MacBook-Pro.local (CPE-60-226-3-158.wrcz1.cha.bigpond.net.au [60.226.3.158]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id CA6A7280F5D; Sun, 20 Dec 2015 15:18:04 +1000 (AEST) Subject: Re: bhyve PCI pass-through to Linux guest To: Sergey Manucharian References: <20151220045821.GG22018@dendrobates.araler.com> <56763672.3090207@freebsd.org> <20151220051015.GH22018@dendrobates.araler.com> Cc: FreeBSD virtualization From: Peter Grehan Message-ID: <56763A0B.8010802@freebsd.org> Date: Sun, 20 Dec 2015 15:18:03 +1000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:38.0) Gecko/20100101 Thunderbird/38.4.0 MIME-Version: 1.0 In-Reply-To: <20151220051015.GH22018@dendrobates.araler.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.1 cv=B9IZqLZM c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=OIgypsHbAvIw1X5S2PUfDQ==:17 a=3FMX7HLxAAAA:8 a=6I5d2MoRAAAA:8 a=Sv2sojjTAAAA:8 a=N659UExz7-8A:10 a=wUQvQvOEmiQA:10 a=3AddMd3w7Gf1v9KUbYYA:9 a=pILNOxqGKmIA:10 a=2T5gjdO81zMA:10 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Dec 2015 05:18:09 -0000 Hi Sergey, >>> # bhyve -S ... -s 7,passthru,0/20/0 ... >>> >> Make sure you are also passing the '-S' option to grub-bhyve to force >> wiring of memory. > > Sure! I showed it in the command line above. That's the bhyve command line (if that's the one you meant). You also have to pass '-S' when invoking grub-bhyve, since that's when the memory resources are created. later, Peter. From owner-freebsd-virtualization@freebsd.org Sun Dec 20 05:36:48 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 08C7FA4D95A for ; Sun, 20 Dec 2015 05:36:48 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: from mail-io0-x236.google.com (mail-io0-x236.google.com [IPv6:2607:f8b0:4001:c06::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C63FA1FF2 for ; Sun, 20 Dec 2015 05:36:47 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: by mail-io0-x236.google.com with SMTP id q126so127234719iof.2 for ; Sat, 19 Dec 2015 21:36:47 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ara-ler-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=hV7yrVtbyHBJRZkdH6KBKeDPVvulJ97BY7Z5HHv487s=; b=X5tlZgdcVpy5iCmeQpXxuhF2utRijwxJC4Z823YkAG7UAa3ag9jgzmG3SO8wwCsgwP ljS58be82i+YLJP/MEdtqKeOaW/VXbe8ttRSk5ZSQ7dV50VQO4kPwr6yvkm2tENbs+P0 +qqovsaV2tWsXhJ8vnAnTavY5rAVlKOeB9TFpCo1qcyQLFsj3ihk+UqRgU9uu4eYkiKN sU29sdm9FjwMiUokG1fuBEkVNHFKWR44cdWdoC8J2FjQUoFfUydvE9Hplhqjma010uTj IZ7lKnZRoDBFwj7fihDtTXDT+woB6/EFu/JYnBVkVtMzKjGTM27PlzAO1WgjFlbVbxYO R0bw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=hV7yrVtbyHBJRZkdH6KBKeDPVvulJ97BY7Z5HHv487s=; b=XEqGrQLlAyRw+JO39ELhEamJXan1vpZ6u58Rmo7OdLV24GqnJLqyxPdmEIszA9He6P tHsjyMKclC0G1EvuSvPodkTxkFDcIj9Pt8JCa7WkqjhTNVU2EsOevgyDZtOiDRn53tK3 HQXl4Xg65UFfqAVW2TWRztp0GomUfhAoviKrFYCLOohL2e0m2kNDV4W2j/M23OIgaP/j EdigwYlS6hgk/45hJkv+PKpUwrlfpbUH14q6oDFrcfx6Hs0pOgBVArMRXmylMUmhR6a4 y41cB5ARqlARDWNGL6kP89nbtPZjf7vn3Sx/X1DjglXydmGre9dEydp1w93xrVra8FGr 0QlA== X-Gm-Message-State: ALoCoQkIpg53xbNuMxJP5kj7ex7OF2vxHCMCblNWG1IbOAOPWniVKwz7jimXXV5mxiNCPEv1icPDf08y5DnDwnRdT95W1Pfpkw== X-Received: by 10.107.26.144 with SMTP id a138mr13563206ioa.100.1450589807266; Sat, 19 Dec 2015 21:36:47 -0800 (PST) Received: from dendrobates.araler.com (70-59-19-232.hlrn.qwest.net. [70.59.19.232]) by smtp.gmail.com with ESMTPSA id je1sm5783067igb.11.2015.12.19.21.36.46 (version=TLSv1/SSLv3 cipher=OTHER); Sat, 19 Dec 2015 21:36:46 -0800 (PST) Date: Sat, 19 Dec 2015 22:36:44 -0700 From: Sergey Manucharian To: Peter Grehan Cc: FreeBSD virtualization Subject: Re: bhyve PCI pass-through to Linux guest Message-ID: <20151220053644.GI22018@dendrobates.araler.com> References: <20151220045821.GG22018@dendrobates.araler.com> <56763672.3090207@freebsd.org> <20151220051015.GH22018@dendrobates.araler.com> <56763A0B.8010802@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <56763A0B.8010802@freebsd.org> User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Dec 2015 05:36:48 -0000 Excerpts from Peter Grehan's message from Sun 20-Dec-15 15:18: > >>> # bhyve -S ... -s 7,passthru,0/20/0 ... > >>> > >> Make sure you are also passing the '-S' option to grub-bhyve to force > >> wiring of memory. > > > > Sure! I showed it in the command line above. > > That's the bhyve command line (if that's the one you meant). You also > have to pass '-S' when invoking grub-bhyve, since that's when the memory > resources are created. Thanks, Peter! I've missed that! What a foolish omission! Works fine now. S. From owner-freebsd-virtualization@freebsd.org Sun Dec 20 08:25:39 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F0A69A4B28B for ; Sun, 20 Dec 2015 08:25:39 +0000 (UTC) (envelope-from Peter.Ross@alumni.tu-berlin.de) Received: from mail-2.alumni.tu-berlin.de (mail-2.alumni.tu-berlin.de [130.149.5.29]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BB75C13B8 for ; Sun, 20 Dec 2015 08:25:39 +0000 (UTC) (envelope-from Peter.Ross@alumni.tu-berlin.de) X-tubIT-Incoming-IP: 118.209.130.33 Received: from ppp118-209-130-33.lns20.mel8.internode.on.net ([118.209.130.33] helo=[192.168.1.130]) by mailbox.alumni.tu-berlin.de (exim-4.76) with esmtpsa [UNKNOWN:AES256-GCM-SHA384:256] for id 1aAZ9a-0001Lg-Rb; Sun, 20 Dec 2015 09:15:43 +0100 Date: Sun, 20 Dec 2015 19:15:31 +1100 (EST) From: Peter Ross X-X-Sender: petros@sams.my.domain To: freebsd-virtualization@freebsd.org Subject: Re: available hypervisors in FreeBSD In-Reply-To: <551BC8B3.2030900@bestsolution.at> Message-ID: References: <551BC8B3.2030900@bestsolution.at> User-Agent: Alpine 2.20 (BSF 67 2015-01-07) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Dec 2015 08:25:40 -0000 Hi all, I read through an older threat I kept in my archive. It started like this: On Wed, 1 Apr 2015, Udo Rader wrote: > As far as my homework digging revealed, FreeBSD supports four hypervisors: > > * bhyve > * KVM > * QEMU > * VirtualBox .. and later Xen was mentioned. I ask myself which of the solutions are most mature at the moment and immediately usable in production. Reason is a potential company move from VMware ESXi/Centos(6/7) with some critical Windows 2008 and 2012 IIS/.NET applications) involved. While most of open source may go into FreeBSD jails, we have a few CentOS6/7 boxes with proprietary software we have to keep, as well as the Windows VMs to maintain (there is a long term effort to move them to Open Source too but the final migration of all may be years away). We may phase out ESXi gradually, or just keep it, depending on the performance and maturity of FreeBSD based solutions. I have experience with Linux on VirtualBox and it worked well if the load was not high but the performance wasn't too good when under stress (but it never crashed, I might add). Which of the solutions are worth testing? Do you have recommendations? I am thinking of server software and "containerisation" only, so USB passthrough or PCI etc. is not really important. Stability, performance and resource utilisation (e.g. possible over-allocation of RAM) are matter most. Thanks for any advice Peter From owner-freebsd-virtualization@freebsd.org Sun Dec 20 08:57:59 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7E572A4C979 for ; Sun, 20 Dec 2015 08:57:59 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 43B2B121F for ; Sun, 20 Dec 2015 08:57:58 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from elsa.codelab.cz (localhost [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id E330728422; Sun, 20 Dec 2015 09:57:56 +0100 (CET) Received: from illbsd.quip.test (ip-86-49-16-209.net.upcbroadband.cz [86.49.16.209]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id E47EA28412; Sun, 20 Dec 2015 09:57:55 +0100 (CET) Message-ID: <56766D93.9030808@quip.cz> Date: Sun, 20 Dec 2015 09:57:55 +0100 From: Miroslav Lachman <000.fbsd@quip.cz> User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:35.0) Gecko/20100101 Firefox/35.0 SeaMonkey/2.32 MIME-Version: 1.0 To: Peter Ross , freebsd-virtualization@freebsd.org Subject: Re: available hypervisors in FreeBSD References: <551BC8B3.2030900@bestsolution.at> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Dec 2015 08:57:59 -0000 Peter Ross wrote on 12/20/2015 09:15: > Hi all, > > I read through an older threat I kept in my archive. It started like this: > > On Wed, 1 Apr 2015, Udo Rader wrote: > >> As far as my homework digging revealed, FreeBSD supports four >> hypervisors: >> >> * bhyve >> * KVM >> * QEMU >> * VirtualBox > > .. and later Xen was mentioned. > > I ask myself which of the solutions are most mature at the moment and > immediately usable in production. > > Reason is a potential company move from VMware ESXi/Centos(6/7) with > some critical Windows 2008 and 2012 IIS/.NET applications) involved. > > While most of open source may go into FreeBSD jails, we have a few > CentOS6/7 boxes with proprietary software we have to keep, as well as > the Windows VMs to maintain (there is a long term effort to move them to > Open Source too but the final migration of all may be years away). > > We may phase out ESXi gradually, or just keep it, depending on the > performance and maturity of FreeBSD based solutions. > > I have experience with Linux on VirtualBox and it worked well if the > load was not high but the performance wasn't too good when under stress > (but it never crashed, I might add). > > Which of the solutions are worth testing? Do you have recommendations? > > I am thinking of server software and "containerisation" only, so USB > passthrough or PCI etc. is not really important. > > Stability, performance and resource utilisation (e.g. possible > over-allocation of RAM) are matter most. VirtualBox is the most usable and you can use it in headless mode. If you are really not satified with VirtualBox, you can try Xen. The other options is not mature enough to run highly loaded Windows in production. (it is just my opinion and somebody else can see it otherwise) Miroslav Lachman From owner-freebsd-virtualization@freebsd.org Sun Dec 20 15:08:51 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F110FA4C2AF for ; Sun, 20 Dec 2015 15:08:50 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: from mail-wm0-x231.google.com (mail-wm0-x231.google.com [IPv6:2a00:1450:400c:c09::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9813A1BC1 for ; Sun, 20 Dec 2015 15:08:50 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: by mail-wm0-x231.google.com with SMTP id p187so40420880wmp.1 for ; Sun, 20 Dec 2015 07:08:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=XyoboGDVYWu5a06SeL6PA8Fag0iUOFjLycGocC1Y5GA=; b=hsgamtMo3NXlkFTBOTQAZEwVrf6pPlk/g9eXQxNaHkfmeuxloHghBCDldtFJDUxoXx U0/uzNxUMFORA2fCdVg4OO0DjIa0N55f2ZwXoib5lCVfncHdwryOxltwlsvtSz8J7+eK dQ+BsGa1Hr9am/m7oIoUTYVNKgsPO7inS6EZSCzxEdMQQlQyJv/S0qdRiIVoSj9366sp Dt9wAMEEZqg8IfBFICjwqPpW6aSrzgLFeJOH4Y+zCJ0cOrXuUw1mKJaOiCB5v/JPhAWZ ee7QaZxCu1lPwIidrtvBJtFf/VAi6xumBGcX4lp1eLppm22sFMo7iBMJlCdNgStBXULl 7Img== MIME-Version: 1.0 X-Received: by 10.194.9.169 with SMTP id a9mr15170669wjb.60.1450624128123; Sun, 20 Dec 2015 07:08:48 -0800 (PST) Received: by 10.194.192.33 with HTTP; Sun, 20 Dec 2015 07:08:48 -0800 (PST) In-Reply-To: References: <551BC8B3.2030900@bestsolution.at> Date: Sun, 20 Dec 2015 09:08:48 -0600 Message-ID: Subject: Re: available hypervisors in FreeBSD From: Adam Vande More To: Peter Ross Cc: FreeBSD virtualization Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Dec 2015 15:08:51 -0000 On Sun, Dec 20, 2015 at 2:15 AM, Peter Ross wrote: > Hi all, > > I read through an older threat I kept in my archive. It started like this: > > On Wed, 1 Apr 2015, Udo Rader wrote: > > As far as my homework digging revealed, FreeBSD supports four hypervisors: >> >> * bhyve >> * KVM >> * QEMU >> * VirtualBox >> > > .. and later Xen was mentioned. > > I ask myself which of the solutions are most mature at the moment and > immediately usable in production. > > Reason is a potential company move from VMware ESXi/Centos(6/7) with some > critical Windows 2008 and 2012 IIS/.NET applications) involved. > > While most of open source may go into FreeBSD jails, we have a few > CentOS6/7 boxes with proprietary software we have to keep, as well as the > Windows VMs to maintain (there is a long term effort to move them to Open > Source too but the final migration of all may be years away). > > We may phase out ESXi gradually, or just keep it, depending on the > performance and maturity of FreeBSD based solutions. > > I have experience with Linux on VirtualBox and it worked well if the load > was not high but the performance wasn't too good when under stress (but it > never crashed, I might add). > > Which of the solutions are worth testing? Do you have recommendations? > > I am thinking of server software and "containerisation" only, so USB > passthrough or PCI etc. is not really important. > > Stability, performance and resource utilisation (e.g. possible > over-allocation of RAM) are matter most. > VBox is fine, it works well and really has all the features of vitalization of the big 3 except for clustering and a few side things. I've been using bhyve and I like it. I have no stability issues on dozens of guests some with a lot of IO net and disk. I had hoped VPS[1] would make it in, but that seems to have stalled. [1] http://www.7he.at/freebsd/vps/ -- Adam From owner-freebsd-virtualization@freebsd.org Sun Dec 20 15:25:48 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F0999A4CF8C for ; Sun, 20 Dec 2015 15:25:47 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: from mail-io0-x234.google.com (mail-io0-x234.google.com [IPv6:2607:f8b0:4001:c06::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C3A001759 for ; Sun, 20 Dec 2015 15:25:47 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: by mail-io0-x234.google.com with SMTP id o67so133391804iof.3 for ; Sun, 20 Dec 2015 07:25:47 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ara-ler-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=5H2vMP9oiQi2EnusL0NsmUP6IzsZkKTa+HJ7dTJ/ako=; b=JJEeDg7DaeIWHZ+gbNURB8au/oXf9VwSfMd0k7vvRu8Qn4FVfQfJ3xhio4OUSLmCwQ J1zwvi0Tow0MmWEkL9Ft5oC08fQ1PnwpoXc5d2K7OUn5zTnG+osCAXy8K3/jbx1YgoZn E2q0bGAtyFTXS3h9lNgeRuNSL0EvwEm5Rm3uQZdwtWDz8VRpFSpPsGRtiTcwEgV/BncY LsD3VpztTpa+rEibujIf1eo8AnUNOrYjrWU5zqNwsdYo+R+AYUWg+OKqfAA+DIREGM4F ySnFSdRWBlmN3LfrcSIz2ro8GtxhbfQjSqZu7P9PaA+3y2zNxO4R/gtUv7xpdo5Prks7 zswg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=5H2vMP9oiQi2EnusL0NsmUP6IzsZkKTa+HJ7dTJ/ako=; b=jJEhk9LEG4j3K51AQRktCOKmIxgzU+pmcNuB4F8nVVFvkqxKoFPEvJ7Ko7vKY94y/2 NI4a2bHSV8CJ2fUG0gnf96lMvg3OSScfsUhlRS/5/Kxim3pZ3Qb3vdzZ8dU4DY90zUGQ kn6/IzJkVCovP6QGZ3nkoG2DMIL2NEsvQRmKmca1WrQBKVANWEtVjO106aDP3JUq7UXK Nsf/W1d7YTCzIjErSs+qeNLiJLkoD/Gej+8c+vNiYYu+QVO446p4SrEh8a0q31sBjdMv vZbJBjMGPR0iK3aKELzazWL1ifUKb5B+02GcgwoUYviJ7EtVuclnoDLDmVs41i7HS4Qn iGqw== X-Gm-Message-State: ALoCoQnjnonMCwtAckUIKk5Z6i03H8sIJYh5aUNkOK5yR50WaMPowqfFnDg9qa45uQOciXBK5C4zF6ZBiBSwTbcD0MaJyggUPg== X-Received: by 10.107.169.27 with SMTP id s27mr14524393ioe.192.1450625146930; Sun, 20 Dec 2015 07:25:46 -0800 (PST) Received: from dendrobates.araler.com (70-59-19-232.hlrn.qwest.net. [70.59.19.232]) by smtp.gmail.com with ESMTPSA id s13sm10290857ioi.29.2015.12.20.07.25.46 for (version=TLSv1/SSLv3 cipher=OTHER); Sun, 20 Dec 2015 07:25:46 -0800 (PST) Date: Sun, 20 Dec 2015 08:25:44 -0700 From: Sergey Manucharian To: freebsd-virtualization@freebsd.org Subject: Re: available hypervisors in FreeBSD Message-ID: <20151220152544.GA4053@dendrobates.araler.com> References: <551BC8B3.2030900@bestsolution.at> <56766D93.9030808@quip.cz> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <56766D93.9030808@quip.cz> User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Dec 2015 15:25:48 -0000 Excerpts from Miroslav Lachman's message from Sun 20-Dec-15 09:57: > Peter Ross wrote on 12/20/2015 09:15: > >> As far as my homework digging revealed, FreeBSD supports four > >> hypervisors: > >> > >> * bhyve > >> * KVM > >> * QEMU > >> * VirtualBox > > > > .. and later Xen was mentioned. > > ........ > > Which of the solutions are worth testing? Do you have recommendations? > > > > I am thinking of server software and "containerisation" only, so USB > > passthrough or PCI etc. is not really important. > > ........ > > Stability, performance and resource utilisation (e.g. possible > > over-allocation of RAM) are matter most. > > VirtualBox is the most usable and you can use it in headless mode. If > you are really not satified with VirtualBox, you can try Xen. I agree that VirtualBox is really stable, and I'm using it in production environments for many years. However, there are a couple of possible drawbacks: It does not support VRDP (remote console) and USB2/3 on FreeBSD. Tha latter is probably not really important (although I needed it too). The lack of remote console is bad for troubleshooting and/or remote (re)installation. Currently I have one bhyve Windows Server 2012 machine, which works fine, although it's not really loaded at the moment. Sergey From owner-freebsd-virtualization@freebsd.org Sun Dec 20 15:36:07 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0B711A4D6EE for ; Sun, 20 Dec 2015 15:36:07 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: from mail-wm0-x230.google.com (mail-wm0-x230.google.com [IPv6:2a00:1450:400c:c09::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9F6F01074 for ; Sun, 20 Dec 2015 15:36:06 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: by mail-wm0-x230.google.com with SMTP id p187so41338884wmp.0 for ; Sun, 20 Dec 2015 07:36:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=t5M3m7Im6XtIW2snPzfP5e6Xq3mYJdaARB2+wK35k7g=; b=g5wxqqhK7GriOQxgOR6wyLlmK9u2honatwpLa4y532yOo/b3ohglPP6IJtM8maqPA4 Iuvuu2i2Taoly0m7rwP7Sl6ZUjjSMyGgsOVoSXAoCtpYDmQDp4IpA5aL7JlCxNB3TPGv ue2h1yISS9DwFeAq/rqH1AIBY0kNduxHKrRdmrwZTEaJZ82Dj0UsF2hdtJcjRtQClep4 l0FNhN0BUPoqpYmX++P9phvpwspvDjtY0KaVt2/RzA/Oyk3EPFYzfiCxj7uuqPoEEVrz IEfuYhR8zF0nhO5JTTMYeuvn0tBlZeD9E64X+R/U2PWNFvd7t0U5EDhj5qCwTU6ZYxFG bPhQ== MIME-Version: 1.0 X-Received: by 10.194.9.169 with SMTP id a9mr15283471wjb.60.1450625765045; Sun, 20 Dec 2015 07:36:05 -0800 (PST) Received: by 10.194.192.33 with HTTP; Sun, 20 Dec 2015 07:36:04 -0800 (PST) In-Reply-To: <20151220152544.GA4053@dendrobates.araler.com> References: <551BC8B3.2030900@bestsolution.at> <56766D93.9030808@quip.cz> <20151220152544.GA4053@dendrobates.araler.com> Date: Sun, 20 Dec 2015 09:36:04 -0600 Message-ID: Subject: Re: available hypervisors in FreeBSD From: Adam Vande More To: Sergey Manucharian Cc: FreeBSD virtualization Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Dec 2015 15:36:07 -0000 On Sun, Dec 20, 2015 at 9:25 AM, Sergey Manucharian wrote: > I agree that VirtualBox is really stable, and I'm using it in production > environments for many years. However, there are a couple of possible > drawbacks: It does not support VRDP (remote console) and USB2/3 on FreeBSD. > > Tha latter is probably not really important (although I needed it too). > The lack of remote console is bad for troubleshooting and/or remote > (re)installation. > Remote console is available via VNC, not RDP. -- Adam From owner-freebsd-virtualization@freebsd.org Sun Dec 20 16:10:08 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0723EA4DAA6 for ; Sun, 20 Dec 2015 16:10:08 +0000 (UTC) (envelope-from listudo@bestsolution.at) Received: from mail.bestsolution.at (mail.bestsolution.at [94.198.139.5]) by mx1.freebsd.org (Postfix) with ESMTP id BD0031EE9 for ; Sun, 20 Dec 2015 16:10:07 +0000 (UTC) (envelope-from listudo@bestsolution.at) Received: from marathon.bestsolution.at (mara.bestsolution.at [172.16.5.80]) by mail.bestsolution.at (Postfix) with ESMTP id A354E4E6C23 for ; Sun, 20 Dec 2015 16:04:49 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=bestsolution.at; h=content-transfer-encoding:content-type:content-type :in-reply-to:mime-version:user-agent:date:date:message-id:from :from:references:subject:subject:received:received; s=default; t=1450623886; x=1452438287; bh=GvNXQ06mQ22LQ54gAS97iaiDiwC01hNf f0hH3kFipTs=; b=cH0pEX0+lDbNB8tGxjuqszEJizfMxV6fkNbXGl1W6Z5Jl8Rb r553hVWdwBLtkQt1dNtACxns0a+rLP81DcB/p06ZhZPuPeU4J8GizSJxZZpv0p/y Nnbv08yKQ4D1G3AhkBbkKnAxz4NIl4QGgikt9b/AjDbAPp4GtUvu9MnLkQg= X-Virus-Scanned: BestSolution.at amavisd-new at bestsolution.at Received: from mail.bestsolution.at ([127.0.0.1]) by marathon.bestsolution.at (marathon.bestsolution.at [127.0.0.1]) (amavisd-new, port 10024) with LMTP id llwvYCsTltzS for ; Sun, 20 Dec 2015 16:04:46 +0100 (CET) Received: from artio.bestsolution.at (77.117.125.130.wireless.dyn.drei.com [77.117.125.130]) by mail.bestsolution.at (Postfix) with ESMTPSA id A2C2D4E6C1F for ; Sun, 20 Dec 2015 16:04:46 +0100 (CET) Subject: Re: available hypervisors in FreeBSD To: freebsd-virtualization@freebsd.org References: <551BC8B3.2030900@bestsolution.at> From: Udo Rader Message-ID: <5676D19E.7050103@bestsolution.at> Date: Sun, 20 Dec 2015 17:04:46 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Dec 2015 16:10:08 -0000 On 12/20/2015 09:15 AM, Peter Ross wrote: > Hi all, > > I read through an older threat I kept in my archive. It started like this: > > On Wed, 1 Apr 2015, Udo Rader wrote: > >> As far as my homework digging revealed, FreeBSD supports four >> hypervisors: >> >> * bhyve >> * KVM >> * QEMU >> * VirtualBox > > .. and later Xen was mentioned. > > I ask myself which of the solutions are most mature at the moment and > immediately usable in production. > > Reason is a potential company move from VMware ESXi/Centos(6/7) with > some critical Windows 2008 and 2012 IIS/.NET applications) involved. > > While most of open source may go into FreeBSD jails, we have a few > CentOS6/7 boxes with proprietary software we have to keep, as well as > the Windows VMs to maintain (there is a long term effort to move them to > Open Source too but the final migration of all may be years away). > > We may phase out ESXi gradually, or just keep it, depending on the > performance and maturity of FreeBSD based solutions. > > I have experience with Linux on VirtualBox and it worked well if the > load was not high but the performance wasn't too good when under stress > (but it never crashed, I might add). > > Which of the solutions are worth testing? Do you have recommendations? > > I am thinking of server software and "containerisation" only, so USB > passthrough or PCI etc. is not really important. > > Stability, performance and resource utilisation (e.g. possible > over-allocation of RAM) are matter most. two thoughts: first, PCI passthru is a nice thing if you want to directly address NICs, which again is a nice feature for virtualized servers relying in almost native network throughput. and second, but you are probably aware of that already, IIRC Xen dom0 support is quite new & lacks some features (http://wiki.xenproject.org/wiki/FreeBSD_Dom0) From owner-freebsd-virtualization@freebsd.org Sun Dec 20 16:14:09 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A7EB1A4DDD0 for ; Sun, 20 Dec 2015 16:14:09 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: from mail-io0-x22a.google.com (mail-io0-x22a.google.com [IPv6:2607:f8b0:4001:c06::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 79A561189 for ; Sun, 20 Dec 2015 16:14:09 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: by mail-io0-x22a.google.com with SMTP id o67so133996097iof.3 for ; Sun, 20 Dec 2015 08:14:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ara-ler-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=G8UUlrcqn9WKKIrmvV2RhoTRZJRvo4ZGMWwO/YK+g+8=; b=IoAJGIrqgEfbK0XgBm25P/wJXZsphuA5BdYSZD1+zPaFy6UrcPt9yO3k+Si2zzbT9B Klfu8LBvqGXcEaEqAinvIlt1V4xFM2h3+YoJFT1PHcVSVm8Wn1TeX2arrw0zq1bjvSUf xl4U/b84BF2IYZDquKaZHHFTf/ER5kOPnHcskkuyv7C5kw9GWHlVlfUdkfZ7vGhIXTrT RAtHqTGDF0zzoUksBqitMrJ9w762HEYxeZg3pwQlLybQpQypWt9hLuNaZbMnZ2gjmiq6 4qZU8NvIoimBiHNYQZR/AhbWumCp6Sh/I84gwdMBfcbJRJ16LEDnj9l5stJqBbmbW2Zy SlEw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=G8UUlrcqn9WKKIrmvV2RhoTRZJRvo4ZGMWwO/YK+g+8=; b=QvlDqjZKUGTMtt6aaOlvb8VyYi9VbGzB1JP5nIjUjSaw7efNyttC5kFo7MImgToQZV X95UuEJm6m0TeGFP+ock2LQfIOC/b1jWK3m1w1GcXX0PzM4V+AIL0OXAoEy9bQcqxrQv tRVSuZulxbwwINGCjDSDueQ14RwEh9ckqv92HGUxV6UAWwvaO3AFX1CU/40Y8hpFubLp P7RBU/Y7etSgxRFc2Us/poIydEF6aiX+APTw0KLvxLDdDVbe7qfFMciLLebKMGu+Ubgu xF2b+G232GXdZtYOsR298094CM8joN09I3jfTDuiD/ovUG4r5EX3v78z4gyacZ5Wcwtc FNuA== X-Gm-Message-State: ALoCoQnanlrSH14JjgCtKNkORBWqk58lwSCkYW4u4ZpaUwi6FscHl21zWRad13Mg3K8LNFNv/eB0QAC65E7RrJzk6ivonsxINQ== X-Received: by 10.107.40.76 with SMTP id o73mr10947140ioo.157.1450628048612; Sun, 20 Dec 2015 08:14:08 -0800 (PST) Received: from dendrobates.araler.com (70-59-19-232.hlrn.qwest.net. [70.59.19.232]) by smtp.gmail.com with ESMTPSA id c2sm6422722igg.4.2015.12.20.08.14.07 (version=TLSv1/SSLv3 cipher=OTHER); Sun, 20 Dec 2015 08:14:07 -0800 (PST) Date: Sun, 20 Dec 2015 09:14:05 -0700 From: Sergey Manucharian To: FreeBSD virtualization Subject: Re: available hypervisors in FreeBSD Message-ID: <20151220161405.GB4053@dendrobates.araler.com> References: <551BC8B3.2030900@bestsolution.at> <56766D93.9030808@quip.cz> <20151220152544.GA4053@dendrobates.araler.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Dec 2015 16:14:09 -0000 Excerpts from Adam Vande More's message from Sun 20-Dec-15 09:36: > On Sun, Dec 20, 2015 at 9:25 AM, Sergey Manucharian wrote: > > > I agree that VirtualBox is really stable, and I'm using it in production > > environments for many years. However, there are a couple of possible > > drawbacks: It does not support VRDP (remote console) and USB2/3 on FreeBSD. > > > > Tha latter is probably not really important (although I needed it too). > > The lack of remote console is bad for troubleshooting and/or remote > > (re)installation. > > > > Remote console is available via VNC, not RDP. It is VNC, and I use it Linux hosts, it's rather confusing since the option is "--vrde on|off". But isn't it a part of the extension pack, which is not available for FreeBSD? https://www.virtualbox.org/manual/ch07.html S. From owner-freebsd-virtualization@freebsd.org Sun Dec 20 16:37:43 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CB572A4DC9E for ; Sun, 20 Dec 2015 16:37:43 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: from mail-wm0-x22c.google.com (mail-wm0-x22c.google.com [IPv6:2a00:1450:400c:c09::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 54DD81CB8 for ; Sun, 20 Dec 2015 16:37:43 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: by mail-wm0-x22c.google.com with SMTP id l126so42130945wml.1 for ; Sun, 20 Dec 2015 08:37:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=DmjznjQMmXEYhs0GdeVCYoAlgCcN6fe4/2alk67MlFA=; b=DBSAzo1OjyEk7X0EJ+Pkuy9PGmHBDl2kAnNKbc49T/g0olfbG4X7ZJ73rHCSwTVhVF +0pYLWIr4NL+tRnWEv2ZtVvfT+mwaXz7xjgaQdfSF+37UnsjMzJSccpjyL5bWDlGvAlI sEFq9r0K/+cNCvOFpWlMosBW9Pgoe8tC99xJpEvF8+QvZ6ZJ8VQOmkD3Q4kiYIn4waW+ TaxeCW3ybOMPQ0DOK0yri6Kpcox+n/0esM1ojyHyzyE57azr1D175RkMZJD4vj/aVNkU Rtl0GuTifCzA9SzfcEQIrjkFiudpvoPIJ5htOkwAlFRIwlm4ND+gadvhYS+HTNLvQSln k5ng== MIME-Version: 1.0 X-Received: by 10.28.23.135 with SMTP id 129mr14362745wmx.11.1450629460642; Sun, 20 Dec 2015 08:37:40 -0800 (PST) Received: by 10.194.192.33 with HTTP; Sun, 20 Dec 2015 08:37:40 -0800 (PST) In-Reply-To: <20151220161405.GB4053@dendrobates.araler.com> References: <551BC8B3.2030900@bestsolution.at> <56766D93.9030808@quip.cz> <20151220152544.GA4053@dendrobates.araler.com> <20151220161405.GB4053@dendrobates.araler.com> Date: Sun, 20 Dec 2015 10:37:40 -0600 Message-ID: Subject: Re: available hypervisors in FreeBSD From: Adam Vande More To: Sergey Manucharian Cc: FreeBSD virtualization Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Dec 2015 16:37:44 -0000 On Sun, Dec 20, 2015 at 10:14 AM, Sergey Manucharian wrote: > > Remote console is available via VNC, not RDP. > > It is VNC, and I use it Linux hosts, it's rather confusing since the option > is "--vrde on|off". See https://lists.freebsd.org/pipermail/freebsd-emulation/2013-January/010354.html You can also set options like VNCAddress4 for listening address. > But isn't it a part of the extension pack, which is > not available for FreeBSD? > > https://www.virtualbox.org/manual/ch07.html > The explanation lies within that page. VRDP is only in extension pack, VRDE is available to all. So someone with enough gumption could write a VRDE RDP support. -- Adam From owner-freebsd-virtualization@freebsd.org Sun Dec 20 21:52:44 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7EFEBA4EEC7 for ; Sun, 20 Dec 2015 21:52:44 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: from mail-ig0-x243.google.com (mail-ig0-x243.google.com [IPv6:2607:f8b0:4001:c05::243]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 09D271D18 for ; Sun, 20 Dec 2015 21:52:43 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: by mail-ig0-x243.google.com with SMTP id rx7so3552577igc.3 for ; Sun, 20 Dec 2015 13:52:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ara-ler-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=eyDoDqia8XGJux2J0eB+YfqBUXjckIJ8ixws4VWVqbg=; b=ybmbDukMiIzz1SxWoO7HC8A8iQl02msrz5SJzcJHtwp3Fp/eyswpfrGAZaEbZGlB1w i29hRJYaPiB/4ILI0UcRGonPQX4u84rn+xymB+LqUTRfVEHcXMTYtMfoHBukoIN0FbBR VQrz3yEezYBBvpRY2v6I1ioVbRe7EdBW9JbOm+EeUCk5O+ajhSuabOwwN9XpB7Ron9AS mg17emLhfAtFCJTCbawkrrLhlLhfk6RLC7oVh60uGAaFDU0+VjVvSh23ke+PYgGeaKZX 59Epr+h/ceHrbG5S4vZxwh6FCMytGIi/yy0sYodNdm6ZejAko3o+xqvJTXnKSyeWK7Mm 47cg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=eyDoDqia8XGJux2J0eB+YfqBUXjckIJ8ixws4VWVqbg=; b=YZ+5lFOOlUt3VyUCeYOnXZu2ZQWiDNhAqkBfobbFT4KAO+v+De2G3qVZjuUESXjZYS kAP9pWV7fJoHUp3tf4Z3xQtPqImtosLyXk8S0WWxgqEiXA8qN7716cO6dd+MRZgFG+Zf T3i5N+0TLkFQTEyWi0amfcCDifwZUteTfPahf4iEZHURf4FICQzn2ZeV1qs8JDbOMGzs 7WTyjBxFuONpf4UMAkVhBHHbOjGUz8exTqbAi8fB18gWMnVTE8hGMoREhmKzrs+P99Ql 3km1jfI3sImShFcR3QPaWHx9Lr7qUsJQ2lj2yTBWXztNpLMbsTp3P8ghhSz7NUJcBk2X YaPw== X-Gm-Message-State: ALoCoQkht8THU62LrTPXjCaSm99GwYTAcJB1AipG4ux2+CCdlKNQNPLNAdM4832JwyPUGAkqpUdjlzsT9TouKnf1nxEUps8wQQ== X-Received: by 10.50.124.101 with SMTP id mh5mr15811425igb.53.1450648363153; Sun, 20 Dec 2015 13:52:43 -0800 (PST) Received: from dendrobates.araler.com (70-59-19-232.hlrn.qwest.net. [70.59.19.232]) by smtp.gmail.com with ESMTPSA id 198sm6651661ioe.30.2015.12.20.13.52.42 for (version=TLSv1/SSLv3 cipher=OTHER); Sun, 20 Dec 2015 13:52:42 -0800 (PST) Date: Sun, 20 Dec 2015 14:52:40 -0700 From: Sergey Manucharian To: FreeBSD virtualization Subject: Re: bhyve PCI pass-through to Linux guest Message-ID: <20151220215240.GB4064@dendrobates.araler.com> References: <20151220045821.GG22018@dendrobates.araler.com> <56763672.3090207@freebsd.org> <20151220051015.GH22018@dendrobates.araler.com> <56763A0B.8010802@freebsd.org> <20151220053644.GI22018@dendrobates.araler.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20151220053644.GI22018@dendrobates.araler.com> User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Dec 2015 21:52:44 -0000 Excerpts from Sergey Manucharian's message from Sat 19-Dec-15 22:36: > Excerpts from Peter Grehan's message from Sun 20-Dec-15 15:18: > > >>> # bhyve -S ... -s 7,passthru,0/20/0 ... > > > > That's the bhyve command line (if that's the one you meant). You also > > have to pass '-S' when invoking grub-bhyve, since that's when the memory > > resources are created. > > Works fine now. This is pretty reproducible: I pass trough a PCI device (USB controller) to a Linux guest. It works properly. Then I halt the VM, make sure that bhyve destroyed it and run Windows guest with the same PCI device passed-through. Windows device manager does show the device, however, e.g. a flash drive plugged in is not presented to Windows, instead it's being processed by FreeBSD. After that it does not work in Linux guest as well. Kernel module (vmm) unloading and reloading does not help. Of course, I never run two guests with the same PCI pass-through device. Thanks for advices, Sergey From owner-freebsd-virtualization@freebsd.org Mon Dec 21 03:02:07 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D53B6A4DE82 for ; Mon, 21 Dec 2015 03:02:07 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 99831188B for ; Mon, 21 Dec 2015 03:02:07 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id D20A820B4A0C for ; Mon, 21 Dec 2015 13:02:04 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id CCFAC282504 for ; Mon, 21 Dec 2015 13:02:04 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 04lKsMKuucGC for ; Mon, 21 Dec 2015 13:02:04 +1000 (AEST) Received: from Peters-MacBook-Pro.local (CPE-60-226-3-158.wrcz1.cha.bigpond.net.au [60.226.3.158]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 9C42E282026; Mon, 21 Dec 2015 13:02:02 +1000 (AEST) Subject: Re: Windows/bhyve Bluescreen 0x50 To: Trent Thompson References: Cc: freebsd-virtualization@freebsd.org From: Peter Grehan Message-ID: <56776BAA.1040102@freebsd.org> Date: Mon, 21 Dec 2015 13:02:02 +1000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:38.0) Gecko/20100101 Thunderbird/38.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.1 cv=B9IZqLZM c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=OIgypsHbAvIw1X5S2PUfDQ==:17 a=3FMX7HLxAAAA:8 a=6I5d2MoRAAAA:8 a=Sv2sojjTAAAA:8 a=N659UExz7-8A:10 a=wUQvQvOEmiQA:10 a=NEAV23lmAAAA:8 a=DivTarRf1mjK-JIxaSwA:9 a=pILNOxqGKmIA:10 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 21 Dec 2015 03:02:07 -0000 Hi Trent, Revisiting this old topic: > I started playing with Peter's Windows guide and have run into a Blue > Screen of Death already. > I am using Windows 2016, and only changed the passwords in the AutoUnattend. > The zvol is 64GB in size. > I also tried it with a 40GB empty file for a disk, just to be sure. > > The last 150 lines or so of the SAC output can be found here: > https://gist.github.com/pr1ntf/f019e5922bee6dbc791d ... > > > TYPE="string">"0x50" > not yet initialized It appears to be related to the number of vCPUs. Using a single vCPU will result in this, wherease >= 2 seems to work Ok with 2k16 tp3. I'll be hooking up the debugger to see what Windows sees as the issue. later, Peter. From owner-freebsd-virtualization@freebsd.org Mon Dec 21 18:33:41 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0B1A9A4E7C8 for ; Mon, 21 Dec 2015 18:33:41 +0000 (UTC) (envelope-from rowley.evan@gmail.com) Received: from mail-ob0-x232.google.com (mail-ob0-x232.google.com [IPv6:2607:f8b0:4003:c01::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B5880129F for ; Mon, 21 Dec 2015 18:33:40 +0000 (UTC) (envelope-from rowley.evan@gmail.com) Received: by mail-ob0-x232.google.com with SMTP id bx1so11469816obb.0 for ; Mon, 21 Dec 2015 10:33:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=ofvop6Ut2w3RdeHUZEebfSZ+k4Px/yejYuhsX1V5y0Y=; b=Gb9NN3jqMiQt5+Y8vv+IqlxLiWNGCvyEYns+Rw+iKgsqYOTdUrd9gbYhT9uId0eiep /yhiHdiRvvkP/FNxvbZi9gOLDartfRzqgcWhYH0ztAUt5q3jPoLvv6f55vKaCsa/BhA+ GZFL+WtutsU7/LREx7imysc0vn6X+lpZWSKZqrbfRf+Sb9tn+haeoiiJkUAzwjbSOUoe ZZYRXwUiaaMZp+Eq2MBeiDO7sjEYzSmXmUi1OhpfVYolOhRuUGJdc+ziyhGZe51yjAes UgD38NmnUsXlY5UcR5yVONxlI2nXGS84kciThB6YdYtlSSO/+04OsOBYE/d1TW3e+pcu x71w== MIME-Version: 1.0 X-Received: by 10.182.142.170 with SMTP id rx10mr8150493obb.34.1450722819675; Mon, 21 Dec 2015 10:33:39 -0800 (PST) Received: by 10.76.157.195 with HTTP; Mon, 21 Dec 2015 10:33:39 -0800 (PST) Date: Mon, 21 Dec 2015 13:33:39 -0500 Message-ID: Subject: Bhyve UEFI VM on non-UEFI host From: Evan Rowley To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 21 Dec 2015 18:33:41 -0000 Hello I am interested in running bhyve VMs utilizing UEFI, as described in Peter's Windows guide: http://pr1ntf.xyz/windowsunderbhyve.html The host machine will be an dual AMD Opteron 6166 HE processor, AMD SR5670 / SP5100 chipset, Supermicro H8DGU-F motherboard. There is no UEFI support on this motherboard and the BIOS is standard AMI like the other Supermicro boards from this era. Despite not having native UEFI support on the motherboard, will I still be able to use virtualized UEFI via bhyve, for booting Windows VMs? -- - EJR From owner-freebsd-virtualization@freebsd.org Mon Dec 21 18:37:22 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AC531A4F072 for ; Mon, 21 Dec 2015 18:37:22 +0000 (UTC) (envelope-from neelnatu@gmail.com) Received: from mail-pa0-x235.google.com (mail-pa0-x235.google.com [IPv6:2607:f8b0:400e:c03::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 84D1E17AA for ; Mon, 21 Dec 2015 18:37:22 +0000 (UTC) (envelope-from neelnatu@gmail.com) Received: by mail-pa0-x235.google.com with SMTP id wq6so103384259pac.1 for ; Mon, 21 Dec 2015 10:37:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=references:mime-version:in-reply-to:content-type :content-transfer-encoding:message-id:cc:from:subject:date:to; bh=KxSyfOa4/J80eVbOTVOI3KwlCdMWS2JmuMF7wzygZ0Q=; b=s/O71PiQNlfLfXwhKJJcf2kdvwXmNHSzfHQW0BolT1sKmLBoaqiYyKFgzjVtjRbnX9 lYGvz/2EewIIFUXZNF+Bd8fEIZhd2KaTrLRTbPelJqqAkWPu7HYXtFk5QVsOFu9Ks8kD xYEp/LCoAi0oNWQJwaq9njMskApT7BeZiokxTH1Z7cIWL5aIq/OoRvonIIfU3+ZpBN6q RLy6g3rnaaKm8D7H5Evwrvg5/HwD/NDQuW8q8Kyc5BH6buTDIBrpX280cUa/tP+FUbI+ A1CdR7h808DCaqGXWd7qwwGL/Ry1ESGOTpaCs+1ruk4Fhzmv98/CskJBryfzJ5X2+C2L pCFA== X-Received: by 10.66.154.161 with SMTP id vp1mr29225842pab.25.1450723042116; Mon, 21 Dec 2015 10:37:22 -0800 (PST) Received: from [192.168.1.95] (108-228-13-158.lightspeed.sntcca.sbcglobal.net. [108.228.13.158]) by smtp.gmail.com with ESMTPSA id u67sm36215307pfa.84.2015.12.21.10.37.19 (version=TLSv1/SSLv3 cipher=OTHER); Mon, 21 Dec 2015 10:37:20 -0800 (PST) References: Mime-Version: 1.0 (1.0) In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Message-Id: <5A4CFBA5-83C5-4A23-B498-6850E03BFC15@gmail.com> Cc: "freebsd-virtualization@freebsd.org" X-Mailer: iPhone Mail (11D257) From: Neel Natu Subject: Re: Bhyve UEFI VM on non-UEFI host Date: Mon, 21 Dec 2015 10:37:16 -0800 To: Evan Rowley X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 21 Dec 2015 18:37:22 -0000 > On Dec 21, 2015, at 10:33 AM, Evan Rowley wrote: >=20 > Hello >=20 > I am interested in running bhyve VMs utilizing UEFI, as described in > Peter's Windows guide: http://pr1ntf.xyz/windowsunderbhyve.html >=20 > The host machine will be an dual AMD Opteron 6166 HE processor, AMD SR5670= > / SP5100 chipset, Supermicro H8DGU-F motherboard. There is no UEFI support= > on this motherboard and the BIOS is standard AMI like the other Supermicro= > boards from this era. >=20 > Despite not having native UEFI support on the motherboard, will I still be= > able to use virtualized UEFI via bhyve, for booting Windows VMs? >=20 Yes, that's correct. Best Neel >=20 >=20 > --=20 > - EJR > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freeb= sd.org" From owner-freebsd-virtualization@freebsd.org Tue Dec 22 03:09:11 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A20D2A4E732 for ; Tue, 22 Dec 2015 03:09:11 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 64E981954 for ; Tue, 22 Dec 2015 03:09:11 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id D45DB20B4BB4 for ; Tue, 22 Dec 2015 13:09:02 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id CDCEB282026 for ; Tue, 22 Dec 2015 13:09:02 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 1BCTR5KG2Tqh for ; Tue, 22 Dec 2015 13:09:02 +1000 (AEST) Received: from Peters-MacBook-Pro.local (CPE-60-226-3-158.wrcz1.cha.bigpond.net.au [60.226.3.158]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 4285528098C; Tue, 22 Dec 2015 13:09:00 +1000 (AEST) Subject: Re: {Spam?} Re: bhyve PCI pass-through to Linux guest To: Sergey Manucharian References: <20151220045821.GG22018@dendrobates.araler.com> <56763672.3090207@freebsd.org> <20151220051015.GH22018@dendrobates.araler.com> <56763A0B.8010802@freebsd.org> <20151220053644.GI22018@dendrobates.araler.com> <20151220215240.GB4064@dendrobates.araler.com> Cc: FreeBSD virtualization From: Peter Grehan Message-ID: <5678BECC.7090200@freebsd.org> Date: Tue, 22 Dec 2015 13:09:00 +1000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:38.0) Gecko/20100101 Thunderbird/38.4.0 MIME-Version: 1.0 In-Reply-To: <20151220215240.GB4064@dendrobates.araler.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.1 cv=B9IZqLZM c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=OIgypsHbAvIw1X5S2PUfDQ==:17 a=3FMX7HLxAAAA:8 a=6I5d2MoRAAAA:8 a=Sv2sojjTAAAA:8 a=N659UExz7-8A:10 a=wUQvQvOEmiQA:10 a=_OFQ3fp2lvZQrjQQJzYA:9 a=pILNOxqGKmIA:10 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Dec 2015 03:09:11 -0000 Hi Sergey, > This is pretty reproducible: > > I pass trough a PCI device (USB controller) to a Linux guest. It works > properly. Then I halt the VM, make sure that bhyve destroyed it and run > Windows guest with the same PCI device passed-through. > > Windows device manager does show the device, however, e.g. a flash drive > plugged in is not presented to Windows, instead it's being processed by > FreeBSD. > > After that it does not work in Linux guest as well. Kernel module (vmm) > unloading and reloading does not help. The flash drive being processed by FreeBSD would indicate that it has ownership of the device. Would you be able to try a 'pciconf -vl' after the Linux guest exists, and after the Windows guest exits ? later, Peter. From owner-freebsd-virtualization@freebsd.org Tue Dec 22 03:45:01 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 80FD3A4C042 for ; Tue, 22 Dec 2015 03:45:01 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: from mail-ig0-x234.google.com (mail-ig0-x234.google.com [IPv6:2607:f8b0:4001:c05::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5216215E5 for ; Tue, 22 Dec 2015 03:45:01 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: by mail-ig0-x234.google.com with SMTP id to18so49526603igc.0 for ; Mon, 21 Dec 2015 19:45:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ara-ler-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=cNWXKyh35/mqWrJoTd5Oic7uxzQPCfQ5iP4xDd3qNuk=; b=D72hMKWHBnEEb2JYFpwyFh/4wH9Ubo0JjHX7spuPapQI5zLuTVTsRFDWBlaRMiuTud H8WVSLKbgFvqd0r1LyEdry4IlzX5muytvkSMcPwCziIcOZ0BpKWXb8cydDeNoCyD8/lp 05IS4b8PKgf4va0Sr5qCS5et1aG0DB9HfEnSQFGByDgHPvazcz9AzLdwG9/LuEM7Pjmm VY+AeAMRHLARe3Bldv8lLFZiInT4k3XeZ3iYyiAXQFaqv4PVtgmmTL+LWCTrVIsDvLi9 zN4bQiWhKyKRPvmTbKI6Ot4SulfHU3c/LQfncdu+LBZTNwp5Rn4E96hEJueNdKVm6bEe 7bDw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=cNWXKyh35/mqWrJoTd5Oic7uxzQPCfQ5iP4xDd3qNuk=; b=ZSSBuJ6VwuIYthOVK/vHQFrxU2TCUWJ7MRhXIivh3M0ummWlF+UpqJnPNYlWYlnwfk DjEtAKiXyxrCF0YtqchlJgLJYQVhEGZLiv1IeOl4TDnS7q7CqB7gLx6A28elkzNTQiHD h38nsJtyb8yatmwyk22zNaTB/hBdcaXfRe4dTCXZfltWdGUaXcpsVNdQnmNqI2AcyECp RNM8PYbNqGkCcVZyJa3pz5TAPeSO3SS7B4leLbIT7HSAKh1rraU7heQ1qcgJzUGSBkN6 nURlsjgJ28mMDiC/IofQ/zaHOvqU0KjN48QeunLSqifZXFC0wbPZG6aNrezH3En5yOrG asQg== X-Gm-Message-State: ALoCoQmO5YyjolQk4G6xxgf1fp1YKfYiFPk+jurqO9NQw3tOMBm8UFv02/C4DWEBgzhMhQNmU99Fq3cPVTvrdTFmvKmVhXHMXw== X-Received: by 10.50.142.99 with SMTP id rv3mr20834833igb.72.1450755900433; Mon, 21 Dec 2015 19:45:00 -0800 (PST) Received: from dendrobates.araler.com (70-59-19-232.hlrn.qwest.net. [70.59.19.232]) by smtp.gmail.com with ESMTPSA id c67sm4653112iod.5.2015.12.21.19.44.59 for (version=TLSv1/SSLv3 cipher=OTHER); Mon, 21 Dec 2015 19:44:59 -0800 (PST) Date: Mon, 21 Dec 2015 20:44:57 -0700 From: Sergey Manucharian To: FreeBSD virtualization Subject: Re: bhyve PCI pass-through to Linux guest Message-ID: <20151222034457.GA40078@dendrobates.araler.com> References: <20151220045821.GG22018@dendrobates.araler.com> <56763672.3090207@freebsd.org> <20151220051015.GH22018@dendrobates.araler.com> <56763A0B.8010802@freebsd.org> <20151220053644.GI22018@dendrobates.araler.com> <20151220215240.GB4064@dendrobates.araler.com> <5678BECC.7090200@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5678BECC.7090200@freebsd.org> User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Dec 2015 03:45:01 -0000 Excerpts from Peter Grehan's message from Tue 22-Dec-15 13:09: > Hi Sergey, > > > This is pretty reproducible: > > > > I pass trough a PCI device (USB controller) to a Linux guest. It works > > properly. Then I halt the VM, make sure that bhyve destroyed it and run > > Windows guest with the same PCI device passed-through. > > > > Windows device manager does show the device, however, e.g. a flash drive > > plugged in is not presented to Windows, instead it's being processed by > > FreeBSD. > > > > After that it does not work in Linux guest as well. Kernel module (vmm) > > unloading and reloading does not help. > > The flash drive being processed by FreeBSD would indicate that it has > ownership of the device. Would you be able to try a 'pciconf -vl' after > the Linux guest exists, and after the Windows guest exits ? OK, I've experimented more and found that even with the same Linux VM after halting it once, the pass-through device doesn't work when that Linux guest is restarted again. It looks that both host and guest report exactly the same data before and after restarting the guest: Linux - first run: ================= $ lspci -v 00:07.0 USB controller: Intel Corporation 7 Series/C210 Series Chipset Family USB xHCI Host Controller (rev 04) (prog-if 30 [XHCI]) Subsystem: Lenovo Device 21f3 Flags: bus master, medium devsel, latency 0, IRQ 24 Memory at c0010000 (64-bit, prefetchable) [size=64K] Capabilities: [70] Power Management version 2 Capabilities: [80] MSI: Enable+ Count=1/8 Maskable- 64bit+ Kernel driver in use: xhci_hcd $ lsusb Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub Bus 001 Device 002: ID 0781:5530 SanDisk Corp. Cruzer Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub FreeBSD when Linux is running first time: ========================================= $ pciconf -v ppt0@pci0:0:20:0: class=0x0c0330 card=0x21f317aa chip=0x1e318086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = '7 Series/C210 Series Chipset Family USB xHCI Host Controller' class = serial bus subclass = USB Linux - second run: =================== $ lspci -v 00:07.0 USB controller: Intel Corporation 7 Series/C210 Series Chipset Family USB xHCI Host Controller (rev 04) (prog-if 30 [XHCI]) Subsystem: Lenovo Device 21f3 Flags: bus master, medium devsel, latency 0, IRQ 24 Memory at c0010000 (64-bit, prefetchable) [size=64K] Capabilities: [70] Power Management version 2 Capabilities: [80] MSI: Enable+ Count=1/8 Maskable- 64bit+ Kernel driver in use: xhci_hcd FreeBSD when Linux is running second time: ========================================== $ pciconf -lv ppt0@pci0:0:20:0: class=0x0c0330 card=0x21f317aa chip=0x1e318086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = '7 Series/C210 Series Chipset Family USB xHCI Host Controller' class = serial bus subclass = USB -- Thanks, Sergey From owner-freebsd-virtualization@freebsd.org Tue Dec 22 03:48:42 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F29E4A4C127 for ; Tue, 22 Dec 2015 03:48:42 +0000 (UTC) (envelope-from trentnthompson@gmail.com) Received: from mail-lb0-x230.google.com (mail-lb0-x230.google.com [IPv6:2a00:1450:4010:c04::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7F2281787 for ; Tue, 22 Dec 2015 03:48:42 +0000 (UTC) (envelope-from trentnthompson@gmail.com) Received: by mail-lb0-x230.google.com with SMTP id oh2so24536339lbb.3 for ; Mon, 21 Dec 2015 19:48:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=ybqEfvYClFZz8s4700sXflQvIC27rZKVfRMXFLgNaCo=; b=WEdajvW9DCKi/hMhqGx3wM7MtlEOO+hQxrUiOT0DeRn1DkRYMBa7e3CZfxpDwobCWK b/sg7mjhfCSlRY8lM9U05d0fksqXAK5N/5+tqqbZidtjBnvWBH3mc6jnnCiz7QoHGfXW amsLk58osqBR/x4I9LbYIq3iO8CiK0R+ST7xRu90gFvztxb2mi9UqS6hLmKxHmNeFTwN 5c8u5IVIDZ3BXLg8esh2B9YTYpdz7i8b19Hm/dPR+haXpXB+nTC8jECUOdr1WbTpAWcT dYA/xwotRlaDvVu9jE3cTpBkHOTlnr7DOI6oC0/fixCovhtdHDLv8YCxq86kPjs3i1vL hAPA== MIME-Version: 1.0 X-Received: by 10.112.160.202 with SMTP id xm10mr6176829lbb.22.1450756120472; Mon, 21 Dec 2015 19:48:40 -0800 (PST) Received: by 10.25.198.2 with HTTP; Mon, 21 Dec 2015 19:48:40 -0800 (PST) In-Reply-To: <5678BECC.7090200@freebsd.org> References: <20151220045821.GG22018@dendrobates.araler.com> <56763672.3090207@freebsd.org> <20151220051015.GH22018@dendrobates.araler.com> <56763A0B.8010802@freebsd.org> <20151220053644.GI22018@dendrobates.araler.com> <20151220215240.GB4064@dendrobates.araler.com> <5678BECC.7090200@freebsd.org> Date: Mon, 21 Dec 2015 20:48:40 -0700 Message-ID: Subject: Re: {Spam?} Re: bhyve PCI pass-through to Linux guest From: Trent Thompson To: Sergey Manucharian Cc: FreeBSD virtualization Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Dec 2015 03:48:43 -0000 Sergey, I've seen some success passing through devices that have their driver disabled in the FreeBSD kernel. See the USB 3.0 pass through that Eresia set up in iohyve. https://github.com/pr1ntf/iohyve/wiki/USB-3.0-PCI-Controller-Pass-through When he disabled the kernel module in FreeBSD, he can then use the device in the bhyve guest. Unfortunately, I have not worked on this specific problem myself, and cannot speak for this solution. -Trent On Mon, Dec 21, 2015 at 8:09 PM, Peter Grehan wrote: > Hi Sergey, > > This is pretty reproducible: >> >> I pass trough a PCI device (USB controller) to a Linux guest. It works >> properly. Then I halt the VM, make sure that bhyve destroyed it and run >> Windows guest with the same PCI device passed-through. >> >> Windows device manager does show the device, however, e.g. a flash drive >> plugged in is not presented to Windows, instead it's being processed by >> FreeBSD. >> >> After that it does not work in Linux guest as well. Kernel module (vmm) >> unloading and reloading does not help. >> > > The flash drive being processed by FreeBSD would indicate that it has > ownership of the device. Would you be able to try a 'pciconf -vl' after the > Linux guest exists, and after the Windows guest exits ? > > later, > > Peter. > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@freebsd.org Tue Dec 22 04:13:10 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B6E3BA4CA32 for ; Tue, 22 Dec 2015 04:13:10 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: from mail-ig0-x22c.google.com (mail-ig0-x22c.google.com [IPv6:2607:f8b0:4001:c05::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8022611C7 for ; Tue, 22 Dec 2015 04:13:10 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: by mail-ig0-x22c.google.com with SMTP id ph11so52195164igc.1 for ; Mon, 21 Dec 2015 20:13:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ara-ler-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=BW8F33jL94XjwdBo8LJmA4YNaokg0v3KMSdwlBK4jyU=; b=M8ayUj9YI8ZscwvwnGf0Y1ndLRk7lfsAj9ik7s4aZnH1hqJdmJIjJcsDIUcQQErvaD z1m4bCc3C/B6WXzXzcfW+9Cg9XuhHntwSZlfjU0XoERRcyxocTYWr8pKjVw4Intz63b3 3Xxb1hIPsjBrptbM7vVWfpMKCYq7Vekd9fcDIhZ8YAHyosA5pKirvPk5NST3EpNWdycl iXlxvE6BE0WjuStY0yiHCviSjFkzal6Q78ZksD2URui91yxCW72ivhh+vALfkr7lzeSD NC6zeQTBYUrdHBI2PCFx00ek6FsEkk0Bg/VGfBxIv/kaJURBeKBHiX2sxxY1GgRaqDx0 98dQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=BW8F33jL94XjwdBo8LJmA4YNaokg0v3KMSdwlBK4jyU=; b=iKcc3PlwjtIiLVxDPKKsya2k9g3T6wk/aEdhRXSOPIMwcomeBM5va0Gn6ZsnRPEpR/ Z/f+u9uHVCv4J8tAnm4NYTTu3tsnGJPxnNvr6KZJgShpLXZXuetozgSwfmgBdkl2TzNL 7RbxMGBddcdIeKUThRrjQ3ykikAsCw7QkIiBZaYIz1nTlHh4sDVXIZt/3qkvvz/xwrJ7 nFYR/r0C/jFMKpeVO5+TL5gge5FKm0oTAHwyRGIfzZ88wufBF9mcfpM8xM/pcIwR1BNG Ue1iJxxXAmvepBLLBCzuADe/Srg0hQVyoCQC9DzV68UzMxzBlXlrOqvi5B0BRUYxnobB 2IDQ== X-Gm-Message-State: ALoCoQlupz7/D9iT+hjkMR3V4S3jcIy8Mui3dXKBz0kozKl2JZZghaloCGL0cuSM88cl//YGRJBGTloMjGP+4HT/4ndOChHxqA== X-Received: by 10.50.41.65 with SMTP id d1mr21057359igl.44.1450757589818; Mon, 21 Dec 2015 20:13:09 -0800 (PST) Received: from dendrobates.araler.com (70-59-19-232.hlrn.qwest.net. [70.59.19.232]) by smtp.gmail.com with ESMTPSA id c21sm13493191ioc.24.2015.12.21.20.13.08 for (version=TLSv1/SSLv3 cipher=OTHER); Mon, 21 Dec 2015 20:13:09 -0800 (PST) Date: Mon, 21 Dec 2015 21:13:07 -0700 From: Sergey Manucharian To: FreeBSD virtualization Subject: Re: Re: {Spam?} Re: bhyve PCI pass-through to Linux guest Message-ID: <20151222041307.GB40078@dendrobates.araler.com> References: <20151220045821.GG22018@dendrobates.araler.com> <56763672.3090207@freebsd.org> <20151220051015.GH22018@dendrobates.araler.com> <56763A0B.8010802@freebsd.org> <20151220053644.GI22018@dendrobates.araler.com> <20151220215240.GB4064@dendrobates.araler.com> <5678BECC.7090200@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Dec 2015 04:13:10 -0000 Excerpts from Trent Thompson's message from Mon 21-Dec-15 20:48: > I've seen some success passing through devices that have their driver > disabled in the FreeBSD kernel. > See the USB 3.0 pass through that Eresia set up in iohyve. > https://github.com/pr1ntf/iohyve/wiki/USB-3.0-PCI-Controller-Pass-through > > When he disabled the kernel module in FreeBSD, he can then use the device > in the bhyve guest. Thank you for the advice, Trent. Of course, that's probably a good work-around. However if it works once there should be a way to rectify that behaviour. Sergey From owner-freebsd-virtualization@freebsd.org Tue Dec 22 05:48:02 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B3B36A4E726 for ; Tue, 22 Dec 2015 05:48:02 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: from mail-vk0-x235.google.com (mail-vk0-x235.google.com [IPv6:2607:f8b0:400c:c05::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A12381A06 for ; Tue, 22 Dec 2015 05:48:01 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: by mail-vk0-x235.google.com with SMTP id a189so112601186vkh.2 for ; Mon, 21 Dec 2015 21:48:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=VSpB+kp/gaa2iy2yVybLk0+8fo9MkgKP0GmDBFcaB1Y=; b=K0eJZWaeuwmjkv1Jd3ANKK30TDVuSzJ2f0pEkMN5k6Z+zIiFpd/UGoD+8djM5u3yul iJQznC1+MlAnqQ0SUDqdvvjVEgXPzz70ERKVYzGXiJ99grJn655GsDdp2x77XZh6bSYT auxwkJBICRn+JtiXOhok/J5aqz6Zh8W2AficLZz3FE4l+wfOWPHDXUsMFL21+LSJRyR+ /0c27InUub4F2mV1/Cav0X/vRhZQ7ZbXtp62dtyWdveljbgSV5V9G983iRzGS5+CltwA v/+jWjnpWJ6WnzftwBZp+k3+Eob6IRrNARH36U63OXOZUlqRVfp0Iid6yheFJJcIx8wC jNlA== MIME-Version: 1.0 X-Received: by 10.31.163.197 with SMTP id m188mr14874759vke.89.1450763280660; Mon, 21 Dec 2015 21:48:00 -0800 (PST) Received: by 10.31.163.135 with HTTP; Mon, 21 Dec 2015 21:48:00 -0800 (PST) In-Reply-To: <20151222034457.GA40078@dendrobates.araler.com> References: <20151220045821.GG22018@dendrobates.araler.com> <56763672.3090207@freebsd.org> <20151220051015.GH22018@dendrobates.araler.com> <56763A0B.8010802@freebsd.org> <20151220053644.GI22018@dendrobates.araler.com> <20151220215240.GB4064@dendrobates.araler.com> <5678BECC.7090200@freebsd.org> <20151222034457.GA40078@dendrobates.araler.com> Date: Mon, 21 Dec 2015 21:48:00 -0800 Message-ID: Subject: Re: bhyve PCI pass-through to Linux guest From: Anish To: Sergey Manucharian Cc: FreeBSD virtualization Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Dec 2015 05:48:02 -0000 >ppt0@pci0:0:20:0: class=0x0c0330 card=0x21f317aa chip=0x1e318086 Passthrough stub driver, part of vmm, controls the USB controller. Can you share output of /usr/sbin/devinfo from FreeBSD host, highlighting the usb mass/flash device in tree? Regards, Anish On Mon, Dec 21, 2015 at 7:44 PM, Sergey Manucharian wrote: > Excerpts from Peter Grehan's message from Tue 22-Dec-15 13:09: > > Hi Sergey, > > > > > This is pretty reproducible: > > > > > > I pass trough a PCI device (USB controller) to a Linux guest. It works > > > properly. Then I halt the VM, make sure that bhyve destroyed it and run > > > Windows guest with the same PCI device passed-through. > > > > > > Windows device manager does show the device, however, e.g. a flash > drive > > > plugged in is not presented to Windows, instead it's being processed by > > > FreeBSD. > > > > > > After that it does not work in Linux guest as well. Kernel module (vmm) > > > unloading and reloading does not help. > > > > The flash drive being processed by FreeBSD would indicate that it has > > ownership of the device. Would you be able to try a 'pciconf -vl' after > > the Linux guest exists, and after the Windows guest exits ? > > OK, I've experimented more and found that even with the same Linux VM > after halting it once, the pass-through device doesn't work when that > Linux guest is restarted again. > > It looks that both host and guest report exactly the same data before and > after restarting the guest: > > Linux - first run: > ================= > $ lspci -v > 00:07.0 USB controller: Intel Corporation 7 Series/C210 Series Chipset > Family USB xHCI Host Controller (rev 04) (prog-if 30 [XHCI]) > Subsystem: Lenovo Device 21f3 > Flags: bus master, medium devsel, latency 0, IRQ 24 > Memory at c0010000 (64-bit, prefetchable) [size=64K] > Capabilities: [70] Power Management version 2 > Capabilities: [80] MSI: Enable+ Count=1/8 Maskable- 64bit+ > Kernel driver in use: xhci_hcd > > $ lsusb > Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub > Bus 001 Device 002: ID 0781:5530 SanDisk Corp. Cruzer > Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub > > FreeBSD when Linux is running first time: > ========================================= > $ pciconf -v > ppt0@pci0:0:20:0: class=0x0c0330 card=0x21f317aa chip=0x1e318086 > rev=0x04 hdr=0x00 > vendor = 'Intel Corporation' > device = '7 Series/C210 Series Chipset Family USB xHCI Host > Controller' > class = serial bus > subclass = USB > > Linux - second run: > =================== > $ lspci -v > 00:07.0 USB controller: Intel Corporation 7 Series/C210 Series Chipset > Family USB xHCI Host Controller (rev 04) (prog-if 30 [XHCI]) > Subsystem: Lenovo Device 21f3 > Flags: bus master, medium devsel, latency 0, IRQ 24 > Memory at c0010000 (64-bit, prefetchable) [size=64K] > Capabilities: [70] Power Management version 2 > Capabilities: [80] MSI: Enable+ Count=1/8 Maskable- 64bit+ > Kernel driver in use: xhci_hcd > > FreeBSD when Linux is running second time: > ========================================== > $ pciconf -lv > ppt0@pci0:0:20:0: class=0x0c0330 card=0x21f317aa chip=0x1e318086 > rev=0x04 hdr=0x00 > vendor = 'Intel Corporation' > device = '7 Series/C210 Series Chipset Family USB xHCI Host > Controller' > class = serial bus > subclass = USB > > > -- > Thanks, > Sergey > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@freebsd.org Tue Dec 22 16:49:42 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A0046A4E168 for ; Tue, 22 Dec 2015 16:49:42 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8094215C2 for ; Tue, 22 Dec 2015 16:49:42 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from ralph.baldwin.cx (c-73-231-226-104.hsd1.ca.comcast.net [73.231.226.104]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 30C1BB958; Tue, 22 Dec 2015 11:49:41 -0500 (EST) From: John Baldwin To: freebsd-virtualization@freebsd.org, "G. Amanakis" Subject: Re: BAR and pci passthrough Date: Tue, 22 Dec 2015 08:44:12 -0800 Message-ID: <2573974.qrpbG8qZMs@ralph.baldwin.cx> User-Agent: KMail/4.14.3 (FreeBSD/10.2-STABLE; KDE/4.14.3; amd64; ; ) In-Reply-To: References: <4F251D2F-8C0C-46FF-B5E1-D88DE84904D8@yahoo.com> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Tue, 22 Dec 2015 11:49:41 -0500 (EST) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Dec 2015 16:49:42 -0000 On Saturday, December 12, 2015 02:04:17 PM G. Amanakis via freebsd-virtualization wrote: > Changing > #define PCIM_BAR_MEM_BASE 0xfffffffffffffff0ULL > to > #define PCIM_BAR_MEM_BASE 0xfffffffffffff000ULL > in > sys/dev/PCI/pcireg.h makes the min size of a memory BAR equal to 0x1000 or 4096 bytes and it lets me passthrough the device. Any objections to this strategy? This constant defines the spec as implemented in hardware. You will break real hardware on bare metal if you make this change. As Neel notes, this is hard to fix properly. The proper fix is to modify the ppt(4) driver so that it asks the PCI bus to allocate a full page for BARs that are smaller than a page. Unfortunately the PCI bus driver doesn't currently provide a way to do that. Even if it did it would not necessarily always work since the device may be behind a PCI-PCI bridge whose windows can't grow due to existing allocations of adjacent addresses. Alternatively the hypervisor could trap all accesses to this page and only permit accesses to the range that contains the BAR, but that would be quite slow. > On December 2, 2015 11:54:03 PM GMT+01:00, Neel Natu wrote: > >On Wed, Dec 2, 2015 at 3:13 AM, G. Amanakis via freebsd-virtualization > > wrote: > >> I am facing the following problem: > >> on a X9SCM with an E3-1220Lv2 I am trying to passthrough the > >onboard usb controllers. I disable the usb module from the kernel > >config and using pptdev the controllers are assigned to ppt devices. > >However running bhyve on FreeBSD 10.2 with: > >> > >> sudo bhyve -AI -H -P -s 0:0,hostbridge -s 1:0,lpc -s > >2:0,virtio-net,tap0 -s 3:0,virtio-blk,./linux.img -s > >4:0,passthru,0/29/0 -l com1,stdio -c 2 -m 2048M linuxguest > >> > >> returns : > >> > >> passthru device 0/29/0 BAR 0: base 0xdf823000 or size 0x400 not > >page aligned > >> > >> The problem probably that the length of the bar is smaller and not > >aligned with the pagesize. Could the length of the BAR be modified in > >order to perform the pci passthrough? > > > >Yes, that's correct - the size of the BAR is not a multiple of the > >page size which leads to the error. If this BAR is mapped into the > >guest's address space then it will "leak" an additional 3K into the > >guest (since the minimum nested mapping is 4KB in size). > > > >It is hard to fix this in the general case if you want to truly > >passthrough the BAR to the guest. > > > >best > >Neel > > > >> -- > >> Sent from my Android device with K-9 Mail. Please excuse my brevity. > >> _______________________________________________ > >> freebsd-virtualization@freebsd.org mailing list > >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > >> To unsubscribe, send any mail to > >"freebsd-virtualization-unsubscribe@freebsd.org" > > -- John Baldwin From owner-freebsd-virtualization@freebsd.org Wed Dec 23 00:14:21 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D47E3A508BE for ; Wed, 23 Dec 2015 00:14:21 +0000 (UTC) (envelope-from trentnthompson@gmail.com) Received: from mail-lf0-x22b.google.com (mail-lf0-x22b.google.com [IPv6:2a00:1450:4010:c07::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 64D6C1BCF; Wed, 23 Dec 2015 00:14:21 +0000 (UTC) (envelope-from trentnthompson@gmail.com) Received: by mail-lf0-x22b.google.com with SMTP id z124so133588112lfa.3; Tue, 22 Dec 2015 16:14:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=Ca7y/7QeUCeCeM8DBjsjcVfGWGlxvkNI6IVasw0/yng=; b=lXPI4EjMMO+YMu9STvqjGSTecmJrCOfG3gBn/DC8nqefa/LckxQsqR8BjF5r9YpNqS 5aS4Fta5PlW9o9QeLJy8PW06JiUmyuw2EkY1Hwx/jHnRFHj1+AkDkcwILqKIF0UYtrFm WReX4udVJuq+gJi5GtSx/k88mtWZ17xsJ40InYiPVkFDLB5ULaxBETP56icIMLBUXf0r jB/CHedoxkeb2xeUcl80J3rfTFDn6N1yJG07b72q94SY0HSP7huM7J52jyaTx6XGB1eO OUFIBiUwqPZAMrx6WntGO2fDmKW2Pfa1L9H6YJEbtLf7yKoUPmrirGQdHxls780Qdr+u 1ZDw== MIME-Version: 1.0 X-Received: by 10.25.151.69 with SMTP id z66mr7695752lfd.122.1450829658871; Tue, 22 Dec 2015 16:14:18 -0800 (PST) Received: by 10.25.198.2 with HTTP; Tue, 22 Dec 2015 16:14:18 -0800 (PST) In-Reply-To: <56776BAA.1040102@freebsd.org> References: <56776BAA.1040102@freebsd.org> Date: Tue, 22 Dec 2015 17:14:18 -0700 Message-ID: Subject: Re: Windows/bhyve Bluescreen 0x50 From: Trent Thompson To: Peter Grehan Cc: FreeBSD virtualization Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Dec 2015 00:14:22 -0000 >It appears to be related to the number of vCPUs. Using a single vCPU will result in this, wherease >= 2 seems to work Ok with 2k16 tp3. That did the trick! I still seem to be having issues with the firmware on the i5 machine getting Windows 2016 to boot. (Windows 2008 and 2012 work fine) bhyve exits with: >$ vm exit[0] > reason VMX > rip 0x00000000017ca1d7 > inst_length 2 > status 0 > exit_reason 2 > qualification 0x0000000000000000 > inst_type 0 > inst_error 0 >$ sysctl hw.model >hw.model: Intel(R) Core(TM) i5-2520M CPU @ 2.50GHz Thanks for all your help! From owner-freebsd-virtualization@freebsd.org Wed Dec 23 00:33:06 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 88A89A50EB1 for ; Wed, 23 Dec 2015 00:33:06 +0000 (UTC) (envelope-from ipluta@wp.pl) Received: from mx3.wp.pl (mx3.wp.pl [212.77.101.9]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.wp.pl", Issuer "RapidSSL SHA256 CA - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 20FA3161D for ; Wed, 23 Dec 2015 00:33:05 +0000 (UTC) (envelope-from ipluta@wp.pl) Received: (wp-smtpd smtp.wp.pl 4405 invoked from network); 22 Dec 2015 23:46:19 +0100 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=wp.pl; s=1024a; t=1450824379; bh=5AaaRR0BIpAPHeIL86+xO8Iuv9wOKUs5WFkDmTpif6c=; h=To:From:Subject; b=R1QDWn6MH7GMSrDTDbqKlbKM/ZpX++Au1UJSvbCZ4nuGKZ49bIdbutgSo0vPeUJI+ jwW+9vB3PdvUDaI7Sta/+XFs+JBKQZWxLGvaEO1LfGqOcYEUCPxL00t9aj6Io6gFU5 D/LlzpoHY04BFrwcvnyQXCQQMZs3BHNDEx1TEpBA= Received: from bit125.neoplus.adsl.tpnet.pl (HELO [10.0.0.227]) (ipluta@[83.28.135.125]) (envelope-sender ) by smtp.wp.pl (WP-SMTPD) with ECDHE-RSA-AES256-SHA encrypted SMTP for ; 22 Dec 2015 23:46:19 +0100 To: freebsd-virtualization@freebsd.org From: Ireneusz Pluta Subject: Failed to start virtualbox natnetwork Message-ID: <5679D2B6.3080302@wp.pl> Date: Tue, 22 Dec 2015 23:46:14 +0100 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.4.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-WP-MailID: 0a8427a7c89d07e6b478aa3166b365c2 X-WP-AV: skaner antywirusowy poczty Wirtualnej Polski S. A. X-WP-SPAM: NO 0000000 [sXO0] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Dec 2015 00:33:06 -0000 Hello, I am trying to use virtualbox natnetwork on a FreeBSD host. Natnetwork configuration seems to complete ok, but actual natnetwork start fails with NS_ERROR_FAILURE (0x80004005), more details below. Is there a way to get it working? Thanks Irek. $ uname -rs FreeBSD 10.2-RELEASE-p7 $ VBoxManage --version 4.3.34_OSEr104062 $ VBoxManage list natnetworks NetworkName: czajnet IP: 10.0.22.1 Network: 10.0.22.0/24 IPv6 Enabled: No IPv6 Prefix: DHCP Enabled: Yes Enabled: Yes loopback mappings (ipv4) 127.0.0.1=2 $ VBoxManage natnetwork start --netname czajnet VBoxManage: error: Code NS_ERROR_FAILURE (0x80004005) - Operation failed (extended info not available) VBoxManage: error: Context: "Start(Bstr("whatever").raw())" at line 449 of file VBoxManageNATNetwork.cpp VBoxManage: error: Failed to start network From owner-freebsd-virtualization@freebsd.org Wed Dec 23 04:56:31 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 308A2A4FC01 for ; Wed, 23 Dec 2015 04:56:31 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: from mail-ig0-x235.google.com (mail-ig0-x235.google.com [IPv6:2607:f8b0:4001:c05::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EA30E15BB for ; Wed, 23 Dec 2015 04:56:30 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: by mail-ig0-x235.google.com with SMTP id ph11so74200100igc.1 for ; Tue, 22 Dec 2015 20:56:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ara-ler-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=fatjAAvG+DEO2SA6yceZDAUiWIhTFLP6s/vmygMCsAU=; b=r6z4teT6NbwzpsEbywnNCXmD1bjAvNuXN3M7HJQUuYXp4MihiCpEsXjTI5S4zponLe XZ60LyfcoGAcIgq3aa9vtaSdYjM7g+XkcMAO95x4kmmYlbqNvTG0ZaEJ+0a5FLSjqmtO oqfTtZB42IW91V8YRC3giP//T1FpUtQLTreWjryHFEY8oPrcVjioR/hkdArR7RhXDuIz cVS1s3gCuvit16YhqogXSfn3Pt3dFNkdSMioFsHOKlFaEnfbWaHKd7pDxW5ijgct/vSa 4h5f08ZHwCBEpgl+DwnIa2P+4kGsNui8j1WS/i/2hyI32ihJELsNv/c3oMBXpynMztGn QCQQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=fatjAAvG+DEO2SA6yceZDAUiWIhTFLP6s/vmygMCsAU=; b=lVzCQGyft0iwH/EIdqfVAnrH7dvAOWif7r5ppMtqrTCvQWB5B8v+sABC2N7lq79L6j w5BikV+cOBn7xuXR8DsbTX9vr+69kq4qw6jXJUOU/0frPmwCIMtLDMt4+dIOU+yAsuvy fzxFJtDARuMAUT8XBaAVRJ9FQNm0AdyMQK9THjQbaryRlxZYqPgnd5//uBH9/Nlxg+N3 1XsI9ZFGn5eNxLHJ/N+ZowxVOLAVKdrBQoPczyN0Ds+dcrD8a++3+IhloTGbis/YhJDo Sv+K2fS671P+AgDrQHIhTX0yIhYGosAFFBvb/LmGBaScHf2WkPmTTk8HST2HE1hWwqoW H5TA== X-Gm-Message-State: ALoCoQnLvhkVOK/qLFt8BDmZ3UtFOPzlyD2KpZ/rOicWzoHSiNG6zGvn5YNZnX5LjgNdHJ+yZ5WLXcfs1tsP/fP5CcwB4kWP+w== X-Received: by 10.50.66.179 with SMTP id g19mr11079256igt.94.1450846590232; Tue, 22 Dec 2015 20:56:30 -0800 (PST) Received: from dendrobates.araler.com (70-59-19-232.hlrn.qwest.net. [70.59.19.232]) by smtp.gmail.com with ESMTPSA id n128sm2036079ion.13.2015.12.22.20.56.29 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 22 Dec 2015 20:56:29 -0800 (PST) Date: Tue, 22 Dec 2015 21:56:27 -0700 From: Sergey Manucharian To: FreeBSD virtualization Subject: Re: bhyve PCI pass-through to Linux guest Message-ID: <20151223045627.GA1450@dendrobates.araler.com> References: <20151220045821.GG22018@dendrobates.araler.com> <56763672.3090207@freebsd.org> <20151220051015.GH22018@dendrobates.araler.com> <56763A0B.8010802@freebsd.org> <20151220053644.GI22018@dendrobates.araler.com> <20151220215240.GB4064@dendrobates.araler.com> <5678BECC.7090200@freebsd.org> <20151222034457.GA40078@dendrobates.araler.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Dec 2015 04:56:31 -0000 Excerpts from Anish's message from Mon 21-Dec-15 21:48: > >ppt0@pci0:0:20:0: class=0x0c0330 card=0x21f317aa chip=0x1e318086 > Passthrough stub driver, part of vmm, controls the USB controller. > > Can you share output of /usr/sbin/devinfo from FreeBSD host, highlighting > the usb mass/flash device in tree? > Before I start the guest VM the flash drive is not in the list. Right after shuting down the guest OS it appears: pcib1 pci1 sdhci_pci0 pcib2 pci2 iwn0 pcib3 pci3 ehci1 usbus1 uhub1 uhub3 umass0 As you can see it's under "ehci", it looks that my USB3 controller is fully USB2 backward compatible and work with "ehci" driver. I tried (as Trent suggested in this thread) to recompile the kernel without "xhci", and nothing changed, still behaves exactly the same way.. S. From owner-freebsd-virtualization@freebsd.org Wed Dec 23 05:07:31 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 12445A4FE9D for ; Wed, 23 Dec 2015 05:07:31 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: from mail-ig0-x235.google.com (mail-ig0-x235.google.com [IPv6:2607:f8b0:4001:c05::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C47861962 for ; Wed, 23 Dec 2015 05:07:30 +0000 (UTC) (envelope-from sm@ara-ler.com) Received: by mail-ig0-x235.google.com with SMTP id to4so73832351igc.0 for ; Tue, 22 Dec 2015 21:07:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ara-ler-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=k2WeZWlNkPbZzqwKWv1naub20XjJKvYdaDZNSUnobR4=; b=iaQ2lfP9CAusX05zPirWlGE4cq8tMa7FT1zAljEg9icc4IyqM58YkoTzArMHyYIvd5 7ztHYXBRt9sFWiCL9grV6fXRw9hsA2Z1h/gvpRZ7j6lRM/9W2d4TSNCjX1EAgFv2tWxx HUtcgK/jI8KT9HWuzOBhhGn4LNQojfFlcxKMDmh8cF+odQP5SSpOI8uyeWu2URbcwnve PgCZ512VKAD/a8kiCzKR/dxQUilMdSaDeX77k193pwam6cmwuHtg9IjyEMEGY/AMexkq aRFiStYWUYXUBIZlgjw1bQ4Bmn2ob9Rqu0t6bR4MR85wTgj9PMkS5AMbWjAkW04hN6cd ZKQg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=k2WeZWlNkPbZzqwKWv1naub20XjJKvYdaDZNSUnobR4=; b=kKiNDEp9miu13qmZlwRhtF3k6ZFIWfRLClO0di3HFg38MJc3kBAzUPmKZ/OVubb0oS plTJyA03pIxvpdJTijPAJleG6+tNhpWrCw+vGXlxotjkhxbo58RC61x+8wC8ZA45ENGn BXRO5qBUQv/Sw+n2Tu9V858BbjOMqUNnt2q2/FBBtlZifDRTCRdhqubQez+XipO5C7dk D2tl3N+LstKPn3PwHN8IrtvVfU8+hs9rIBQcCiLp65pe9Bq+uG1hIH9L17UL7GTuJ7YY TeCxuX11CzZAikukF6LgbOxkSvScRKInFOcEm+o+QrrKntcSCCJG18FD9F5KYJ/F1H1Y ckeg== X-Gm-Message-State: ALoCoQkVywjDq9i7A8/wtXJLOuKhvScZjZ9LwkwHusTGgCXfzEGfMrXsJDTgsNPKBq5mn4TNt0Q+MfUoHp40QTGWPvGG9YNZMw== X-Received: by 10.50.183.7 with SMTP id ei7mr148488igc.17.1450847250224; Tue, 22 Dec 2015 21:07:30 -0800 (PST) Received: from dendrobates.araler.com (70-59-19-232.hlrn.qwest.net. [70.59.19.232]) by smtp.gmail.com with ESMTPSA id b10sm11489525igx.19.2015.12.22.21.07.29 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 22 Dec 2015 21:07:29 -0800 (PST) Date: Tue, 22 Dec 2015 22:07:27 -0700 From: Sergey Manucharian To: FreeBSD virtualization Subject: Re: bhyve PCI pass-through to Linux guest Message-ID: <20151223050727.GB1450@dendrobates.araler.com> References: <20151220045821.GG22018@dendrobates.araler.com> <56763672.3090207@freebsd.org> <20151220051015.GH22018@dendrobates.araler.com> <56763A0B.8010802@freebsd.org> <20151220053644.GI22018@dendrobates.araler.com> <20151220215240.GB4064@dendrobates.araler.com> <5678BECC.7090200@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5678BECC.7090200@freebsd.org> User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Dec 2015 05:07:31 -0000 Excerpts from Peter Grehan's message from Tue 22-Dec-15 13:09: > > I pass trough a PCI device (USB controller) to a Linux guest. It works > > properly. Then I halt the VM, make sure that bhyve destroyed it and run > > Windows guest with the same PCI device passed-through. > > > > Windows device manager does show the device, however, e.g. a flash drive > > plugged in is not presented to Windows, instead it's being processed by > > FreeBSD. > > > > After that it does not work in Linux guest as well. Kernel module (vmm) > > unloading and reloading does not help. > > The flash drive being processed by FreeBSD would indicate that it has > ownership of the device. Would you be able to try a 'pciconf -vl' after > the Linux guest exists, and after the Windows guest exits ? First of all I found that I do not need to switch between guests. It is 100% reproducible with a single Linux VM. In freshly booted FreeBSD the USB ports (ones passed through) do not sense any device plugged in. When I boot Linux VM, it fully controls those ports, and I see the USB flash in Linux. As soon as I halt Linux, the flash drive appears in the host! Today I've checked out the latest sources and recompiled the whole system. Nothing has changed. Here is the corresponding output of pciconf iand devinfo after Linux exits: $ pciconf -vl .... ppt0@pci0:0:20:0: class=0x0c0330 card=0x21f317aa chip=0x1e318086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = '7 Series/C210 Series Chipset Family USB xHCI Host Controller' class = serial bus subclass = USB .... $ devinfo | grep -B15 mass .... pcib1 pci1 sdhci_pci0 pcib2 pci2 iwn0 pcib3 pci3 ehci1 usbus1 uhub1 uhub3 umass0 .... -- S. From owner-freebsd-virtualization@freebsd.org Wed Dec 23 05:48:43 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 28551A5093F for ; Wed, 23 Dec 2015 05:48:43 +0000 (UTC) (envelope-from torres.g.alex@gmail.com) Received: from mail-vk0-x229.google.com (mail-vk0-x229.google.com [IPv6:2607:f8b0:400c:c05::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D754A13CF for ; Wed, 23 Dec 2015 05:48:42 +0000 (UTC) (envelope-from torres.g.alex@gmail.com) Received: by mail-vk0-x229.google.com with SMTP id j66so128647692vkg.1 for ; Tue, 22 Dec 2015 21:48:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=xWBCnD140bxCteVLPwRs0qXsmtDPxUbA7PLJyhyJzyU=; b=Ij4hsQDQlwLWItqHNJbBGlE3JGoYJ1NL632tD6pixKc/44BXJd/APjfOQw0BHI1ejI H1gmiZ7xsJaNd0NzQA9ifibs8P9hbjC7uxQbXCICf1Y7qzkoeJceHqlIDAkljOxjX+dj iV4EQeeo9Ei6x3dnoOgBPxMOpQeVZUCJCGE5OeIwcOIWJbVU8P4wPXEnawl4gYxeGWXg VNyCwNQ2kbAAr8RA+qSgv62knSkYQ/CiZMlFdwfZ99zhZ5V2mX0Drg5Kqdoq5IAEbXL5 aqVA4YoUzU1AghZ0VKRcduOez4WI/NMbJMc26ZKloHMBFj9ySPhKuXxWAsCIt6W8JDep k/Wg== MIME-Version: 1.0 X-Received: by 10.31.179.80 with SMTP id c77mr16313553vkf.50.1450849721798; Tue, 22 Dec 2015 21:48:41 -0800 (PST) Received: by 10.31.174.72 with HTTP; Tue, 22 Dec 2015 21:48:41 -0800 (PST) Date: Wed, 23 Dec 2015 13:48:41 +0800 Message-ID: Subject: 10.2-RELEASE-p7 - bhyve crash ... From: Alex Torres To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Dec 2015 05:48:43 -0000 Hi all, I'm trying to install a Linux guest (debian and ubuntu) using bhyve. Upon installation on either of these guest installs bhyve crashes. OS: 10.2-RELEASE-p7 FreeBSD 10.2-RELEASE-p7 amd64 (GENERIC kernel) GUEST: ubuntu-14.10-server-amd64.iso GUEST: debian-8.2.0-amd64-CD-1.iso Hardware: IBM System x3550 M4 Server -[7914L2M] with the following VT-x extensions: VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID. Load + installation bootstrap: #grub-bhyve -r cd0 -m device.map -M 2048 ubuntu-14.10-server #bhyve -AI -H -P -s 0:0,hostbridge -s 1:0,lpc -s 2:0,virtio-net,tap0 -s 3:0,virtio-blk,./linux.img -s 4:0,ahci-cd,./ubuntu-14.10-server-amd64.iso -l com1,stdio -c 4 -m 2048M ubuntu-14.10-server The Crash Upon installation: Installing the system... =E2=94=9C=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=90 =E2=94=82 =E2=94=82 =E2=94=82 50% =E2=94=82 =E2=94=82 =E2=94=82 =E2=94=82 [ 158.064496] BUG: unable to handle kernel paging request at 0000000010000000 [ 158.065128] IP: [] __blk_bios_map_sg+0x1b1/0x3c0 =E2=94=82 [ 158.065668] PGD 7065b067 PUD 79126067 PMD 0 =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=98 [ 158.066071] Oops: 0000 [#1] SMP [ 158.066375] Modules linked in: squashfs xfs libcrc32c jfs btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq raid1 raid0 multipath linear ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper nls_utf8(E) isofs(E) usb_storage(E) ahci(E) libahci(E) [ 158.069152] CPU: 0 PID: 136 Comm: kworker/u8:5 Tainted: G E 3.16.0-23-generic #31-Ubuntu [ 158.069905] Hardware name: BHYVE, BIOS 1.00 03/14/2014 [ 158.070353] Workqueue: writeback bdi_writeback_workfn (flush-252:0) [ 158.070907] task: ffff88007ba532f0 ti: ffff88007a600000 task.ti: ffff88007a600000 [ 158.071532] RIP: 0010:[] [] __blk_bios_map_sg+0x1b1/0x3c0 [ 158.072265] RSP: 0018:ffff88007a603820 EFLAGS: 00010206 [ 158.072712] RAX: 0000000010000000 RBX: 0000000000004000 RCX: ffff88007a6038a8 [ 158.073306] RDX: 0000000010000001 RSI: 0000000073cb1000 RDI: ffff88007bb1ea20 [ 158.073902] RBP: ffff88007a603898 R08: 0000000000000000 R09: 0000160000000000 [ 158.074496] R10: 000000000000001d R11: 0000000073cb3000 R12: 0000000000000000 [ 158.075091] R13: 0000000000001000 R14: 000000000000001d R15: ffff88007a7ef420 [ 158.075688] FS: 0000000000000000(0000) GS:ffff88007fc00000(0000) knlGS:0000000000000000 [ 158.076360] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 158.076843] CR2: 0000000010000000 CR3: 000000007065a000 CR4: 00000000000406f0 [ 158.077439] Stack: [ 158.077617] ffff88007d001700 ffff88007bb1e5a0 ffff880000093e00 000000000000001d [ 158.078290] ffff88007a6038a8 0100000000000025 ffffea0001cf2c40 0000000000001000 [ 158.078962] ffffea0001cf2c80 0000000000001000 ffff88007bb1e400 ffff880000093e00 [ 158.079632] Call Trace: [ 158.079852] [] blk_rq_map_sg+0x35/0x170 [ 158.080316] [] virtio_queue_rq+0x9d/0x260 [ 158.080795] [] __blk_mq_run_hw_queue+0x1bf/0x320 [ 158.081321] [] blk_mq_run_hw_queue+0x65/0x80 [ 158.081821] [] blk_mq_insert_requests+0xcf/0x130 [ 158.082346] [] blk_mq_flush_plug_list+0x129/0x140 [ 158.082882] [] blk_flush_plug_list+0xd1/0x230 [ 158.083387] [] blk_finish_plug+0x14/0x50 [ 158.083859] [] ext4_writepages+0x3e9/0xcf0 [ 158.084343] [] ? global_dirtyable_memory+0x50/0x50 [ 158.084885] [] do_writepages+0x1e/0x30 [ 158.085341] [] __writeback_single_inode+0x40/0x210 [ 158.085883] [] ? wake_up_bit+0x25/0x30 [ 158.086338] [] writeback_sb_inodes+0x247/0x3b0 [ 158.086849] [] __writeback_inodes_wb+0x9f/0xd0 [ 158.087356] [] wb_writeback+0x223/0x2c0 [ 158.087820] [] bdi_writeback_workfn+0x1b9/0x430 [ 158.088337] [] process_one_work+0x182/0x4e0 [ 158.088829] [] worker_thread+0x6b/0x6a0 [ 158.089290] [] ? process_one_work+0x4e0/0x4e0 [ 158.089796] [] kthread+0xdb/0x100 [ 158.090215] [] ? kthread_create_on_node+0x1c0/0x1c0 [ 158.090764] [] ret_from_fork+0x7c/0xb0 [ 158.091218] [] ? kthread_create_on_node+0x1c0/0x1c0 [ 158.091765] Code: 39 f3 0f 84 4a 01 00 00 48 83 20 fd 4c 89 54 24 18 48 8b 39 48 89 4c 24 20 e8 5c a6 03 00 48 8b 4c 24 20 4c 8b 54 24 18 48 89 01 <48> 8b 30 48 8b 54 24 30 8b 7c 24 3c 83 e6 03 f6 c2 03 0f 85 07 [ 158.094199] RIP [] __blk_bios_map_sg+0x1b1/0x3c0 [ 158.094736] RSP [ 158.095035] CR2: 0000000010000000 [ 158.095320] ---[ end trace 86aa70b9ee9da8be ]--- [ 158.095900] BUG: unable to handle kernel paging request at ffffffffffffffd8 [ 158.096532] IP: [] kthread_data+0x10/0x20 [ 158.097041] PGD 1c16067 PUD 1c18067 PMD 0 [ 158.097447] Oops: 0000 [#2] SMP [ 158.097753] Modules linked in: squashfs xfs libcrc32c jfs btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq raid1 raid0 multipath linear ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper nls_utf8(E) isofs(E) usb_storage(E) ahci(E) libahci(E) [ 158.100528] CPU: 0 PID: 136 Comm: kworker/u8:5 Tainted: G D E 3.16.0-23-generic #31-Ubuntu [ 158.101278] Hardware name: BHYVE, BIOS 1.00 03/14/2014 [ 158.101730] task: ffff88007ba532f0 ti: ffff88007a600000 task.ti: ffff88007a600000 [ 158.102350] RIP: 0010:[] [] kthread_data+0x10/0x20 [ 158.103032] RSP: 0018:ffff88007a603470 EFLAGS: 00010002 [ 158.103483] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000001 [ 158.104076] RDX: 0000000000000009 RSI: 0000000000000000 RDI: ffff88007ba532f0 [ 158.104671] RBP: ffff88007a603470 R08: 0000000000000000 R09: 0000000000000001 [ 158.105267] R10: 00000000000055f8 R11: ffff88007a5a0548 R12: ffff88007fc14800 [ 158.105862] R13: ffff88007fc14800 R14: ffff88007ba532f0 R15: 0000000000000000 [ 158.106457] FS: 0000000000000000(0000) GS:ffff88007fc00000(0000) knlGS:0000000000000000 [ 158.107132] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 158.107616] CR2: 0000000000000028 CR3: 000000007065a000 CR4: 00000000000406f0 [ 158.108212] Stack: [ 158.108390] ffff88007a603488 ffffffff8108e761 0000000000000000 ffff88007a6034e8 [ 158.109064] ffffffff81782c9d ffff88007ba532f0 0000000000014800 ffff88007a603fd8 [ 158.109737] 0000000000014800 ffff88007ba532f0 ffff88007ba53a48 ffff88007ba532e0 [ 158.110410] Call Trace: [ 158.110624] [] wq_worker_sleeping+0x11/0x90 [ 158.111116] [] __schedule+0x6ed/0x890 [ 158.111578] [] schedule+0x29/0x70 [ 158.112001] [] do_exit+0x840/0xab0 [ 158.112430] [] oops_end+0xad/0x150 [ 158.112859] [] no_context+0x12c/0x310 [ 158.113308] [] ? __add_to_page_cache_locked+0x140/0x2b0 [ 158.113886] [] __bad_area_nosemaphore+0x7d/0x210 [ 158.114412] [] bad_area_nosemaphore+0x13/0x20 [ 158.114918] [] __do_page_fault+0xce/0x580 [ 158.115394] [] ? __find_get_block_slow+0xd0/0x170 [ 158.115930] [] ? ext4_mb_generate_buddy+0x28f/0x330 [ 158.116479] [] ? __bt_get+0x10f/0x1c0 [ 158.116926] [] do_page_fault+0x31/0x70 [ 158.117382] [] page_fault+0x28/0x30 [ 158.117816] [] ? __blk_bios_map_sg+0x1b1/0x3c0 [ 158.118329] [] blk_rq_map_sg+0x35/0x170 [ 158.118792] [] virtio_queue_rq+0x9d/0x260 [ 158.119268] [] __blk_mq_run_hw_queue+0x1bf/0x320 [ 158.119792] [] blk_mq_run_hw_queue+0x65/0x80 [ 158.120290] [] blk_mq_insert_requests+0xcf/0x130 [ 158.120818] [] blk_mq_flush_plug_list+0x129/0x140 [ 158.121351] [] blk_flush_plug_list+0xd1/0x230 [ 158.121857] [] blk_finish_plug+0x14/0x50 [ 158.122325] [] ext4_writepages+0x3e9/0xcf0 [ 158.122809] [] ? global_dirtyable_memory+0x50/0x50 [ 158.123349] [] do_writepages+0x1e/0x30 [ 158.123807] [] __writeback_single_inode+0x40/0x210 [ 158.124344] [] ? wake_up_bit+0x25/0x30 [ 158.124798] [] writeback_sb_inodes+0x247/0x3b0 [ 158.125311] [] __writeback_inodes_wb+0x9f/0xd0 [ 158.125823] [] wb_writeback+0x223/0x2c0 [ 158.126286] [] bdi_writeback_workfn+0x1b9/0x430 [ 158.126809] [] process_one_work+0x182/0x4e0 [ 158.127298] [] worker_thread+0x6b/0x6a0 [ 158.127762] [] ? process_one_work+0x4e0/0x4e0 [ 158.128266] [] kthread+0xdb/0x100 [ 158.128689] [] ? kthread_create_on_node+0x1c0/0x1c0 [ 158.129240] [] ret_from_fork+0x7c/0xb0 [ 158.129699] [] ? kthread_create_on_node+0x1c0/0x1c0 [ 158.130246] Code: 00 48 89 e5 5d 48 8b 40 c8 48 c1 e8 02 83 e0 01 c3 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 48 8b 87 c8 04 00 00 55 48 89 e5 <48> 8b 40 d8 5d c3 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 [ 158.132684] RIP [] kthread_data+0x10/0x20 [ 158.133174] RSP [ 158.133473] CR2: ffffffffffffffd8 [ 158.133758] ---[ end trace 86aa70b9ee9da8bf ]--- [ 158.134147] Fixing recursive fault but reboot is needed! Anyone seen this before ? Any solutions ? -Alex From owner-freebsd-virtualization@freebsd.org Wed Dec 23 09:47:07 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 97C1BA4999A for ; Wed, 23 Dec 2015 09:47:07 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from phabric-backend.rbsd.freebsd.org (unknown [IPv6:2607:fc50:2000:101::1bb:73]) by mx1.freebsd.org (Postfix) with ESMTP id 8398C1A4F for ; Wed, 23 Dec 2015 09:47:07 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by phabric-backend.rbsd.freebsd.org (Postfix, from userid 1346) id 7FDB210018; Wed, 23 Dec 2015 09:47:07 +0000 (UTC) Date: Wed, 23 Dec 2015 09:47:07 +0000 To: freebsd-virtualization@freebsd.org From: "robak (Bartek Rutkowski)" Reply-to: D1944+333+b09c6235d993877b@reviews.freebsd.org Subject: [Differential] [Commented On] D1944: PF and VIMAGE fixes Message-ID: <272e53495d193ca37d7377ed4d1a1c75@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: Thread-Topic: D1944: PF and VIMAGE fixes X-Herald-Rules: none X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk In-Reply-To: References: Thread-Index: NDc2NzM0MzY4OTdiYThiNTU1MjY2ZDZmMTJiIFZ6bZs= MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Dec 2015 09:47:07 -0000 robak added a comment. Any news on that review? REVISION DETAIL https://reviews.freebsd.org/D1944 EMAIL PREFERENCES https://reviews.freebsd.org/settings/panel/emailpreferences/ To: nvass-gmx.com, bz, trociny, kristof, gnn, zec, rodrigc, glebius, eri Cc: mmoll, javier_ovi_yahoo.com, farrokhi, julian, robak, freebsd-virtualization-list, freebsd-pf-list, freebsd-net-list From owner-freebsd-virtualization@freebsd.org Thu Dec 24 04:12:18 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6D158A5044A for ; Thu, 24 Dec 2015 04:12:18 +0000 (UTC) (envelope-from torres.g.alex@gmail.com) Received: from mail-vk0-x232.google.com (mail-vk0-x232.google.com [IPv6:2607:f8b0:400c:c05::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 25CA41A05 for ; Thu, 24 Dec 2015 04:12:18 +0000 (UTC) (envelope-from torres.g.alex@gmail.com) Received: by mail-vk0-x232.google.com with SMTP id j66so142821597vkg.1 for ; Wed, 23 Dec 2015 20:12:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=OdXM+9z6+r9zMT4Q1Ka78QrVFqDJZzc1WPCDRsm8yGo=; b=g1Edbg4sl86VX1bLzkCyD8TFi1qjkgMwmB0CyqGyFv8kWsRgGMRdrIdB+P0qwr3DGj 4phmzykZWEnE2MZeAHhDyWOlalmAXGravB1jSfhG1rU1jMe05J7rJPcLm27qmmVlVxMD 3Uqd8GtH5BL3ZOi9slAe/SDANkf++Pp67ZwJwC3/qWA/bUGZarI/lH8iusdJmW4iZ4s0 LMB5ElnmLuDIw7+73QC1yKemBmYriR+8V1ZpFeEzbZHf4PO2tNFOgPIAZWDya2dPLkue hkOPtCbBKMkHXn777fhCZKxdIkEwB5Hqns2MWcPOmzNFMYpgIE1Xh0rF1nb6yF5byPKE 1vfg== MIME-Version: 1.0 X-Received: by 10.31.47.197 with SMTP id v188mr21993417vkv.6.1450930337051; Wed, 23 Dec 2015 20:12:17 -0800 (PST) Received: by 10.31.149.197 with HTTP; Wed, 23 Dec 2015 20:12:17 -0800 (PST) In-Reply-To: References: Date: Thu, 24 Dec 2015 12:12:17 +0800 Message-ID: Subject: Re: 10.2-RELEASE-p7 - bhyve crash ... From: Alex Torres To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 24 Dec 2015 04:12:18 -0000 After further testing this does not happen on -CURRENT but DOES happen on -STABLE. -Alex On Wed, Dec 23, 2015 at 1:48 PM, Alex Torres wrote: > Hi all, > > I'm trying to install a Linux guest (debian and ubuntu) using bhyve. Upon > installation on either of these guest installs bhyve crashes. > > OS: 10.2-RELEASE-p7 FreeBSD 10.2-RELEASE-p7 amd64 (GENERIC kernel) > GUEST: ubuntu-14.10-server-amd64.iso > GUEST: debian-8.2.0-amd64-CD-1.iso > > Hardware: > > IBM System x3550 M4 Server -[7914L2M] with the following VT-x extensions: > VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID. > > Load + installation bootstrap: > > #grub-bhyve -r cd0 -m device.map -M 2048 ubuntu-14.10-server > #bhyve -AI -H -P -s 0:0,hostbridge -s 1:0,lpc -s 2:0,virtio-net,tap0 -s > 3:0,virtio-blk,./linux.img -s 4:0,ahci-cd,./ubuntu-14.10-server-amd64.iso > -l com1,stdio -c 4 -m 2048M ubuntu-14.10-server > > The Crash Upon installation: > > Installing the system... =E2=94=9C=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=90 > > =E2=94=82 = =E2=94=82 > =E2=94=82 > 50% =E2=94=82 > > =E2=94=82 = =E2=94=82 > =E2=94=82 [ 158.064496] BUG: unable to handle kernel paging request at > 0000000010000000 > [ 158.065128] IP: [] > __blk_bios_map_sg+0x1b1/0x3c0 =E2=94=82 > [ 158.065668] PGD 7065b067 PUD 79126067 PMD 0 > =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=98 > [ 158.066071] Oops: 0000 [#1] SMP > [ 158.066375] Modules linked in: squashfs xfs libcrc32c jfs btrfs raid10 > raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor > raid6_pq raid1 raid0 multipath linear ghash_clmulni_intel aesni_intel > aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper nls_utf8(E) isofs(= E) > usb_storage(E) ahci(E) libahci(E) > [ 158.069152] CPU: 0 PID: 136 Comm: kworker/u8:5 Tainted: G E > 3.16.0-23-generic #31-Ubuntu > [ 158.069905] Hardware name: BHYVE, BIOS 1.00 03/14/2014 > [ 158.070353] Workqueue: writeback bdi_writeback_workfn (flush-252:0) > [ 158.070907] task: ffff88007ba532f0 ti: ffff88007a600000 task.ti: > ffff88007a600000 > [ 158.071532] RIP: 0010:[] [] > __blk_bios_map_sg+0x1b1/0x3c0 > [ 158.072265] RSP: 0018:ffff88007a603820 EFLAGS: 00010206 > [ 158.072712] RAX: 0000000010000000 RBX: 0000000000004000 RCX: > ffff88007a6038a8 > [ 158.073306] RDX: 0000000010000001 RSI: 0000000073cb1000 RDI: > ffff88007bb1ea20 > [ 158.073902] RBP: ffff88007a603898 R08: 0000000000000000 R09: > 0000160000000000 > [ 158.074496] R10: 000000000000001d R11: 0000000073cb3000 R12: > 0000000000000000 > [ 158.075091] R13: 0000000000001000 R14: 000000000000001d R15: > ffff88007a7ef420 > [ 158.075688] FS: 0000000000000000(0000) GS:ffff88007fc00000(0000) > knlGS:0000000000000000 > [ 158.076360] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > [ 158.076843] CR2: 0000000010000000 CR3: 000000007065a000 CR4: > 00000000000406f0 > [ 158.077439] Stack: > [ 158.077617] ffff88007d001700 ffff88007bb1e5a0 ffff880000093e00 > 000000000000001d > [ 158.078290] ffff88007a6038a8 0100000000000025 ffffea0001cf2c40 > 0000000000001000 > [ 158.078962] ffffea0001cf2c80 0000000000001000 ffff88007bb1e400 > ffff880000093e00 > [ 158.079632] Call Trace: > [ 158.079852] [] blk_rq_map_sg+0x35/0x170 > [ 158.080316] [] virtio_queue_rq+0x9d/0x260 > [ 158.080795] [] __blk_mq_run_hw_queue+0x1bf/0x320 > [ 158.081321] [] blk_mq_run_hw_queue+0x65/0x80 > [ 158.081821] [] blk_mq_insert_requests+0xcf/0x130 > [ 158.082346] [] blk_mq_flush_plug_list+0x129/0x140 > [ 158.082882] [] blk_flush_plug_list+0xd1/0x230 > [ 158.083387] [] blk_finish_plug+0x14/0x50 > [ 158.083859] [] ext4_writepages+0x3e9/0xcf0 > [ 158.084343] [] ? global_dirtyable_memory+0x50/0x50 > [ 158.084885] [] do_writepages+0x1e/0x30 > [ 158.085341] [] __writeback_single_inode+0x40/0x210 > [ 158.085883] [] ? wake_up_bit+0x25/0x30 > [ 158.086338] [] writeback_sb_inodes+0x247/0x3b0 > [ 158.086849] [] __writeback_inodes_wb+0x9f/0xd0 > [ 158.087356] [] wb_writeback+0x223/0x2c0 > [ 158.087820] [] bdi_writeback_workfn+0x1b9/0x430 > [ 158.088337] [] process_one_work+0x182/0x4e0 > [ 158.088829] [] worker_thread+0x6b/0x6a0 > [ 158.089290] [] ? process_one_work+0x4e0/0x4e0 > [ 158.089796] [] kthread+0xdb/0x100 > [ 158.090215] [] ? kthread_create_on_node+0x1c0/0x1c0 > [ 158.090764] [] ret_from_fork+0x7c/0xb0 > [ 158.091218] [] ? kthread_create_on_node+0x1c0/0x1c0 > [ 158.091765] Code: 39 f3 0f 84 4a 01 00 00 48 83 20 fd 4c 89 54 24 18 4= 8 > 8b 39 48 89 4c 24 20 e8 5c a6 03 00 48 8b 4c 24 20 4c 8b 54 24 18 48 89 0= 1 > <48> 8b 30 48 8b 54 24 30 8b 7c 24 3c 83 e6 03 f6 c2 03 0f 85 07 > [ 158.094199] RIP [] __blk_bios_map_sg+0x1b1/0x3c0 > [ 158.094736] RSP > [ 158.095035] CR2: 0000000010000000 > [ 158.095320] ---[ end trace 86aa70b9ee9da8be ]--- > [ 158.095900] BUG: unable to handle kernel paging request at > ffffffffffffffd8 > [ 158.096532] IP: [] kthread_data+0x10/0x20 > [ 158.097041] PGD 1c16067 PUD 1c18067 PMD 0 > [ 158.097447] Oops: 0000 [#2] SMP > [ 158.097753] Modules linked in: squashfs xfs libcrc32c jfs btrfs raid10 > raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor > raid6_pq raid1 raid0 multipath linear ghash_clmulni_intel aesni_intel > aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper nls_utf8(E) isofs(= E) > usb_storage(E) ahci(E) libahci(E) > [ 158.100528] CPU: 0 PID: 136 Comm: kworker/u8:5 Tainted: G D E > 3.16.0-23-generic #31-Ubuntu > [ 158.101278] Hardware name: BHYVE, BIOS 1.00 03/14/2014 > [ 158.101730] task: ffff88007ba532f0 ti: ffff88007a600000 task.ti: > ffff88007a600000 > [ 158.102350] RIP: 0010:[] [] > kthread_data+0x10/0x20 > [ 158.103032] RSP: 0018:ffff88007a603470 EFLAGS: 00010002 > [ 158.103483] RAX: 0000000000000000 RBX: 0000000000000000 RCX: > 0000000000000001 > [ 158.104076] RDX: 0000000000000009 RSI: 0000000000000000 RDI: > ffff88007ba532f0 > [ 158.104671] RBP: ffff88007a603470 R08: 0000000000000000 R09: > 0000000000000001 > [ 158.105267] R10: 00000000000055f8 R11: ffff88007a5a0548 R12: > ffff88007fc14800 > [ 158.105862] R13: ffff88007fc14800 R14: ffff88007ba532f0 R15: > 0000000000000000 > [ 158.106457] FS: 0000000000000000(0000) GS:ffff88007fc00000(0000) > knlGS:0000000000000000 > [ 158.107132] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > [ 158.107616] CR2: 0000000000000028 CR3: 000000007065a000 CR4: > 00000000000406f0 > [ 158.108212] Stack: > [ 158.108390] ffff88007a603488 ffffffff8108e761 0000000000000000 > ffff88007a6034e8 > [ 158.109064] ffffffff81782c9d ffff88007ba532f0 0000000000014800 > ffff88007a603fd8 > [ 158.109737] 0000000000014800 ffff88007ba532f0 ffff88007ba53a48 > ffff88007ba532e0 > [ 158.110410] Call Trace: > [ 158.110624] [] wq_worker_sleeping+0x11/0x90 > [ 158.111116] [] __schedule+0x6ed/0x890 > [ 158.111578] [] schedule+0x29/0x70 > [ 158.112001] [] do_exit+0x840/0xab0 > [ 158.112430] [] oops_end+0xad/0x150 > [ 158.112859] [] no_context+0x12c/0x310 > [ 158.113308] [] ? > __add_to_page_cache_locked+0x140/0x2b0 > [ 158.113886] [] __bad_area_nosemaphore+0x7d/0x210 > [ 158.114412] [] bad_area_nosemaphore+0x13/0x20 > [ 158.114918] [] __do_page_fault+0xce/0x580 > [ 158.115394] [] ? __find_get_block_slow+0xd0/0x170 > [ 158.115930] [] ? ext4_mb_generate_buddy+0x28f/0x330 > [ 158.116479] [] ? __bt_get+0x10f/0x1c0 > [ 158.116926] [] do_page_fault+0x31/0x70 > [ 158.117382] [] page_fault+0x28/0x30 > [ 158.117816] [] ? __blk_bios_map_sg+0x1b1/0x3c0 > [ 158.118329] [] blk_rq_map_sg+0x35/0x170 > [ 158.118792] [] virtio_queue_rq+0x9d/0x260 > [ 158.119268] [] __blk_mq_run_hw_queue+0x1bf/0x320 > [ 158.119792] [] blk_mq_run_hw_queue+0x65/0x80 > [ 158.120290] [] blk_mq_insert_requests+0xcf/0x130 > [ 158.120818] [] blk_mq_flush_plug_list+0x129/0x140 > [ 158.121351] [] blk_flush_plug_list+0xd1/0x230 > [ 158.121857] [] blk_finish_plug+0x14/0x50 > [ 158.122325] [] ext4_writepages+0x3e9/0xcf0 > [ 158.122809] [] ? global_dirtyable_memory+0x50/0x50 > [ 158.123349] [] do_writepages+0x1e/0x30 > [ 158.123807] [] __writeback_single_inode+0x40/0x210 > [ 158.124344] [] ? wake_up_bit+0x25/0x30 > [ 158.124798] [] writeback_sb_inodes+0x247/0x3b0 > [ 158.125311] [] __writeback_inodes_wb+0x9f/0xd0 > [ 158.125823] [] wb_writeback+0x223/0x2c0 > [ 158.126286] [] bdi_writeback_workfn+0x1b9/0x430 > [ 158.126809] [] process_one_work+0x182/0x4e0 > [ 158.127298] [] worker_thread+0x6b/0x6a0 > [ 158.127762] [] ? process_one_work+0x4e0/0x4e0 > [ 158.128266] [] kthread+0xdb/0x100 > [ 158.128689] [] ? kthread_create_on_node+0x1c0/0x1c0 > [ 158.129240] [] ret_from_fork+0x7c/0xb0 > [ 158.129699] [] ? kthread_create_on_node+0x1c0/0x1c0 > [ 158.130246] Code: 00 48 89 e5 5d 48 8b 40 c8 48 c1 e8 02 83 e0 01 c3 6= 6 > 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 48 8b 87 c8 04 00 00 55 48 89 e= 5 > <48> 8b 40 d8 5d c3 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 > [ 158.132684] RIP [] kthread_data+0x10/0x20 > [ 158.133174] RSP > [ 158.133473] CR2: ffffffffffffffd8 > [ 158.133758] ---[ end trace 86aa70b9ee9da8bf ]--- > [ 158.134147] Fixing recursive fault but reboot is needed! > > > Anyone seen this before ? Any solutions ? > > -Alex > From owner-freebsd-virtualization@freebsd.org Thu Dec 24 05:49:07 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 14D3CA4F143 for ; Thu, 24 Dec 2015 05:49:07 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: from mail-wm0-x233.google.com (mail-wm0-x233.google.com [IPv6:2a00:1450:400c:c09::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AAB2919E3 for ; Thu, 24 Dec 2015 05:49:06 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: by mail-wm0-x233.google.com with SMTP id p187so169271732wmp.1 for ; Wed, 23 Dec 2015 21:49:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=4vtmAYBtC8GCzceXrSFx57lv9TmwJ8M0Nd9aVCHbLS8=; b=wjKkx/49EqLS6RnVlidnHJVVi7YwFFZ24qIDn5obsV7NTuCXJhjPOpkcRXE5mTH+mh mD9Gqh1OzTNkzRLWVxYm0kHln/27FVoKIKx40qAoFgsusVRl9tYPNu6/hf2GGl3JcwkA eI/NV3frxuSDOatzBVXO5mwpHEjLFzchE+BZAv+k9HhL8dH+NdWI6W/35FKVwJcaDPC+ M4Ymalv2iBySObkVr8PI7RE7aBfJk56cyYs/u1Y0Y6qPKpJxwNbpk+rFbjtWt3SRINJO 2rvo9Mo1qpD0OpAoaAh7m/3DUWdcUusOHrn9N+AEtUSM8XIExvMQiwch3uFgxrIL8+4X I+gQ== MIME-Version: 1.0 X-Received: by 10.28.135.1 with SMTP id j1mr35799461wmd.11.1450936144178; Wed, 23 Dec 2015 21:49:04 -0800 (PST) Received: by 10.194.192.33 with HTTP; Wed, 23 Dec 2015 21:49:04 -0800 (PST) Date: Wed, 23 Dec 2015 23:49:04 -0600 Message-ID: Subject: Bhyve guest ntp server woes From: Adam Vande More To: FreeBSD virtualization Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 24 Dec 2015 05:49:07 -0000 I am unable to get a 10.2 bhyve ntp server to be stable. Most configurations of kern.timecounter.* sysctl kern.eventtimer.* in the guest seem to make little difference, however kern.eventtimer.periodic=1 does seem to stabilize it a little. However after some runtime, I get very high jitter and offsets and extraordinary dispersion and distance values when seen from the host using guest as server(not actually sync'd against). How can I get some sane ntp in bhyve? Thanks, -- Adam From owner-freebsd-virtualization@freebsd.org Thu Dec 24 08:16:17 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 47A67A5106A for ; Thu, 24 Dec 2015 08:16:17 +0000 (UTC) (envelope-from wanpengqian@gmail.com) Received: from mail-vk0-x22f.google.com (mail-vk0-x22f.google.com [IPv6:2607:f8b0:400c:c05::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0787115CF for ; Thu, 24 Dec 2015 08:16:17 +0000 (UTC) (envelope-from wanpengqian@gmail.com) Received: by mail-vk0-x22f.google.com with SMTP id a188so146212665vkc.0 for ; Thu, 24 Dec 2015 00:16:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=T2rCFo7Rq330WDH8yV4EKCRX9oRd1AYjywekxpVs2y4=; b=wHg8tKa5SpAAv8bhf1HtEzoYPpZ3rkCWcvft84KKAYXBYgDdDeTfd02U4tpzf+qNXe a8plgVmuAQLVMzDj6HSzLCsmTZMBd7vcmeXZkHmXb9udvDvuCyGC40+sSNmUC84zVc0H zZdK0eDajqKJC/EgsZH52OZH44+VUgTZdm36QSkE7Dd77GPI7Ps1UdB3MPqMgFcSBqlW UHzKtd910pP8I0PfWWWyhQkoB6p/BHmHKXnh8abMtwWx0WYJYf7LbwFesOm6QpwWCZfI 63DAX7BgeCJVtC5/33aGQR/E7MV4l/As09wp++3mxtGa7pn9fZG6YvdQclTAGum0Xu4O B/6Q== MIME-Version: 1.0 X-Received: by 10.31.54.149 with SMTP id d143mr22561022vka.111.1450944975839; Thu, 24 Dec 2015 00:16:15 -0800 (PST) Received: by 10.31.87.1 with HTTP; Thu, 24 Dec 2015 00:16:15 -0800 (PST) Date: Thu, 24 Dec 2015 17:16:15 +0900 Message-ID: Subject: Performance of virtio net in bhyve, Linux vs Windows 2012 From: Qian Wanpeng To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 24 Dec 2015 08:16:17 -0000 I found the network performance between Linux guest and windows guest are different. Both two guest(Debian 8.0 and Windows 2012) are bridge to same bridge interface. and assign an IP to that bridge interface. In FreeBSD host, start a iperf server, both guests as iperf client. I did not tunning any parameter yet. Here is the result. Linux virtio driver is builtin Debian 8.0. and Windows virtio driver is from Redhat. 62.71.104.9600 1. TCP From Linux guest. root@vm01:~# iperf -c 10.51.197.40 -i 1 ------------------------------------------------------------ Client connecting to 10.51.197.40, TCP port 5001 TCP window size: 85.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.51.197.41 port 49823 connected with 10.51.197.40 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0- 1.0 sec 182 MBytes 1.53 Gbits/sec [ 3] 1.0- 2.0 sec 195 MBytes 1.63 Gbits/sec [ 3] 2.0- 3.0 sec 190 MBytes 1.60 Gbits/sec [ 3] 3.0- 4.0 sec 200 MBytes 1.68 Gbits/sec [ 3] 4.0- 5.0 sec 233 MBytes 1.96 Gbits/sec [ 3] 5.0- 6.0 sec 198 MBytes 1.67 Gbits/sec [ 3] 6.0- 7.0 sec 223 MBytes 1.87 Gbits/sec [ 3] 7.0- 8.0 sec 208 MBytes 1.74 Gbits/sec [ 3] 8.0- 9.0 sec 219 MBytes 1.84 Gbits/sec [ 3] 9.0-10.0 sec 176 MBytes 1.48 Gbits/sec [ 3] 0.0-10.0 sec 1.98 GBytes 1.70 Gbits/sec the result is reasonble. 2. TCP From Windows guest. C:\Apps\iperf_1.70>iperf -c 10.51.197.40 -i 1 ------------------------------------------------------------ Client connecting to 10.51.197.40, TCP port 5001 TCP window size: 64.0 KByte (default) ------------------------------------------------------------ [196] local 10.51.197.42 port 63676 connected with 10.51.197.40 port 5001 [ ID] Interval Transfer Bandwidth [196] 0.0- 1.0 sec 45.4 MBytes 381 Mbits/sec [196] 1.0- 2.0 sec 44.9 MBytes 377 Mbits/sec [196] 2.0- 3.0 sec 45.0 MBytes 378 Mbits/sec [196] 3.0- 4.0 sec 46.5 MBytes 390 Mbits/sec [196] 4.0- 5.0 sec 49.9 MBytes 419 Mbits/sec [196] 5.0- 6.0 sec 48.2 MBytes 405 Mbits/sec [196] 6.0- 7.0 sec 46.4 MBytes 389 Mbits/sec [196] 7.0- 8.0 sec 48.5 MBytes 407 Mbits/sec [196] 8.0- 9.0 sec 47.5 MBytes 399 Mbits/sec [196] 9.0-10.0 sec 47.4 MBytes 398 Mbits/sec [196] 0.0-10.0 sec 470 MBytes 394 Mbits/sec Compare to TCP, UDP even worst. 3. UDP From Linux guest root@vm01:~# iperf -c 10.51.197.40 -u -i 1 -b 2000M ------------------------------------------------------------ Client connecting to 10.51.197.40, UDP port 5001 Sending 1470 byte datagrams UDP buffer size: 208 KByte (default) ------------------------------------------------------------ [ 3] local 10.51.197.41 port 37731 connected with 10.51.197.40 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0- 1.0 sec 92.4 MBytes 775 Mbits/sec [ 3] 1.0- 2.0 sec 93.0 MBytes 780 Mbits/sec [ 3] 2.0- 3.0 sec 92.2 MBytes 773 Mbits/sec [ 3] 3.0- 4.0 sec 92.0 MBytes 772 Mbits/sec [ 3] 4.0- 5.0 sec 91.3 MBytes 766 Mbits/sec [ 3] 5.0- 6.0 sec 91.7 MBytes 769 Mbits/sec [ 3] 6.0- 7.0 sec 92.0 MBytes 772 Mbits/sec [ 3] 7.0- 8.0 sec 92.7 MBytes 778 Mbits/sec [ 3] 8.0- 9.0 sec 92.6 MBytes 777 Mbits/sec [ 3] 0.0-10.0 sec 922 MBytes 773 Mbits/sec [ 3] Sent 657375 datagrams [ 3] Server Report: [ 3] 0.0-10.0 sec 914 MBytes 767 Mbits/sec 0.002 ms 5500/657374 (0.84%) [ 3] 0.0-10.0 sec 1 datagrams received out-of-order 4. UDP From Windows guest. C:\Apps\iperf_1.70>iperf -c 10.51.197.40 -u -i 1 -b 2000M ------------------------------------------------------------ Client connecting to 10.51.197.40, UDP port 5001 Sending 1470 byte datagrams UDP buffer size: 64.0 KByte (default) ------------------------------------------------------------ [196] local 10.51.197.42 port 62673 connected with 10.51.197.40 port 5001 [ ID] Interval Transfer Bandwidth [196] 0.0- 1.0 sec 20.8 MBytes 174 Mbits/sec [196] 1.0- 2.0 sec 19.4 MBytes 163 Mbits/sec [196] 2.0- 3.0 sec 19.3 MBytes 162 Mbits/sec [196] 3.0- 4.0 sec 21.2 MBytes 178 Mbits/sec [196] 4.0- 5.0 sec 20.1 MBytes 168 Mbits/sec [196] 5.0- 6.0 sec 21.1 MBytes 177 Mbits/sec [196] 6.0- 7.0 sec 21.9 MBytes 183 Mbits/sec [196] 7.0- 8.0 sec 18.9 MBytes 158 Mbits/sec [196] 8.0- 9.0 sec 18.6 MBytes 156 Mbits/sec [196] 9.0-10.0 sec 22.0 MBytes 184 Mbits/sec [196] 0.0-10.0 sec 203 MBytes 170 Mbits/sec [196] Server Report: [196] 0.0-10.0 sec 203 MBytes 170 Mbits/sec 1.055 ms 0/144929 (0%) [196] Sent 144929 datagrams Any idea why so different? Am I missing anything? Best Regards. From owner-freebsd-virtualization@freebsd.org Fri Dec 25 13:46:21 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BF752A5055A for ; Fri, 25 Dec 2015 13:46:21 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from phabric-backend.rbsd.freebsd.org (unknown [IPv6:2607:fc50:2000:101::1bb:73]) by mx1.freebsd.org (Postfix) with ESMTP id A64E41965 for ; Fri, 25 Dec 2015 13:46:21 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by phabric-backend.rbsd.freebsd.org (Postfix, from userid 1346) id A2412331E73D; Fri, 25 Dec 2015 13:46:21 +0000 (UTC) Date: Fri, 25 Dec 2015 13:46:21 +0000 To: freebsd-virtualization@freebsd.org From: "robak (Bartek Rutkowski)" Reply-to: D1944+333+b09c6235d993877b@reviews.freebsd.org Subject: [Differential] [Commented On] D1944: PF and VIMAGE fixes Message-ID: <51f814917ebec1844d5b62e3c0a9d0b8@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: Thread-Topic: D1944: PF and VIMAGE fixes X-Herald-Rules: none X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk In-Reply-To: References: Thread-Index: NDc2NzM0MzY4OTdiYThiNTU1MjY2ZDZmMTJiIFZ9SK0= MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 25 Dec 2015 13:46:21 -0000 robak added a comment. @bz: you've made some commits to VIMAGE code in past few days, how do they relate to this revision? Any chance you could review it and comment/commit on this? REVISION DETAIL https://reviews.freebsd.org/D1944 EMAIL PREFERENCES https://reviews.freebsd.org/settings/panel/emailpreferences/ To: nvass-gmx.com, bz, trociny, kristof, gnn, zec, rodrigc, glebius, eri Cc: mmoll, javier_ovi_yahoo.com, farrokhi, julian, robak, freebsd-virtualization-list, freebsd-pf-list, freebsd-net-list From owner-freebsd-virtualization@freebsd.org Fri Dec 25 23:57:25 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9A182A52213 for ; Fri, 25 Dec 2015 23:57:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8B7E2117D for ; Fri, 25 Dec 2015 23:57:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id tBPNvPu8078645 for ; Fri, 25 Dec 2015 23:57:25 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 205549] bhyve pci passthru stops working after guest is restarted Date: Fri, 25 Dec 2015 23:57:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 25 Dec 2015 23:57:25 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=205549 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-virtualization@Free | |BSD.org -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-virtualization@freebsd.org Fri Dec 25 23:57:43 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 28F77A5224E for ; Fri, 25 Dec 2015 23:57:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1A489125A for ; Fri, 25 Dec 2015 23:57:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id tBPNvg4I079134 for ; Fri, 25 Dec 2015 23:57:42 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 205445] [bhyve] PCI passthru pci_intr_map: bad interrupt line 20, OpenBSD guest couldn't map interrupt Date: Fri, 25 Dec 2015 23:57:43 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 25 Dec 2015 23:57:43 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=205445 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|emulation@FreeBSD.org |freebsd-virtualization@Free | |BSD.org --- Comment #2 from Mark Linimon --- Correct assignment. -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-virtualization@freebsd.org Sat Dec 26 01:44:18 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 95AFAA52203 for ; Sat, 26 Dec 2015 01:44:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 868FE1847 for ; Sat, 26 Dec 2015 01:44:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id tBQ1iIju005680 for ; Sat, 26 Dec 2015 01:44:18 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 205445] [bhyve] PCI passthru pci_intr_map: bad interrupt line 20, OpenBSD guest couldn't map interrupt Date: Sat, 26 Dec 2015 01:44:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: grehan@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 26 Dec 2015 01:44:18 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=205445 Peter Grehan changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |grehan@FreeBSD.org --- Comment #3 from Peter Grehan --- PCI passthru with bhyve is restricted to devices that support MSI or MSI-X, which is generally PCI-e devices. Unfortunately the fxp adapter is parallel PCI and only supports legacy interrupts. I'll modify the bhyve wiki page to clarify this restriction. -- You are receiving this mail because: You are the assignee for the bug.