From owner-freebsd-virtualization@FreeBSD.ORG Sun May 26 05:12:23 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id BCAAE144 for ; Sun, 26 May 2013 05:12:23 +0000 (UTC) (envelope-from scrappy@hub.org) Received: from hub.org (hub.org [200.46.208.146]) by mx1.freebsd.org (Postfix) with ESMTP id 7EB019EA for ; Sun, 26 May 2013 05:12:23 +0000 (UTC) Received: from maia.hub.org (unknown [200.46.151.188]) by hub.org (Postfix) with ESMTP id B63EEE29073 for ; Sun, 26 May 2013 02:03:38 -0300 (ADT) Received: from hub.org ([200.46.208.146]) by maia.hub.org (mx1.hub.org [200.46.151.188]) (amavisd-maia, port 10024) with ESMTP id 64657-04 for ; Sun, 26 May 2013 05:03:38 +0000 (UTC) Received: from [192.168.0.52] (S01067cb21b2ff4ca.gv.shawcable.net [24.108.26.71]) by hub.org (Postfix) with ESMTPA id B699BE29072 for ; Sun, 26 May 2013 02:03:37 -0300 (ADT) From: Marc Fournier Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Subject: Virtualbox: time sync Message-Id: <5414678B-A9BD-4882-A79B-CBA296D73CBF@hub.org> Date: Sat, 25 May 2013 22:03:34 -0700 To: freebsd-virtualization@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 6.3 \(1503\)) X-Mailer: Apple Mail (2.1503) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 May 2013 05:12:23 -0000 First, thank you for the answer about switching from straight bridge to = using a tap device =85 that made a *huge* difference =85 I'm not able to = actually run a build world within the environment without having the = whole machine lock up =85 So, went next step =85 now that I can successfully build, I added the = Guest Additions =85 from what I've read, its what is required in order = to get time sync to work between host and guest =85 but doesn't quite = seem to do it: # ssh ams "(uptime; date)" ; date 1:55AM up 1 day, 20:30, 0 users, load averages: 0.05, 0.07, 0.08 Sun May 26 01:55:16 ADT 2013 Sun May 26 04:57:57 UTC 2013 kldstat shows the vboxguest.ko module has been loaded =85 I have ntpd = disabled, so I don't believe I'm *supposed* to need it, correct? =20 Are there known issues with this, or have I missed a setting somewhere? = Or should I actually need ntpd to be running even with the Guest = additions? Thanks =85 From owner-freebsd-virtualization@FreeBSD.ORG Sun May 26 09:54:16 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 88E1F543 for ; Sun, 26 May 2013 09:54:16 +0000 (UTC) (envelope-from m.tsatsenko@gmail.com) Received: from mail-ve0-x235.google.com (mail-ve0-x235.google.com [IPv6:2607:f8b0:400c:c01::235]) by mx1.freebsd.org (Postfix) with ESMTP id 504D6E9 for ; Sun, 26 May 2013 09:54:16 +0000 (UTC) Received: by mail-ve0-f181.google.com with SMTP id db10so2600579veb.26 for ; Sun, 26 May 2013 02:54:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=uSqUWtinaL2bGBuHhs0xiVNLDnqsNHcqB+cCzfiYxUY=; b=ipSTXGvL+yp+9Z0JW+KYLJLkbmjkp2ctDLBTp8brTEM51b3VCGoPReoF+B9SwNT8Za w69VkRv2JHwx3FXmdZrrO0qQEPbwESLqRbEnmfvL2/FKqja4Entp2jfevYWPf7JtZHVE BmP1t9G2gCYf2dSrTVMSC3L9xUtFTXtBjaITB/87ZbIDn7MuFfZszIXhqbpSr/zPjB2c rLaxAYySu9q2w9Tj0npn6hDMX0Yjrx09htyWNk/Eqk8V1bJ03VWinp4Ug9zJywqZ7J0Z PY3KKoRWddHY2a/7R8ezG/t7TOE+FDkSBpNEfQH2QcAAQvekQb02GJ4Ok3qqP3TJTPy7 TDLQ== MIME-Version: 1.0 X-Received: by 10.52.172.73 with SMTP id ba9mr11225628vdc.16.1369562054816; Sun, 26 May 2013 02:54:14 -0700 (PDT) Received: by 10.58.189.230 with HTTP; Sun, 26 May 2013 02:54:14 -0700 (PDT) In-Reply-To: <5414678B-A9BD-4882-A79B-CBA296D73CBF@hub.org> References: <5414678B-A9BD-4882-A79B-CBA296D73CBF@hub.org> Date: Sun, 26 May 2013 13:54:14 +0400 Message-ID: Subject: Re: Virtualbox: time sync From: Mikhail Tsatsenko To: Marc Fournier Content-Type: text/plain; charset=KOI8-R Content-Transfer-Encoding: quoted-printable Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 May 2013 09:54:16 -0000 2013/5/26 Marc Fournier : Hi > > First, thank you for the answer about switching from straight bridge to u= sing a tap device ... that made a *huge* difference ... I'm not able to act= ually run a build world within the environment without having the whole mac= hine lock up ... > > So, went next step ... now that I can successfully build, I added the Gue= st Additions ... from what I've read, its what is required in order to get = time sync to work between host and guest ... but doesn't quite seem to do i= t: > > # ssh ams "(uptime; date)" ; date > 1:55AM up 1 day, 20:30, 0 users, load averages: 0.05, 0.07, 0.08 > Sun May 26 01:55:16 ADT 2013 > Sun May 26 04:57:57 UTC 2013 > > kldstat shows the vboxguest.ko module has been loaded ... I have ntpd dis= abled, so I don't believe I'm *supposed* to need it, correct? try setting sysctl kern.eventtimer.idletick=3D1 It should resolve the issue > Are there known issues with this, or have I missed a setting somewhere? = Or should I actually need ntpd to be running even with the Guest additions= ? > > Thanks ... > > > > > > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@free= bsd.org" -- =ED=C9=C8=C1=C9=CC From owner-freebsd-virtualization@FreeBSD.ORG Sun May 26 16:25:17 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id A52DC242 for ; Sun, 26 May 2013 16:25:17 +0000 (UTC) (envelope-from scrappy@hub.org) Received: from hub.org (hub.org [200.46.208.146]) by mx1.freebsd.org (Postfix) with ESMTP id 6FBB01B5 for ; Sun, 26 May 2013 16:25:17 +0000 (UTC) Received: from maia.hub.org (unknown [200.46.151.188]) by hub.org (Postfix) with ESMTP id ECFA5ABDA44; Sun, 26 May 2013 13:25:15 -0300 (ADT) Received: from hub.org ([200.46.208.146]) by maia.hub.org (mx1.hub.org [200.46.151.188]) (amavisd-maia, port 10024) with ESMTP id 84834-07; Sun, 26 May 2013 16:25:15 +0000 (UTC) Received: from [192.168.0.52] (S01067cb21b2ff4ca.gv.shawcable.net [24.108.26.71]) by hub.org (Postfix) with ESMTPA id 41EE6ABDA43; Sun, 26 May 2013 13:25:15 -0300 (ADT) Content-Type: text/plain; charset=windows-1251 Mime-Version: 1.0 (Mac OS X Mail 6.3 \(1503\)) Subject: Re: Virtualbox: time sync From: Marc Fournier In-Reply-To: Date: Sun, 26 May 2013 09:25:13 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: <2DF2B359-97D5-49DA-97C6-A2F6C7E61CF2@hub.org> References: <5414678B-A9BD-4882-A79B-CBA296D73CBF@hub.org> To: Mikhail Tsatsenko X-Mailer: Apple Mail (2.1503) Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 May 2013 16:25:17 -0000 On 2013-05-26, at 2:54 AM, Mikhail Tsatsenko = wrote: > 2013/5/26 Marc Fournier : > Hi >>=20 >> First, thank you for the answer about switching from straight bridge = to using a tap device ... that made a *huge* difference ... I'm not able = to actually run a build world within the environment without having the = whole machine lock up ... >>=20 >> So, went next step ... now that I can successfully build, I added the = Guest Additions ... from what I've read, its what is required in order = to get time sync to work between host and guest ... but doesn't quite = seem to do it: >>=20 >> # ssh ams "(uptime; date)" ; date >> 1:55AM up 1 day, 20:30, 0 users, load averages: 0.05, 0.07, 0.08 >> Sun May 26 01:55:16 ADT 2013 >> Sun May 26 04:57:57 UTC 2013 >>=20 >> kldstat shows the vboxguest.ko module has been loaded ... I have ntpd = disabled, so I don't believe I'm *supposed* to need it, correct? > try setting sysctl kern.eventtimer.idletick=3D1 > It should resolve the issue Just to confirm =85is this within the Guest, or on the Host itself? Thx From owner-freebsd-virtualization@FreeBSD.ORG Mon May 27 08:12:32 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 9DA1262A for ; Mon, 27 May 2013 08:12:32 +0000 (UTC) (envelope-from m.tsatsenko@gmail.com) Received: from mail-vc0-f181.google.com (mail-vc0-f181.google.com [209.85.220.181]) by mx1.freebsd.org (Postfix) with ESMTP id 63780B16 for ; Mon, 27 May 2013 08:12:32 +0000 (UTC) Received: by mail-vc0-f181.google.com with SMTP id lf11so4459237vcb.26 for ; Mon, 27 May 2013 01:12:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=ySJHwgnxT4kZ8xpwl+XHC27h3E0Uw8XsIvEvzpY190A=; b=sjdbwpWzesBzDjpbYX2hAYT9nqPc2Rvr6xILtXlApj9q6t3D4GEhLN7Mqr4rviDs6w 9fuxhbVPWkxwA8VgjmFTKXvmWEU2pQ80kLuOv1qzNqRJWTlo7DXingvU9DLwEyNH6TF0 bnLTZidTMgsDRazmJFPeup0fNy4ostg9WA0t3mcOWjYgH6JFfkEQzZBLc8oHzXLDoNSt LFacqDj/2DJv5kaYCzKNZl0f2qKaWO8b0YJnUcB013m1ATZU7yStsqkNjRWhld5XGi6A eu3cgqlk08jry/vDu4PtW6kMsnuZ1YI75TVujiN7bcZ4LpzElYjZFUPGAAkzIGs3Oadm Hw9g== MIME-Version: 1.0 X-Received: by 10.58.65.101 with SMTP id w5mr14646166ves.16.1369642350691; Mon, 27 May 2013 01:12:30 -0700 (PDT) Received: by 10.58.189.230 with HTTP; Mon, 27 May 2013 01:12:30 -0700 (PDT) In-Reply-To: <2DF2B359-97D5-49DA-97C6-A2F6C7E61CF2@hub.org> References: <5414678B-A9BD-4882-A79B-CBA296D73CBF@hub.org> <2DF2B359-97D5-49DA-97C6-A2F6C7E61CF2@hub.org> Date: Mon, 27 May 2013 12:12:30 +0400 Message-ID: Subject: Re: Virtualbox: time sync From: Mikhail Tsatsenko To: Marc Fournier Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 May 2013 08:12:32 -0000 2013/5/26 Marc Fournier : > > On 2013-05-26, at 2:54 AM, Mikhail Tsatsenko wrot= e: > >> 2013/5/26 Marc Fournier : >> Hi >>> >>> First, thank you for the answer about switching from straight bridge to= using a tap device ... that made a *huge* difference ... I'm not able to a= ctually run a build world within the environment without having the whole m= achine lock up ... >>> >>> So, went next step ... now that I can successfully build, I added the G= uest Additions ... from what I've read, its what is required in order to ge= t time sync to work between host and guest ... but doesn't quite seem to do= it: >>> >>> # ssh ams "(uptime; date)" ; date >>> 1:55AM up 1 day, 20:30, 0 users, load averages: 0.05, 0.07, 0.08 >>> Sun May 26 01:55:16 ADT 2013 >>> Sun May 26 04:57:57 UTC 2013 >>> >>> kldstat shows the vboxguest.ko module has been loaded ... I have ntpd d= isabled, so I don't believe I'm *supposed* to need it, correct? >> try setting sysctl kern.eventtimer.idletick=3D1 >> It should resolve the issue > > Just to confirm =85is this within the Guest, or on the Host itself? > Thx within the Guest -- Mikhail From owner-freebsd-virtualization@FreeBSD.ORG Mon May 27 11:06:56 2013 Return-Path: Delivered-To: freebsd-virtualization@FreeBSD.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 186CC397 for ; Mon, 27 May 2013 11:06:56 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by mx1.freebsd.org (Postfix) with ESMTP id 01BCC6DF for ; Mon, 27 May 2013 11:06:56 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.7/8.14.7) with ESMTP id r4RB6twZ016209 for ; Mon, 27 May 2013 11:06:55 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.7/8.14.7/Submit) id r4RB6tmd016207 for freebsd-virtualization@FreeBSD.org; Mon, 27 May 2013 11:06:55 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 27 May 2013 11:06:55 GMT Message-Id: <201305271106.r4RB6tmd016207@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-virtualization@FreeBSD.org Subject: Current problem reports assigned to freebsd-virtualization@FreeBSD.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 May 2013 11:06:56 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/170096 virtualization[vimage] Dynamically-attached network interface will c o kern/169991 virtualization[run] [vimage] panic after device plugged in o kern/165252 virtualization[vimage] [pf] [panic] kernel panics with VIMAGE and PF o kern/161094 virtualization[vimage] [pf] [panic] kernel panic with pf + VIMAGE wh o kern/160541 virtualization[vimage][pf][patch] panic: userret: Returning on td 0x o kern/160496 virtualization[vimage] [pf] [patch] kernel panic with pf + VIMAGE o kern/148155 virtualization[vimage] [pf] Kernel panic with PF + VIMAGE kernel opt a kern/147950 virtualization[vimage] [carp] VIMAGE + CARP = kernel crash s kern/143808 virtualization[pf] pf does not work inside jail a kern/141696 virtualization[rum] [vimage] [panic] rum(4)+ vimage = kernel panic 10 problems total. From owner-freebsd-virtualization@FreeBSD.ORG Tue May 28 04:17:00 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 06B437C2 for ; Tue, 28 May 2013 04:17:00 +0000 (UTC) (envelope-from bryanv@daemoninthecloset.org) Received: from torment.daemoninthecloset.org (ip-static-94-242-209-234.as5577.net [94.242.209.234]) by mx1.freebsd.org (Postfix) with ESMTP id 913C8656 for ; Tue, 28 May 2013 04:16:58 +0000 (UTC) Received: from sage.daemoninthecloset.org (unknown [70.114.209.60]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "sage.daemoninthecloset.org", Issuer "daemoninthecloset.org" (verified OK)) by torment.daemoninthecloset.org (Postfix) with ESMTPS id A6FAD42C254B; Tue, 28 May 2013 05:52:47 +0200 (CEST) X-Virus-Scanned: amavisd-new at daemoninthecloset.org X-Virus-Scanned: amavisd-new at daemoninthecloset.org Date: Mon, 27 May 2013 22:51:44 -0500 (CDT) From: Bryan Venteicher To: Julian Stecklina Message-ID: <970038826.7286.1369713104543.JavaMail.root@daemoninthecloset.org> In-Reply-To: References: Subject: Re: virtio-net vs qemu 1.5.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [192.168.10.20] X-Mailer: Zimbra 8.0.2_GA_5569 (ZimbraWebClient - GC20 ([unknown])/8.0.2_GA_5569) Thread-Topic: virtio-net vs qemu 1.5.0 Thread-Index: 0hgePEmCDhnXrg5MN9P59NPoUTggWA== Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 May 2013 04:17:00 -0000 Hi, ----- Original Message ----- > Hello, > > I filed a bug: > http://www.freebsd.org/cgi/query-pr.cgi?pr=178955 > I committed a fix to this in the multiqueue driver [1] during BSDCan, haven't merged it back into HEAD yet. I'll do that in a couple of days. Unless you have multiple MAC unicast and/or multicast addresses configured on an interface, the error is harmless (for QEMU, which AFAIK, is the only implementation that supports this feature). [1] http://svnweb.freebsd.org/base?view=revision&revision=250802 > Julian > > On 05/23/2013 02:00 PM, Julian Stecklina wrote: > > Hello, > > > > I just compiled qemu 1.5.0 and noticed that virtio network (on CURRENT as > > of today) seems to have problems updating the MAC filter table: > > > > vtnet0: error setting host MAC filter table > > > > As far as I understand, if_vtnet.c does the following in > > vtnet_rx_filter_mac. It appends two full struct vtnet_mac_tables (one for > > unicast and one for multicast) to the request. Each consists of the number > > of actual entries in the table and space for 128 (mostly unused) entries > > in total. > > > > The qemu code parses this differently. It first reads the number of > > elements in the first table and then skips over so many MAC addresses and > > then expects the header to the second table (which in our case points to > > zero'd memory). Then it skips those 0 MAC entries as well and expects that > > it has consumed the whole request and returns an error, because there is > > still data left. The relevant code is in qemu/hw/net/virtio-net.c in > > virtio_net_handle_rx_mode. > > > > Assuming the qemu code is correct (of which I am not sure) the correct > > solution would be to enqueue only so many MACs in the original requests as > > are actually used. The following (a bit dirty) patch fixes this for me: > > > > > > diff --git a/sys/dev/virtio/network/if_vtnet.c > > b/sys/dev/virtio/network/if_vtnet.c > > index ffc349a..6f00dfb 100644 > > --- a/sys/dev/virtio/network/if_vtnet.c > > +++ b/sys/dev/virtio/network/if_vtnet.c > > @@ -2470,9 +2470,9 @@ vtnet_rx_filter_mac(struct vtnet_softc *sc) > > sglist_init(&sg, 4, segs); > > error |= sglist_append(&sg, &hdr, sizeof(struct > > virtio_net_ctrl_hdr)); > > error |= sglist_append(&sg, &filter->vmf_unicast, > > - sizeof(struct vtnet_mac_table)); > > + sizeof(uint32_t) + > > ETHER_ADDR_LEN*filter->vmf_unicast.nentries); > > error |= sglist_append(&sg, &filter->vmf_multicast, > > - sizeof(struct vtnet_mac_table)); > > + sizeof(uint32_t) + > > ETHER_ADDR_LEN*filter->vmf_multicast.nentries); > > error |= sglist_append(&sg, &ack, sizeof(uint8_t)); > > KASSERT(error == 0 && sg.sg_nseg == 4, > > ("error adding MAC filtering message to sglist")); > > > > Any virtio guru here to comment on this? > > > > Julian > > > > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to > "freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@FreeBSD.ORG Tue May 28 07:44:23 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 2CEDE4E6 for ; Tue, 28 May 2013 07:44:23 +0000 (UTC) (envelope-from "gallasch"@free.de) Received: from smtp.free.de (smtp.free.de [91.204.6.103]) by mx1.freebsd.org (Postfix) with ESMTP id 9A67AFB4 for ; Tue, 28 May 2013 07:44:21 +0000 (UTC) Received: (qmail 54653 invoked from network); 28 May 2013 09:44:09 +0200 Received: from smtp.free.de (HELO orwell.free.de) (gallasch@free.de@[91.204.4.103]) (envelope-sender ) by smtp.free.de (qmail-ldap-1.03) with AES128-SHA encrypted SMTP for ; 28 May 2013 09:44:09 +0200 Subject: Re: Virtualbox: time sync Mime-Version: 1.0 (Apple Message framework v1085) Content-Type: text/plain; charset=windows-1252 From: Kai Gallasch In-Reply-To: <5414678B-A9BD-4882-A79B-CBA296D73CBF@hub.org> Date: Tue, 28 May 2013 09:44:09 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <7308FDE0-C3B2-4E85-96E5-D3AD428B8F11@free.de> References: <5414678B-A9BD-4882-A79B-CBA296D73CBF@hub.org> To: Marc Fournier X-Mailer: Apple Mail (2.1085) Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 May 2013 07:44:23 -0000 Am 26.05.2013 um 07:03 schrieb Marc Fournier: >=20 > First, thank you for the answer about switching from straight bridge = to using a tap device =85 that made a *huge* difference =85 I'm not able = to actually run a build world within the environment without having the = whole machine lock up =85 Hi Marc. Would you share your knowledge of using TAP(4) as an alternative to the = generic vbox bridge mode? I cannot find much reference to that, especially when it comes to = running vbox on FreeBSD. If you have serveral vbox guests bridged to a physical "--bridgeadapter" = or to a tap device used as a bridge adapter - is there a way to lock = down / enforce an ip address for a vbox guest? I don't like the idea = that someone inside a vbox guests uses ip addresses for the guest, that = are already in use on the vbox server or uses non-allowed IPs. One possible solution I thought is to make the switch that the vbox = server hardware is plugged into, lock down the mac-adress of a vbox = tap-device to a fixed ip-adresses (if the switch is capable of that) Kai.= From owner-freebsd-virtualization@FreeBSD.ORG Tue May 28 10:29:40 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 4BD1320D for ; Tue, 28 May 2013 10:29:40 +0000 (UTC) (envelope-from gofd-freebsd-virtualization@m.gmane.org) Received: from plane.gmane.org (plane.gmane.org [80.91.229.3]) by mx1.freebsd.org (Postfix) with ESMTP id 108B1A01 for ; Tue, 28 May 2013 10:29:39 +0000 (UTC) Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1UhH9u-000409-OG for freebsd-virtualization@freebsd.org; Tue, 28 May 2013 12:29:38 +0200 Received: from august.inf.tu-dresden.de ([141.76.48.124]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 28 May 2013 12:29:38 +0200 Received: from jsteckli by august.inf.tu-dresden.de with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 28 May 2013 12:29:38 +0200 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-virtualization@freebsd.org From: Julian Stecklina Subject: Re: virtio-net vs qemu 1.5.0 Date: Tue, 28 May 2013 12:29:28 +0200 Lines: 8 Message-ID: References: <970038826.7286.1369713104543.JavaMail.root@daemoninthecloset.org> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: august.inf.tu-dresden.de User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130514 Thunderbird/17.0.6 In-Reply-To: <970038826.7286.1369713104543.JavaMail.root@daemoninthecloset.org> X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 May 2013 10:29:40 -0000 On 05/28/2013 05:51 AM, Bryan Venteicher wrote: > I committed a fix to this in the multiqueue driver [1] during BSDCan, > haven't merged it back into HEAD yet. I'll do that in a couple of days. Thx! Do you plan to merge the multiqueue branch? Julian From owner-freebsd-virtualization@FreeBSD.ORG Tue May 28 12:59:25 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 084469DA for ; Tue, 28 May 2013 12:59:25 +0000 (UTC) (envelope-from bryanv@daemoninthecloset.org) Received: from torment.daemoninthecloset.org (ip-static-94-242-209-234.as5577.net [94.242.209.234]) by mx1.freebsd.org (Postfix) with ESMTP id C30E9867 for ; Tue, 28 May 2013 12:59:24 +0000 (UTC) Received: from sage.daemoninthecloset.org (unknown [70.114.209.60]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "sage.daemoninthecloset.org", Issuer "daemoninthecloset.org" (verified OK)) by torment.daemoninthecloset.org (Postfix) with ESMTPS id 91B6042C260C; Tue, 28 May 2013 15:00:13 +0200 (CEST) X-Virus-Scanned: amavisd-new at daemoninthecloset.org X-Virus-Scanned: amavisd-new at daemoninthecloset.org Date: Tue, 28 May 2013 07:59:07 -0500 (CDT) From: Bryan Venteicher To: Julian Stecklina Message-ID: <1461162857.7377.1369745947317.JavaMail.root@daemoninthecloset.org> In-Reply-To: References: <970038826.7286.1369713104543.JavaMail.root@daemoninthecloset.org> Subject: Re: virtio-net vs qemu 1.5.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [192.168.10.20] X-Mailer: Zimbra 8.0.2_GA_5569 (ZimbraWebClient - GC20 ([unknown])/8.0.2_GA_5569) Thread-Topic: virtio-net vs qemu 1.5.0 Thread-Index: Q1aMg+4DRVUf9E0kHCOqw7YeDNtCXg== Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 May 2013 12:59:25 -0000 ----- Original Message ----- > Thx! Do you plan to merge the multiqueue branch? > Hopefully within 1-2 months. > Julian > > > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to > "freebsd-virtualization-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@FreeBSD.ORG Tue May 28 15:21:23 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 6F423F22; Tue, 28 May 2013 15:21:23 +0000 (UTC) (envelope-from outbackdingo@gmail.com) Received: from mail-ob0-x229.google.com (mail-ob0-x229.google.com [IPv6:2607:f8b0:4003:c01::229]) by mx1.freebsd.org (Postfix) with ESMTP id 2E0AF200; Tue, 28 May 2013 15:21:23 +0000 (UTC) Received: by mail-ob0-f169.google.com with SMTP id up14so2731431obb.14 for ; Tue, 28 May 2013 08:21:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=xPio3IJVaVY6s+Qwj4M56F5c7VWlzuT0VWXOERhJuEs=; b=Ht02x/SllwFrhBg9lfNPLC6mxvv+1tYU+fvf9/Ng7O4Q4YOML5tRcHvIPWlPWqZzHY vYdW7NiBhYPDFqeQYM/+X3DKQXLtG5NBR6RXk2hh5S3Xr6lir68wiDhXk8KJGxf7l4wY nT0X36xja+u3MRMFNcMrtRgHv6hUB1AINvHM5eSlHETfVvhEEWSLTZcbIWX78G3UM7F4 2Fbrqkl4jzZ4aoV41mqtpbLIoLz4GI2nOKBwHKMvGZo5yEBYdHDzvcKAOkJYZIMHHp7H HIWVvWOPVCV6W+Q3qYMm6d3IHNuWgTvuGzJ+3JFCWElaQYgNseCGoCQZCSDDAzdlFfeD 19cQ== MIME-Version: 1.0 X-Received: by 10.182.118.42 with SMTP id kj10mr20822987obb.99.1369754482743; Tue, 28 May 2013 08:21:22 -0700 (PDT) Received: by 10.76.152.225 with HTTP; Tue, 28 May 2013 08:21:22 -0700 (PDT) In-Reply-To: References: <519131D8.9010307@citrix.com> <647F6650-AEED-4784-8A45-98324860EE0A@dckd.nl> <519E1A0C.3070609@citrix.com> Date: Tue, 28 May 2013 11:21:22 -0400 Message-ID: Subject: Re: FreeBSD PVHVM call for testing From: Outback Dingo To: Craig Rodrigues Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: "freebsd-xen@freebsd.org" , "xen-users@lists.xen.org" , xen-devel , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 May 2013 15:21:23 -0000 On Fri, May 24, 2013 at 6:27 PM, Craig Rodrigues wr= ote: > On Thu, May 23, 2013 at 6:30 AM, Roger Pau Monn=E9 >wrote: > > > On 23/05/13 15:20, Jeroen van der Ham wrote: > > > > > > On 13 May 2013, at 20:32, Roger Pau Monn=E9 > wrote: > > >> Also, I've created a wiki page that explains how to set up a FreeBSD > > >> PVHVM for testing: > > >> > > >> http://wiki.xen.org/wiki/Testing_FreeBSD_PVHVM > > > > > > > > > You mention on that page that it is easier to install on 10.0-CURRENT > > snapshots. > > > What are the issues with installing this on 9.1? Is it possible? > > > > I don't think it is recommended to use a HEAD (10) kernel with a 9.1 > > userland. You can always install a 9.1 and then do a full update with > > the source on my repository. > > > > > Actually in FreeBSD, it is possible to run an older userland on a newer > kernel, > and a lot of effort is spent in preserving this type of backwards > compatibility. > So a 9.1 userland with a 10 kernel will work. > However, running a newer userland on an older kernel is not guaranteed to > work. > So running a 10 userland with a 9.1 kernel will most likely not work. > > However, since you guys are doing very cutting edge stuff with 10-CURRENT= , > it is better that you do not waste time with 9.1. > > I recommend you start with a 10.0 CURRENT snapshot ISO and go from there. > I am going through a similar setup exercise with a Google Summer of Code > student > where he needs to have a latest CURRENT system running in a VM. > > I wrote this blog post: > > > http://blogs.freebsdish.org/rodrigc/2013/05/24/setting-up-a-vm-for-doing-= gsoc-work/ > > for the steps how to do it. You can follow those steps to get bootstrapp= ed > with a working environment if it helps you out. > > Good luck. > > Any chance this will be backported to 9.X or 9-STABLE at least ?? > -- > Craig > _______________________________________________ > freebsd-xen@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-xen > To unsubscribe, send any mail to "freebsd-xen-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@FreeBSD.ORG Tue May 28 16:15:12 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 977F56E; Tue, 28 May 2013 16:15:12 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.eu.citrix.com [46.33.159.39]) by mx1.freebsd.org (Postfix) with ESMTP id E01FF6DA; Tue, 28 May 2013 16:15:11 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.87,758,1363132800"; d="scan'208";a="5059085" Received: from lonpex01cl01.citrite.net ([10.30.203.101]) by LONPIPO01.EU.CITRIX.COM with ESMTP/TLS/AES128-SHA; 28 May 2013 16:15:01 +0000 Received: from [192.168.1.30] (10.30.203.1) by LONPEX01CL01.citrite.net (10.30.203.101) with Microsoft SMTP Server id 14.2.342.3; Tue, 28 May 2013 17:15:01 +0100 Message-ID: <51A4D804.9050208@citrix.com> Date: Tue, 28 May 2013 18:15:00 +0200 From: =?UTF-8?B?Um9nZXIgUGF1IE1vbm7DqQ==?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130509 Thunderbird/17.0.6 MIME-Version: 1.0 To: Colin Percival Subject: Re: FreeBSD PVHVM call for testing References: <519131D8.9010307@citrix.com> <51952BAE.6010609@freebsd.org> <51957D42.9060801@citrix.com> <51959ED9.6040405@freebsd.org> <51974EC9.9030204@citrix.com> <5197A1EA.2040404@freebsd.org> <519CAFC7.1070908@citrix.com> <519D24A9.3050407@freebsd.org> <519DDC0A.9000201@citrix.com> <519E6958.6020606@freebsd.org> <519F3CD0.5090405@citrix.com> In-Reply-To: <519F3CD0.5090405@citrix.com> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 8bit X-Originating-IP: [10.30.203.1] Cc: "freebsd-xen@freebsd.org" , "xen-users@lists.xen.org" , Matt Wilson , "freebsd-virtualization@freebsd.org" , xen-devel X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 May 2013 16:15:12 -0000 On 24/05/13 12:11, Roger Pau Monné wrote: > On 23/05/13 21:09, Colin Percival wrote: >> On 05/23/13 02:06, Roger Pau Monné wrote: >>> On 22/05/13 22:03, Colin Percival wrote: >>>> Testing on a cr1.8xlarge EC2 instance, I get Xen 4.2, but it ends up with >>>> a panic -- console output below. I can get a backtrace and possibly even >>>> a dump if those would help. >>> >>> Thanks for the test, I've been using Xen 4.2 (and 4.3) without problems >>> so far. By looking at the Xen code, the only reason the timer setup >>> could return -22 (EINVAL), is that we try to set the timer for a >>> different vCPU than the one we are running on. >>> >>> I've been able to boot a 32 vCPU DomU on my 8way box using Xen 4.2.1 >>> (using both qemu-xen and qemu-xen-traditional device models), so I'm >>> unsure if this could be due to some patch Amazon applies to Xen. Could >>> you try the following patch and post the error message? I would like to >>> see if the cpuid reported by kdb and the vCPU that we are trying to set >>> the timer are the same. >> >> Looks like there's agreement about the cpuids here. Anything else I should >> try testing? > > Thanks for the test, this is what I expected. I'm a little bit out of > ideas since I'm not able to reproduce this on upstream Xen 4.2. Without > knowing what's happening inside the hypervisor it's hard to tell what's > wrong. It would be interesting to try if the same happens with a Linux > PVHVM (not PV) running on the same instance type. Hello Matt, Colin has found an issue on the FreeBSD PVHVM port that I haven't been able to reproduce using open source Xen, even when using the same version as the one reported by EC2. Is there anyway you could provide some help debugging this? Without seeing the Xen code that causes VCPUOP_set_singleshot_timer to return EINVAL it is quite hard to figure out what's happening inside the hypervisor. Thanks, Roger. From owner-freebsd-virtualization@FreeBSD.ORG Tue May 28 16:52:02 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 4EE92617; Tue, 28 May 2013 16:52:02 +0000 (UTC) (envelope-from konrad.wilk@oracle.com) Received: from aserp1050.oracle.com (aserp1050.oracle.com [141.146.126.70]) by mx1.freebsd.org (Postfix) with ESMTP id BDEDB8D9; Tue, 28 May 2013 16:52:01 +0000 (UTC) Received: from aserp1040.oracle.com (aserp1040.oracle.com [141.146.126.69]) by aserp1050.oracle.com (Sentrion-MTA-4.3.1/Sentrion-MTA-4.3.1) with ESMTP id r4SDh3r1005995 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Tue, 28 May 2013 13:43:10 GMT Received: from acsinet22.oracle.com (acsinet22.oracle.com [141.146.126.238]) by aserp1040.oracle.com (Sentrion-MTA-4.3.1/Sentrion-MTA-4.3.1) with ESMTP id r4SDgxJE021182 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Tue, 28 May 2013 13:43:00 GMT Received: from userz7021.oracle.com (userz7021.oracle.com [156.151.31.85]) by acsinet22.oracle.com (8.14.4+Sun/8.14.4) with ESMTP id r4SDgwNj008485 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=FAIL); Tue, 28 May 2013 13:42:59 GMT Received: from abhmt102.oracle.com (abhmt102.oracle.com [141.146.116.54]) by userz7021.oracle.com (8.14.4+Sun/8.14.4) with ESMTP id r4SDgvEG017409; Tue, 28 May 2013 13:42:58 GMT Received: from phenom.dumpdata.com (/50.195.21.189) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Tue, 28 May 2013 06:42:57 -0700 Received: by phenom.dumpdata.com (Postfix, from userid 1000) id 6CF821BF781; Tue, 28 May 2013 09:42:56 -0400 (EDT) Date: Tue, 28 May 2013 09:42:56 -0400 From: Konrad Rzeszutek Wilk To: Craig Rodrigues Subject: Re: [Xen-devel] FreeBSD PVHVM call for testing Message-ID: <20130528134256.GF724@phenom.dumpdata.com> References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <20130524141400.GB3900@phenom.dumpdata.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Content-Transfer-Encoding: quoted-printable X-Source-IP: aserp1040.oracle.com [141.146.126.69] Cc: "freebsd-xen@freebsd.org" , xen-devel , "freebsd-virtualization@freebsd.org" , "xen-users@lists.xen.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 May 2013 16:52:02 -0000 On Fri, May 24, 2013 at 03:21:54PM -0700, Craig Rodrigues wrote: > On Fri, May 24, 2013 at 7:14 AM, Konrad Rzeszutek Wilk < > konrad.wilk@oracle.com> wrote: >=20 > > On Thu, May 23, 2013 at 07:41:50PM +0200, Roger Pau Monn=E9 wrote: > > > Hello, > > > > > > I've pushed a new branch, pvhvm_v10 that contains a PV IPI > > > implementation for both amd64 and i386. I've also updated the wiki = to > > > point to the pvhvm_v10 branch: > > > > I feel a bit stupid to ask this, but how I install 'gmake'? Doing 'pk= g_add > > -r gmake' > > tells me there is no package (perhaps I am using a too modern version= of > > FreeBSD > > (FreeBSD-10.0-CURRENT-amd64-20130512-r250582-release.iso)? > > > > The Wiki mentions how to install git but that fails b/c it can't find > > gmake. > > >=20 > For 10.0-CURRENT, not all the packages are available yet from the main > FreeBSD.org ftp site. > I am going through a similar setup issue with someone who has signed up= for > Google Summer of Code, > and I need him to use close to the latest 10.0-CURRENT and have a usabl= e > system. >=20 > I wrote this blog post for the student: > http://blogs.freebsdish.org/rodrigc/2013/05/24/setting-up-a-vm-for-doin= g-gsoc-work/ Excellent! Thanks for the link. From owner-freebsd-virtualization@FreeBSD.ORG Tue May 28 19:19:10 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 1AA3DF0D; Tue, 28 May 2013 19:19:10 +0000 (UTC) (envelope-from prvs=8537416cf=msw@amazon.com) Received: from smtp-fw-2101.amazon.com (smtp-fw-2101.amazon.com [72.21.196.25]) by mx1.freebsd.org (Postfix) with ESMTP id A74C89E; Tue, 28 May 2013 19:19:09 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amazon.com; i=msw@amazon.com; q=dns/txt; s=amazon201209; t=1369768749; x=1401304749; h=date:from:to:cc:subject:message-id:references: mime-version:content-transfer-encoding:in-reply-to; bh=yG55VFh0WNP2/pY5xjZtRFXtjo7WsphkGwXc+KaVu14=; b=OvCxN2tJpmlGyiYjR4GGFsiei9/fHj/u/klfTLSK4pfZquLZJsMBYqsF Mr5ZcSWV27vycTm4TJtnwuOe9nwiryEy0t9xNRLrUKnXqL7u5Bh6ocEF+ k/QCb/ij5Nlm/r6aaTphrM7/V3DsOXijEQg8Y2Qx1p590nd7QkjO9ne2y Q=; X-IronPort-AV: E=Sophos;i="4.87,759,1363132800"; d="scan'208";a="568049173" Received: from smtp-in-1002.vdc.amazon.com ([10.118.132.23]) by smtp-border-fw-out-2101.iad2.amazon.com with ESMTP/TLS/DHE-RSA-AES256-SHA; 28 May 2013 19:18:58 +0000 Received: from ex10-hub-9002.ant.amazon.com (ex10-hub-9002.ant.amazon.com [10.185.137.130]) by smtp-in-1002.vdc.amazon.com (8.13.8/8.13.8) with ESMTP id r4SJIubK015557 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=OK); Tue, 28 May 2013 19:18:58 GMT Received: from u109add4315675089e695.ant.amazon.com (10.184.8.86) by ex10-hub-9002.ant.amazon.com (10.185.137.130) with Microsoft SMTP Server id 14.2.247.3; Tue, 28 May 2013 12:18:56 -0700 Received: by u109add4315675089e695.ant.amazon.com (sSMTP sendmail emulation); Tue, 28 May 2013 12:18:55 -0700 Date: Tue, 28 May 2013 12:18:55 -0700 From: Matt Wilson To: Roger Pau =?iso-8859-1?Q?Monn=E9?= Subject: Re: [Xen-devel] FreeBSD PVHVM call for testing Message-ID: <20130528191855.GA13736@u109add4315675089e695.ant.amazon.com> References: <51957D42.9060801@citrix.com> <51959ED9.6040405@freebsd.org> <51974EC9.9030204@citrix.com> <5197A1EA.2040404@freebsd.org> <519CAFC7.1070908@citrix.com> <519D24A9.3050407@freebsd.org> <519DDC0A.9000201@citrix.com> <519E6958.6020606@freebsd.org> <519F3CD0.5090405@citrix.com> <51A4D804.9050208@citrix.com> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <51A4D804.9050208@citrix.com> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: "freebsd-xen@freebsd.org" , xen-devel , "freebsd-virtualization@freebsd.org" , Colin Percival , "xen-users@lists.xen.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 May 2013 19:19:10 -0000 On Tue, May 28, 2013 at 06:15:00PM +0200, Roger Pau Monné wrote: > On 24/05/13 12:11, Roger Pau Monné wrote: > > > > Thanks for the test, this is what I expected. I'm a little bit out of > > ideas since I'm not able to reproduce this on upstream Xen 4.2. Without > > knowing what's happening inside the hypervisor it's hard to tell what's > > wrong. It would be interesting to try if the same happens with a Linux > > PVHVM (not PV) running on the same instance type. > > Hello Matt, > > Colin has found an issue on the FreeBSD PVHVM port that I haven't been > able to reproduce using open source Xen, even when using the same > version as the one reported by EC2. Is there anyway you could provide > some help debugging this? Without seeing the Xen code that causes > VCPUOP_set_singleshot_timer to return EINVAL it is quite hard to figure > out what's happening inside the hypervisor. Hi Roger, VCPUOP_set_singleshot_timer returns -EINVAL when: 1) the specified vCPU ID is out of range (<0 or >MAX_VIRT_CPUS) 2) the specified vCPU ID doesn't match the running vCPU. It seems that there is a confusion between the logical vCPU ID and the local APIC physical ID. I added some debugging to case 2): diff --git a/xen/common/domain.c b/xen/common/domain.c index e728819..e3efb8c 100644 --- a/xen/common/domain.c +++ b/xen/common/domain.c @@ -901,7 +901,12 @@ long do_vcpu_op(int cmd, int vcpuid, XEN_GUEST_HANDLE(void) arg) struct vcpu_set_singleshot_timer set; if ( v != current ) + { + printk("Domain %d (vcpu#%d) VCPUOP_set_singleshot_timer specified vcpuid %d\n", + d->domain_id, current->vcpu_id, vcpuid); + return -EINVAL; + } if ( copy_from_guest(&set, arg, 1) ) return -EFAULT; The output from booting ami-e75c358e on a cr1.8xlarge: (XEN) Domain 1 (vcpu#16) VCPUOP_set_singleshot_timer specified vcpuid 1 (XEN) Domain 1 (vcpu#7) VCPUOP_set_singleshot_timer specified vcpuid 14 (XEN) Domain 1 (vcpu#23) VCPUOP_set_singleshot_timer specified vcpuid 15 (XEN) Domain 1 (vcpu#11) VCPUOP_set_singleshot_timer specified vcpuid 22 (XEN) Domain 1 (vcpu#27) VCPUOP_set_singleshot_timer specified vcpuid 23 (XEN) Domain 1 (vcpu#18) VCPUOP_set_singleshot_timer specified vcpuid 5 (XEN) Domain 1 (vcpu#2) VCPUOP_set_singleshot_timer specified vcpuid 4 (XEN) Domain 1 (vcpu#9) VCPUOP_set_singleshot_timer specified vcpuid 18 (XEN) Domain 1 (vcpu#25) VCPUOP_set_singleshot_timer specified vcpuid 19 (XEN) Domain 1 (vcpu#1) VCPUOP_set_singleshot_timer specified vcpuid 2 (XEN) Domain 1 (vcpu#6) VCPUOP_set_singleshot_timer specified vcpuid 12 (XEN) Domain 1 (vcpu#22) VCPUOP_set_singleshot_timer specified vcpuid 13 (XEN) Domain 1 (vcpu#26) VCPUOP_set_singleshot_timer specified vcpuid 21 (XEN) Domain 1 (vcpu#10) VCPUOP_set_singleshot_timer specified vcpuid 20 (XEN) Domain 1 (vcpu#14) VCPUOP_set_singleshot_timer specified vcpuid 28 (XEN) Domain 1 (vcpu#30) VCPUOP_set_singleshot_timer specified vcpuid 29 (XEN) Domain 1 (vcpu#3) VCPUOP_set_singleshot_timer specified vcpuid 6 (XEN) Domain 1 (vcpu#19) VCPUOP_set_singleshot_timer specified vcpuid 7 (XEN) Domain 1 (vcpu#12) VCPUOP_set_singleshot_timer specified vcpuid 24 (XEN) Domain 1 (vcpu#28) VCPUOP_set_singleshot_timer specified vcpuid 25 (XEN) Domain 1 (vcpu#5) VCPUOP_set_singleshot_timer specified vcpuid 10 (XEN) Domain 1 (vcpu#21) VCPUOP_set_singleshot_timer specified vcpuid 11 (XEN) Domain 1 (vcpu#24) VCPUOP_set_singleshot_timer specified vcpuid 17 (XEN) Domain 1 (vcpu#8) VCPUOP_set_singleshot_timer specified vcpuid 16 (XEN) Domain 1 (vcpu#17) VCPUOP_set_singleshot_timer specified vcpuid 3 (XEN) Domain 1 (vcpu#20) VCPUOP_set_singleshot_timer specified vcpuid 9 (XEN) Domain 1 (vcpu#4) VCPUOP_set_singleshot_timer specified vcpuid 8 (XEN) Domain 1 (vcpu#13) VCPUOP_set_singleshot_timer specified vcpuid 26 (XEN) Domain 1 (vcpu#29) VCPUOP_set_singleshot_timer specified vcpuid 27 (XEN) Domain 1 (vcpu#15) VCPUOP_set_singleshot_timer specified vcpuid 30 Note from the FreeBSD boot output: APIC: CPU 0 has ACPI ID 0 APIC: CPU 1 has ACPI ID 16 APIC: CPU 2 has ACPI ID 1 APIC: CPU 3 has ACPI ID 17 APIC: CPU 4 has ACPI ID 2 APIC: CPU 5 has ACPI ID 18 APIC: CPU 6 has ACPI ID 3 APIC: CPU 7 has ACPI ID 19 APIC: CPU 8 has ACPI ID 4 APIC: CPU 9 has ACPI ID 20 APIC: CPU 10 has ACPI ID 5 APIC: CPU 11 has ACPI ID 21 APIC: CPU 12 has ACPI ID 6 APIC: CPU 13 has ACPI ID 22 APIC: CPU 14 has ACPI ID 7 APIC: CPU 15 has ACPI ID 23 APIC: CPU 16 has ACPI ID 8 APIC: CPU 17 has ACPI ID 24 APIC: CPU 18 has ACPI ID 9 APIC: CPU 19 has ACPI ID 25 APIC: CPU 20 has ACPI ID 10 APIC: CPU 21 has ACPI ID 26 APIC: CPU 22 has ACPI ID 11 APIC: CPU 23 has ACPI ID 27 APIC: CPU 24 has ACPI ID 12 APIC: CPU 25 has ACPI ID 28 APIC: CPU 26 has ACPI ID 13 APIC: CPU 27 has ACPI ID 29 APIC: CPU 28 has ACPI ID 14 APIC: CPU 29 has ACPI ID 30 APIC: CPU 30 has ACPI ID 15 APIC: CPU 31 has ACPI ID 31 --msw From owner-freebsd-virtualization@FreeBSD.ORG Tue May 28 21:34:05 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id AD725683 for ; Tue, 28 May 2013 21:34:05 +0000 (UTC) (envelope-from bounces+73574-9b34-freebsd-virtualization=freebsd.org@sendgrid.me) Received: from o3.shared.sendgrid.net (o3.shared.sendgrid.net [208.117.48.85]) by mx1.freebsd.org (Postfix) with SMTP id 6AFCDB48 for ; Tue, 28 May 2013 21:34:05 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=sendgrid.info; h=from :mime-version:to:cc:subject:references:in-reply-to:content-type :content-transfer-encoding; s=smtpapi; bh=FDhmtoph41CXde4pcXthb1 JkJeA=; b=VepaRyE3w9GKnv7Fw6F1q5uuI9CH1ZdgqkCvrKCL8rEy7XJsS2uMZ8 HdYco8KuOptX5S4+DegMxwRSAB/aqhWrgJRD2LhiKnnBero5yyOFZfpmhT0WLCR2 z420tWwJMByyuYs6+E/He5M5k+jkY4JBYqQZP+NFdg91gxsnOgM90= Received: by 10.4.35.246 with SMTP id mf61.14530.51A522C63 Tue, 28 May 2013 21:33:58 +0000 (UTC) Received: from mail.tarsnap.com (unknown [10.60.208.13]) by mi21 (SG) with ESMTP id 13eed0fd899.5f83.ccb0ab for ; Tue, 28 May 2013 16:33:58 -0500 (CST) Received: (qmail 83663 invoked from network); 28 May 2013 21:33:57 -0000 Received: from unknown (HELO clamshell.daemonology.net) (127.0.0.1) by ec2-107-20-205-189.compute-1.amazonaws.com with ESMTP; 28 May 2013 21:33:57 -0000 Received: (qmail 67058 invoked from network); 28 May 2013 21:33:19 -0000 Received: from unknown (HELO clamshell.daemonology.net) (127.0.0.1) by clamshell.daemonology.net with SMTP; 28 May 2013 21:33:19 -0000 Message-ID: <51A5229F.80205@freebsd.org> Date: Tue, 28 May 2013 14:33:19 -0700 From: Colin Percival User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130406 Thunderbird/17.0.5 MIME-Version: 1.0 To: Matt Wilson , =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= Subject: Re: [Xen-devel] FreeBSD PVHVM call for testing References: <51957D42.9060801@citrix.com> <51959ED9.6040405@freebsd.org> <51974EC9.9030204@citrix.com> <5197A1EA.2040404@freebsd.org> <519CAFC7.1070908@citrix.com> <519D24A9.3050407@freebsd.org> <519DDC0A.9000201@citrix.com> <519E6958.6020606@freebsd.org> <519F3CD0.5090405@citrix.com> <51A4D804.9050208@citrix.com> <20130528191855.GA13736@u109add4315675089e695.ant.amazon.com> In-Reply-To: <20130528191855.GA13736@u109add4315675089e695.ant.amazon.com> X-Enigmail-Version: 1.5.1 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-SG-EID: 5BcF9P+ypITprUjXJktHhsiUBkkeW691hQUndAFAEhADTHpMuO2yZVPB1LkeEe7rVixeEjSBW0cTZyrQfaH6gJBHfV6TecxbvGGjVDh43KVhIjQUH0/8/42eMsrq9lokg4fRwpPMDFBi25hb3LDO+Q== Cc: "freebsd-xen@freebsd.org" , xen-devel , "freebsd-virtualization@freebsd.org" , "xen-users@lists.xen.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 May 2013 21:34:05 -0000 On 05/28/13 12:18, Matt Wilson wrote: > VCPUOP_set_singleshot_timer returns -EINVAL when: > > 1) the specified vCPU ID is out of range (<0 or >MAX_VIRT_CPUS) > 2) the specified vCPU ID doesn't match the running vCPU. > > It seems that there is a confusion between the logical vCPU ID and the > local APIC physical ID. > [...] > (XEN) Domain 1 (vcpu#16) VCPUOP_set_singleshot_timer specified vcpuid 1 > [...] > APIC: CPU 1 has ACPI ID 16 Thanks Matt! Looks like we need to pass our acpi_id to the Xen hypercall instead of our cpuid. Roger, changing the line int cpu = PCPU_GET(cpuid); to int cpu = PCPU_GET(acpi_id); in xentimer_et_start and xentimer_et_stop fixes this panic and gets me slightly further; the following lines are now added to the console output prior to the system appearing to hang: > ioapic0: routing intpin 1 (ISA IRQ 1) to lapic 1 vector 48 > ioapic0: routing intpin 4 (ISA IRQ 4) to lapic 2 vector 48 > ioapic0: routing intpin 9 (ISA IRQ 9) to lapic 3 vector 48 > ioapic0: routing intpin 12 (ISA IRQ 12) to lapic 4 vector 48 > ioapic0: routing intpin 14 (ISA IRQ 14) to lapic 5 vector 48 > ioapic0: routing intpin 15 (ISA IRQ 15) to lapic 6 vector 48 > ioapic0: routing intpin 28 (PCI IRQ 28) to lapic 7 vector 48 > TSC timecounter discards lower 1 bit(s) > Timecounter "TSC-low" frequency 1300024860 Hz quality -100 > WARNING: WITNESS option enabled, expect reduced performance. On a cc2.8xlarge EC2 instance, the lines which come after this are > GEOM: new disk xbd1 > GEOM: new disk xbd2 > GEOM: new disk xbd3 > GEOM: new disk xbd4 > Trying to mount root from ufs:/dev/ad0a [rw]... > start_init: trying /sbin/init and then the userland boot process; have you made any bug fixes after your pvhvm_v7 which would explain why tasting disks was hanging? -- Colin Percival Security Officer Emeritus, FreeBSD | The power to serve Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid From owner-freebsd-virtualization@FreeBSD.ORG Tue May 28 22:11:11 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 4E9D4366; Tue, 28 May 2013 22:11:11 +0000 (UTC) (envelope-from crodr001@gmail.com) Received: from mail-lb0-f179.google.com (mail-lb0-f179.google.com [209.85.217.179]) by mx1.freebsd.org (Postfix) with ESMTP id 9AD71DC6; Tue, 28 May 2013 22:11:10 +0000 (UTC) Received: by mail-lb0-f179.google.com with SMTP id r11so8371888lbv.38 for ; Tue, 28 May 2013 15:11:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=UXaSWdt0YceK8+p8mJKAIgiWbRnQxqsjNhdBxXt/E+w=; b=0Cy937kms2ehq7LIRwRxGf9+Imjfxixr/OYKwirld6vs0Ai5I5tuQHOvMmeznPDE5j Ah7MsNyBl2g/DgYhSm0t3WTAwQcThKKyiJlLhdAoV4xeiI4+qfIsupyGo2dUymALXW2j wVQbOvrcF/JhqLtcw380qu6WOU7ty63N9SsIkdDb531ZxAmo9Hz+9pXJW9S8me4cu0H8 k6j56bUS+RO+Cd0ieljsfNjhBPwKD4wd6qthCkItdvX8Jo9R2LUzJJMdbteM89fmIwwu v45kOUov2Y0fSjKzfWj4rEyhJgTZBoFHarn8fNkwHUIYDC9jdeC6/46kAXEcHlyVwxEl SAbA== MIME-Version: 1.0 X-Received: by 10.112.131.232 with SMTP id op8mr248051lbb.2.1369778709501; Tue, 28 May 2013 15:05:09 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.13.135 with HTTP; Tue, 28 May 2013 15:05:09 -0700 (PDT) In-Reply-To: References: <519131D8.9010307@citrix.com> <647F6650-AEED-4784-8A45-98324860EE0A@dckd.nl> <519E1A0C.3070609@citrix.com> Date: Tue, 28 May 2013 15:05:09 -0700 X-Google-Sender-Auth: j4j0ndJlBDA_uaiB5Cl3r9fcm2A Message-ID: Subject: Re: FreeBSD PVHVM call for testing From: Craig Rodrigues To: Outback Dingo Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: "freebsd-xen@freebsd.org" , "xen-users@lists.xen.org" , xen-devel , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 May 2013 22:11:11 -0000 On Tue, May 28, 2013 at 8:21 AM, Outback Dingo wrote: > > > > On Fri, May 24, 2013 at 6:27 PM, Craig Rodrigues wrote: > >> I wrote this blog post: >> >> >> http://blogs.freebsdish.org/rodrigc/2013/05/24/setting-up-a-vm-for-doing-gsoc-work/ >> >> for the steps how to do it. You can follow those steps to get >> bootstrapped >> with a working environment if it helps you out. >> >> Good luck. >> >> > Any chance this will be backported to 9.X or 9-STABLE at least ?? > > I wrote a blog post specifically for installing 10-CURRENT from a snapshot ISO and getting bootstrapped from there, to help the Google Summer of Code Student that I am mentoring. What specifically do you want to be backported to 9-STABLE? -- Craig From owner-freebsd-virtualization@FreeBSD.ORG Tue May 28 22:43:11 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 133CB93E; Tue, 28 May 2013 22:43:11 +0000 (UTC) (envelope-from outbackdingo@gmail.com) Received: from mail-oa0-f41.google.com (mail-oa0-f41.google.com [209.85.219.41]) by mx1.freebsd.org (Postfix) with ESMTP id C6794F2F; Tue, 28 May 2013 22:43:10 +0000 (UTC) Received: by mail-oa0-f41.google.com with SMTP id n9so10893695oag.14 for ; Tue, 28 May 2013 15:43:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=3MKzpE72joJRwtIMoPRIH253+u4d5UIFd3W13OLCUcg=; b=vBw65N2BLw80oj6n/j08QGxpRL0agycCKTeDUDmpl/7ZqZOeLgbscURMGmL3oiKMPL GbJ6u2uAhsS5wy4bD++6wY7ecw29ms4zZCt8445T4jV7/scQjtW23UdSgrDzX3uDsb7v sAkfqlfvdrAB5WTdps/oCsAdRDbEINQp2bM5DR6duSEo4vGrHdjmBaiXZdAMzaFPEyOY VzT02Td1BhWHMwgvKzprSUjB+9qefPQ5M+Ik3qUVMIiR2BHkJzGm5NPq5cyd32qvo/3r d5TbVe7uhXKGnfXnCoYj8U4YYiGSwy4KH+YHi8owuyO0LrmdI+SSdtO8JGSZF1Mzm9wH 9KQw== MIME-Version: 1.0 X-Received: by 10.182.65.100 with SMTP id w4mr19891373obs.70.1369780990087; Tue, 28 May 2013 15:43:10 -0700 (PDT) Received: by 10.76.152.225 with HTTP; Tue, 28 May 2013 15:43:09 -0700 (PDT) In-Reply-To: References: <519131D8.9010307@citrix.com> <647F6650-AEED-4784-8A45-98324860EE0A@dckd.nl> <519E1A0C.3070609@citrix.com> Date: Tue, 28 May 2013 18:43:09 -0400 Message-ID: Subject: Re: FreeBSD PVHVM call for testing From: Outback Dingo To: Craig Rodrigues Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: "freebsd-xen@freebsd.org" , "xen-users@lists.xen.org" , xen-devel , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 May 2013 22:43:11 -0000 On Tue, May 28, 2013 at 6:05 PM, Craig Rodrigues wrote: > > > > On Tue, May 28, 2013 at 8:21 AM, Outback Dingo wrote: > >> >> >> >> On Fri, May 24, 2013 at 6:27 PM, Craig Rodrigues wrote: >> >>> I wrote this blog post: >>> >>> >>> http://blogs.freebsdish.org/rodrigc/2013/05/24/setting-up-a-vm-for-doing-gsoc-work/ >>> >>> for the steps how to do it. You can follow those steps to get >>> bootstrapped >>> with a working environment if it helps you out. >>> >>> Good luck. >>> >>> >> Any chance this will be backported to 9.X or 9-STABLE at least ?? >> >> > > > I wrote a blog post specifically for installing 10-CURRENT from a snapshot > ISO and getting bootstrapped > from there, to help the Google Summer of Code Student that I am mentoring. > What specifically do you want to be backported to 9-STABLE? > Yes Ive seen the post, however we have a hard requirement for 9-STABLE for some development work we are currently involved in. And I would prefer not to move our current infrastructure for development to CURRENT. A major portion of our development environment is based on XEN for testing and development. Therefor we realize PVHVM is a work in progress, and we have built some VMs from it, they run exceptionally well, However our build environments refuse to build 9-STABLE on CURRENT PVHVM, or 10-CURRENT. Lastly Im sure theres a ton of users who would like to see this in 9.x or 9-STABLE > > > -- > Craig > From owner-freebsd-virtualization@FreeBSD.ORG Tue May 28 23:09:25 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id B9E24DD5; Tue, 28 May 2013 23:09:25 +0000 (UTC) (envelope-from crodr001@gmail.com) Received: from mail-lb0-f177.google.com (mail-lb0-f177.google.com [209.85.217.177]) by mx1.freebsd.org (Postfix) with ESMTP id 0FF55131; Tue, 28 May 2013 23:09:24 +0000 (UTC) Received: by mail-lb0-f177.google.com with SMTP id o10so8366934lbi.36 for ; Tue, 28 May 2013 16:09:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=88+Z2qJJlPt/wKZY7PhNbLLP4DzErOxq3ntBJgkyH9A=; b=REyETal2QS5ViptyhmBsF9f/xnTNVlbKd7sqVY/MFN52/UBiphG5M6WTcH7O/XD0Vn HZtrc2WZqt12xYI9XHNm4BAuncCBB6unquSx+vwtdgvyUFJ3FUhaQkC7qWH9svC5TQO8 R9G8QMy/+RsaOszOeMQrJMLYuFYBaGUfI+0td9qW3bL8mssOBbV/R9DFDyQKXJrGvfii GQI3RIEFeHnn0pBSP50Em1hLkjOxRovjrMs+DW1uRcF3B1lIMwaUuHzOuOshax0NTXRU xz+K/l6TXhgu2ttAhEYShvSlKa8GPT1ffG2D9+gjCAIrWyJO2CZ2gtH2Oe+Tc/1rk7F6 3MAA== MIME-Version: 1.0 X-Received: by 10.112.202.198 with SMTP id kk6mr332939lbc.4.1369782557857; Tue, 28 May 2013 16:09:17 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.13.135 with HTTP; Tue, 28 May 2013 16:09:17 -0700 (PDT) In-Reply-To: References: <519131D8.9010307@citrix.com> <647F6650-AEED-4784-8A45-98324860EE0A@dckd.nl> <519E1A0C.3070609@citrix.com> Date: Tue, 28 May 2013 16:09:17 -0700 X-Google-Sender-Auth: F7wslqn-XWHo_QHDbyFwfcICc2Y Message-ID: Subject: Re: FreeBSD PVHVM call for testing From: Craig Rodrigues To: Outback Dingo Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: "freebsd-xen@freebsd.org" , "xen-users@lists.xen.org" , xen-devel , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 May 2013 23:09:25 -0000 On Tue, May 28, 2013 at 3:43 PM, Outback Dingo wrote: > > I wrote a blog post specifically for installing 10-CURRENT from a snapshot >> ISO and getting bootstrapped >> from there, to help the Google Summer of Code Student that I am mentoring. >> What specifically do you want to be backported to 9-STABLE? >> > > Yes Ive seen the post, however we have a hard requirement for 9-STABLE for > some development work we are > currently involved in. And I would prefer not to move our current > infrastructure for development to CURRENT. > A major portion of our development environment is based on XEN for testing > and development. > Therefor we realize PVHM is a work in progress, and we have built some > VMs from it, they run exceptionally > well, However our build environments refuse to build 9-STABLE on CURRENT > PVHVM, or 10-CURRENT. > Lastly Im sure theres a ton of users who would like to see this in 9.x or > 9-STABLE > > OK, I misunderstood you since you responded in the thread and quoted some of my post. My blog post has nothing relevant to Xen and PVHM, and is specific to setting up a Google Summer of Code student on a 10-CURRENT environment. The FreeBSD Xen and PVHM developers will need to provide the details about their plans to merge their changes to the 9-STABLE branch..... that's something which I am not familiar with. -- Craig From owner-freebsd-virtualization@FreeBSD.ORG Tue May 28 23:20:11 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id D39CC233; Tue, 28 May 2013 23:20:11 +0000 (UTC) (envelope-from outbackdingo@gmail.com) Received: from mail-oa0-f46.google.com (mail-oa0-f46.google.com [209.85.219.46]) by mx1.freebsd.org (Postfix) with ESMTP id 8232D201; Tue, 28 May 2013 23:20:11 +0000 (UTC) Received: by mail-oa0-f46.google.com with SMTP id h2so10837883oag.33 for ; Tue, 28 May 2013 16:20:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=76aqlEgSLgZKQz61HoiLpwcekGgZsWplRIhP5qzYz7c=; b=EOR2PcCf89fw5QtJZ/Q1+yNOK+uNDfyRYOd1pjvmDvUlz5c/pUZzxnSmaAvrl1iFZf 731aJDo1CnCavBRfkOC/Rm1n2zQ6VCXb+dPAGjrIh0GglhtV373MTyBFvvXTFOVDxO3S 7/ReXbe8cPuId4JhYDs4tDV3UTpGjLg3zdntmG7Z7HGJyx5lsPOEOVJ+oKn9BFFS8N8+ 6EaKfFfzyM9nlLc3ZpUm4mi1Jm2pwZrjAmvPaHSX9yt4o7QPBBPSPz5wjBdgAr9iToon iw2v8utXNEfUPbGNMZ2A6RCGo20Dg9yzGYzVO28hdvs58vbBZOOqv6DaT1AC8wdcriXE NG7A== MIME-Version: 1.0 X-Received: by 10.60.102.145 with SMTP id fo17mr35764oeb.76.1369783210747; Tue, 28 May 2013 16:20:10 -0700 (PDT) Received: by 10.76.152.225 with HTTP; Tue, 28 May 2013 16:20:10 -0700 (PDT) In-Reply-To: References: <519131D8.9010307@citrix.com> <647F6650-AEED-4784-8A45-98324860EE0A@dckd.nl> <519E1A0C.3070609@citrix.com> Date: Tue, 28 May 2013 19:20:10 -0400 Message-ID: Subject: Re: FreeBSD PVHVM call for testing From: Outback Dingo To: Craig Rodrigues Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: "freebsd-xen@freebsd.org" , "xen-users@lists.xen.org" , xen-devel , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 May 2013 23:20:11 -0000 On Tue, May 28, 2013 at 7:09 PM, Craig Rodrigues wrote: > > > > On Tue, May 28, 2013 at 3:43 PM, Outback Dingo wrote: > >> >> I wrote a blog post specifically for installing 10-CURRENT from a >>> snapshot ISO and getting bootstrapped >>> from there, to help the Google Summer of Code Student that I am >>> mentoring. >>> What specifically do you want to be backported to 9-STABLE? >>> >> >> Yes Ive seen the post, however we have a hard requirement for 9-STABLE >> for some development work we are >> currently involved in. And I would prefer not to move our current >> infrastructure for development to CURRENT. >> A major portion of our development environment is based on XEN for >> testing and development. >> Therefor we realize PVHM is a work in progress, and we have built some >> VMs from it, they run exceptionally >> well, However our build environments refuse to build 9-STABLE on CURRENT >> PVHVM, or 10-CURRENT. >> Lastly Im sure theres a ton of users who would like to see this in 9.x or >> 9-STABLE >> >> > > OK, I misunderstood you since you responded in the thread and quoted some > of my post. > My blog post has nothing relevant to Xen and PVHM, and is specific to > setting up > a Google Summer of Code student on a 10-CURRENT environment. The FreeBSD > Xen > and PVHM developers will need to provide the details about their plans to > merge their changes to the 9-STABLE branch..... > that's something which I am not familiar with. > If we can get a diff of the work done against the master Id be happy to help backporting and testing > > > -- > Craig > From owner-freebsd-virtualization@FreeBSD.ORG Wed May 29 13:16:12 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 645226F; Wed, 29 May 2013 13:16:12 +0000 (UTC) (envelope-from larrymelia@gmail.com) Received: from mail-pd0-f172.google.com (mail-pd0-f172.google.com [209.85.192.172]) by mx1.freebsd.org (Postfix) with ESMTP id 3C984D4C; Wed, 29 May 2013 13:16:12 +0000 (UTC) Received: by mail-pd0-f172.google.com with SMTP id 10so8915976pdi.3 for ; Wed, 29 May 2013 06:16:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=IbtXjr/31sluB0AbKGYf6Vd04ZWGFbd3REzWgKXlEiI=; b=cUhXdi5laAKgWIf3W802xXcRtIkF/9YiOkP1bxJGnsMXcZL/FVF1UzVUuvmluAJh8i o5Eav9c1//hXjk5QVT0rO5DsYsPFsWWymKfTjfqFTJ6gEyR6/VaOrOP0v6VNP0DfCa0q 3mboFsPvpsVbdFxVECCMHkAzmLrWa52HJLtk6k68psmkBW1jTaNcLrQdF024Msr2A8GN +lD0zIBgqTeUv7rT967JtmLML5OHqD97n9KYEYcq3j+a/A6WnwxmtQS1fq0JwCHb++7A zSw21FzLL5W81VeKokqpVaTZUggzqoad1YiW+fgewlYvYIfMx0W+YhCc35u+DDJikvpL xDUg== X-Received: by 10.66.163.5 with SMTP id ye5mr3372795pab.60.1369833371497; Wed, 29 May 2013 06:16:11 -0700 (PDT) MIME-Version: 1.0 Received: by 10.70.123.200 with HTTP; Wed, 29 May 2013 06:15:31 -0700 (PDT) In-Reply-To: <5176C98B.4050607@FreeBSD.org> References: <5176C98B.4050607@FreeBSD.org> From: Larry Melia Date: Wed, 29 May 2013 06:15:31 -0700 Message-ID: Subject: Re: Proposal for better support of hypervisors and their synthetic drivers at boot-time To: Alexander Motin Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: "Abhishek Gupta \(LIS\)" , KY Srinivasan , freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 May 2013 13:16:12 -0000 Hi Alexander, Thanks for your help. I've been working on getting the dummy driver to load at boot time, but having some issues. After rereading your comments, however, I'm wondering if I'm overriding the correct driver. I've been trying to override the pci-ata driver, but should I be PCI bus driver one level up (pci.c)? I suspect I'm trying to override the wrong driver. On Tue, Apr 23, 2013 at 10:48 AM, Alexander Motin wrote: > On 23.04.2013 17:07, Larry Melia wrote: > >> I=92m on a team of developers working on synthetic device drivers for >> FreeBSD on Hyper-V. In late March, I briefly mentioned (on this list) >> that we're trying to get our drivers included with the FreeBSD >> distribution. Also noted were some necessary patches to the ATA driver. >> The changes are necessary to achieve significant performance gains by >> replacing the native ATA driver with our synthetic storage driver >> when when Hyper-V is detected. Alexander Motin, the maintainer of the >> ATA code-base, however, expressed some concerns about making these >> modifications that are so specific to Hyper-V and the AMD64 build. We >> understand his concerns and have subsequently removed these patches from >> our vendor branch. Our drivers are now completely independent and >> require no changes to the kernel or other drivers. The only touch-point >> is the common makefile for modules/drivers. >> >> Removing our ATA patches, on the other hand, results in a huge >> performance loss. This is because the root file system is managed by the >> ATA driver, which is emulated under Hyper-V. Furthermore, there may be >> other native drivers that we wish to replace with synthetic ones at boot >> time (e.g., mouse driver, video driver), but, there appears to be no >> easy way to do this.Therefore, we would like to work with the developer >> community to come up with better solution that would improve support for >> synthetic drivers at boot-time. >> >> One possible solution: >> >> (1) Move the call to init_param1() (in sys/kern/subr_parm.c), which is >> used for hypervisor detection, to an earlier point in the boot process. >> Presently, it appears to be called after the ATA driver is selected, >> which is too late in the boot process. (This was discovered after some >> testing with the ATA driver.) Therefore, before the bus drivers and >> native controllers are detected and selected, discovery of a host >> hypervisor should be done first. >> >> (2) Extend the boot process to dynamically insert and prioritize >> synthetic drivers over native ones. Presently, FreeBSD supports the >> selection of generic drivers for a given device, but these can be >> overridden when a more specific driver is available. This priority >> scheme could be extended by first detecting the presence of a >> hypervisor, then allowing this priority mechanism to override the native >> drivers with their synthetic cousins (i.e., we only want to override a >> native driver when a specific hypervisor is detected and synthetic >> drivers for it have been configured). This could be arranged in a >> separate, table-driven, input file or perhaps, by extending the existing >> driver/module configuration file with additional mappings of native to >> synthetic drivers. >> >> (3) Upgrade the init_param1() function (in sys/kern/subr_parm.c) to use >> the more recent approach to hypervisor detection. This approach uses the >> CPU-identify functions to retrieve a unique signature consisting of a >> fixed string of ASCII characters. This was done on Linux about five >> years. For backward compatibility, however, the existing logic would be >> retained, but augmented with this new approach. It would also be >> conditionally added only for x86/AMD64 builds. >> >> When reviewing the changes we're not looking at a lot of lines of >> code.The difficultly lies, however, in where the changes are made. >> Obviously, we need to work closely with the committers responsible for >> the kernel modules we're looking to touch. Retrospectively, these >> upgrades only bring FreeBSD up to the same level of hypervisor support >> already present in Linux.There are other issues that we would also like >> to discuss, but the improvements described here are on the top of the >> list. >> >> We look forward to working more closely with the FreeBSD community and >> welcome your remarks and feedback on this proposal. >> > > I am sorry, I don't really understand what is your proposition, so I just > describe my vision of the solution here, hoping it will be useful. > > You are right that FreeBSD has priority mechanism to select best driver > for each device. That mechanism should be sufficient to prevent default O= S > driver from attaching to emulated ATA controller when Hyper-V environment > is detected and paravirtual drivers are installed. To do that you should > just create a very small dummy driver for PCI bus, implementing single > probe() method. That probe() method should in your preferable way check > that Hyper-V environment is active and match PCI ID of the device against > the list of used by Hyper-V for emulated ATA controller. If both conditio= ns > match, the probe() method should return highest priority value to overrid= e > any other ATA driver in system for this specific device. After that the > dummy driver should just have empty attach() and detach() routines, not > doing anything with the emulated device, relying on paravitrual driver to > handle the disks. > > Since the dummy driver can be made machine-dependent, you may use there > any VM detection mechanisms you like, even direct MSR access. Dummy drive= r > can be made completely independent from the rest of the system, so it can > even be loaded as kernel module without requiring any base system > modifications. If you still prefer it for some reason (for example to not > do some complicated checks multiple times in multiple drivers), you may > move Hyper-V detection logic out of that driver to some single place in > base system. But you don't need to touch OS-native ATA driver in any way. > > -- > Alexander Motin > From owner-freebsd-virtualization@FreeBSD.ORG Wed May 29 17:03:50 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id A71A046B; Wed, 29 May 2013 17:03:50 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.eu.citrix.com [46.33.159.39]) by mx1.freebsd.org (Postfix) with ESMTP id EF79F9F8; Wed, 29 May 2013 17:03:49 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.87,765,1363132800"; d="scan'208";a="5104336" Received: from lonpex01cl01.citrite.net ([10.30.203.101]) by LONPIPO01.EU.CITRIX.COM with ESMTP/TLS/AES128-SHA; 29 May 2013 17:03:42 +0000 Received: from [192.168.1.30] (10.30.203.1) by LONPEX01CL01.citrite.net (10.30.203.101) with Microsoft SMTP Server id 14.2.342.3; Wed, 29 May 2013 18:03:41 +0100 Message-ID: <51A634EC.7050805@citrix.com> Date: Wed, 29 May 2013 19:03:40 +0200 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130509 Thunderbird/17.0.6 MIME-Version: 1.0 To: Colin Percival Subject: Re: [Xen-devel] FreeBSD PVHVM call for testing References: <51957D42.9060801@citrix.com> <51959ED9.6040405@freebsd.org> <51974EC9.9030204@citrix.com> <5197A1EA.2040404@freebsd.org> <519CAFC7.1070908@citrix.com> <519D24A9.3050407@freebsd.org> <519DDC0A.9000201@citrix.com> <519E6958.6020606@freebsd.org> <519F3CD0.5090405@citrix.com> <51A4D804.9050208@citrix.com> <20130528191855.GA13736@u109add4315675089e695.ant.amazon.com> <51A5229F.80205@freebsd.org> In-Reply-To: <51A5229F.80205@freebsd.org> Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit X-Originating-IP: [10.30.203.1] Cc: "freebsd-xen@freebsd.org" , xen-devel , "freebsd-virtualization@freebsd.org" , Matt Wilson , "xen-users@lists.xen.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 May 2013 17:03:50 -0000 On 28/05/13 23:33, Colin Percival wrote: > On 05/28/13 12:18, Matt Wilson wrote: >> VCPUOP_set_singleshot_timer returns -EINVAL when: >> >> 1) the specified vCPU ID is out of range (<0 or >MAX_VIRT_CPUS) >> 2) the specified vCPU ID doesn't match the running vCPU. >> >> It seems that there is a confusion between the logical vCPU ID and the >> local APIC physical ID. >> [...] >> (XEN) Domain 1 (vcpu#16) VCPUOP_set_singleshot_timer specified vcpuid 1 >> [...] >> APIC: CPU 1 has ACPI ID 16 > > Thanks Matt! Looks like we need to pass our acpi_id to the Xen hypercall > instead of our cpuid. > > Roger, changing the line > int cpu = PCPU_GET(cpuid); > to > int cpu = PCPU_GET(acpi_id); > in xentimer_et_start and xentimer_et_stop fixes this panic and gets me > slightly further; the following lines are now added to the console output > prior to the system appearing to hang: >> ioapic0: routing intpin 1 (ISA IRQ 1) to lapic 1 vector 48 >> ioapic0: routing intpin 4 (ISA IRQ 4) to lapic 2 vector 48 >> ioapic0: routing intpin 9 (ISA IRQ 9) to lapic 3 vector 48 >> ioapic0: routing intpin 12 (ISA IRQ 12) to lapic 4 vector 48 >> ioapic0: routing intpin 14 (ISA IRQ 14) to lapic 5 vector 48 >> ioapic0: routing intpin 15 (ISA IRQ 15) to lapic 6 vector 48 >> ioapic0: routing intpin 28 (PCI IRQ 28) to lapic 7 vector 48 >> TSC timecounter discards lower 1 bit(s) >> Timecounter "TSC-low" frequency 1300024860 Hz quality -100 >> WARNING: WITNESS option enabled, expect reduced performance. Hello, Thanks Matt and Colin for the testing and help! I've pushed yet another version, now it's branch pvhvm_v12, which I *think* should solve the issues with cpuid != acpi_id: http://xenbits.xen.org/gitweb/?p=people/royger/freebsd.git;a=shortlog;h=refs/heads/pvhvm_v12 Since I'm not able to reproduce the cpuid != acpi_id case, could you give it a try and report the results? > On a cc2.8xlarge EC2 instance, the lines which come after this are >> GEOM: new disk xbd1 >> GEOM: new disk xbd2 >> GEOM: new disk xbd3 >> GEOM: new disk xbd4 >> Trying to mount root from ufs:/dev/ad0a [rw]... >> start_init: trying /sbin/init > and then the userland boot process; have you made any bug fixes after > your pvhvm_v7 which would explain why tasting disks was hanging? I'm not sure I follow, did you found a regression from previous branches? i.e. it used to work with branch pvhvm_v6 and not pvhvm_v7? From owner-freebsd-virtualization@FreeBSD.ORG Wed May 29 17:07:48 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 90F4F62D; Wed, 29 May 2013 17:07:48 +0000 (UTC) (envelope-from gibbs@scsiguy.com) Received: from aslan.scsiguy.com (ns1.scsiguy.com [70.89.174.89]) by mx1.freebsd.org (Postfix) with ESMTP id 9FE2BA23; Wed, 29 May 2013 17:07:47 +0000 (UTC) Received: from [192.168.6.146] (207-225-98-3.dia.static.qwest.net [207.225.98.3]) (authenticated bits=0) by aslan.scsiguy.com (8.14.7/8.14.5) with ESMTP id r4TH7INa052503 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Wed, 29 May 2013 17:07:20 GMT (envelope-from gibbs@scsiguy.com) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 6.3 \(1503\)) Subject: Re: FreeBSD PVHVM call for testing From: "Justin T. Gibbs" In-Reply-To: Date: Wed, 29 May 2013 11:07:13 -0600 Content-Transfer-Encoding: quoted-printable Message-Id: References: <519131D8.9010307@citrix.com> <647F6650-AEED-4784-8A45-98324860EE0A@dckd.nl> <519E1A0C.3070609@citrix.com> To: Outback Dingo X-Mailer: Apple Mail (2.1503) X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (aslan.scsiguy.com [70.89.174.89]); Wed, 29 May 2013 17:07:22 +0000 (UTC) Cc: "xen-users@lists.xen.org" , xen-devel , "freebsd-virtualization@freebsd.org" , "freebsd-xen@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 May 2013 17:07:48 -0000 On May 28, 2013, at 5:20 PM, Outback Dingo = wrote: > On Tue, May 28, 2013 at 7:09 PM, Craig Rodrigues = wrote: >=20 >> On Tue, May 28, 2013 at 3:43 PM, Outback Dingo = wrote: >>=20 >>>=20 >>> I wrote a blog post specifically for installing 10-CURRENT from a >>>> snapshot ISO and getting bootstrapped >>>> from there, to help the Google Summer of Code Student that I am >>>> mentoring. >>>> What specifically do you want to be backported to 9-STABLE? >>>>=20 >>>=20 >>> Yes Ive seen the post, however we have a hard requirement for = 9-STABLE >>> for some development work we are >>> currently involved in. And I would prefer not to move our current >>> infrastructure for development to CURRENT. >>> A major portion of our development environment is based on XEN for >>> testing and development. >>> Therefor we realize PVHM is a work in progress, and we have built = some >>> VMs from it, they run exceptionally >>> well, However our build environments refuse to build 9-STABLE on = CURRENT >>> PVHVM, or 10-CURRENT. >>> Lastly Im sure theres a ton of users who would like to see this in = 9.x or >>> 9-STABLE >>>=20 >>>=20 >>=20 >> OK, I misunderstood you since you responded in the thread and quoted = some >> of my post. >> My blog post has nothing relevant to Xen and PVHM, and is specific to >> setting up >> a Google Summer of Code student on a 10-CURRENT environment. The = FreeBSD >> Xen >> and PVHM developers will need to provide the details about their = plans to >> merge their changes to the 9-STABLE branch..... >> that's something which I am not familiar with. >>=20 >=20 > If we can get a diff of the work done against the master Id be happy = to > help backporting and testing I plan to backport the work once we have it all in -current. -- Justin= From owner-freebsd-virtualization@FreeBSD.ORG Wed May 29 17:22:30 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id F1A5C7C1; Wed, 29 May 2013 17:22:29 +0000 (UTC) (envelope-from prvs=854e4d353=msw@amazon.com) Received: from smtp-fw-2101.amazon.com (smtp-fw-2101.amazon.com [72.21.196.25]) by mx1.freebsd.org (Postfix) with ESMTP id 7E7A4ABB; Wed, 29 May 2013 17:22:29 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amazon.com; i=msw@amazon.com; q=dns/txt; s=amazon201209; t=1369848149; x=1401384149; h=date:from:to:cc:subject:message-id:references: mime-version:content-transfer-encoding:in-reply-to; bh=EtD99msgmr/hICSmuSUv9+Q5jjpgnXxuR0eMMuvNfa8=; b=Ukk9jb0Gu5iJC4WQp6QLBsFY+X71oE/QJ1O5SaLjMcFCArciORC8zfQh ImvG5+mfqrH3td7wEQFc4+DjL+Gds1w+53gxFjxjr6IqH/Pe+3QB9/TEl 9VDZta/hbOf1PJQlkDK2zMciHInGiD8DEa/bSmoE3cfonhndL0UQLRQmv w=; X-IronPort-AV: E=Sophos;i="4.87,765,1363132800"; d="scan'208";a="568401090" Received: from smtp-in-1101.vdc.amazon.com ([10.146.54.37]) by smtp-border-fw-out-2101.iad2.amazon.com with ESMTP/TLS/DHE-RSA-AES256-SHA; 29 May 2013 17:22:27 +0000 Received: from ex10-hub-9003.ant.amazon.com (ex10-hub-9003.ant.amazon.com [10.185.137.132]) by smtp-in-1101.vdc.amazon.com (8.13.8/8.13.8) with ESMTP id r4THMOUl029000 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=OK); Wed, 29 May 2013 17:22:27 GMT Received: from u109add4315675089e695.ant.amazon.com (10.184.8.86) by ex10-hub-9003.ant.amazon.com (10.185.137.132) with Microsoft SMTP Server id 14.2.247.3; Wed, 29 May 2013 10:22:03 -0700 Received: by u109add4315675089e695.ant.amazon.com (sSMTP sendmail emulation); Wed, 29 May 2013 10:22:03 -0700 Date: Wed, 29 May 2013 10:22:03 -0700 From: Matt Wilson To: Roger Pau =?iso-8859-1?Q?Monn=E9?= Subject: Re: [Xen-devel] FreeBSD PVHVM call for testing Message-ID: <20130529172201.GA20973@u109add4315675089e695.ant.amazon.com> References: <5197A1EA.2040404@freebsd.org> <519CAFC7.1070908@citrix.com> <519D24A9.3050407@freebsd.org> <519DDC0A.9000201@citrix.com> <519E6958.6020606@freebsd.org> <519F3CD0.5090405@citrix.com> <51A4D804.9050208@citrix.com> <20130528191855.GA13736@u109add4315675089e695.ant.amazon.com> <51A5229F.80205@freebsd.org> <51A634EC.7050805@citrix.com> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <51A634EC.7050805@citrix.com> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: "freebsd-xen@freebsd.org" , "xen-users@lists.xen.org" , "freebsd-virtualization@freebsd.org" , Colin Percival , xen-devel X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 May 2013 17:22:30 -0000 On Wed, May 29, 2013 at 07:03:40PM +0200, Roger Pau Monné wrote: > > Hello, > > Thanks Matt and Colin for the testing and help! I've pushed yet another > version, now it's branch pvhvm_v12, which I *think* should solve the > issues with cpuid != acpi_id: > > http://xenbits.xen.org/gitweb/?p=people/royger/freebsd.git;a=shortlog;h=refs/heads/pvhvm_v12 > > Since I'm not able to reproduce the cpuid != acpi_id case, could you > give it a try and report the results? Colin, can you build an AMI with this new kernel? [...] > On 28/05/13 23:33, Colin Percival wrote: > > On a cc2.8xlarge EC2 instance, the lines which come after this are > >> GEOM: new disk xbd1 > >> GEOM: new disk xbd2 > >> GEOM: new disk xbd3 > >> GEOM: new disk xbd4 > >> Trying to mount root from ufs:/dev/ad0a [rw]... > >> start_init: trying /sbin/init > > and then the userland boot process; have you made any bug fixes after > > your pvhvm_v7 which would explain why tasting disks was hanging? > > I'm not sure I follow, did you found a regression from previous > branches? i.e. it used to work with branch pvhvm_v6 and not pvhvm_v7? Colin was saying that his local change only moved the boot process a bit farther for cr1.8xlarge. Perhaps some of the other changes you made in the latest pvhvm_v12 branch will get the VM all the way up. --msw From owner-freebsd-virtualization@FreeBSD.ORG Wed May 29 17:45:34 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id F1524E8F; Wed, 29 May 2013 17:45:33 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.eu.citrix.com [46.33.159.39]) by mx1.freebsd.org (Postfix) with ESMTP id 468F8C01; Wed, 29 May 2013 17:45:32 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.87,765,1363132800"; d="scan'208";a="5105590" Received: from lonpex01cl03.citrite.net ([10.30.203.103]) by LONPIPO01.EU.CITRIX.COM with ESMTP/TLS/AES128-SHA; 29 May 2013 17:45:25 +0000 Received: from [192.168.1.30] (10.30.203.1) by LONPEX01CL03.citrite.net (10.30.203.103) with Microsoft SMTP Server id 14.2.342.3; Wed, 29 May 2013 18:45:23 +0100 Message-ID: <51A63EB3.5090007@citrix.com> Date: Wed, 29 May 2013 19:45:23 +0200 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130509 Thunderbird/17.0.6 MIME-Version: 1.0 To: Matt Wilson Subject: Re: [Xen-devel] FreeBSD PVHVM call for testing References: <5197A1EA.2040404@freebsd.org> <519CAFC7.1070908@citrix.com> <519D24A9.3050407@freebsd.org> <519DDC0A.9000201@citrix.com> <519E6958.6020606@freebsd.org> <519F3CD0.5090405@citrix.com> <51A4D804.9050208@citrix.com> <20130528191855.GA13736@u109add4315675089e695.ant.amazon.com> <51A5229F.80205@freebsd.org> <51A634EC.7050805@citrix.com> <20130529172201.GA20973@u109add4315675089e695.ant.amazon.com> In-Reply-To: <20130529172201.GA20973@u109add4315675089e695.ant.amazon.com> Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 8bit X-Originating-IP: [10.30.203.1] Cc: "freebsd-xen@freebsd.org" , "xen-users@lists.xen.org" , "freebsd-virtualization@freebsd.org" , Colin Percival , xen-devel X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 May 2013 17:45:34 -0000 On 29/05/13 19:22, Matt Wilson wrote: > On Wed, May 29, 2013 at 07:03:40PM +0200, Roger Pau Monné wrote: >> >> Hello, >> >> Thanks Matt and Colin for the testing and help! I've pushed yet another >> version, now it's branch pvhvm_v12, which I *think* should solve the >> issues with cpuid != acpi_id: >> >> http://xenbits.xen.org/gitweb/?p=people/royger/freebsd.git;a=shortlog;h=refs/heads/pvhvm_v12 >> >> Since I'm not able to reproduce the cpuid != acpi_id case, could you >> give it a try and report the results? > > Colin, can you build an AMI with this new kernel? > > [...] > >> On 28/05/13 23:33, Colin Percival wrote: >>> On a cc2.8xlarge EC2 instance, the lines which come after this are >>>> GEOM: new disk xbd1 >>>> GEOM: new disk xbd2 >>>> GEOM: new disk xbd3 >>>> GEOM: new disk xbd4 >>>> Trying to mount root from ufs:/dev/ad0a [rw]... >>>> start_init: trying /sbin/init >>> and then the userland boot process; have you made any bug fixes after >>> your pvhvm_v7 which would explain why tasting disks was hanging? >> >> I'm not sure I follow, did you found a regression from previous >> branches? i.e. it used to work with branch pvhvm_v6 and not pvhvm_v7? > > Colin was saying that his local change only moved the boot process a > bit farther for cr1.8xlarge. Perhaps some of the other changes you > made in the latest pvhvm_v12 branch will get the VM all the way up. Oh, sure, more changes where needed in order to get it to work, like using acpi_id to map the vcpu_info and perform the cpu bindings. From owner-freebsd-virtualization@FreeBSD.ORG Wed May 29 20:59:44 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id D6ACDC65 for ; Wed, 29 May 2013 20:59:44 +0000 (UTC) (envelope-from bounces+73574-9b34-freebsd-virtualization=freebsd.org@sendgrid.me) Received: from o3.shared.sendgrid.net (o3.shared.sendgrid.net [208.117.48.85]) by mx1.freebsd.org (Postfix) with SMTP id 6B62F918 for ; Wed, 29 May 2013 20:59:42 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=sendgrid.info; h=from :mime-version:to:cc:subject:references:in-reply-to:content-type :content-transfer-encoding; s=smtpapi; bh=CO65JV4e5UB5JIGKX9Y3Ul WcJ/s=; b=sbFIOE3RfM/e4zIzqC47515Yk5hskaEPjX5tcBEGVy+oCRrlqXspGT zlPt2gPTMh69MgwnT6wUX9J27TIPV9HByBbD96BzDTV/66GnV1pHIVyv7GZq/h9H GzypdtMiXmxiuLSv7Ckt0QZVfITNewxMph1T5KeSm+ypTEoROi0eg= Received: by 10.37.85.72 with SMTP id mf94.524.51A66C3E4 Wed, 29 May 2013 20:59:42 +0000 (UTC) Received: from mail.tarsnap.com (unknown [10.60.208.13]) by mi19 (SG) with ESMTP id 13ef216d2ec.482a.e213e7 for ; Wed, 29 May 2013 15:59:42 -0500 (CST) Received: (qmail 33091 invoked from network); 29 May 2013 20:59:41 -0000 Received: from unknown (HELO clamshell.daemonology.net) (127.0.0.1) by ec2-107-20-205-189.compute-1.amazonaws.com with ESMTP; 29 May 2013 20:59:41 -0000 Received: (qmail 82717 invoked from network); 29 May 2013 20:58:59 -0000 Received: from unknown (HELO clamshell.daemonology.net) (127.0.0.1) by clamshell.daemonology.net with SMTP; 29 May 2013 20:58:59 -0000 Message-ID: <51A66C13.7060203@freebsd.org> Date: Wed, 29 May 2013 13:58:59 -0700 From: Colin Percival User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130406 Thunderbird/17.0.5 MIME-Version: 1.0 To: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= , Matt Wilson Subject: Re: [Xen-devel] FreeBSD PVHVM call for testing References: <5197A1EA.2040404@freebsd.org> <519CAFC7.1070908@citrix.com> <519D24A9.3050407@freebsd.org> <519DDC0A.9000201@citrix.com> <519E6958.6020606@freebsd.org> <519F3CD0.5090405@citrix.com> <51A4D804.9050208@citrix.com> <20130528191855.GA13736@u109add4315675089e695.ant.amazon.com> <51A5229F.80205@freebsd.org> <51A634EC.7050805@citrix.com> <20130529172201.GA20973@u109add4315675089e695.ant.amazon.com> <51A63EB3.5090007@citrix.com> In-Reply-To: <51A63EB3.5090007@citrix.com> X-Enigmail-Version: 1.5.1 Content-Type: text/plain; charset=ISO-8859-1 content-transfer-encoding: quoted-printable X-SG-EID: 5BcF9P+ypITprUjXJktHhsiUBkkeW691hQUndAFAEhADTHpMuO2yZVPB1LkeEe7r4wenkLPXeITS7lZA0/PHl1QWFJoKR/gQ7Ic61uk6uvQLimEKQ+AQsgg3TFLPn2Eb4AyUOdgreEa8Rka1xTM0KQ== Cc: "freebsd-xen@freebsd.org" , "xen-users@lists.xen.org" , "freebsd-virtualization@freebsd.org" , xen-devel X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 May 2013 20:59:44 -0000 On 05/29/13 10:45, Roger Pau Monn=E9 wrote:=0D > Oh, sure, more changes where needed in order to get it to work, like=0D > using acpi_id to map the vcpu_info and perform the cpu bindings.=0D =0D Ah, that explains it. I looked at timer.c for other places where that=0D change was needed but it didn't occur to me that the same problem would=0D exist in other parts of the tree.=0D =0D > On 29/05/13 19:22, Matt Wilson wrote:=0D >> On Wed, May 29, 2013 at 07:03:40PM +0200, Roger Pau Monn=E9 wrote:=0D >>> http://xenbits.xen.org/gitweb/?p=3Dpeople/royger/freebsd.git;a=3Dshortl= og;h=3Drefs/heads/pvhvm_v12=0D >>=0D >> Colin, can you build an AMI with this new kernel?=0D =0D Done, ami-95177dfc in us-east-1.=0D =0D This is now booting successfully on cr1.8xlarge; are there any other instan= ce=0D types I should test? I don't know which Xen versions you have deployed acr= oss=0D the entire fleet.=0D =0D -- =0D Colin Percival=0D Security Officer Emeritus, FreeBSD | The power to serve=0D Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid= =0D From owner-freebsd-virtualization@FreeBSD.ORG Wed May 29 22:19:39 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 3C3B56F1; Wed, 29 May 2013 22:19:39 +0000 (UTC) (envelope-from prvs=854e4d353=msw@amazon.com) Received: from smtp-fw-2101.amazon.com (smtp-fw-2101.amazon.com [72.21.196.25]) by mx1.freebsd.org (Postfix) with ESMTP id CADB2BF5; Wed, 29 May 2013 22:19:38 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amazon.com; i=msw@amazon.com; q=dns/txt; s=amazon201209; t=1369865979; x=1401401979; h=date:from:to:cc:subject:message-id:references: mime-version:in-reply-to; bh=XGVOenp68XzTGWakqk7DQ0mhpSM/HhxUccS9pC4m3P0=; b=kv7nW3UsC2oNF/cxbnkgqdjtmjSbyUD1sHSke+Eofi1t1iWGAhuEc3FD OpcME5H3ABeR4Oq55jRDSWeQlfWC6mQ+6ZuaeIczP3CF2S5t2dpMx7qmJ G3naK5b4hwZ5KDLmaeZ2y0JHCum3eebV15Z4dB+xoe0uo6Uik8gGkvfAE 0=; X-IronPort-AV: E=Sophos;i="4.87,766,1363132800"; d="scan'208";a="568497162" Received: from smtp-in-6001.iad6.amazon.com ([10.195.76.178]) by smtp-border-fw-out-2101.iad2.amazon.com with ESMTP/TLS/DHE-RSA-AES256-SHA; 29 May 2013 22:19:32 +0000 Received: from ex10-hub-31005.ant.amazon.com (ex10-hub-31005.sea31.amazon.com [10.185.176.12]) by smtp-in-6001.iad6.amazon.com (8.13.8/8.13.8) with ESMTP id r4TMJVTH021659 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=OK); Wed, 29 May 2013 22:19:32 GMT Received: from u109add4315675089e695.ant.amazon.com (10.184.8.82) by ex10-hub-31005.ant.amazon.com (10.185.176.12) with Microsoft SMTP Server id 14.2.247.3; Wed, 29 May 2013 15:19:22 -0700 Received: by u109add4315675089e695.ant.amazon.com (sSMTP sendmail emulation); Wed, 29 May 2013 15:19:22 -0700 Date: Wed, 29 May 2013 15:19:22 -0700 From: Matt Wilson To: Colin Percival Subject: Re: [Xen-devel] FreeBSD PVHVM call for testing Message-ID: <20130529221920.GC20973@u109add4315675089e695.ant.amazon.com> References: <519DDC0A.9000201@citrix.com> <519E6958.6020606@freebsd.org> <519F3CD0.5090405@citrix.com> <51A4D804.9050208@citrix.com> <20130528191855.GA13736@u109add4315675089e695.ant.amazon.com> <51A5229F.80205@freebsd.org> <51A634EC.7050805@citrix.com> <20130529172201.GA20973@u109add4315675089e695.ant.amazon.com> <51A63EB3.5090007@citrix.com> <51A66C13.7060203@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: <51A66C13.7060203@freebsd.org> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: "freebsd-xen@freebsd.org" , "xen-users@lists.xen.org" , xen-devel , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 May 2013 22:19:39 -0000 On Wed, May 29, 2013 at 01:58:59PM -0700, Colin Percival wrote: > On 29/05/13 19:22, Matt Wilson wrote: > > Colin, can you build an AMI with this new kernel? > > Done, ami-95177dfc in us-east-1. > > This is now booting successfully on cr1.8xlarge; are there any other instance > types I should test? I don't know which Xen versions you have deployed across > the entire fleet. Nice! The other interesting instance types for problems like this are cc1.4xlarge, cg1.4xlarge and cc2.8xlarge. --msw From owner-freebsd-virtualization@FreeBSD.ORG Thu May 30 01:11:28 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 069C15FE for ; Thu, 30 May 2013 01:11:28 +0000 (UTC) (envelope-from bounces+73574-9b34-freebsd-virtualization=freebsd.org@sendgrid.me) Received: from o3.shared.sendgrid.net (o3.shared.sendgrid.net [208.117.48.85]) by mx1.freebsd.org (Postfix) with SMTP id 9048795E for ; Thu, 30 May 2013 01:11:27 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=sendgrid.info; h=from :mime-version:to:cc:subject:references:in-reply-to:content-type :content-transfer-encoding; s=smtpapi; bh=ey/PxumD4JidgGLj3YWl3A lHxJU=; b=hJTpqHDEwwNzH1At4M1PM0C4wJB4LUH3/GKnDabKaZ63WquZ28FgqG N/ZaUDb5oAFc8owurMTMO8TTu7wREll7Z9YaXSm9XO3eEbI0MCpTnFT8BdZ6eydA 5ocL/+fUETfGQ4SmaT/0JDh+jJk1dbWCqJGQVoz7PKoxXcN+XM+rk= Received: by 10.16.240.28 with SMTP id mf104.14550.51A6A73E6 Thu, 30 May 2013 01:11:26 +0000 (UTC) Received: from mail.tarsnap.com (unknown [10.60.208.13]) by mi3 (SG) with ESMTP id 13ef2fd4c59.48ef.d52bcf for ; Wed, 29 May 2013 20:11:26 -0500 (CST) Received: (qmail 40951 invoked from network); 30 May 2013 01:11:25 -0000 Received: from unknown (HELO clamshell.daemonology.net) (127.0.0.1) by ec2-107-20-205-189.compute-1.amazonaws.com with ESMTP; 30 May 2013 01:11:25 -0000 Received: (qmail 84449 invoked from network); 30 May 2013 01:10:43 -0000 Received: from unknown (HELO clamshell.daemonology.net) (127.0.0.1) by clamshell.daemonology.net with SMTP; 30 May 2013 01:10:43 -0000 Message-ID: <51A6A712.6070401@freebsd.org> Date: Wed, 29 May 2013 18:10:42 -0700 From: Colin Percival User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130406 Thunderbird/17.0.5 MIME-Version: 1.0 To: Matt Wilson Subject: Re: [Xen-devel] FreeBSD PVHVM call for testing References: <519DDC0A.9000201@citrix.com> <519E6958.6020606@freebsd.org> <519F3CD0.5090405@citrix.com> <51A4D804.9050208@citrix.com> <20130528191855.GA13736@u109add4315675089e695.ant.amazon.com> <51A5229F.80205@freebsd.org> <51A634EC.7050805@citrix.com> <20130529172201.GA20973@u109add4315675089e695.ant.amazon.com> <51A63EB3.5090007@citrix.com> <51A66C13.7060203@freebsd.org> <20130529221920.GC20973@u109add4315675089e695.ant.amazon.com> In-Reply-To: <20130529221920.GC20973@u109add4315675089e695.ant.amazon.com> X-Enigmail-Version: 1.5.1 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-SG-EID: 5BcF9P+ypITprUjXJktHhsiUBkkeW691hQUndAFAEhADTHpMuO2yZVPB1LkeEe7rxtusbdhqLL2fbgBg0Li4pOYLt5cFL3ldtJ4dgsB/KWmJauMqZTetY9vopuSHVbqjEJhSXNfl75OXeGOks7YXcA== Cc: "freebsd-xen@freebsd.org" , "xen-users@lists.xen.org" , xen-devel , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 May 2013 01:11:28 -0000 On 05/29/13 15:19, Matt Wilson wrote: > On Wed, May 29, 2013 at 01:58:59PM -0700, Colin Percival wrote: >> On 29/05/13 19:22, Matt Wilson wrote: >>> Colin, can you build an AMI with this new kernel? >> >> Done, ami-95177dfc in us-east-1. >> >> This is now booting successfully on cr1.8xlarge; are there any other instance >> types I should test? I don't know which Xen versions you have deployed across >> the entire fleet. > > Nice! The other interesting instance types for problems like this are > cc1.4xlarge, cg1.4xlarge and cc2.8xlarge. I've tried on all three of those and everything seems good -- but I'm only seeing Xen 3.4 on those instance types, so we're not really testing anything interesting there. I'll resist asking whether there will be Xen 4.x anywhere else in EC2 in the near future since I've had enough of a taste of Amazon NDAs to know that I almost certainly wouldn't get an answer... ;-) -- Colin Percival Security Officer Emeritus, FreeBSD | The power to serve Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid From owner-freebsd-virtualization@FreeBSD.ORG Thu May 30 08:51:03 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 3E83DF2B; Thu, 30 May 2013 08:51:03 +0000 (UTC) (envelope-from jeroen@dckd.nl) Received: from positron.dckd.nl (positron.dckd.nl [94.142.246.99]) by mx1.freebsd.org (Postfix) with ESMTP id 0612CC22; Thu, 30 May 2013 08:51:02 +0000 (UTC) Received: from nb-vdham.science.uva.nl (nb-vdham.science.uva.nl [146.50.52.179]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by positron.dckd.nl (Postfix) with ESMTPSA id DA968F8062; Thu, 30 May 2013 10:50:54 +0200 (CEST) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 6.3 \(1503\)) Subject: Re: FreeBSD PVHVM call for testing From: Jeroen van der Ham In-Reply-To: <519E54DE.5090304@citrix.com> Date: Thu, 30 May 2013 10:50:53 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <6B8B9354-AF52-4081-B67B-04565D1BCE99@dckd.nl> References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> To: =?iso-8859-1?Q?Roger_Pau_Monn=E9?= X-Mailer: Apple Mail (2.1503) Cc: "freebsd-xen@freebsd.org" , xen-devel , "freebsd-virtualization@freebsd.org" , "xen-users@lists.xen.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 May 2013 08:51:03 -0000 Hi, On 23 May 2013, at 19:41, Roger Pau Monn=E9 = wrote: > Hello, >=20 > I've pushed a new branch, pvhvm_v10 that contains a PV IPI > implementation for both amd64 and i386. I've also updated the wiki to > point to the pvhvm_v10 branch: I've been running a VM with this kernel for about a week now. It ran = fine, until about 3:30 in the morning. The only thing I can see is the = following cryptic messages in /var/log/messages, followed by a reboot of = the system. May 29 23:42:30 image01 sshd[31227]: error: Received disconnect from = 150.165.15.175: 11: Bye Bye [preauth] May 30 03:30:57 image01 kernel: . May 30 03:30:57 image01 ntpd[4436]: ntpd exiting on signal 15 May 30 03:30:57 image01 kernel: . May 30 03:30:58 image01 kernel: . May 30 03:31:00 image01 syslogd: exiting on signal 15 May 30 03:32:52 image01 syslogd: kernel boot file is /boot/kernel/kernel May 30 03:32:52 image01 kernel: Copyright (c) 1992-2013 The FreeBSD = Project. May 30 03:32:52 image01 kernel: Copyright (c) 1979, 1980, 1983, 1986, = 1988, 1989, 1991, 1992, 1993, 1994 May 30 03:32:52 image01 kernel: The Regents of the University of = California. All rights reserved. May 30 03:32:52 image01 kernel: FreeBSD is a registered trademark of The = FreeBSD Foundation. I'm happy to help to gather more information, just tell me what you = need. Jeroen. From owner-freebsd-virtualization@FreeBSD.ORG Thu May 30 09:04:26 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 2A646199; Thu, 30 May 2013 09:04:26 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.eu.citrix.com [46.33.159.39]) by mx1.freebsd.org (Postfix) with ESMTP id 986CFCEA; Thu, 30 May 2013 09:04:25 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.87,769,1363132800"; d="scan'208";a="5126445" Received: from lonpex01cl02.citrite.net ([10.30.203.102]) by LONPIPO01.EU.CITRIX.COM with ESMTP/TLS/AES128-SHA; 30 May 2013 09:04:23 +0000 Received: from [192.168.1.30] (10.30.203.1) by LONPEX01CL02.citrite.net (10.30.203.102) with Microsoft SMTP Server id 14.2.342.3; Thu, 30 May 2013 10:04:23 +0100 Message-ID: <51A71616.4060508@citrix.com> Date: Thu, 30 May 2013 11:04:22 +0200 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130509 Thunderbird/17.0.6 MIME-Version: 1.0 To: Jeroen van der Ham Subject: Re: FreeBSD PVHVM call for testing References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <6B8B9354-AF52-4081-B67B-04565D1BCE99@dckd.nl> In-Reply-To: <6B8B9354-AF52-4081-B67B-04565D1BCE99@dckd.nl> Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 8bit X-Originating-IP: [10.30.203.1] Cc: "freebsd-xen@freebsd.org" , xen-devel , "freebsd-virtualization@freebsd.org" , "xen-users@lists.xen.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 May 2013 09:04:26 -0000 On 30/05/13 10:50, Jeroen van der Ham wrote: > Hi, > > On 23 May 2013, at 19:41, Roger Pau Monné wrote: > >> Hello, >> >> I've pushed a new branch, pvhvm_v10 that contains a PV IPI >> implementation for both amd64 and i386. I've also updated the wiki to >> point to the pvhvm_v10 branch: > > I've been running a VM with this kernel for about a week now. It ran fine, until about 3:30 in the morning. The only thing I can see is the following cryptic messages in /var/log/messages, followed by a reboot of the system. > > May 29 23:42:30 image01 sshd[31227]: error: Received disconnect from 150.165.15.175: 11: Bye Bye [preauth] > May 30 03:30:57 image01 kernel: . > May 30 03:30:57 image01 ntpd[4436]: ntpd exiting on signal 15 > May 30 03:30:57 image01 kernel: . > May 30 03:30:58 image01 kernel: . > May 30 03:31:00 image01 syslogd: exiting on signal 15 > May 30 03:32:52 image01 syslogd: kernel boot file is /boot/kernel/kernel > May 30 03:32:52 image01 kernel: Copyright (c) 1992-2013 The FreeBSD Project. > May 30 03:32:52 image01 kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > May 30 03:32:52 image01 kernel: The Regents of the University of California. All rights reserved. > May 30 03:32:52 image01 kernel: FreeBSD is a registered trademark of The FreeBSD Foundation. > > I'm happy to help to gather more information, just tell me what you need. Hello Jeroen, So it looks like the system rebooted (but it was not a crash or a sporadic reboot? the kernel seems to be aware of the reboot request). It would be interesting if you could provide the output of the serial console when this happens, that might be helpful. Did you enable xenconsoled logging? Also, could you provide more info about your system, Xen version, what workload was the DomU running, Dom0 kernel version? From owner-freebsd-virtualization@FreeBSD.ORG Thu May 30 09:15:47 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 2D579428; Thu, 30 May 2013 09:15:47 +0000 (UTC) (envelope-from jeroen@dckd.nl) Received: from positron.dckd.nl (positron.dckd.nl [94.142.246.99]) by mx1.freebsd.org (Postfix) with ESMTP id E80EFD65; Thu, 30 May 2013 09:15:46 +0000 (UTC) Received: from nb-vdham.science.uva.nl (nb-vdham.science.uva.nl [146.50.52.179]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by positron.dckd.nl (Postfix) with ESMTPSA id 26C78F8062; Thu, 30 May 2013 11:15:45 +0200 (CEST) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 6.3 \(1503\)) Subject: Re: FreeBSD PVHVM call for testing From: Jeroen van der Ham In-Reply-To: <51A71616.4060508@citrix.com> Date: Thu, 30 May 2013 11:15:44 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <6B8B9354-AF52-4081-B67B-04565D1BCE99@dckd.nl> <51A71616.4060508@citrix.com> To: =?iso-8859-1?Q?Roger_Pau_Monn=E9?= X-Mailer: Apple Mail (2.1503) Cc: "freebsd-xen@freebsd.org" , xen-devel , "freebsd-virtualization@freebsd.org" , "xen-users@lists.xen.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 May 2013 09:15:47 -0000 Hi, On 30 May 2013, at 11:04, Roger Pau Monn=E9 = wrote: > So it looks like the system rebooted (but it was not a crash or a > sporadic reboot? the kernel seems to be aware of the reboot request). = It > would be interesting if you could provide the output of the serial > console when this happens, that might be helpful. Did you enable > xenconsoled logging? Unfortunately I did not. > Also, could you provide more info about your system, Xen version, what > workload was the DomU running, Dom0 kernel version? There was no one logged in at the time of the reboot according to the = last log. I did do some sysbench tests during the day, but that was way before it = rebooted. The only thing that could be running during that time was = daily periodic. $ sudo xm info host : soleus01.soleus.nu release : 2.6.32-5-xen-amd64 version : #1 SMP Mon Oct 3 07:53:54 UTC 2011 machine : x86_64 nr_cpus : 8 nr_nodes : 2 cores_per_socket : 4 threads_per_core : 1 cpu_mhz : 2200 hw_caps : = 178bf3ff:efd3fbff:00000000:00001310:00802001:00000000:000037ff:00000000 virt_caps : hvm total_memory : 65534 free_memory : 6866 node_to_cpu : node0:0-3 node1:4-7 node_to_memory : node0:3128 node1:3737 node_to_dma32_mem : node0:3128 node1:0 max_node_id : 1 xen_major : 4 xen_minor : 0 xen_extra : .1 xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 = hvm-3.0-x86_32p hvm-3.0-x86_64 xen_scheduler : credit xen_pagesize : 4096 platform_params : virt_start=3D0xffff800000000000 xen_changeset : unavailable xen_commandline : placeholder dom0_mem=3D1852M cc_compiler : gcc version 4.4.5 (Debian 4.4.5-10) cc_compile_by : waldi cc_compile_domain : debian.org cc_compile_date : Wed Jan 12 14:04:06 UTC 2011 xend_config_format : 4 $ uname -a Linux soleus01.soleus.nu 2.6.32-5-xen-amd64 #1 SMP Mon Oct 3 07:53:54 = UTC 2011 x86_64 GNU/Linux Jeroen. From owner-freebsd-virtualization@FreeBSD.ORG Thu May 30 14:56:07 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id C5393B11; Thu, 30 May 2013 14:56:07 +0000 (UTC) (envelope-from outbackdingo@gmail.com) Received: from mail-ob0-x22c.google.com (mail-ob0-x22c.google.com [IPv6:2607:f8b0:4003:c01::22c]) by mx1.freebsd.org (Postfix) with ESMTP id 84AB4A49; Thu, 30 May 2013 14:56:07 +0000 (UTC) Received: by mail-ob0-f172.google.com with SMTP id wo10so775781obc.3 for ; Thu, 30 May 2013 07:56:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=og4uCGSek8Bq04fLhmLhP4wK2egizPR1eG0bUU4G0UY=; b=Q8BX/9n1UGrOybtpkX4l6eCWRtIrdAQybOnNQLdPUNcdHdLxbxQGpRmscOggbIAit4 wwhgWemYJHKCtZH7tUKkOnJKlRCWMFjopkJhF2oMhWS5muLHZ8TAryfMjLww9DdWvmvX GphUWQWFF1fsJjeMhxFCK+hGTslYTnG08EqwvHk/knbMZ6x9aA8h7rr+YLYlSvtfwEzG kj2oeFuUkNEpAZST0RBxp/hcyCFXg7uJDCf+w1MHVZenRzMuC4oATR2M21ISEKXBN0ci 2eGd3cfbO2+gYBZRrC2Du14z9td5y5jw1e/vlGCh7jEzo82+x4iypc/GIrndTrB6U7tQ 3PLQ== MIME-Version: 1.0 X-Received: by 10.60.42.140 with SMTP id o12mr4385416oel.60.1369925767106; Thu, 30 May 2013 07:56:07 -0700 (PDT) Received: by 10.76.152.225 with HTTP; Thu, 30 May 2013 07:56:06 -0700 (PDT) In-Reply-To: References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <6B8B9354-AF52-4081-B67B-04565D1BCE99@dckd.nl> <51A71616.4060508@citrix.com> Date: Thu, 30 May 2013 10:56:06 -0400 Message-ID: Subject: Re: FreeBSD PVHVM call for testing From: Outback Dingo To: Jeroen van der Ham Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: "freebsd-xen@freebsd.org" , "xen-users@lists.xen.org" , xen-devel , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 May 2013 14:56:07 -0000 On Thu, May 30, 2013 at 5:15 AM, Jeroen van der Ham wrote: > Hi, > > On 30 May 2013, at 11:04, Roger Pau Monn=E9 wrote: > > So it looks like the system rebooted (but it was not a crash or a > > sporadic reboot? the kernel seems to be aware of the reboot request). I= t > > would be interesting if you could provide the output of the serial > > console when this happens, that might be helpful. Did you enable > > xenconsoled logging? > > Unfortunately I did not. > > > Also, could you provide more info about your system, Xen version, what > > workload was the DomU running, Dom0 kernel version? > > There was no one logged in at the time of the reboot according to the las= t > log. > I did do some sysbench tests during the day, but that was way before it > rebooted. The only thing that could be running during that time was daily > periodic. > > $ sudo xm info > host : soleus01.soleus.nu > release : 2.6.32-5-xen-amd64 > version : #1 SMP Mon Oct 3 07:53:54 UTC 2011 > machine : x86_64 > nr_cpus : 8 > nr_nodes : 2 > cores_per_socket : 4 > threads_per_core : 1 > cpu_mhz : 2200 > hw_caps : > 178bf3ff:efd3fbff:00000000:00001310:00802001:00000000:000037ff:00000000 > virt_caps : hvm > total_memory : 65534 > free_memory : 6866 > node_to_cpu : node0:0-3 > node1:4-7 > node_to_memory : node0:3128 > node1:3737 > node_to_dma32_mem : node0:3128 > node1:0 > max_node_id : 1 > xen_major : 4 > xen_minor : 0 > xen_extra : .1 > xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 > hvm-3.0-x86_32p hvm-3.0-x86_64 > xen_scheduler : credit > xen_pagesize : 4096 > platform_params : virt_start=3D0xffff800000000000 > xen_changeset : unavailable > xen_commandline : placeholder dom0_mem=3D1852M > cc_compiler : gcc version 4.4.5 (Debian 4.4.5-10) > cc_compile_by : waldi > cc_compile_domain : debian.org > cc_compile_date : Wed Jan 12 14:04:06 UTC 2011 > xend_config_format : 4 > > $ uname -a > Linux soleus01.soleus.nu 2.6.32-5-xen-amd64 #1 SMP Mon Oct 3 07:53:54 UTC > 2011 x86_64 GNU/Linux > > Jeroen. > > first is this a public vm ? and if so who is?? May 29 23:42:30 image01 sshd[31227]: error: Received disconnect from 150.165.15.175: 11: Bye Bye [preauth] because it is after this potential ssh login attempt, so is this you, has there been a breach ? only thing i noticed, but it might be nothing. > _______________________________________________ > freebsd-xen@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-xen > To unsubscribe, send any mail to "freebsd-xen-unsubscribe@freebsd.org" > From owner-freebsd-virtualization@FreeBSD.ORG Thu May 30 15:11:02 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 8ABCAF67; Thu, 30 May 2013 15:11:02 +0000 (UTC) (envelope-from jeroen@dckd.nl) Received: from positron.dckd.nl (positron.dckd.nl [IPv6:2a02:898:62:f6::63]) by mx1.freebsd.org (Postfix) with ESMTP id 5030FB75; Thu, 30 May 2013 15:11:02 +0000 (UTC) Received: from wcw-staff-215-240.wireless.uva.nl (wcw-staff-215-240.wireless.uva.nl [145.18.215.240]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by positron.dckd.nl (Postfix) with ESMTPSA id 7C1E2F8905; Thu, 30 May 2013 17:10:59 +0200 (CEST) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 6.3 \(1503\)) Subject: Re: FreeBSD PVHVM call for testing From: Jeroen van der Ham In-Reply-To: Date: Thu, 30 May 2013 17:10:59 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <9BD00E17-0A80-44C6-8B7B-2933265F4664@dckd.nl> References: <519131D8.9010307@citrix.com> <519E54DE.5090304@citrix.com> <6B8B9354-AF52-4081-B67B-04565D1BCE99@dckd.nl> <51A71616.4060508@citrix.com> To: Outback Dingo X-Mailer: Apple Mail (2.1503) Cc: "freebsd-xen@freebsd.org" , "xen-users@lists.xen.org" , xen-devel , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 May 2013 15:11:02 -0000 Hi, On 30 May 2013, at 16:56, Outback Dingo wrote: > first is this a public vm ? and if so who is?? > May 29 23:42:30 image01 sshd[31227]: error: Received disconnect from > 150.165.15.175: 11: Bye Bye [preauth] >=20 > because it is after this potential ssh login attempt, so is this you, = has > there been a breach ? only thing i noticed, but it might be nothing. This VM is on a public IP indeed, and SSH connectivity is enabled. As = with any publicly accessible host this then becomes the target of ssh = scans. I included the message just to show that between it and the reboot = nothing had been logged. AFAICT there has not been a breach, and I have not seen any indications = at all that there may be one. Jeroen. From owner-freebsd-virtualization@FreeBSD.ORG Sat Jun 1 21:45:11 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 89FF27FC for ; Sat, 1 Jun 2013 21:45:11 +0000 (UTC) (envelope-from mack@macktronics.com) Received: from coco.macktronics.com (coco.macktronics.com [209.181.253.65]) by mx1.freebsd.org (Postfix) with ESMTP id 339CAFF4 for ; Sat, 1 Jun 2013 21:45:10 +0000 (UTC) Received: from coco.macktronics.com (coco.macktronics.com [209.181.253.65]) by coco.macktronics.com (Postfix) with ESMTP id E28D94AC40 for ; Sat, 1 Jun 2013 16:39:45 -0500 (CDT) Date: Sat, 1 Jun 2013 16:39:45 -0500 (CDT) From: Dan Mack To: freebsd-virtualization@freebsd.org Subject: bhyve: calcru runtime msgs still ocurring ... Message-ID: <20130601163331.B14955@coco.macktronics.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Jun 2013 21:45:11 -0000 Just FYI/FWIW I am still seeing semi-regular messages like this on my bhyve console on releases as late as head-251224: calcru: runtime went backwards from 992 usec to 982 usec for pid 794 (sshd) calcru: runtime went backwards from 702 usec to 695 usec for pid 800 (sendmail) I am not seeing stability issues due to this but they are concerning. Here's a dmesg from the host and from a guest both at 251224: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #33 r251224: Sat Jun 1 09:48:40 CDT 2013 root@olive.macktronics.com:/usr/obj/usr/src/sys/MACKGEN amd64 FreeBSD clang version 3.3 (trunk 178860) 20130405 CPU: Intel(R) Core(TM) i7-3930K CPU @ 3.20GHz (3200.18-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x206d7 Family = 0x6 Model = 0x2d Stepping = 7 Features=0xbfebfbff Features2=0x1fbee3bf AMD Features=0x2c100800 AMD Features2=0x1 TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 63216635904 (60288 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 SMT threads cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 cpu4 (AP): APIC ID: 4 cpu5 (AP): APIC ID: 5 cpu6 (AP): APIC ID: 6 cpu7 (AP): APIC ID: 7 cpu8 (AP): APIC ID: 8 cpu9 (AP): APIC ID: 9 cpu10 (AP): APIC ID: 10 cpu11 (AP): APIC ID: 11 ioapic1 irqs 24-47 on motherboard ioapic0 irqs 0-23 on motherboard lapic0: Forcing LINT1 to edge trigger kbd1 at kbdmux0 ctl: CAM Target Layer loaded acpi0: on motherboard acpi0: Power Button (fixed) acpi0: reservation of f0000000, 18000000 (3) failed cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 cpu4: on acpi0 cpu5: on acpi0 cpu6: on acpi0 cpu7: on acpi0 cpu8: on acpi0 cpu9: on acpi0 cpu10: on acpi0 cpu11: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed03fff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 acpi_button0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci1: on pcib1 pcib2: at device 1.1 on pci0 pci2: on pcib2 xhci0: mem 0xe3400000-0xe3401fff irq 16 at device 0.0 on pci2 usbus0: waiting for BIOS to give up control xhci0: 32 byte context size. usbus0 on xhci0 pcib3: at device 2.0 on pci0 pci3: on pcib3 vgapci0: port 0x3000-0x307f mem 0xe2000000-0xe2ffffff,0xd0000000-0xdfffffff,0xe0000000-0xe1ffffff irq 16 at device 0.0 on pci3 pci3: at device 0.1 (no driver attached) pcib4: at device 3.0 on pci0 pci4: on pcib4 pci0: at device 5.0 (no driver attached) pci0: at device 5.2 (no driver attached) pcib5: at device 17.0 on pci0 pci5: on pcib5 pci0: at device 22.0 (no driver attached) em0: port 0x4040-0x405f mem 0xe3500000-0xe351ffff,0xe3521000-0xe3521fff irq 20 at device 25.0 on pci0 em0: Using an MSI interrupt em0: Ethernet address: 4c:72:b9:d1:b2:d2 ehci0: mem 0xe3601000-0xe36013ff irq 16 at device 26.0 on pci0 usbus1: EHCI version 1.0 usbus1 on ehci0 pcib6: at device 28.0 on pci0 pci6: on pcib6 pcib7: at device 28.2 on pci0 pci7: on pcib7 pci7: at device 0.0 (no driver attached) pcib8: at device 28.3 on pci0 pci8: on pcib8 xhci1: mem 0xe3200000-0xe3201fff irq 19 at device 0.0 on pci8 usbus2: waiting for BIOS to give up control xhci1: 32 byte context size. usbus2 on xhci1 pcib9: at device 28.5 on pci0 pci9: on pcib9 em1: port 0x1000-0x101f mem 0xe3100000-0xe311ffff,0xe3120000-0xe3123fff irq 17 at device 0.0 on pci9 em1: Using MSIX interrupts with 3 vectors em1: Ethernet address: 4c:72:b9:d1:b2:d3 ehci1: mem 0xe3602000-0xe36023ff irq 23 at device 29.0 on pci0 usbus3: EHCI version 1.0 usbus3 on ehci1 pcib10: at device 30.0 on pci0 pci10: on pcib10 isab0: at device 31.0 on pci0 isa0: on isab0 ahci0: port 0x4068-0x406f,0x4074-0x4077,0x4060-0x4067,0x4070-0x4073,0x4020-0x403f mem 0xe3523000-0xe35237ff irq 18 at device 31.2 on pci0 ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahcich4: at channel 4 on ahci0 ahcich5: at channel 5 on ahci0 ahciem0: on ahci0 pci0: at device 31.3 (no driver attached) orm0: at iomem 0xd1000-0xd1fff,0xd2000-0xd2fff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] ppc0: cannot reserve I/O port range est0: on cpu0 p4tcc0: on cpu0 est1: on cpu1 p4tcc1: on cpu1 est2: on cpu2 p4tcc2: on cpu2 est3: on cpu3 p4tcc3: on cpu3 est4: on cpu4 p4tcc4: on cpu4 est5: on cpu5 p4tcc5: on cpu5 est6: on cpu6 p4tcc6: on cpu6 est7: on cpu7 p4tcc7: on cpu7 est8: on cpu8 p4tcc8: on cpu8 est9: on cpu9 p4tcc9: on cpu9 est10: on cpu10 p4tcc10: on cpu10 est11: on cpu11 p4tcc11: on cpu11 ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec usbus0: 5.0Gbps Super Speed USB v3.0 usbus1: 480Mbps High Speed USB v2.0 usbus2: 5.0Gbps Super Speed USB v3.0 usbus3: 480Mbps High Speed USB v2.0 ugen1.1: at usbus1 uhub0: on usbus1 ugen0.1: <0x1033> at usbus0 uhub1: <0x1033 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 ugen3.1: at usbus3 uhub2: on usbus3 ugen2.1: <0x1033> at usbus2 uhub3: <0x1033 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus2 ses0 at ahciem0 bus 0 scbus6 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA-9 SATA 3.x device ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 122104MB (250069680 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad4 ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ATA-9 SATA 3.x device ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 114473MB (234441648 512 byte sectors: 16H 63S/T 16383C) ada1: Previously was known as ad6 ada2 at ahcich2 bus 0 scbus2 target 0 lun 0 ada2: ATA-8 SATA 3.x device ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada2: Command Queueing enabled ada2: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C) ada2: Previously was known as ad8 ada3 at ahcich3 bus 0 scbus3 target 0 lun 0 ada3: ATA-8 SATA 3.x device ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada3: Command Queueing enabled ada3: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C) ada3: Previously was known as ad10 ada4 at ahcich4 bus 0 scbus4 target 0 lun 0 ada4: ATA-8 SATA 3.x device ada4: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada4: Command Queueing enabled ada4: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C) ada4: Previously was known as ad12 ada5 at ahcich5 bus 0 scbus5 target 0 lun 0 ada5: ATA-8 SATA 3.x device ada5: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada5: Command Queueing enabled ada5: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C) ada5: Previously was known as ad14 lapic1: Forcing LINT1 to edge trigger SMP: AP CPU #1 Launched! lapic9: Forcing LINT1 to edge trigger SMP: AP CPU #9 Launched! lapic4: Forcing LINT1 to edge trigger SMP: AP CPU #4 Launched! lapic7: Forcing LINT1 to edge trigger SMP: AP CPU #7 Launched! lapic3: Forcing LINT1 to edge trigger SMP: AP CPU #3 Launched! lapic8: Forcing LINT1 to edge trigger SMP: AP CPU #8 Launched! lapic10: Forcing LINT1 to edge trigger SMP: AP CPU #10 Launched! lapic6: Forcing LINT1 to edge trigger SMP: AP CPU #6 Launched! lapic5: Forcing LINT1 to edge trigger SMP: AP CPU #5 Launched! lapic2: Forcing LINT1 to edge trigger SMP: AP CPU #2 Launched! lapic11: Forcing LINT1 to edge trigger SMP: AP CPU #11 Launched! uhub1: 4 ports with 4 removable, self powered uhub3: 4 ports with 4 removable, self powered Root mount waiting for: usbus3 usbus1 uhub2: 2 ports with 2 removable, self powered uhub0: 2 ports with 2 removable, self powered Root mount waiting for: usbus3 usbus1 ugen3.2: at usbus3 uhub4: on usbus3 ugen1.2: at usbus1 uhub5: on usbus1 Root mount waiting for: usbus3 usbus1 uhub5: 6 ports with 6 removable, self powered uhub4: 8 ports with 8 removable, self powered ugen1.3: at usbus1 ukbd0: on usbus1 kbd2 at ukbd0 ugen3.3: at usbus3 Root mount waiting for: usbus3 ugen3.4: at usbus3 Trying to mount root from zfs:tron []... ums0: on usbus1 ums0: 5 buttons and [XYZ] coordinates ID=0 run0: <1.0> on usbus3 run0: MAC/BBP RT3070 (rev 0x0201), RF RT3020 (MIMO 1T1R), address 94:db:c9:e3:6e:c8 ubt0: on usbus3 WARNING: attempt to domain_add(bluetooth) after domainfinalize() WARNING: attempt to domain_add(netgraph) after domainfinalize() tap0: Ethernet address: 00:bd:c6:d3:3a:00 tap1: Ethernet address: 00:bd:c7:d3:3a:01 bridge0: Ethernet address: 02:4c:89:ce:33:00 tap0: promiscuous mode enabled bridge0: link state changed to DOWN em0: promiscuous mode enabled em0: link state changed to DOWN bridge1: Ethernet address: 02:4c:89:ce:33:01 tap1: promiscuous mode enabled bridge1: link state changed to DOWN em1: link state changed to DOWN em1: promiscuous mode enabled em1: link state changed to UP bridge1: link state changed to UP em0: link state changed to UP ==== dmesg from the guest root@drag:~ # dmesg | less Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #33 r251224: Sat Jun 1 09:48:40 CDT 2013 root@olive.macktronics.com:/usr/obj/usr/src/sys/MACKGEN amd64 FreeBSD clang version 3.3 (trunk 178860) 20130405 CPU: Intel(R) Core(TM) i7-3930K CPU @ 3.20GHz (3199.84-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x206d7 Family = 0x6 Model = 0x2d Stepping = 7 Features=0x8fa3ab7f Features2=0x83bee217 AMD Features=0x2c100800 AMD Features2=0x1 real memory = 2147483648 (2048 MB) avail memory = 1985380352 (1893 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs FreeBSD/SMP: 2 package(s) x 1 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 ioapic0: Changing APIC ID to 2 ioapic0 irqs 0-16 on motherboard module_register_init: MOD_LOAD (vesa, 0xffffffff807bb380, 0) error 19 kbd0 at kbdmux0 acpi0: on motherboard atrtc0: port 0x70-0x71,0x72-0x77 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib0: no PRT entry for 0.31.INTA virtio_pci0: port 0x2000-0x201f mem 0xc0000000-0xc0001fff at device 1.0 on pci0 vtnet0: on virtio_pci0 virtio_pci0: host features: 0x1018020 virtio_pci0: negotiated features: 0x1018020 vtnet0: Ethernet address: 00:a0:98:58:64:98 virtio_pci1: port 0x2020-0x203f mem 0xc0002000-0xc0003fff at device 2.0 on pci0 vtnet1: on virtio_pci1 virtio_pci1: host features: 0x1018020 virtio_pci1: negotiated features: 0x1018020 vtnet1: Ethernet address: 00:a0:98:ec:d7:5d virtio_pci2: port 0x2040-0x207f mem 0xc0004000-0xc0005fff at device 3.0 on pci0 vtblk0: on virtio_pci2 virtio_pci2: host features: 0x10000004 virtio_pci2: negotiated features: 0x10000004 vtblk0: 24576MB (50331648 512 byte sectors) uart2: <16550 or compatible> port 0x3f8-0x3ff irq 4 at device 31.0 on pci0 uart2: console (9600,n,8,1) ctl: CAM Target Layer loaded Timecounters tick every 10.000 msec g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT SMP: AP CPU #1 Launched! Trying to mount root from ufs:/dev/vtbd0p2 [rw]... g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT calcru: runtime went backwards from 992 usec to 982 usec for pid 794 (sshd) calcru: runtime went backwards from 702 usec to 695 usec for pid 800 (sendmail) Thanks, hope this might help, Dan