From owner-freebsd-virtualization@freebsd.org Sun May 5 00:54:53 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0279F159D5DF for ; Sun, 5 May 2019 00:54:52 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: from mail-wr1-x42e.google.com (mail-wr1-x42e.google.com [IPv6:2a00:1450:4864:20::42e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B8E3677C3B for ; Sun, 5 May 2019 00:54:51 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: by mail-wr1-x42e.google.com with SMTP id v10so239061wrt.6 for ; Sat, 04 May 2019 17:54:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:cc; bh=6Loufd1vEuSj2mA4jQW1YdZWaxlJe78JhY8B3z78tiw=; b=BGsmYuLr1BfPKijr54UIqGhhmtAl4GyKpMT02xlymsvVE0A6IWfjoJ20xniPiWp+qj nRnXLHBEh0DQywgHebOlQX9sBg5aMeRbllq8X9DSv0NaEZF1yQY+7tvI1k0/BDXYxwP8 75+moxe/8yyH+ftL1vMd9fqd5x/uoK7KjIS3Y9Fj+54dQ3samQq1IAo4fJdAefuiMX+W 6sVx9nPJaW5E+LLQ2FUgfQnrUdHp/lk8FHLepjXcVK4IADac6+Loj4DLWzfn1PZk36VL VpIiViSkGxnf+y0FqHjOqg4ezZgdQhB8XtKJL0N1IU4iFrQSzVKhv3RCmarwMOhZRzGn r3bA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:cc; bh=6Loufd1vEuSj2mA4jQW1YdZWaxlJe78JhY8B3z78tiw=; b=ZW11JSqFduDZ693GoE1WzSppKHodeIHcgCdYzCv2VHAN/Q0fP6rzOHG3SDkSJ25wpX U/jmsJI1loq511/ajqYmnc8UBb/0dF/ZImZSJY58umdPoMeFpRk1lxK7aSvEOjdxfMGc OtT3czRQncuiUuTa0h1hjbT0zliDYOrCB/erwKWRair3/1t1pMCsFcpkRFuvtzf2aXoJ g86rgMGUrhcUVxca2V+z2NOfjMeCW7vKcfmu0L5dflbN1umXH+uY0ztwY4WPyiclojfR Wc4we+upQ6Jl2Fz4xkuQws+wsjAFm/y89lVf14zS2trmMaf1BZROOiSySodfcYpwpiW5 Uomg== X-Gm-Message-State: APjAAAWViIRAaMVJz3dZBXLVnTlsSRg6ltVB9Ju/6EyU3sQeWDQK9rr5 6NalNZLjKlGjXJfKe5hleTg41XgvBLgVQNt5bKk= X-Received: by 2002:adf:fc49:: with SMTP id e9mt10003066wrs.269.1557017690452; Sat, 04 May 2019 17:54:50 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Anish Date: Sat, 4 May 2019 17:54:39 -0700 Message-ID: Subject: Re: BSD11 vs BSD12 KVM performance Cc: "Bapat, Udayan" , "freebsd-virtualization@freebsd.org" X-Rspamd-Queue-Id: B8E3677C3B X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=BGsmYuLr; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of akgupt3@gmail.com designates 2a00:1450:4864:20::42e as permitted sender) smtp.mailfrom=akgupt3@gmail.com X-Spamd-Result: default: False [-4.40 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; MISSING_TO(2.00)[]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.67)[-0.669,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[e.2.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.72)[ip: (-9.04), ipnet: 2a00:1450::/32(-2.23), asn: 15169(-2.25), country: US(-0.06)]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 May 2019 00:54:53 -0000 Hi Udayan, Intel VM-x and AMD SVM allow hypervisor to intercept TSC access for save/restore of VM migration, so when these intercepts are enabled, rdtsc will require switch between root and non-root mode which is expensive and may cost few hundreds of cpu cycles. Is it possible that one has these intercepts always enabled even when migration is not started? -Anish From owner-freebsd-virtualization@freebsd.org Sun May 5 13:29:20 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 90A80158B1C8 for ; Sun, 5 May 2019 13:29:20 +0000 (UTC) (envelope-from Udayan.Bapat@netapp.com) Received: from NAM02-SN1-obe.outbound.protection.outlook.com (mail-eopbgr770073.outbound.protection.outlook.com [40.107.77.73]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5032C9343A for ; Sun, 5 May 2019 13:29:17 +0000 (UTC) (envelope-from Udayan.Bapat@netapp.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.onmicrosoft.com; s=selector1-netapp-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=88RF97Tr+Fn30gsYfaPzfpnKCrZzelF9oGmtjQPffag=; b=qWGSCaByvQC3iqB40TrDbznCLgu3glx7RoUd6cn/CFhNtQuZNXOhQjcnu46mEGgsTiEOt+JW+ebMSnkkqFi2uiDIUdckSoOQsWqOlQg+zXwyYE2QFqsX1yr9e5RLZonkax3hOruAjznAJXUu+M7pbBiLvFrI/GYpXuXvCjPCekc= Received: from BN7PR06MB6051.namprd06.prod.outlook.com (20.176.31.148) by BN7PR06MB5250.namprd06.prod.outlook.com (20.176.29.221) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1856.10; Sun, 5 May 2019 13:29:14 +0000 Received: from BN7PR06MB6051.namprd06.prod.outlook.com ([fe80::15b8:895e:5491:e4e2]) by BN7PR06MB6051.namprd06.prod.outlook.com ([fe80::15b8:895e:5491:e4e2%7]) with mapi id 15.20.1856.012; Sun, 5 May 2019 13:29:14 +0000 From: "Bapat, Udayan" To: Anish , Harry Schmalzbauer CC: "freebsd-virtualization@freebsd.org" Subject: Re: BSD11 vs BSD12 KVM performance Thread-Topic: BSD11 vs BSD12 KVM performance Thread-Index: AQHVARgeQBBS4Dr1OEWHI3GrvmsxdKZawViAgAD2s4CAAI/FgA== Date: Sun, 5 May 2019 13:29:13 +0000 Message-ID: <1C0C46D0-7B1A-46AF-A354-B210EB2D0D2F@netapp.com> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [99.111.157.171] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: f3181115-fa70-4a6b-6cc3-08d6d15daa91 x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605104)(2017052603328)(7193020); SRVR:BN7PR06MB5250; x-ms-traffictypediagnostic: BN7PR06MB5250: x-ms-exchange-purlcount: 2 x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:8882; x-forefront-prvs: 00286C0CA6 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(376002)(39860400002)(396003)(366004)(346002)(136003)(199004)(189003)(51914003)(86362001)(72206003)(26005)(110136005)(33656002)(71190400001)(53936002)(99286004)(76176011)(316002)(3846002)(6116002)(14444005)(71200400001)(83716004)(2906002)(102836004)(256004)(5024004)(478600001)(6506007)(2616005)(186003)(14454004)(486006)(11346002)(476003)(446003)(66066001)(82746002)(66556008)(66946007)(7736002)(64756008)(73956011)(66446008)(76116006)(8936002)(8676002)(81156014)(81166006)(66476007)(6436002)(5660300002)(6486002)(68736007)(229853002)(25786009)(36756003)(6246003)(6306002)(54896002)(6512007)(4326008); DIR:OUT; SFP:1101; SCL:1; SRVR:BN7PR06MB5250; H:BN7PR06MB6051.namprd06.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: netapp.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam-message-info: 84auXoH4/JlmmalVSyt431M0LSBB48EF4gEaUEvFIWZa+NCkK8SXYL9SCRQJz6Kku+NFcovFGLe4Vl9xsxb+cxuhqic2sPuxeh1GlWj2rsd3gT/iNwUsQ4AWwbZ1AL/LoCXUzOBTtVPwUnxxB7CKPibKzlsmC5MLapOXwamTb9AW/6X1jPalJHhfC+FLneEuad44buCzRzOhPx9KUoDw7+w73SHl1KTK8XTvWPOR+yW0gQqP+t8ZgWNSBgXKsCdTFJyRfN1dvzSEMx6QjIzJRoArrCEfPxPBIX+hjOTg6sLJmM2aHSJEnD8P278OVXJzxunML+jDSDS/5rO4xlG4X4BQEA/1YxLRXq8+igquLqdxponmKEq5NwfRM+lhfLteHfws1QvGsKni5PuZJ46P97ytION9NpPeczh63gMzWBQ= MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-Network-Message-Id: f3181115-fa70-4a6b-6cc3-08d6d15daa91 X-MS-Exchange-CrossTenant-originalarrivaltime: 05 May 2019 13:29:14.1066 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN7PR06MB5250 X-Rspamd-Queue-Id: 5032C9343A X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netapp.onmicrosoft.com header.s=selector1-netapp-com header.b=qWGSCaBy; spf=pass (mx1.freebsd.org: domain of Udayan.Bapat@netapp.com designates 40.107.77.73 as permitted sender) smtp.mailfrom=Udayan.Bapat@netapp.com X-Spamd-Result: default: False [-4.36 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; HAS_XOIP(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[netapp.onmicrosoft.com:+]; MX_GOOD(-0.01)[mx1.netapp.iphmx.com,mx2.netapp.iphmx.com,mx1.netapp.iphmx.com,mx2.netapp.iphmx.com,mx1.netapp.iphmx.com,mx2.netapp.iphmx.com,mx1.netapp.iphmx.com,mx2.netapp.iphmx.com,mx1.netapp.iphmx.com,mx2.netapp.iphmx.com]; MIME_BASE64_TEXT(0.10)[]; NEURAL_HAM_SHORT(-0.95)[-0.952,0]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(-0.99)[ipnet: 40.64.0.0/10(-2.68), asn: 8075(-2.23), country: US(-0.06)]; MIME_TRACE(0.00)[0:+,1:+]; ASN(0.00)[asn:8075, ipnet:40.64.0.0/10, country:US]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[netapp.onmicrosoft.com:s=selector1-netapp-com]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[netapp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[73.77.107.40.list.dnswl.org : 127.0.3.0] Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 May 2019 13:29:20 -0000 VGhhbmtzIGZvciB0aGUgcmVzcG9uc2VzLg0KDQpNeSBiYWQuIEkgbWVhbnQgQlNEMTAgdnMgQlNE MTEgYW5kIG5vdCAxMSB2cyAxMi4NCg0KQWxzbyBJIGFtIG5vdCBkb2luZyBhbnkgbWlncmF0aW9u LiBUaGlzIGlzIHB1cmVseSBhIG5vcm1hbCBydW50aW1lIGJlaGF2aW9yIGRpZmZlcmVuY2UuIFdl IGhhdmUgZW5hYmxlZCBhbGwgdGhlIGhvc3QgaHlwZXJ2aXNvciBWTS14IGJlc3QgcHJhY3RpY2Vz LiBTbyBjb3VsZCB5b3UgcGxlYXNlIGNsYXJpZnkgd2hhdCB5b3UgbWVhbiBieSDigJxpbnRlcmNl cHRzIGFsd2F5cyBlbmFibGVk4oCdPw0KDQoNCkZyb206IEFuaXNoIDxha2d1cHQzQGdtYWlsLmNv bT4NCkRhdGU6IFNhdHVyZGF5LCBNYXkgNCwgMjAxOSBhdCA4OjU0IFBNDQpDYzogIkJhcGF0LCBV ZGF5YW4iIDxVZGF5YW4uQmFwYXRAbmV0YXBwLmNvbT4sICJmcmVlYnNkLXZpcnR1YWxpemF0aW9u QGZyZWVic2Qub3JnIiA8ZnJlZWJzZC12aXJ0dWFsaXphdGlvbkBmcmVlYnNkLm9yZz4NClN1Ympl Y3Q6IFJlOiBCU0QxMSB2cyBCU0QxMiBLVk0gcGVyZm9ybWFuY2UNCg0KTmV0QXBwIFNlY3VyaXR5 IFdBUk5JTkc6IFRoaXMgaXMgYW4gZXh0ZXJuYWwgZW1haWwuIERvIG5vdCBjbGljayBsaW5rcyBv ciBvcGVuIGF0dGFjaG1lbnRzIHVubGVzcyB5b3UgcmVjb2duaXplIHRoZSBzZW5kZXIgYW5kIGtu b3cgdGhlIGNvbnRlbnQgaXMgc2FmZS4NCg0KDQoNCkhpIFVkYXlhbiwNCg0KSW50ZWwgVk0teCBh bmQgQU1EIFNWTSBhbGxvdyBoeXBlcnZpc29yIHRvIGludGVyY2VwdCBUU0MgYWNjZXNzIGZvciBz YXZlL3Jlc3RvcmUgb2YgVk0gbWlncmF0aW9uLCBzbyB3aGVuIHRoZXNlIGludGVyY2VwdHMgYXJl IGVuYWJsZWQsIHJkdHNjIHdpbGwgcmVxdWlyZSBzd2l0Y2ggYmV0d2VlbiByb290IGFuZCBub24t cm9vdCBtb2RlIHdoaWNoIGlzIGV4cGVuc2l2ZSBhbmQgbWF5IGNvc3QgZmV3IGh1bmRyZWRzIG9m IGNwdSBjeWNsZXMuIElzIGl0IHBvc3NpYmxlIHRoYXQgb25lIGhhcyB0aGVzZSBpbnRlcmNlcHRz IGFsd2F5cyBlbmFibGVkIGV2ZW4gd2hlbiBtaWdyYXRpb24gaXMgbm90IHN0YXJ0ZWQ/DQoNCi1B bmlzaA0KDQoNCg== From owner-freebsd-virtualization@freebsd.org Tue May 7 08:03:02 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E55B815A2968 for ; Tue, 7 May 2019 08:03:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 7DDFD7672F for ; Tue, 7 May 2019 08:03:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 4149815A2966; Tue, 7 May 2019 08:03:01 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1EEA215A2965 for ; Tue, 7 May 2019 08:03:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AA8247672B for ; Tue, 7 May 2019 08:03:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id E61251FBFA for ; Tue, 7 May 2019 08:02:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x4782xwp005051 for ; Tue, 7 May 2019 08:02:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x4782xKK005050 for virtualization@FreeBSD.org; Tue, 7 May 2019 08:02:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 231117] I/O lockups inside bhyve vms Date: Tue, 07 May 2019 08:02:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kwiat3k@panic.pl X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 May 2019 08:03:02 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231117 Mateusz Kwiatkowski changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |kwiat3k@panic.pl --- Comment #19 from Mateusz Kwiatkowski --- I have very similar problem as described in this issue: I/O in guests hangs. I've experienced this with FreeBSD 11.2, 12.0 (both with ZFS inside) and Ub= untu 18.04 (ext4) guests. This started happening after migrating guests from old hypervisor running 1= 2.0 on Xeon, to the new on running CURRENT (r347183) on AMD Epyc. On old hyperv= isor these VMs were running stable for couple of months. On the new hypervisor there's plenty of free resources. Swap is disabled. Mem: 3761M Active, 1636M Inact, 5802M Wired, 51G Free ARC: 4000M Total, 487M MFU, 3322M MRU, 3456K Anon, 129M Header, 59M Other 2228M Compressed, 3202M Uncompressed, 1.44:1 Ratio vfs.zfs.arc_min: 8215740416 vfs.zfs.arc_max: 52582796492 Procstat from bhyve provess: root@utgard:~ # procstat -kk 95379 PID TID COMM TDNAME KSTACK 95379 101075 bhyve mevent mi_switch+0x174 sleepq_switch+0x110 sleepq_catch_signals+0x3e7 sleepq_wait_sig+0xf _sleep+0= x2d0 kqueue_kevent+0xa94 kern_kevent_fp+0x95 kern_kevent+0x9f kern_kevent_generic+0x70 sys_kevent+0x61 amd64_syscall+0x276 fast_syscall_common+0x101 95379 101258 bhyve blk-4:0-0 mi_switch+0x174 sleepq_switch+0x110 sleepq_catch_signals+0x3e7 sleepq_wait_sig+0xf _sleep+0= x2d0 umtxq_sleep+0x153 do_wait+0x206 __umtx_op_wait_uint_private+0x7e amd64_syscall+0x276 fast_syscall_common+0x101 95379 101259 bhyve blk-4:0-1 mi_switch+0x174 sleepq_switch+0x110 sleepq_catch_signals+0x3e7 sleepq_wait_sig+0xf _sleep+0= x2d0 umtxq_sleep+0x153 do_wait+0x206 __umtx_op_wait_uint_private+0x7e amd64_syscall+0x276 fast_syscall_common+0x101 95379 101260 bhyve blk-4:0-2 mi_switch+0x174 sleepq_switch+0x110 sleepq_catch_signals+0x3e7 sleepq_wait_sig+0xf _sleep+0= x2d0 umtxq_sleep+0x153 do_wait+0x206 __umtx_op_wait_uint_private+0x7e amd64_syscall+0x276 fast_syscall_common+0x101 95379 101261 bhyve blk-4:0-3 mi_switch+0x174 sleepq_switch+0x110 sleepq_catch_signals+0x3e7 sleepq_wait_sig+0xf _sleep+0= x2d0 umtxq_sleep+0x153 do_wait+0x206 __umtx_op_wait_uint_private+0x7e amd64_syscall+0x276 fast_syscall_common+0x101 95379 101262 bhyve blk-4:0-4 mi_switch+0x174 sleepq_switch+0x110 sleepq_catch_signals+0x3e7 sleepq_wait_sig+0xf _sleep+0= x2d0 umtxq_sleep+0x153 do_wait+0x206 __umtx_op_wait_uint_private+0x7e amd64_syscall+0x276 fast_syscall_common+0x101 95379 101263 bhyve blk-4:0-5 mi_switch+0x174 sleepq_switch+0x110 sleepq_catch_signals+0x3e7 sleepq_wait_sig+0xf _sleep+0= x2d0 umtxq_sleep+0x153 do_wait+0x206 __umtx_op_wait_uint_private+0x7e amd64_syscall+0x276 fast_syscall_common+0x101 95379 101264 bhyve blk-4:0-6 mi_switch+0x174 sleepq_switch+0x110 sleepq_catch_signals+0x3e7 sleepq_wait_sig+0xf _sleep+0= x2d0 umtxq_sleep+0x153 do_wait+0x206 __umtx_op_wait_uint_private+0x7e amd64_syscall+0x276 fast_syscall_common+0x101 95379 101265 bhyve blk-4:0-7 mi_switch+0x174 sleepq_switch+0x110 sleepq_catch_signals+0x3e7 sleepq_wait_sig+0xf _sleep+0= x2d0 umtxq_sleep+0x153 do_wait+0x206 __umtx_op_wait_uint_private+0x7e amd64_syscall+0x276 fast_syscall_common+0x101 95379 101266 bhyve vtnet-5:0 tx mi_switch+0x174 sleepq_switch+0x110 sleepq_catch_signals+0x3e7 sleepq_wait_sig+0xf _sleep+0= x2d0 umtxq_sleep+0x153 do_wait+0x206 __umtx_op_wait_uint_private+0x7e amd64_syscall+0x276 fast_syscall_common+0x101 95379 101267 bhyve vcpu 0 mi_switch+0x174 sleepq_switch+0x110 sleepq_timedwait+0x4f msleep_spin_sbt+0x144 vm_run+0x970 vmmdev_ioctl+0x7ea devfs_ioctl+0xca VOP_IOCTL_APV+0x63 vn_ioctl+0x124 devfs_ioctl_f+0x1f kern_ioctl+0x28a sys_ioctl+0x15d amd64_syscall+0x276 fast_syscall_common+0x101 95379 101268 bhyve vcpu 1 mi_switch+0x174 sleepq_switch+0x110 sleepq_timedwait+0x4f msleep_spin_sbt+0x144 vm_run+0x970 vmmdev_ioctl+0x7ea devfs_ioctl+0xca VOP_IOCTL_APV+0x63 vn_ioctl+0x124 devfs_ioctl_f+0x1f kern_ioctl+0x28a sys_ioctl+0x15d amd64_syscall+0x276 fast_syscall_common+0x101 I will be happy to provide more information to help solving this issue. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue May 7 09:32:16 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 602F315A5074 for ; Tue, 7 May 2019 09:32:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id EC43D81BDE for ; Tue, 7 May 2019 09:32:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id B078A15A5071; Tue, 7 May 2019 09:32:15 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8C5CD15A5070 for ; Tue, 7 May 2019 09:32:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0DC4981BD7 for ; Tue, 7 May 2019 09:32:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 5C0A1208D0 for ; Tue, 7 May 2019 09:32:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x479WEQR020543 for ; Tue, 7 May 2019 09:32:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x479WElb020542 for virtualization@FreeBSD.org; Tue, 7 May 2019 09:32:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 231117] I/O lockups inside bhyve vms Date: Tue, 07 May 2019 09:32:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kwiat3k@panic.pl X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 May 2019 09:32:16 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231117 --- Comment #20 from Mateusz Kwiatkowski --- Output of procstat -kk -a | grep zfs: # procstat -kk -a | grep zfs 0 100403 kernel zfsvfs mi_switch+0x174 sleepq_switch+0x110 sleepq_wait+0x43 _sleep+0x2da taskqueue_thread_loop+0xe1 fork_exit+0x84 fork_trampoline+0xe 0 100771 kernel zfs_vn_rele_taskq mi_switch+0x174 sleepq_switch+0x110 sleepq_wait+0x43 _sleep+0x2da taskqueue_thread_loop+0xe1 fork_exit+0x84 fork_trampoline+0xe 46 100365 zfskern solthread 0xfffffff mi_switch+0x174 sleepq_switch+0x110 sleepq_timedwait+0x4f _cv_timedwait_sbt+0x185 zthr_procedure+0x12c fork_exit+0x84 fork_trampoline+0xe 46 100366 zfskern solthread 0xfffffff mi_switch+0x174 sleepq_switch+0x110 sleepq_timedwait+0x4f _cv_timedwait_sbt+0x185 zthr_procedure+0x12c fork_exit+0x84 fork_trampoline+0xe 46 100367 zfskern arc_dnlc_evicts_thr mi_switch+0x174 sleepq_switch+0x110 sleepq_wait+0x43 _cv_wait+0x15b arc_dnlc_evicts_thread+0x133 fork_exit+0x84 fork_trampoline+0xe 46 100369 zfskern dbuf_evict_thread mi_switch+0x174 sleepq_switch+0x110 sleepq_timedwait+0x4f _cv_timedwait_sbt+0x185 dbuf_evict_thread+0x296 fork_exit+0x84 fork_trampoline+0xe 46 100402 zfskern l2arc_feed_thread mi_switch+0x174 sleepq_switch+0x110 sleepq_timedwait+0x4f _cv_timedwait_sbt+0x185 l2arc_feed_thread+0x1d5 fork_exit+0x84 fork_trampoline+0xe 46 100698 zfskern trim zroot mi_switch+0x174 sleepq_switch+0x110 sleepq_timedwait+0x4f _cv_timedwait_sbt+0x185 trim_thread+0xab fork_exit+0x84 fork_trampoline+0xe 46 100812 zfskern txg_thread_enter mi_switch+0x174 sleepq_switch+0x110 sleepq_wait+0x43 _cv_wait+0x15b txg_thread_wait+0x9a txg_quiesce_thread+0x2a6 fork_exit+0x84 fork_trampoline+0xe 46 100813 zfskern txg_thread_enter mi_switch+0x174 sleepq_switch+0x110 sleepq_timedwait+0x4f _cv_timedwait_sbt+0x185 txg_thread_wait+0x8d txg_sync_thread+0x53b fork_exit+0x84 fork_trampoline+0= xe 46 100814 zfskern solthread 0xfffffff mi_switch+0x174 sleepq_switch+0x110 sleepq_wait+0x43 _cv_wait+0x15b zthr_procedure+0xeb fork_exit+0x84 fork_trampoline+0xe 46 100815 zfskern solthread 0xfffffff mi_switch+0x174 sleepq_switch+0x110 sleepq_wait+0x43 _cv_wait+0x15b zthr_procedure+0xeb fork_exit+0x84 fork_trampoline+0xe --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue May 7 09:39:58 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4AE5215A524F for ; Tue, 7 May 2019 09:39:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id D437081ED6 for ; Tue, 7 May 2019 09:39:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 94DC415A524E; Tue, 7 May 2019 09:39:57 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8352C15A524D for ; Tue, 7 May 2019 09:39:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 22B7081ED3 for ; Tue, 7 May 2019 09:39:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 2386E208E6 for ; Tue, 7 May 2019 09:39:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x479duGE028080 for ; Tue, 7 May 2019 09:39:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x479duKO028079 for virtualization@FreeBSD.org; Tue, 7 May 2019 09:39:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 231117] bhyve: I/O lockups inside guests Date: Tue, 07 May 2019 09:39:55 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: performance, regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: short_desc bug_status see_also keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 May 2019 09:39:58 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231117 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|I/O lockups inside bhyve |bhyve: I/O lockups inside |vms |guests Status|New |Open See Also| |https://bugs.freebsd.org/bu | |gzilla/show_bug.cgi?id=3D2= 296 | |14 Keywords| |performance --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue May 7 12:27:55 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C5ED915849A5 for ; Tue, 7 May 2019 12:27:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 47DE58753C for ; Tue, 7 May 2019 12:27:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 055FD15849A3; Tue, 7 May 2019 12:27:55 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E825F15849A2 for ; Tue, 7 May 2019 12:27:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 868C88753A for ; Tue, 7 May 2019 12:27:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id BC5D422130 for ; Tue, 7 May 2019 12:27:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x47CRrBm094840 for ; Tue, 7 May 2019 12:27:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x47CRrUY094839 for virtualization@FreeBSD.org; Tue, 7 May 2019 12:27:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 231117] bhyve: I/O lockups inside guests Date: Tue, 07 May 2019 12:27:53 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rgrimes@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 May 2019 12:27:56 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231117 Rodney W. Grimes changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |rgrimes@FreeBSD.org Keywords|performance | --- Comment #21 from Rodney W. Grimes --- (In reply to Mateusz Kwiatkowski from comment #19) > On the new hypervisor there's plenty of free resources. Swap is disabled. >=20 > Mem: 3761M Active, 1636M Inact, 5802M Wired, 51G Free > ARC: 4000M Total, 487M MFU, 3322M MRU, 3456K Anon, 129M Header, 59M Other > 2228M Compressed, 3202M Uncompressed, 1.44:1 Ratio > > vfs.zfs.arc_min: 8215740416 > vfs.zfs.arc_max: 52582796492 How much memory are your VM's using? Ie, what is the total of all the VM's= you have running at any time? How much total memory does the system have? Your arc max is 52Gbytes, 4G is in use now, so it could try to use another = 48G bytes, your system has 51G free under the above conditions so the arc could drive your system to 3G of free memory. I am concerned your host work load my at times drive your system into memory starvation unless these numbers are actually with all the system under load. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue May 7 18:26:53 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 344BA158FFCE for ; Tue, 7 May 2019 18:26:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id C20646F017 for ; Tue, 7 May 2019 18:26:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 8274B158FFCD; Tue, 7 May 2019 18:26:52 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6FE70158FFCC for ; Tue, 7 May 2019 18:26:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 095556F015 for ; Tue, 7 May 2019 18:26:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 4085C25428 for ; Tue, 7 May 2019 18:26:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x47IQpNS083625 for ; Tue, 7 May 2019 18:26:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x47IQpBt083624 for virtualization@FreeBSD.org; Tue, 7 May 2019 18:26:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 231117] bhyve: I/O lockups inside guests Date: Tue, 07 May 2019 18:26:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kwiat3k@panic.pl X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 May 2019 18:26:53 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231117 --- Comment #22 from Mateusz Kwiatkowski --- (In reply to Rodney W. Grimes from comment #21) > How much memory are your VM's using? Ie, what is the total of all the VM= 's you have > running at any time? How much total memory does the system h= ave? VMs may use 8GBs of RAM in total. Hypervisor has 64GB in total. So VMs and = ARC could create OOM condition but the statistics I provided were taken at the moment when one of the VMs hang. I'll reduce arc_max anyway to 8GB to make = sure this isn't the cause. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue May 7 19:50:46 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1CECC15921AD for ; Tue, 7 May 2019 19:50:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id A727872218 for ; Tue, 7 May 2019 19:50:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 6BA8915921AC; Tue, 7 May 2019 19:50:45 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 593B815921AA for ; Tue, 7 May 2019 19:50:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E75E87220F for ; Tue, 7 May 2019 19:50:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 1F955260CA for ; Tue, 7 May 2019 19:50:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x47Joh2A049553 for ; Tue, 7 May 2019 19:50:43 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x47JohFC049552 for virtualization@FreeBSD.org; Tue, 7 May 2019 19:50:43 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 231117] bhyve: I/O lockups inside guests Date: Tue, 07 May 2019 19:50:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rgrimes@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 May 2019 19:50:46 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231117 --- Comment #23 from Rodney W. Grimes --- (In reply to Mateusz Kwiatkowski from comment #22) > VMs may use 8GBs of RAM in total. Hypervisor has 64GB in total. So VMs an= d ARC could create OOM condition but the statistics I provided were taken a= t themoment when one of the VMs hang. I'll reduce arc_max anyway to 8GB to = make sure this isn't the cause. Not sure you need to cut arc_max to 8GB, but just make sure that arc_max + total(all VM's) + host usage is < than 64GB. I have been pointed at: If the guest(s) are using virtio-block, it might be interesting to check the status of the IO queues for those devices. The reported issues could be a case of https://smartos.org/bugview/OS-7613. (Posted as https://reviews.freebsd.org/D19501) I have pinged the D19501 review and it looks like some forward motion has happened there. You *may* if you can want to try the patch that is there n= ow, knowing that it is about to be revised. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Wed May 8 05:22:13 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CA880159E349 for ; Wed, 8 May 2019 05:22:13 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc::10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0F2B68C0ED for ; Wed, 8 May 2019 05:22:12 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=sibptus.ru; s=20181118; h=Message-ID:Subject:To:From:Date:In-Reply-To; bh=8Y6QH/myUEcipFs4ME8zKrXTU4d76nYu2nmBmUu1HQ4=; b=DG2mgPBi/Vwxjz0mZ9GsglQmEB f81krySTPPSrCCDePSxQbIBIyVeXNHww037qrXd0Xi5EZ5E9BzNg3JvkUFgoYUzENmr3ZfP2BNBcf KptOKfM8WlZsaomM5MUA+8wbZBM2FSPEWC1Hp46EyFtirYa0uoXsTISiCotr2SqQufG8=; Received: from vas by admin.sibptus.ru with local (Exim 4.92 (FreeBSD)) (envelope-from ) id 1hOF1v-000KYT-Gd for freebsd-virtualization@freebsd.org; Wed, 08 May 2019 12:22:11 +0700 Date: Wed, 8 May 2019 12:22:11 +0700 From: Victor Sudakov To: freebsd-virtualization@freebsd.org Subject: sysutils/docker-freebsd ? Message-ID: <20190508052211.GA78752@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="bg08WKrSYDhXBjb5" Content-Disposition: inline X-PGP-Key: http://www.dreamwidth.org/pubkey?user=victor_sudakov X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.11.4 (2019-03-13) Sender: Victor Sudakov X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 May 2019 05:22:14 -0000 --bg08WKrSYDhXBjb5 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Dear Colleagues, Do you know if there are plans to revive sysutils/docker-freebsd? It has been "broken" for 2 months, and the FreeBSD Wiki says that docker-freebsd is the recommended way of running docker apps. --=20 Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ --bg08WKrSYDhXBjb5 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJc0meDAAoJEA2k8lmbXsY0/NoH/3MTpBywzsknl/SdDcFdNESB mP2HSOc37mAouyj9h6mNd8Xc7jbcHGDT5Aj3NaiYj6uvejg2Uqi/EjeOaNArh1PO IgFse8Ns0R6KYCmE5lNnbT6z7td8kfIBtR+LPsLVvR6GQ8Nto64we91OOJY/F/oz qMRBBt8bS40OaAuSMByOZA/d52fkrJxy42oZg1Y3LV7+QkpRoKtOArqi1ZkOAN85 CkY6q7wPm5dXCvaulsUrXfseNQBfxjt05I7JCWkYHsPwoJYFJ3QWJABjS9sPFl02 xUbk6f7sOzcdvM7n0h9d/kXSHnwd5+zVGohfrVMilXHS5QpnNs0S38Hm0k+GFt8= =eDd2 -----END PGP SIGNATURE----- --bg08WKrSYDhXBjb5-- From owner-freebsd-virtualization@freebsd.org Wed May 8 05:40:47 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 20ABD159E6C5 for ; Wed, 8 May 2019 05:40:47 +0000 (UTC) (envelope-from jason@corrupted.io) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BA4308C618 for ; Wed, 8 May 2019 05:40:46 +0000 (UTC) (envelope-from jason@corrupted.io) Received: from compute6.internal (compute6.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id A472523D15; Wed, 8 May 2019 01:40:40 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute6.internal (MEProxy); Wed, 08 May 2019 01:40:40 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=corrupted.io; h= content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; s=mesmtp; bh=mzXYUjlhp3G5OnAsqOuSZz92jtGUHmF7+pfMEkDBM8g=; b=VvK46K64n9Mp t4yZkLToYrpm+INklh+NwtsisT6//ImJro9dSd9rHDQQuLC1YOr/cH5fjjoJidfq H7ywUIN5ddDM9pbr1dR3efk/S7+e2Bc192J67CuWHuxmgjqMVRZbStLlMPxNkuNb YrFs5rl0DjFVxyleqlqtMD3Tqa3h3HI= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; bh=mzXYUjlhp3G5OnAsqOuSZz92jtGUHmF7+pfMEkDBM 8g=; b=5YLQ5wm6hr9CSIo0YOpt9s9IZnbqFXDHC1rnaeloij7RNO8OXFkQ3mF3e +tVsGkMlbxG/5oyzchVMlz2ydKFcO5ArX4RNqQHvlaIVqy8AGwp7vn1E74n6l6OA fQSPLadryDnHuIh5TLzCnwR0opuyPnPt2p2qR72u5Yj+DlZANr2IUjMZiEGI1kUb l/+7PGmgaWHreWZWGg5t2p/zoUj6is4kpJzZO67Wqaf0An4soUWrpMKQVyh8kRkn i9OQUR/UQSWdCOgFbbmsu7fNmdTLjG1P4z5lW9ArMZKsr5bANMVU7njjHdtanUIm lCHfC0REKQs6vP8U6NMqiT9ltFv6A== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduuddrkedugdeljecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecufghrlhcuvffnffculdeimdenucfjughrpegtggfuhf fojgffgffkfhfvsehtqhhmtdhhtddvnecuhfhrohhmpeflrghsohhnuceurghrsghivghr uceojhgrshhonhestghorhhruhhpthgvugdrihhoqeenucffohhmrghinhepvhgrshdrth homhhskhdrrhhupdhfrhgvvghnohguvgdrnhgvthenucfkphepieejrdduieekrdegiedr uddtkeenucfrrghrrghmpehmrghilhhfrhhomhepjhgrshhonhestghorhhruhhpthgvug drihhonecuvehluhhsthgvrhfuihiivgeptd X-ME-Proxy: Received: from [192.168.254.73] (c-67-168-46-108.hsd1.wa.comcast.net [67.168.46.108]) by mail.messagingengine.com (Postfix) with ESMTPA id E14C4103C8; Wed, 8 May 2019 01:40:38 -0400 (EDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (1.0) Subject: Re: sysutils/docker-freebsd ? From: Jason Barbier X-Mailer: iPhone Mail (16E227) In-Reply-To: <20190508052211.GA78752@admin.sibptus.ru> Date: Tue, 7 May 2019 22:40:32 -0700 Cc: freebsd-virtualization@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <20190508052211.GA78752@admin.sibptus.ru> To: Victor Sudakov X-Rspamd-Queue-Id: BA4308C618 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.994,0]; REPLY(-4.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 May 2019 05:40:47 -0000 yes there are plans, there is some coordinating going on at ircs://chat.free= node.net/#freebsd-docker but it's nothing impressive right now just a few us= ers starting=20 Sent from my a tiny pocket computer. > On May 7, 2019, at 22:22, Victor Sudakov wrote: >=20 > Dear Colleagues, >=20 > Do you know if there are plans to revive sysutils/docker-freebsd? It has > been "broken" for 2 months, and the FreeBSD Wiki says that > docker-freebsd is the recommended way of running docker apps. >=20 > --=20 > Victor Sudakov, VAS4-RIPE, VAS47-RIPN > 2:5005/49@fidonet http://vas.tomsk.ru/ From owner-freebsd-virtualization@freebsd.org Thu May 9 01:54:00 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3B62D15995B2 for ; Thu, 9 May 2019 01:54:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id CAC4070FF1 for ; Thu, 9 May 2019 01:53:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 8EB9015995AF; Thu, 9 May 2019 01:53:59 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7C6A615995AE for ; Thu, 9 May 2019 01:53:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 196F270FEC for ; Thu, 9 May 2019 01:53:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 61607E69D for ; Thu, 9 May 2019 01:53:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x491rwSW036330 for ; Thu, 9 May 2019 01:53:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x491rwV7036327 for virtualization@FreeBSD.org; Thu, 9 May 2019 01:53:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 237636] bhyve guest ZFS filesystem freezes in zcw->zcw_cv state Date: Thu, 09 May 2019 01:53:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 May 2019 01:54:00 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D237636 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |virtualization@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu May 9 06:52:53 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 97D29159F109 for ; Thu, 9 May 2019 06:52:53 +0000 (UTC) (envelope-from jo@durchholz.org) Received: from 5.itsy.de (5.itsy.de [188.40.84.14]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1E8298140E for ; Thu, 9 May 2019 06:52:51 +0000 (UTC) (envelope-from jo@durchholz.org) Received: from [192.168.178.32] (unknown [195.48.33.209]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by 5.itsy.de (Postfix) with ESMTPSA id 6A9F364029 for ; Thu, 9 May 2019 08:52:43 +0200 (CEST) To: freebsd-virtualization@freebsd.org From: Joachim Durchholz Subject: [maybe OT] Strange behaviour when connecting to serial port of a FreeBSD inside a VM Message-ID: <2c875da4-741b-3601-dd38-b191450497d7@durchholz.org> Date: Thu, 9 May 2019 08:52:42 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 1E8298140E X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.11 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-0.97)[-0.970,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; IP_SCORE(-0.75)[ipnet: 188.40.0.0/16(-2.01), asn: 24940(-1.73), country: DE(-0.01)]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; TO_DN_NONE(0.00)[]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; DMARC_NA(0.00)[durchholz.org]; MX_GOOD(-0.01)[188.40.84.14.durchholz.org]; NEURAL_HAM_SHORT(-0.28)[-0.278,0]; RCVD_IN_DNSWL_NONE(0.00)[14.84.40.188.list.dnswl.org : 127.0.10.0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:188.40.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 May 2019 06:52:53 -0000 Sorry if this off-topic, please direct me to the correct list. I have FreeBSD running inside a VirtualBox VM, and while FreeBSD boots and works fine and I could successfully hook up a host's domain socket, I don't see output on the socket. SOMETHING is working: Some boot messages are redirected, though to a place that I do not see. I have a shell script that recreates the entire situation from scratch, I can describe everything in excruciating detail - where do I start? Regards, Jo From owner-freebsd-virtualization@freebsd.org Thu May 9 07:31:05 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B9006159FB3A for ; Thu, 9 May 2019 07:31:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 529D882410 for ; Thu, 9 May 2019 07:31:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 134C9159FB39; Thu, 9 May 2019 07:31:05 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F4059159FB38 for ; Thu, 9 May 2019 07:31:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 893F682407 for ; Thu, 9 May 2019 07:31:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id CADA31163C for ; Thu, 9 May 2019 07:31:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x497V3gd035561 for ; Thu, 9 May 2019 07:31:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x497V3l3035560 for virtualization@FreeBSD.org; Thu, 9 May 2019 07:31:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 231117] bhyve: I/O lockups inside guests Date: Thu, 09 May 2019 07:31:01 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kwiat3k@panic.pl X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 May 2019 07:31:05 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231117 --- Comment #24 from Mateusz Kwiatkowski --- (In reply to Rodney W. Grimes from comment #23) Rodney, many thanks for your engagement in this matter. It seems that you w= ere right suspecting that arc_max is the culprit. After reducing its size virtu= al machines are working stable for over a day. So, instead of stability issue = this was more like user experience issue. As you see we both were tricked by top= (1) output which looked fine and didn't indicate problem. Is it possible to hav= e a notice printed in dmesg that happens (as we have for other kernel limits)? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu May 9 09:58:06 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2632615A3F1A for ; Thu, 9 May 2019 09:58:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id AE691875F9 for ; Thu, 9 May 2019 09:58:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 6F00015A3F17; Thu, 9 May 2019 09:58:05 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5D77B15A3F16 for ; Thu, 9 May 2019 09:58:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F0040875F3 for ; Thu, 9 May 2019 09:58:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 4DD9112BD7 for ; Thu, 9 May 2019 09:58:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x499w4uJ068915 for ; Thu, 9 May 2019 09:58:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x499w4mJ068913 for virtualization@FreeBSD.org; Thu, 9 May 2019 09:58:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 231117] bhyve: I/O lockups inside guests Date: Thu, 09 May 2019 09:58:01 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kwiat3k@panic.pl X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 May 2019 09:58:06 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231117 --- Comment #25 from Mateusz Kwiatkowski --- (In reply to Mateusz Kwiatkowski from comment #24) I'm afraid I celebrated too soon. I/O in VM locked up - it just took more t= ime. Memory stats: Mem: 3846M Active, 4806M Inact, 26G Wired, 27G Free ARC: 7755M Total, 2419M MFU, 4208M MRU, 14M Anon, 478M Header, 635M Other 6145M Compressed, 10G Uncompressed, 1.68:1 Ratio=20 I'll now test patch with virtio barriers. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Fri May 10 07:54:25 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C6AF7159B2AA for ; Fri, 10 May 2019 07:54:25 +0000 (UTC) (envelope-from jonathans.email@icloud.com) Received: from pv50p00im-ztdg10011901.me.com (pv50p00im-ztdg10011901.me.com [17.58.6.50]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D232194C61 for ; Fri, 10 May 2019 07:54:23 +0000 (UTC) (envelope-from jonathans.email@icloud.com) Received: from [192.168.1.28] (unknown [94.1.145.187]) by pv50p00im-ztdg10011901.me.com (Postfix) with ESMTPSA id 136FC8009A8 for ; Fri, 10 May 2019 07:54:14 +0000 (UTC) From: Jonathan Rowley Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (1.0) Date: Fri, 10 May 2019 08:54:10 +0100 Subject: Unsubscribe Message-Id: <8520A110-26D2-4F0C-B81B-F1D984A8C906@icloud.com> To: freebsd-virtualization@freebsd.org X-Mailer: iPhone Mail (16E227) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:, , definitions=2019-05-09_02:, , signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=1 malwarescore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 mlxscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1812120000 definitions=main-1905100055 X-Rspamd-Queue-Id: D232194C61 X-Spamd-Bar: --------- X-Spamd-Result: default: False [-9.89 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[icloud.com]; R_SPF_ALLOW(-0.20)[+ip4:17.58.0.0/16]; MV_CASE(0.50)[]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[icloud.com:+]; DMARC_POLICY_ALLOW(-0.50)[icloud.com,quarantine]; MX_GOOD(-0.01)[mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, m x6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.co m, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud .com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icloud.com, mx6.mail.icloud.com, mx4.mail.icloud.com, mx5.mail.icloud.com, mx2.mail.icloud.com, mx3.mail.icloud.com, mx1.mail.icl oud.com,mx6.mail.icloud.com,mx4.mail.icloud.com,mx5.mail.icloud.com,mx2.mail.icloud.com,mx3.mail.icloud.com,mx1.mail.icloud.com,mx6.mail.icloud.com,mx4.mail.icloud.com,mx5.mail.icloud.com,mx2.mail.icloud.com,mx3.mail.icloud.com,mx1.mail.icloud.com,mx6.mail.icloud.com,mx4.mail.icloud.com,mx5.mail.icloud.com,mx2.mail.icloud.com,mx3.mail.icloud.com,mx1.mail.icloud.com,mx6.mail.icloud.com,mx4.mail.icloud.com,mx5.mail.icloud.com,mx2.mail.icloud.com,mx3.mail.icloud.com]; NEURAL_HAM_SHORT(-0.95)[-0.947,0]; RCVD_IN_DNSWL_LOW(-0.10)[50.6.58.17.list.dnswl.org : 127.0.5.1]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[icloud.com]; ASN(0.00)[asn:714, ipnet:17.58.0.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[icloud.com:s=04042017]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_LOW(-1.00)[icloud.com.dwl.dnswl.org : 127.0.5.1]; IP_SCORE(-2.33)[ip: (-6.73), ipnet: 17.58.0.0/20(-2.55), asn: 714(-2.30), country: US(-0.06)]; WHITELIST_SPF_DKIM(-3.00)[icloud.com:d:+,icloud.com:s:+]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 May 2019 07:54:26 -0000 > On 9 May 2019, at 13:00, freebsd-virtualization-request@freebsd.org wrote:= >=20 > Send freebsd-virtualization mailing list submissions to > freebsd-virtualization@freebsd.org >=20 > To subscribe or unsubscribe via the World Wide Web, visit > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > or, via email, send a message with subject or body 'help' to > freebsd-virtualization-request@freebsd.org >=20 > You can reach the person managing the list at > freebsd-virtualization-owner@freebsd.org >=20 > When replying, please edit your Subject line so it is more specific > than "Re: Contents of freebsd-virtualization digest..." >=20 >=20 > Today's Topics: >=20 > 1. [Bug 237636] bhyve guest ZFS filesystem freezes in > zcw->zcw_cv state (bugzilla-noreply@freebsd.org) > 2. [maybe OT] Strange behaviour when connecting to serial port > of a FreeBSD inside a VM (Joachim Durchholz) > 3. [Bug 231117] bhyve: I/O lockups inside guests > (bugzilla-noreply@freebsd.org) > 4. [Bug 231117] bhyve: I/O lockups inside guests > (bugzilla-noreply@freebsd.org) >=20 >=20 > ---------------------------------------------------------------------- >=20 > Message: 1 > Date: Thu, 09 May 2019 01:53:57 +0000 > From: bugzilla-noreply@freebsd.org > To: virtualization@FreeBSD.org > Subject: [Bug 237636] bhyve guest ZFS filesystem freezes in > zcw->zcw_cv state > Message-ID: > > Content-Type: text/plain; charset=3D"UTF-8" >=20 > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D237636 >=20 > Mark Linimon changed: >=20 > What |Removed |Added > --------------------------------------------------------------------------= -- > Assignee|bugs@FreeBSD.org |virtualization@FreeBSD.org= >=20 > --=20 > You are receiving this mail because: > You are the assignee for the bug. >=20 > ------------------------------ >=20 > Message: 2 > Date: Thu, 9 May 2019 08:52:42 +0200 > From: Joachim Durchholz > To: freebsd-virtualization@freebsd.org > Subject: [maybe OT] Strange behaviour when connecting to serial port > of a FreeBSD inside a VM > Message-ID: <2c875da4-741b-3601-dd38-b191450497d7@durchholz.org> > Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed >=20 > Sorry if this off-topic, please direct me to the correct list. >=20 > I have FreeBSD running inside a VirtualBox VM, and while FreeBSD boots=20 > and works fine and I could successfully hook up a host's domain socket,=20= > I don't see output on the socket. > SOMETHING is working: Some boot messages are redirected, though to a=20 > place that I do not see. >=20 > I have a shell script that recreates the entire situation from scratch,=20= > I can describe everything in excruciating detail - where do I start? >=20 > Regards, > Jo >=20 >=20 > ------------------------------ >=20 > Message: 3 > Date: Thu, 09 May 2019 07:31:01 +0000 > From: bugzilla-noreply@freebsd.org > To: virtualization@FreeBSD.org > Subject: [Bug 231117] bhyve: I/O lockups inside guests > Message-ID: > > Content-Type: text/plain; charset=3D"UTF-8" >=20 > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231117 >=20 > --- Comment #24 from Mateusz Kwiatkowski --- > (In reply to Rodney W. Grimes from comment #23) >=20 > Rodney, many thanks for your engagement in this matter. It seems that you w= ere > right suspecting that arc_max is the culprit. After reducing its size virt= ual > machines are working stable for over a day. So, instead of stability issue= this > was more like user experience issue. As you see we both were tricked by to= p(1) > output which looked fine and didn't indicate problem. Is it possible to ha= ve a > notice printed in dmesg that happens (as we have for other kernel limits)?= >=20 > --=20 > You are receiving this mail because: > You are the assignee for the bug. >=20 > ------------------------------ >=20 > Message: 4 > Date: Thu, 09 May 2019 09:58:01 +0000 > From: bugzilla-noreply@freebsd.org > To: virtualization@FreeBSD.org > Subject: [Bug 231117] bhyve: I/O lockups inside guests > Message-ID: > > Content-Type: text/plain; charset=3D"UTF-8" >=20 > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231117 >=20 > --- Comment #25 from Mateusz Kwiatkowski --- > (In reply to Mateusz Kwiatkowski from comment #24) > I'm afraid I celebrated too soon. I/O in VM locked up - it just took more t= ime. >=20 > Memory stats: > Mem: 3846M Active, 4806M Inact, 26G Wired, 27G Free > ARC: 7755M Total, 2419M MFU, 4208M MRU, 14M Anon, 478M Header, 635M Other > 6145M Compressed, 10G Uncompressed, 1.68:1 Ratio=20 >=20 > I'll now test patch with virtio barriers. >=20 > --=20 > You are receiving this mail because: > You are the assignee for the bug. >=20 > ------------------------------ >=20 > Subject: Digest Footer >=20 > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freeb= sd.org" >=20 >=20 > ------------------------------ >=20 > End of freebsd-virtualization Digest, Vol 441, Issue 4 > ****************************************************** From owner-freebsd-virtualization@freebsd.org Fri May 10 16:37:00 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 295C615A6EEA for ; Fri, 10 May 2019 16:37:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id A8BE880398 for ; Fri, 10 May 2019 16:36:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 6979115A6EE9; Fri, 10 May 2019 16:36:59 +0000 (UTC) Delivered-To: virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 56F4615A6EE8 for ; Fri, 10 May 2019 16:36:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E73178038F for ; Fri, 10 May 2019 16:36:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 351593254 for ; Fri, 10 May 2019 16:36:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x4AGawF8066546 for ; Fri, 10 May 2019 16:36:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x4AGawv8066545 for virtualization@FreeBSD.org; Fri, 10 May 2019 16:36:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 200859] [bhyve] vbsc_ident buffer accessed out of bounds Date: Fri, 10 May 2019 16:36:57 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: araujo@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 May 2019 16:37:00 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D200859 --- Comment #6 from commit-hook@freebsd.org --- A commit references this bug: Author: jhb Date: Fri May 10 16:36:38 UTC 2019 New revision: 347436 URL: https://svnweb.freebsd.org/changeset/base/347436 Log: MFC 340707: Define AHCI_PORT_IDENT and increase by 1 the VTBLK_BLK_ID_BYTES to avoid buffer accessed out of bounds, also switch to snprintf(3). PR: 200859 Changes: _U stable/11/ stable/11/usr.sbin/bhyve/pci_ahci.c stable/11/usr.sbin/bhyve/pci_virtio_block.c --=20 You are receiving this mail because: You are on the CC list for the bug.=