From owner-freebsd-virtualization@freebsd.org Mon Oct 14 18:52:37 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4912913350B; Mon, 14 Oct 2019 18:52:37 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from mx0b-00273201.pphosted.com (mx0b-00273201.pphosted.com [67.231.152.164]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.pphosted.com", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46sSNh2cYyz3F88; Mon, 14 Oct 2019 18:52:36 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from pps.filterd (m0108160.ppops.net [127.0.0.1]) by mx0b-00273201.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id x9EIqYJ7021781; Mon, 14 Oct 2019 11:52:34 -0700 Received: from nam05-dm3-obe.outbound.protection.outlook.com (mail-dm3nam05lp2056.outbound.protection.outlook.com [104.47.49.56]) by mx0b-00273201.pphosted.com with ESMTP id 2vmtf4rdj4-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 14 Oct 2019 11:52:34 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=kQnFGEmKSzp/mcGzwYnFww9WnRaZ/pFWS0XJMJJJD2ZOoqrhF7mnfjj2tqg0bAmnDZSRDQJ2Vz7VdPS1haVz30x9nMH4XgyphDVcgFllTGmXJEuq4usoS+ZocKhZPHQwpIlVladmuGCVYSBPhm+dTHOr73p2D9CCWJbWhyZUfMop1EzD1m9Rcqzv6z0oupyqOdPyc+2k6pjFvjKWOAwsz03rUgpcWiw0j6YKeySk0KViO6Y1J4r8nMIst4NvDxBNTyxl4ZoPW7TJONs02Fq9cqupT6dzglyl2IGJ3Gh4tnB/B7XWQ3YQynMLuKeq4gFf/uyo7nQELMZuOF/avwBs0Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=7pbEtrnHkTUH1/Kq6lo58dRG1EnpGN12BLQFPBltO4I=; b=ix/tWmw36dLHf2S6gzYV76T2UBPfVQ/W9bQQXbT+Q1Fn20gqpq4BdAM9jclilMyslwE6mEgrgXu/IAUGMQy2/myLHTxK8OngUAarsiZHlgQP6ntGAaaoMCOlhTIoAzCtN91y3O0Z4o3LINF0cypz9siwySgDSLePWZEtJAetUW/qY4Tb3vEITfB5cUUQAWZXGdp0IVUNFzQmZQvH7HQ0SNKg/9Nv8nFN/0ZyjVnBGYvTkCawbIYhRPBwEVmCm2pzWRc1iebdI6FGAH3Eeu82k+bziRizqJcBfTAzL/qEWHLwSArF9x6fJ0xHO7gKDA9MvSFRCzkeGFOOh2RP3RPUMg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=softfail (sender ip is 66.129.239.13) smtp.rcpttodomain=freebsd.org smtp.mailfrom=juniper.net; dmarc=fail (p=reject sp=reject pct=100) action=oreject header.from=juniper.net; dkim=none (message not signed); arc=none Received: from SN4PR0501CA0115.namprd05.prod.outlook.com (2603:10b6:803:42::32) by BN7PR05MB4353.namprd05.prod.outlook.com (2603:10b6:406:f6::32) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2347.13; Mon, 14 Oct 2019 18:52:32 +0000 Received: from DM3NAM05FT045.eop-nam05.prod.protection.outlook.com (2a01:111:f400:7e51::203) by SN4PR0501CA0115.outlook.office365.com (2603:10b6:803:42::32) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2367.5 via Frontend Transport; Mon, 14 Oct 2019 18:52:31 +0000 Received-SPF: SoftFail (protection.outlook.com: domain of transitioning juniper.net discourages use of 66.129.239.13 as permitted sender) Received: from P-EXFEND-EQX-02.jnpr.net (66.129.239.13) by DM3NAM05FT045.mail.protection.outlook.com (10.152.98.159) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.2367.5 via Frontend Transport; Mon, 14 Oct 2019 18:52:31 +0000 Received: from P-EXBEND-EQX-01.jnpr.net (10.104.8.52) by P-EXFEND-EQX-02.jnpr.net (10.104.8.55) with Microsoft SMTP Server (TLS) id 15.0.1367.3; Mon, 14 Oct 2019 11:52:30 -0700 Received: from p-mailhub01.juniper.net (10.104.20.6) by P-EXBEND-EQX-01.jnpr.net (10.104.8.52) with Microsoft SMTP Server (TLS) id 15.0.1367.3 via Frontend Transport; Mon, 14 Oct 2019 11:52:30 -0700 Received: from kaos.jnpr.net (kaos.jnpr.net [172.23.50.162]) by p-mailhub01.juniper.net (8.14.4/8.11.3) with ESMTP id x9EIqTCI028584; Mon, 14 Oct 2019 11:52:29 -0700 (envelope-from sjg@juniper.net) Received: by kaos.jnpr.net (Postfix, from userid 1377) id 41BAC3463B; Mon, 14 Oct 2019 11:52:29 -0700 (PDT) Received: from kaos.jnpr.net (localhost [127.0.0.1]) by kaos.jnpr.net (Postfix) with ESMTP id 401733463A; Mon, 14 Oct 2019 11:52:29 -0700 (PDT) To: Tomasz CEDRO CC: grarpamp , , , , Subject: Re: AMD Secure Encrypted Virtualization - FreeBSD Status? In-Reply-To: References: Comments: In-reply-to: Tomasz CEDRO message dated "Thu, 03 Oct 2019 18:10:16 +0200." From: "Simon J. Gerraty" X-Mailer: MH-E 8.6+git; nmh 1.7.1; GNU Emacs 26.1 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <75549.1571079149.1@kaos.jnpr.net> Date: Mon, 14 Oct 2019 11:52:29 -0700 Message-ID: <76102.1571079149@kaos.jnpr.net> X-EXCLAIMER-MD-CONFIG: e3cb0ff2-54e7-4646-8a04-0dae4ac7b136 X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-HT: Tenant X-Forefront-Antispam-Report: CIP:66.129.239.13; IPV:NLI; CTRY:US; EFV:NLI; SFV:NSPM; SFS:(10019020)(39860400002)(396003)(136003)(376002)(346002)(199004)(189003)(76176011)(336012)(316002)(54906003)(16586007)(70206006)(70586007)(478600001)(2906002)(126002)(14444005)(486006)(97876018)(446003)(11346002)(7126003)(46406003)(4326008)(476003)(45080400002)(5660300002)(47776003)(53416004)(4744005)(50466002)(86362001)(23726003)(356004)(9686003)(6266002)(117636001)(55016002)(50226002)(6916009)(186003)(107886003)(8936002)(8676002)(81156014)(81166006)(26005)(229853002)(305945005)(7696005)(97756001)(76506006)(6246003)(6606295002); DIR:OUT; SFP:1102; SCL:1; SRVR:BN7PR05MB4353; H:P-EXFEND-EQX-02.jnpr.net; FPR:; SPF:SoftFail; LANG:en; PTR:InfoDomainNonexistent; A:1; MX:1; X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 85c6b498-dc7c-4cb1-47d9-08d750d7ab3b X-MS-TrafficTypeDiagnostic: BN7PR05MB4353: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:8273; X-Forefront-PRVS: 01901B3451 X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: lR0z13dyPjSN89xCwTpEULla8Lv/MEHBhEY193I2sBd9wry8WEQV/R6QsmsbGzHDHenamf07eZo0nwpxC5O+i98WmlW2vWOOnd9TPzG96Xkmz730R3StWSFfiNeuEZRDxL/G5n6x6c+1dVaqT4XImGp/aX90FwL9gmKGdjl43jlHmAexnxor+ofMO5BxEq2UVq0MlQfGVBVDalGN5Nhen8Rm5eb856q4pPkQwfSOQhu+Ega7E1fJ20COsmWDB72czSCrM9AL8j6zIUdBmTDfMp+uhLDxOWrp0XJjcqmoW4VcR4TrZuW1n//bO6yKzodcPnHgdAuozYGk07AkosVZbEFaBFfiFXDD6gFeN4fS+snFHqJ/oqfYleADEk/rm+4d+iWRBWs6WLZrDhzfIFJuFbC+a6fseArjxnhi0uoxW5E= X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Oct 2019 18:52:31.6283 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 85c6b498-dc7c-4cb1-47d9-08d750d7ab3b X-MS-Exchange-CrossTenant-Id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=bea78b3c-4cdb-4130-854a-1d193232e5f4; Ip=[66.129.239.13]; Helo=[P-EXFEND-EQX-02.jnpr.net] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN7PR05MB4353 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.95,1.0.8 definitions=2019-10-14_09:2019-10-11,2019-10-14 signatures=0 X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 priorityscore=1501 lowpriorityscore=0 spamscore=0 impostorscore=0 suspectscore=3 mlxscore=0 malwarescore=0 mlxlogscore=643 phishscore=0 adultscore=0 bulkscore=0 clxscore=1011 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-1908290000 definitions=main-1910140153 X-Rspamd-Queue-Id: 46sSNh2cYyz3F88 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.03 / 15.00]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[juniper.net:s=PPS1017]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:67.231.152.164]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(-0.93)[ip: (-2.15), ipnet: 67.231.152.0/24(-0.94), asn: 22843(-1.49), country: US(-0.05)]; ARC_ALLOW(-1.00)[i=1]; RCPT_COUNT_FIVE(0.00)[6]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[juniper.net:+]; DMARC_POLICY_ALLOW(-0.50)[juniper.net,reject]; RCVD_IN_DNSWL_LOW(-0.10)[164.152.231.67.list.dnswl.org : 127.0.3.1]; SUBJECT_ENDS_QUESTION(1.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:22843, ipnet:67.231.152.0/24, country:US]; FREEMAIL_CC(0.00)[gmail.com]; RCVD_COUNT_SEVEN(0.00)[10]; FROM_EQ_ENVFROM(0.00)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Oct 2019 18:52:37 -0000 Tomasz CEDRO wrote: > would be really nice also to get UEFI BOOT compatible with SECURE BOOT :-) Unless you are using your own BIOS, the above means getting Microsoft to sign boot1.efi or similar. Shims that simply work around lack of acceptible signature don't help. That would need to then verify loader.efi - which can be built to to verify all the modules and kernel. In my implementation (uses the non efi loader) trust anchors are embedded in loader but there is code in current to lookup trust anchors in /efi I think which would be more generally useful - I've not looked at the attack vectors that introduces though. --sjg From owner-freebsd-virtualization@freebsd.org Mon Oct 14 19:18:31 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 34B3E1349B4; Mon, 14 Oct 2019 19:18:31 +0000 (UTC) (envelope-from clay.daniels.jr@gmail.com) Received: from mail-ua1-x943.google.com (mail-ua1-x943.google.com [IPv6:2607:f8b0:4864:20::943]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46sSyZ2xxlz3Gxf; Mon, 14 Oct 2019 19:18:30 +0000 (UTC) (envelope-from clay.daniels.jr@gmail.com) Received: by mail-ua1-x943.google.com with SMTP id r19so5313844uap.9; Mon, 14 Oct 2019 12:18:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Gz9cgMHiiw0wJ5m7+flRU30EhwdWMFKdcrP7eM/S6K8=; b=KUdFAfDWRpZFbgsnAahNGKjEtTMnqx/RsNL4CrrORJ+3MoK6/y/mOzS3qkwnmgemSV VUehAAkwzpKkLZ7gORYDHXI6IngoaMUM94Uzlvlg6Sx5kbiRK6H/YCutL4TR5FxWc+hj Ypr+UoWciOkE8OIA/sdyvTmxm1IflhoiRrJqIup4CTrmNNMAWA2mbg43Q9G80bCDQeHU ACw4elO1Rh8nRxBtKHGThcD5trun0bvde0V9puU1/jIksVrPjFPZRa/xwONoDhC13EMY wguOLkbg1wMCx0mvtd2GErLc6RClonS1VlBJ6unPYR4/trNfvS73IMRFcFVwXwnmaA4a uf6A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Gz9cgMHiiw0wJ5m7+flRU30EhwdWMFKdcrP7eM/S6K8=; b=l6TuJog9KOqNuYzs3KbLsof3zpGmNaHOhivb22X17CQOVBJm+LQTRu0YKFGHPv2yx3 L1q4Eohsj8V05Qwsy9UNY5KsZHfkqU5fNgeut5ncJyR9Oa/rGdTKpLDLNPiGYuarbSDe wp5u1s3IAfnnBHtVvKZ//UBTCe/DFzvMko1sxUGTXD91T2lv/jJcZWfDlyntK6TUNWaF vTZugYdkmS16WDnehe3uEt6oyC+fQt9y8Kf9p1tk8Vd3eW/QsmboO2xgP8tBkw+hFf+P 81iEN8jXWN80sgkV0IQrZFZ7X6o0mW0ES/bFypTHYvekEJY2xGxDSGU3MiIOQdEBcOOU 9LSw== X-Gm-Message-State: APjAAAU0omTK7BCM7xGImmhpQpNAHlwL6qN4W7PoGPmjod22dWfgj2eR KxTwenTFNhXMjpEePM5q9FXU+FQ64ymK94OqAA== X-Google-Smtp-Source: APXvYqwKi9x3tUPCGqIKAVHB8t2WQ38cy0DLw7YFCW8Mxapb2m0hIwANnWQjUgmXWJ3OK/IO/3o72emQKAMmD0Dnfu0= X-Received: by 2002:ab0:7451:: with SMTP id p17mr8969505uaq.18.1571080708946; Mon, 14 Oct 2019 12:18:28 -0700 (PDT) MIME-Version: 1.0 References: <76102.1571079149@kaos.jnpr.net> In-Reply-To: <76102.1571079149@kaos.jnpr.net> From: "Clay Daniels Jr." Date: Mon, 14 Oct 2019 14:18:18 -0500 Message-ID: Subject: Re: AMD Secure Encrypted Virtualization - FreeBSD Status? To: "Simon J. Gerraty" Cc: Tomasz CEDRO , "freebsd-security@freebsd.org" , "freebsd-current@freebsd.org" , grarpamp , freebsd-virtualization@freebsd.org X-Rspamd-Queue-Id: 46sSyZ2xxlz3Gxf X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=KUdFAfDW; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of claydanielsjr@gmail.com designates 2607:f8b0:4864:20::943 as permitted sender) smtp.mailfrom=claydanielsjr@gmail.com X-Spamd-Result: default: False [-1.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; URI_COUNT_ODD(1.00)[3]; RCPT_COUNT_FIVE(0.00)[6]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; SUBJECT_ENDS_QUESTION(1.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; IP_SCORE(0.00)[ip: (2.61), ipnet: 2607:f8b0::/32(-2.50), asn: 15169(-2.11), country: US(-0.05)]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[3.4.9.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Oct 2019 19:18:31 -0000 Simon, please do elaborate more on your implementation. I suspect you are talking about libsecureboot? I have played with the generation of certs with OpenSSL & LibreSSL, but libsecureboot seems to take a different approach. Please tell us more. Clay On Mon, Oct 14, 2019 at 1:52 PM Simon J. Gerraty via freebsd-security < freebsd-security@freebsd.org> wrote: > Tomasz CEDRO wrote: > > > would be really nice also to get UEFI BOOT compatible with SECURE BOOT > :-) > > Unless you are using your own BIOS, the above means getting Microsoft > to sign boot1.efi or similar. Shims that simply work around lack of > acceptible signature don't help. > > That would need to then verify loader.efi - which can be built to > to verify all the modules and kernel. > > In my implementation (uses the non efi loader) trust anchors are > embedded in loader but there is code in current to lookup trust anchors > in /efi I think which would be more generally useful - I've not looked > at the attack vectors that introduces though. > > --sjg > _______________________________________________ > freebsd-security@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-security > To unsubscribe, send any mail to "freebsd-security-unsubscribe@freebsd.org > " > From owner-freebsd-virtualization@freebsd.org Mon Oct 14 20:21:48 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0AE48136264; Mon, 14 Oct 2019 20:21:48 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from mx0b-00273201.pphosted.com (mx0b-00273201.pphosted.com [67.231.152.164]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.pphosted.com", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46sVMZ5gHpz3Kxc; Mon, 14 Oct 2019 20:21:46 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from pps.filterd (m0108163.ppops.net [127.0.0.1]) by mx0b-00273201.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id x9EKL3In003404; Mon, 14 Oct 2019 13:21:43 -0700 Received: from nam05-by2-obe.outbound.protection.outlook.com (mail-by2nam05lp2059.outbound.protection.outlook.com [104.47.50.59]) by mx0b-00273201.pphosted.com with ESMTP id 2vmvsn89e5-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Mon, 14 Oct 2019 13:21:43 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=BzjNyY0hqdJNw0JtsZQnau6OMTMmRv1LD5LNA6h2+Hgk0eKTR++kilp9CtmGFYCkywIVmObbopUReNC7/f/QAv2sgTpeJo705rhaTDhdwCsVQ23jN2x9TRc0UJZCyNwkgMxlmKyERfeZKFuQYRen2hoAdf9cmLBYc4/qAeR+wBzOlwhcP0J2P67L9zXZ5WARTuBuuUoMxRF8M+Bd54Lz/knJlplCe0OV/K8fykJ6C8AppgpSX+A89dWiz9wVLCiWOL3mcH3vmynF/eP/KZIbVSMzlQ/bChyh1K3+CdTMxbN7aIDjll/TPXfbjDXKqwER3axHL08U1wa6S+LenqL86w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=QU6b2+J+lZWDOAHqhtlg3vvyfCiPZRQjdNFopsuO0u4=; b=E/QdLKDhLzB3tA15IqqdVcYuIJaJJEbgO/9WfJijFQTshlIhTTpqrcV7MMsej6ZFnZ67ndH0mERGijYK3PISm58/TK3P0qs+dIIiGe0k3KfMMJIY2Rlz4DoxPHTUpEZhEcwdXk6QxPK/9M3fVV1bPirFQjwOgKOtKLSohzfosoXkgt+Y8sf2uOiqbCxCZ1SwFY2ZR2eKUm/UUxIEfaHx3j5p5uSY8XG7Jr88731sWrQPClKVY9Vf5ukGZ4wb558bCe/Hi068wOsc8Drh1tobQAfo0kg87IlPhISaSJDEzTYqNen9P/lj5/Wy4/r8RQGTYpuCIkIAylzOdW1cxPbQ+g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=softfail (sender ip is 66.129.239.12) smtp.rcpttodomain=freebsd.org smtp.mailfrom=juniper.net; dmarc=fail (p=reject sp=reject pct=100) action=oreject header.from=juniper.net; dkim=none (message not signed); arc=none Received: from BN6PR05CA0001.namprd05.prod.outlook.com (2603:10b6:405:39::14) by BYAPR05MB4773.namprd05.prod.outlook.com (2603:10b6:a03:4e::31) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2347.15; Mon, 14 Oct 2019 20:21:40 +0000 Received: from BY2NAM05FT028.eop-nam05.prod.protection.outlook.com (2a01:111:f400:7e52::207) by BN6PR05CA0001.outlook.office365.com (2603:10b6:405:39::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2347.16 via Frontend Transport; Mon, 14 Oct 2019 20:21:40 +0000 Received-SPF: SoftFail (protection.outlook.com: domain of transitioning juniper.net discourages use of 66.129.239.12 as permitted sender) Received: from P-EXFEND-EQX-01.jnpr.net (66.129.239.12) by BY2NAM05FT028.mail.protection.outlook.com (10.152.100.165) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.2367.5 via Frontend Transport; Mon, 14 Oct 2019 20:21:39 +0000 Received: from P-EXBEND-EQX-01.jnpr.net (10.104.8.52) by P-EXFEND-EQX-01.jnpr.net (10.104.8.54) with Microsoft SMTP Server (TLS) id 15.0.1367.3; Mon, 14 Oct 2019 13:21:39 -0700 Received: from p-mailhub01.juniper.net (10.104.20.6) by P-EXBEND-EQX-01.jnpr.net (10.104.8.52) with Microsoft SMTP Server (TLS) id 15.0.1367.3 via Frontend Transport; Mon, 14 Oct 2019 13:21:38 -0700 Received: from kaos.jnpr.net (kaos.jnpr.net [172.23.50.162]) by p-mailhub01.juniper.net (8.14.4/8.11.3) with ESMTP id x9EKLcPb012775; Mon, 14 Oct 2019 13:21:38 -0700 (envelope-from sjg@juniper.net) Received: by kaos.jnpr.net (Postfix, from userid 1377) id 69FB43467A; Mon, 14 Oct 2019 13:21:38 -0700 (PDT) Received: from kaos.jnpr.net (localhost [127.0.0.1]) by kaos.jnpr.net (Postfix) with ESMTP id 6981234679; Mon, 14 Oct 2019 13:21:38 -0700 (PDT) To: Clay Daniels Jr. CC: Tomasz CEDRO , "freebsd-security@freebsd.org" , "freebsd-current@freebsd.org" , grarpamp , , Subject: Re: AMD Secure Encrypted Virtualization - FreeBSD Status? In-Reply-To: References: <76102.1571079149@kaos.jnpr.net> Comments: In-reply-to: "Clay Daniels Jr." message dated "Mon, 14 Oct 2019 14:18:18 -0500." From: "Simon J. Gerraty" X-Mailer: MH-E 8.6+git; nmh 1.7.1; GNU Emacs 26.1 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <54832.1571084498.1@kaos.jnpr.net> Content-Transfer-Encoding: quoted-printable Date: Mon, 14 Oct 2019 13:21:38 -0700 Message-ID: <56226.1571084498@kaos.jnpr.net> X-EXCLAIMER-MD-CONFIG: e3cb0ff2-54e7-4646-8a04-0dae4ac7b136 X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-HT: Tenant X-Forefront-Antispam-Report: CIP:66.129.239.12; IPV:NLI; CTRY:US; EFV:NLI; SFV:NSPM; SFS:(10019020)(376002)(396003)(136003)(39860400002)(346002)(199004)(189003)(23726003)(81156014)(8676002)(107886003)(117636001)(6266002)(6246003)(81166006)(97756001)(7696005)(76176011)(966005)(5660300002)(55016002)(86362001)(9686003)(6916009)(50226002)(6306002)(476003)(126002)(46406003)(7126003)(2906002)(53546011)(486006)(336012)(54906003)(356004)(76506006)(11346002)(186003)(26005)(478600001)(50466002)(14444005)(4326008)(47776003)(45080400002)(446003)(70206006)(8936002)(8746002)(70586007)(316002)(97876018)(305945005)(53416004)(229853002)(2690400003)(6606295002); DIR:OUT; SFP:1102; SCL:1; SRVR:BYAPR05MB4773; H:P-EXFEND-EQX-01.jnpr.net; FPR:; SPF:SoftFail; LANG:en; PTR:InfoDomainNonexistent; A:1; MX:1; X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 7aedafa5-d975-4596-367e-08d750e41f14 X-MS-TrafficTypeDiagnostic: BYAPR05MB4773: X-MS-Exchange-PUrlCount: 2 X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:9508; X-Forefront-PRVS: 01901B3451 X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: NrpZk69hHtIEZ4YfybJ+CkAnDM6GolxLuv0x8UThUbLi4BnIff0UHF8mSym5cjZKjdo+c4SH/xeHQvLHzDTpcWQcUY1jA8gZ+zZDxfqJSGMfMC/uBLjQdyF1sTzAlBDOQwNm3gyqIwNrD46VsHySBm0hTm4YRCQga1KIDlsq5Rh7m4k25OtNpEC5005le+iScbq7uUzeGrmCU1URcGd1oSBp1pg/0LstkKPClgausQTD85jrd21Jz/MIgw7oZfJTQf7SaZumo7R+a7cA941H4dEGblwzP22xsFk5tyAeWbKtxhuoo40NV3ozXxMWX+esgQ43q01IQCGxzJLmc4W63vpAV691hegy/F3jyXSSnTcMGMBpps77tIiLUyOuQjx3kVbnvn6M6Qf4XmyTYJTklcOxcO3aiIRt5y+lmQPvjH2ArQ+f3z+Y7KladSaZrKu4IC/H4Klix8JZ+HSuEAdJUA== X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Oct 2019 20:21:39.9637 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 7aedafa5-d975-4596-367e-08d750e41f14 X-MS-Exchange-CrossTenant-Id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=bea78b3c-4cdb-4130-854a-1d193232e5f4; Ip=[66.129.239.12]; Helo=[P-EXFEND-EQX-01.jnpr.net] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR05MB4773 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.95,1.0.8 definitions=2019-10-14_10:2019-10-11,2019-10-14 signatures=0 X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 mlxscore=0 malwarescore=0 spamscore=0 phishscore=0 adultscore=0 clxscore=1011 priorityscore=1501 impostorscore=0 lowpriorityscore=0 suspectscore=1 bulkscore=0 mlxlogscore=999 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-1908290000 definitions=main-1910140169 X-Rspamd-Queue-Id: 46sVMZ5gHpz3Kxc X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.53 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[juniper.net:s=PPS1017]; RCVD_COUNT_SEVEN(0.00)[10]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:67.231.152.164]; IP_SCORE(-0.93)[ip: (-2.15), ipnet: 67.231.152.0/24(-0.94), asn: 22843(-1.49), country: US(-0.05)]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[juniper.net:+]; DMARC_POLICY_ALLOW(-0.50)[juniper.net,reject]; RCPT_COUNT_SEVEN(0.00)[7]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_IN_DNSWL_LOW(-0.10)[164.152.231.67.list.dnswl.org : 127.0.3.1]; SUBJECT_ENDS_QUESTION(1.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:22843, ipnet:67.231.152.0/24, country:US]; ARC_ALLOW(-1.00)[i=1]; SUSPICIOUS_RECIPS(1.50)[]; FROM_EQ_ENVFROM(0.00)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Oct 2019 20:21:48 -0000 Clay Daniels Jr. wrote: > Simon, please do elaborate more on your implementation. I suspect you ar= e > talking about libsecureboot? I have played with the generation of certs > with OpenSSL & LibreSSL, but libsecureboot seems to take a different > approach. Please tell us more. Yes I meant libsecureboot. You should be able to create keys and certs with OpenSSL. That's all we use, but we keep all the private keys etc isolated in signing servers. The local.trust.mk in libsecureboot leverages the sign.py etc described at http://www.crufty.net/sjg/blog/signing-server.htm (which also contains a link to the src) But that does not alter the fact that the certs are simply those created by an OpenSSL based CA - there are a number of good tutorials on the net on how to setup such things. With all that said; you may find it more useful to use OpenPGP for signing we again use sign.py to retrieve OpenPGP public key, but you can do all you need using nothing more than gpg For an embedded vendor like Juniper X.509 makes a lot of sense. For an individual or small scale, OpenPGP is likely simpler. libsecureboot supports both, but you need to tailor local.trust.mk to suit. IIRC you can have local.trust.mk simply set TA_PEM_LIST etc to paths of pre-prepared pem files containing your trust anchors and ta.h and/or TA_ASC_LIST to a list of .asc files containing ascii armored openpgp trust anchors. BTW in current boot1.efi is no more, loader.efi is used. [I'm still mucking about trying to get a VM image booting using efi...] > = > Clay > = > On Mon, Oct 14, 2019 at 1:52 PM Simon J. Gerraty via freebsd-security < > freebsd-security@freebsd.org> wrote: > = > > Tomasz CEDRO wrote: > > > > > would be really nice also to get UEFI BOOT compatible with SECURE BO= OT > > :-) > > > > Unless you are using your own BIOS, the above means getting Microsoft > > to sign boot1.efi or similar. Shims that simply work around lack of > > acceptible signature don't help. > > > > That would need to then verify loader.efi - which can be built to > > to verify all the modules and kernel. > > > > In my implementation (uses the non efi loader) trust anchors are > > embedded in loader but there is code in current to lookup trust anchor= s > > in /efi I think which would be more generally useful - I've not looked > > at the attack vectors that introduces though. > > > > --sjg > > _______________________________________________ > > freebsd-security@freebsd.org mailing list > > https://urldefense.com/v3/__https://lists.freebsd.org/mailman/listinfo= /freebsd-security__;!8WoA6RjC81c!TLaVmP78NH0BviSHHV_3_V0-ispe2o0I7E59vmxZ_= 8XnbmOYxeHxemscoWsaXA$ = > > To unsubscribe, send any mail to "freebsd-security-unsubscribe@freebsd= .org > > " > > From owner-freebsd-virtualization@freebsd.org Tue Oct 15 01:59:39 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 405C0148456; Tue, 15 Oct 2019 01:59:39 +0000 (UTC) (envelope-from grarpamp@gmail.com) Received: from mail-io1-xd42.google.com (mail-io1-xd42.google.com [IPv6:2607:f8b0:4864:20::d42]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46sdsQ1Q64z4QQq; Tue, 15 Oct 2019 01:59:37 +0000 (UTC) (envelope-from grarpamp@gmail.com) Received: by mail-io1-xd42.google.com with SMTP id u8so42295720iom.5; Mon, 14 Oct 2019 18:59:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=9FlJis/L80zp9NhdCoReL86OUQFSm6oYFqN9sYz4+MU=; b=RYPNT0myM6QDjochOfcobDS0rxsut6Byi3EnTEJVa9g1qXcAHoNxBziZd/9mtXEVNX jDV8lPGf5tOTAZjiU1UBU7AaIMznQx6VfCgdS29NDQ3tm+ucLhFEe75zhgm3+qB+Vtxk uMtoMcxTE/xQxR0FYUt4/3l4Q14Gl2ERWbcY2XPHXLxNDMxF/6M1bpjzi9AwULYQLCMy YgmKZpoh7/rVLzroZBq82Sx4FsFTF5SUUuhcEh0D9o3mq0CzzJOJ+bjvAWD8BMuObafj gEMP/PcSOdKfyegNQ9hgsGEu5sJoO3c6l2JuY4pRsVAWeBfEkgL43RpVRUCO7H/SAW1Y rrtQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=9FlJis/L80zp9NhdCoReL86OUQFSm6oYFqN9sYz4+MU=; b=RMAWJUts9OjiBe6153kEeT7M19rWNsN3YbaJivAqfuohzoi//Kr5SYVxnmwD1u3Wj4 Bt7cffA4j6SOaWaSZJQbRL+oZ5XazKLLPiwu8n9k646rlmB32Fo3nQbPiR7WKT7qxKn7 l9Om7U6ztazKmIC+hJz4ZEGwH1qJCw+mWHyGHwATWoRe6mJJRoZdbMcaI62oH0zJWSCD DnRWTUjebPv4zTz03AjHES3yH8sHS8qpHIP+k8Pn5L8obP99BBAyR1RbZVQfnfKuN7/U UDzQUkYPJh7tw5vXiFBqEKcnOab+RAwkZ7j3XYz/5sb7g8Bzk2fEuFK5veGGKSeGZBhn +rVQ== X-Gm-Message-State: APjAAAXD00OEv/VTy+EHrcbOO+/S58aGT03D24onNUifCvs+7ItfsybO jdYQrqeIBacBZdjN5/hXr4JJa68b+3/Doe2Cli3Yw8eO X-Google-Smtp-Source: APXvYqxTHEqLJsjTheADaA+8NrFqiK/AneoFbVxZVUwjVDNeKb/+sprHMSwRz8h0w/2KZ5/yHfkQTmleJ9BKxuwlJrU= X-Received: by 2002:a02:c7c9:: with SMTP id s9mr39745138jao.81.1571104776400; Mon, 14 Oct 2019 18:59:36 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:a02:9f01:0:0:0:0:0 with HTTP; Mon, 14 Oct 2019 18:59:35 -0700 (PDT) In-Reply-To: <76102.1571079149@kaos.jnpr.net> References: <76102.1571079149@kaos.jnpr.net> From: grarpamp Date: Mon, 14 Oct 2019 21:59:35 -0400 Message-ID: Subject: Re: AMD Secure Encrypted Virtualization - FreeBSD Status? To: freebsd-security@freebsd.org Cc: freebsd-current@freebsd.org, freebsd-virtualization@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 46sdsQ1Q64z4QQq X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=RYPNT0my; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grarpamp@gmail.com designates 2607:f8b0:4864:20::d42 as permitted sender) smtp.mailfrom=grarpamp@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; IP_SCORE_FREEMAIL(0.00)[]; IP_SCORE(0.00)[ip: (2.25), ipnet: 2607:f8b0::/32(-2.49), asn: 15169(-2.11), country: US(-0.05)]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2.4.d.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Oct 2019 01:59:39 -0000 >> would be really nice also to get UEFI BOOT compatible with SECURE BOOT >> :-) > > Unless you are using your own BIOS, the above means getting Microsoft > to sign boot1.efi or similar. Shims that simply work around lack of > acceptible signature don't help. As before in this thread, some motherboards will let you delete the Microsoft keys from the BIOS defaults and install your own. With those boards you do not need Microsoft, or any shims signed by Microsoft, or anyone else but you. See the key management parts of the UEFI SECURE BOOT spec... https://uefi.org/ If your mobo maker does not have full key management options in their latest BIOS, ticket and bug them until they do. From owner-freebsd-virtualization@freebsd.org Tue Oct 15 07:51:13 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A42C81567FC for ; Tue, 15 Oct 2019 07:51:13 +0000 (UTC) (envelope-from kiri@truefc.org) Received: from kx.truefc.org (flets-sg1026.kamome.or.jp [202.216.24.26]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp", Issuer "smtp" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 46sng34zShz3Lh2 for ; Tue, 15 Oct 2019 07:51:11 +0000 (UTC) (envelope-from kiri@truefc.org) Received: from kx.truefc.org (kx.truefc.org [202.216.24.26]) by kx.truefc.org (8.15.2/8.15.2) with ESMTP id x9F7p803016663; Tue, 15 Oct 2019 16:51:08 +0900 (JST) (envelope-from kiri@kx.truefc.org) Message-Id: <201910150751.x9F7p803016663@kx.truefc.org> Date: Tue, 15 Oct 2019 16:51:08 +0900 From: KIRIYAMA Kazuhiko To: freebsd-virtualization@freebsd.org Cc: kiri@truefc.org Subject: VM freezed at booting of FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI/1.14.6 (Maruoka) FLIM/1.14.9 (=?ISO-8859-4?Q?Goj=F2?=) APEL/10.8 MULE XEmacs/21.4 (patch 24) (Standard C) (amd64--freebsd) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 46sng34zShz3Lh2 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of kiri@truefc.org has no SPF policy when checking 202.216.24.26) smtp.mailfrom=kiri@truefc.org X-Spamd-Result: default: False [-0.23 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.48)[-0.484,0]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-0.84)[-0.841,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[truefc.org]; AUTH_NA(1.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; R_SPF_NA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:4704, ipnet:202.216.0.0/19, country:JP]; IP_SCORE(-0.00)[country: JP(-0.00)]; ONCE_RECEIVED(0.10)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Oct 2019 07:51:13 -0000 Hi, all I'm managing bhyve vm by vm-bhyve-devel (1.3-devel) port which I've made by github head [1]. When create 13.0-CURRENT vm with FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img as follows: vm create -s 16GB -t tmpfile.gpWbtMxa tbedfc vm install -f tbedfc FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img < /dev/null where /vm/.templates/tmpfile.gpWbtMxa is loader="bhyveload" cpu=2 memory=8GB network0_type="virtio-net" network0_switch=local disk0_type="virtio-blk" disk0_name="disk0.img" storage=16GB But in install to image, boot freezed at: | ____| | _ \ / ____| __ \ | |___ _ __ ___ ___ | |_) | (___ | | | | | ___| '__/ _ \/ _ \| _ < \___ \| | | | | | | | | __/ __/| |_) |____) | |__| | | | | | | | || | | | |_| |_| \___|\___||____/|_____/|_____/ ``` ` s` `.....---.......--.``` -/ +============Welcome to FreeBSD===========+ +o .--` /y:` +. | | yo`:. :o `+- | 1. Boot Multi User [Enter] | y/ -/` -o/ | 2. Boot [S]ingle User | .- ::/sy+:. | 3. [Esc]ape to loader prompt | / `-- / | 4. Reboot | `: :` | | `: :` | Options: | / / | 5. [K]ernel: kernel (1 of 2) | .- -. | 6. Configure Boot [O]ptions... | -- -. | | `:` `:` | | .-- `--. | | .---.....----. +=========================================+ /boot/kernel/kernel text=0x153f9c0 data=0xe0 data=0x8007c0 syms=[0x8+0x1722d8+0x8+0x190cb2] Booting... - Using same image, I installed my note PC successfully. In above state, root@vm:~ # cat /vm/tbedfc/tbedfc.conf loader="bhyveload" cpu=2 memory=8GB network0_type="virtio-net" network0_switch=local disk0_type="virtio-blk" disk0_name="disk0.img" storage=16GB uuid="90a693df-ef1e-11e9-847a-0cc47ab3cfd4" network0_mac="58:9c:fc:0b:65:c9" root@vm:~ # cat /vm/tbedfc/vm-bhyve.log Oct 15 16:36:56: initialising Oct 15 16:36:56: [loader: bhyveload] Oct 15 16:36:56: [cpu: 2] Oct 15 16:36:56: [memory: 8GB] Oct 15 16:36:56: [hostbridge: standard] Oct 15 16:36:56: [com ports: com1] Oct 15 16:36:56: [uuid: 90a693df-ef1e-11e9-847a-0cc47ab3cfd4] Oct 15 16:36:56: [utctime: yes] Oct 15 16:36:56: [debug mode: no] Oct 15 16:36:56: [primary disk: disk0.img] Oct 15 16:36:56: [primary disk dev: file] Oct 15 16:36:56: generated static mac 58:9c:fc:0b:65:c9 (based on 'tbedfc:0:1571125016:0') Oct 15 16:36:56: initialising network device tap0 Oct 15 16:36:56: adding tap0 -> vm-local (local addm) Oct 15 16:36:56: bring up tap0 -> vm-local (local addm) Oct 15 16:36:56: booting Oct 15 16:36:56: bhyveload -m 8GB -e autoboot_delay=3 -d /vm/.iso/FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img tbedfc Oct 15 16:37:00: [bhyve options: -c 2 -m 8GB -AHP -U 90a693df-ef1e-11e9-847a-0cc47ab3cfd4 -u] Oct 15 16:37:00: [bhyve devices: -s 0,hostbridge -s 31,lpc -s 4:0,virtio-blk,/vm/tbedfc/disk0.img -s 5:0,virtio-net,tap0,mac=58:9c:fc:0b:65:c9] Oct 15 16:37:00: [bhyve console: -l com1,stdio] Oct 15 16:37:00: [bhyve iso device: -s 3:0,ahci-hd,/vm/.iso/FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img] Oct 15 16:37:00: starting bhyve (run 1) root@vm:~ # uname -a FreeBSD vm.truefc.org 13.0-CURRENT FreeBSD 13.0-CURRENT #0 r353025: Thu Oct 3 19:38:47 JST 2019 admin@vm.truefc.org:/ds/obj/current/13.0/r353025/ds/src/current/13.0/r353025/amd64.amd64/sys/GENERIC amd64 root@vm:~ # ifconfig igb0: flags=8943 metric 0 mtu 1500 options=4e523bb ether 0c:c4:7a:b3:cf:d4 inet xxx.xxx.xx.xx netmask 0xfffffff8 broadcast xxx.xxx.xx.xx media: Ethernet autoselect (1000baseT ) status: active nd6 options=29 igb1: flags=8943 metric 0 mtu 1500 options=4a520b9 ether 0c:c4:7a:b3:cf:d5 inet 192.168.1.17 netmask 0xffffff00 broadcast 192.168.1.255 media: Ethernet autoselect (1000baseT ) status: active nd6 options=29 lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 vm-public: flags=8843 metric 0 mtu 1500 ether c6:ed:62:0a:b0:4e id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 member: igb0 flags=143 ifmaxaddr 0 port 1 priority 128 path cost 20000 groups: bridge vm-switch viid-4c918@ nd6 options=1 vm-local: flags=8843 metric 0 mtu 1500 ether 8a:d0:25:7d:f7:51 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 member: tap0 flags=143 ifmaxaddr 0 port 6 priority 128 path cost 2000000 member: igb1 flags=143 ifmaxaddr 0 port 2 priority 128 path cost 20000 groups: bridge vm-switch viid-f5dda@ nd6 options=1 tap0: flags=8943 metric 0 mtu 1500 description: vmnet-tbedfc-0-local options=80000 ether 58:9c:fc:10:ff:df groups: tap vm-port media: Ethernet autoselect status: active nd6 options=29 Opened by PID 85496 root@vm:~ # Whats' wrong ? BTW 12.1-PRERELEASE(r352368) and 12.0-RELEASE-p10(r352368) are nothing happened. [1] https://github.com/TrueFC/ports/tree/master/sysutils/vm-bhyve-devel --- KIRIYAMA Kazuhiko From owner-freebsd-virtualization@freebsd.org Tue Oct 15 08:07:27 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BFBD5156F55 for ; Tue, 15 Oct 2019 08:07:27 +0000 (UTC) (envelope-from semfly@fly777.net) Received: from mail.fly777.net (mail.fly777.net [37.228.91.242]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 46sp1m6gldz3MQB for ; Tue, 15 Oct 2019 08:07:24 +0000 (UTC) (envelope-from semfly@fly777.net) Received: from [192.168.77.83] (unknown [212.42.46.124]) (using TLSv1.1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.fly777.net (Postfix) with ESMTPSA id 57B295F8554; Tue, 15 Oct 2019 11:04:39 +0300 (MSK) Date: Tue, 15 Oct 2019 11:07:05 +0300 From: Simon Reply-To: Simon Gusev Message-ID: <03057504.20191015110705@fly777.net> To: freebsd-virtualization@freebsd.org CC: KIRIYAMA Kazuhiko Subject: Re: VM freezed at booting of FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img In-Reply-To: <201910150751.x9F7p803016663@kx.truefc.org> References: <201910150751.x9F7p803016663@kx.truefc.org> X-Rspamd-Queue-Id: 46sp1m6gldz3MQB X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of semfly@fly777.net designates 37.228.91.242 as permitted sender) smtp.mailfrom=semfly@fly777.net X-Spamd-Result: default: False [-1.83 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_REPLYTO(0.00)[semfly@fly777.net]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.fly777.net]; NEURAL_HAM_LONG(-1.00)[-0.996,0]; DMARC_NA(0.00)[fly777.net]; REPLYTO_ADDR_EQ_FROM(0.00)[]; NEURAL_HAM_MEDIUM(-0.97)[-0.973,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MIME_HTML_ONLY(0.20)[]; IP_SCORE(0.14)[asn: 48347(0.67), country: RU(0.01)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:~]; ASN(0.00)[asn:48347, ipnet:37.228.88.0/22, country:RU]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Oct 2019 08:07:27 -0000 From owner-freebsd-virtualization@freebsd.org Tue Oct 15 10:35:35 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3A89115AD06 for ; Tue, 15 Oct 2019 10:35:35 +0000 (UTC) (envelope-from kiri@truefc.org) Received: from kx.truefc.org (flets-sg1026.kamome.or.jp [202.216.24.26]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp", Issuer "smtp" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 46ssJj64wgz41tJ for ; Tue, 15 Oct 2019 10:35:33 +0000 (UTC) (envelope-from kiri@truefc.org) Received: from kx.truefc.org (kx.truefc.org [202.216.24.26]) by kx.truefc.org (8.15.2/8.15.2) with ESMTP id x9FAZNlU043565; Tue, 15 Oct 2019 19:35:23 +0900 (JST) (envelope-from kiri@kx.truefc.org) Message-Id: <201910151035.x9FAZNlU043565@kx.truefc.org> Date: Tue, 15 Oct 2019 19:35:23 +0900 From: KIRIYAMA Kazuhiko To: Simon Gusev Cc: freebsd-virtualization@freebsd.org, KIRIYAMA Kazuhiko Subject: Re: VM freezed at booting of FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img In-Reply-To: <03057504.20191015110705@fly777.net> References: <201910150751.x9F7p803016663@kx.truefc.org> <03057504.20191015110705@fly777.net> User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI/1.14.6 (Maruoka) FLIM/1.14.9 (=?ISO-8859-4?Q?Goj=F2?=) APEL/10.8 MULE XEmacs/21.4 (patch 24) (Standard C) (amd64--freebsd) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 46ssJj64wgz41tJ X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of kiri@truefc.org has no SPF policy when checking 202.216.24.26) smtp.mailfrom=kiri@truefc.org X-Spamd-Result: default: False [-0.38 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.57)[-0.570,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.91)[-0.905,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[truefc.org]; AUTH_NA(1.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:4704, ipnet:202.216.0.0/19, country:JP]; IP_SCORE(-0.00)[country: JP(-0.00)]; ONCE_RECEIVED(0.10)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Oct 2019 10:35:35 -0000 On Tue, 15 Oct 2019 17:07:05 +0900, Simon wrote: >=20 >=20 >=20 > Hi ) > May be the same problem. > I said about this here > https://forums.freebsd.org/threads/freebsd-12-0-release-amd64-freeze-boot= -from-bhyve-uefi-bhyve_uefi-fd-uefi-gop-screen-goes-blank.69616/ > Solution. > Try this > Select > 3 -=A0[Esc]ape to loader prompt=A0 > set boot_serial=3D"NO" > boot `vm install' doesn't wait boot loader. So above manupulation could not work. I've specified it to the bhyveload `-e' option like with `-e boot_serial=3DNO': root@vm:~ # cat /vm/tbedfc/vm-bhyve.log Oct 15 19:27:55: initialising Oct 15 19:27:55: [loader: bhyveload] Oct 15 19:27:55: [cpu: 2] Oct 15 19:27:55: [memory: 8GB] Oct 15 19:27:55: [hostbridge: standard] Oct 15 19:27:55: [com ports: com1] Oct 15 19:27:55: [uuid: 737d1159-ef36-11e9-847a-0cc47ab3cfd4] Oct 15 19:27:55: [utctime: yes] Oct 15 19:27:55: [debug mode: no] Oct 15 19:27:55: [primary disk: disk0.img] Oct 15 19:27:55: [primary disk dev: file] Oct 15 19:27:55: generated static mac 58:9c:fc:02:46:e2 (based on 'tbedfc:0= :1571135275:0') Oct 15 19:27:55: initialising network device tap0 Oct 15 19:27:55: adding tap0 -> vm-local (local addm) Oct 15 19:27:55: bring up tap0 -> vm-local (local addm) Oct 15 19:27:55: booting Oct 15 19:27:55: bhyveload -m 8GB -e autoboot_delay=3D3 -e boot_serial=3DNO= -d /vm/.iso/FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img tbedfc Oct 15 19:27:59: [bhyve options: -c 2 -m 8GB -AHP -U 737d1159-ef36-11e9-84= 7a-0cc47ab3cfd4 -u] Oct 15 19:27:59: [bhyve devices: -s 0,hostbridge -s 31,lpc -s 4:0,virtio-b= lk,/vm/tbedfc/disk0.img -s 5:0,virtio-net,tap0,mac=3D58:9c:fc:02:46:e2] Oct 15 19:27:59: [bhyve console: -l com1,stdio] Oct 15 19:27:59: [bhyve iso device: -s 3:0,ahci-hd,/vm/.iso/FreeBSD-13.0-C= URRENT-amd64-20191011-r353427-memstick.img] Oct 15 19:27:59: starting bhyve (run 1) Oct 15 19:29:54: bhyve exited with status 1 Oct 15 19:29:54: destroying network device tap0 Oct 15 19:29:55: stopped root@vm:~ #=20 but also freezed ;-( > Look here > https://lists.freebsd.org/pipermail/freebsd-virtualization/2018-November/= 006944.html > Simon. > You wrote 15.10.2019, 10:51:08: > > Hi, all > > I'm managing bhyve vm by vm-bhyve-devel (1.3-devel) port > > which I've made by github head [1]. When create 13.0-CURRENT > > vm with FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img > > as follows: > > vm create -s 16GB -t tmpfile.gpWbtMxa tbedfc > > vm install -f tbedfc > > FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img < /dev/null > > where /vm/.templates/tmpfile.gpWbtMxa is > > loader=3D"bhyveload" > > cpu=3D2 > > memory=3D8GB > > network0_type=3D"virtio-net" > > network0_switch=3Dlocal > > disk0_type=3D"virtio-blk" > > disk0_name=3D"disk0.img" > > storage=3D16GB > > But in install to image, boot freezed at: > > =A0| =A0____| =A0 =A0 =A0 =A0 =A0 =A0 | =A0_ \ / ____| =A0__ \ > > =A0| |___ _ __ ___ =A0___ | |_) | (___ | | =A0| | > > =A0| =A0___| '__/ _ \/ _ \| =A0_ < \___ \| | =A0| | > > =A0| | =A0 | | | =A0__/ =A0__/| |_) |____) | |__| | > > =A0| | =A0 | | | =A0 =A0| =A0 =A0|| =A0 =A0 | =A0 =A0 =A0| =A0 =A0 =A0| > > =A0|_| =A0 |_| =A0\___|\___||____/|_____/|_____/ =A0 =A0``` =A0 =A0 =A0= =A0 =A0 =A0 =A0 =A0 =A0 > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0 =A0s` `.....---.......--.``` =A0 -/ > > =A0+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3DWelcome to FreeBSD=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D+ +o =A0 .--` =A0 =A0 =A0 =A0 /y:` +. > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 | =A0yo`:. =A0 =A0 =A0 =A0 =A0 =A0:o =A0 `+- > > =A0| =A01. Boot Multi User [Enter] =A0 =A0 =A0 =A0 =A0 =A0 | =A0 y/ =A0= =A0 =A0 =A0 =A0 =A0 =A0 -/` -o/ > > =A0| =A02. Boot [S]ingle*User =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0| =A0.= - =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0::/sy+:. > > =A0| =A03. [Esc]ape to loader prompt =A0 =A0 =A0 =A0 =A0 | =A0/ =A0 =A0= =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 `-- =A0/ > > =A0| =A04. Reboot =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0| `: =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 :` > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 | `: =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 :` > > =A0| =A0Options: =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 | =A0/ =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 > > =A0| =A05. [K]ernel: kernel (1 of 2) =A0 =A0 =A0 =A0 =A0 | =A0.- =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0-. > > =A0| =A06. Configure Boot [O]ptions... =A0 =A0 =A0 =A0 | =A0 -- =A0 =A0= =A0 =A0 =A0 =A0 =A0 =A0 =A0 -. > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 | =A0 =A0`:` =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 `:` > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 | =A0 =A0 =A0.-- =A0 =A0 =A0 =A0 =A0 =A0 `--. > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 | =A0 =A0 =A0 =A0 .---.....----. > > =A0+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+ > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 > > /boot/kernel/kernel text=3D0x153f9c0 data=3D0xe0 data=3D0x8007c0 syms= =3D[0x8+0x1722d8+0x8+0x190cb2] > > Booting... > > - > > Using same image, I installed my note PC successfully. In > > above state, > > root@vm:~ # cat /vm/tbedfc/tbedfc.conf > > loader=3D"bhyveload" > > cpu=3D2 > > memory=3D8GB > > network0_type=3D"virtio-net" > > network0_switch=3Dlocal > > disk0_type=3D"virtio-blk" > > disk0_name=3D"disk0.img" > > storage=3D16GB > > uuid=3D"90a693df-ef1e-11e9-847a-0cc47ab3cfd4" > > network0_mac=3D"58:9c:fc:0b:65:c9" > > root@vm:~ # cat /vm/tbedfc/vm-bhyve.log > > Oct 15 16:36:56: initialising > > Oct 15 16:36:56: =A0[loader: bhyveload] > > Oct 15 16:36:56: =A0[cpu: 2] > > Oct 15 16:36:56: =A0[memory: 8GB] > > Oct 15 16:36:56: =A0[hostbridge: standard] > > Oct 15 16:36:56: =A0[com ports: com1] > > Oct 15 16:36:56: =A0[uuid: 90a693df-ef1e-11e9-847a-0cc47ab3cfd4] > > Oct 15 16:36:56: =A0[utctime: yes] > > Oct 15 16:36:56: =A0[debug mode: no] > > Oct 15 16:36:56: =A0[primary disk: disk0.img] > > Oct 15 16:36:56: =A0[primary disk dev: file] > > Oct 15 16:36:56: generated static mac 58:9c:fc:0b:65:c9 (based on 'tbed= fc:0:1571125016:0') > > Oct 15 16:36:56: initialising network device tap0 > > Oct 15 16:36:56: adding tap0 -> vm-local (local addm) > > Oct 15 16:36:56: bring up tap0 -> vm-local (local addm) > > Oct 15 16:36:56: booting > > Oct 15 16:36:56: bhyveload -m 8GB -e autoboot_delay=3D3 -d > > /vm/.iso/FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img tbedfc > > Oct 15 16:37:00: =A0[bhyve options: -c 2 -m 8GB -AHP -U > > 90a693df-ef1e-11e9-847a-0cc47ab3cfd4 -u] > > Oct 15 16:37:00: =A0[bhyve devices: -s 0,hostbridge -s 31,lpc -s > > 4:0,virtio-blk,/vm/tbedfc/disk0.img -s > > 5:0,virtio-net,tap0,mac=3D58:9c:fc:0b:65:c9] > > Oct 15 16:37:00: =A0[bhyve console: -l com1,stdio] > > Oct 15 16:37:00: =A0[bhyve iso device: -s > > 3:0,ahci-hd,/vm/.iso/FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memsti= ck.img] > > Oct 15 16:37:00: starting bhyve (run 1) > > root@vm:~ # uname -a > > FreeBSD vm.truefc.org 13.0-CURRENT FreeBSD 13.0-CURRENT #0 r353025: > > Thu Oct =A03 19:38:47 JST 2019 =A0 =A0 > > admin@vm.truefc.org:/ds/obj/current/13.0/r353025/ds/src/current/13.0/r3= 53025/amd64.amd64/sys/GENERIC > amd64 > > root@vm:~ # ifconfig > > igb0: flags=3D8943 metr= ic 0 mtu 1500 > > =A0 =A0 =A0 =A0 > > > options=3D4e523bb > > =A0 =A0 =A0 =A0 ether 0c:c4:7a:b3:cf:d4 > > =A0 =A0 =A0 =A0 inet xxx.xxx.xx.xx netmask 0xfffffff8 broadcast xxx.xxx= .xx.xx > > =A0 =A0 =A0 =A0 media: Ethernet autoselect (1000baseT ) > > =A0 =A0 =A0 =A0 status: active > > =A0 =A0 =A0 =A0 nd6 options=3D29 > > igb1: flags=3D8943 metr= ic 0 mtu 1500 > > =A0 =A0 =A0 =A0 > > > options=3D4a520b9 > > =A0 =A0 =A0 =A0 ether 0c:c4:7a:b3:cf:d5 > > =A0 =A0 =A0 =A0 inet 192.168.1.17 netmask 0xffffff00 broadcast 192.168.= 1.255 > > =A0 =A0 =A0 =A0 media: Ethernet autoselect (1000baseT ) > > =A0 =A0 =A0 =A0 status: active > > =A0 =A0 =A0 =A0 nd6 options=3D29 > > lo0: flags=3D8049 metric 0 mtu 16384 > > =A0 =A0 =A0 =A0 > > options=3D680003 > > =A0 =A0 =A0 =A0 inet6 ::1 prefixlen 128 > > =A0 =A0 =A0 =A0 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 > > =A0 =A0 =A0 =A0 inet 127.0.0.1 netmask 0xff000000 > > =A0 =A0 =A0 =A0 groups: lo > > =A0 =A0 =A0 =A0 nd6 options=3D21 > > vm-public: flags=3D8843 metric = 0 mtu 1500 > > =A0 =A0 =A0 =A0 ether c6:ed:62:0a:b0:4e > > =A0 =A0 =A0 =A0 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddela= y 15 > > =A0 =A0 =A0 =A0 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 > > =A0 =A0 =A0 =A0 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 > > =A0 =A0 =A0 =A0 member: igb0 flags=3D143 > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 ifmaxaddr 0 port 1 priority 128 path co= st 20000 > > =A0 =A0 =A0 =A0 groups: bridge vm-switch viid-4c918@ > > =A0 =A0 =A0 =A0 nd6 options=3D1 > > vm-local: flags=3D8843 metric 0= mtu 1500 > > =A0 =A0 =A0 =A0 ether 8a:d0:25:7d:f7:51 > > =A0 =A0 =A0 =A0 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddela= y 15 > > =A0 =A0 =A0 =A0 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 > > =A0 =A0 =A0 =A0 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 > > =A0 =A0 =A0 =A0 member: tap0 flags=3D143 > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 ifmaxaddr 0 port 6 priority 128 path co= st 2000000 > > =A0 =A0 =A0 =A0 member: igb1 flags=3D143 > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 ifmaxaddr 0 port 2 priority 128 path co= st 20000 > > =A0 =A0 =A0 =A0 groups: bridge vm-switch viid-f5dda@ > > =A0 =A0 =A0 =A0 nd6 options=3D1 > > tap0: flags=3D8943 metr= ic 0 mtu 1500 > > =A0 =A0 =A0 =A0 description: vmnet-tbedfc-0-local > > =A0 =A0 =A0 =A0 options=3D80000 > > =A0 =A0 =A0 =A0 ether 58:9c:fc:10:ff:df > > =A0 =A0 =A0 =A0 groups: tap vm-port > > =A0 =A0 =A0 =A0 media: Ethernet autoselect > > =A0 =A0 =A0 =A0 status: active > > =A0 =A0 =A0 =A0 nd6 options=3D29 > > =A0 =A0 =A0 =A0 Opened by PID 85496 > > root@vm:~ # > > Whats' wrong ? =A0BTW 12.1-PRERELEASE(r352368) and > > 12.0-RELEASE-p10(r352368) are nothing happened. > > [1] > > https://github.com/TrueFC/ports/tree/master/sysutils/vm-bhyve-devel > > --- > > KIRIYAMA Kazuhiko > > _______________________________________________ > > freebsd-virtualization@freebsd.org=A0mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > To unsubscribe, send any mail to > > "freebsd-virtualization-unsubscribe@freebsd.org" >=20 >=20 --- KIRIYAMA Kazuhiko From owner-freebsd-virtualization@freebsd.org Tue Oct 15 10:56:37 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2610315B460 for ; Tue, 15 Oct 2019 10:56:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 46ssn10F26z43Bh for ; Tue, 15 Oct 2019 10:56:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 062E515B45F; Tue, 15 Oct 2019 10:56:37 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 05E6515B45E for ; Tue, 15 Oct 2019 10:56:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46ssn06PDmz43Bg for ; Tue, 15 Oct 2019 10:56:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BAB791D82C for ; Tue, 15 Oct 2019 10:56:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x9FAuaXf040394 for ; Tue, 15 Oct 2019 10:56:36 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x9FAua14040393 for virtualization@FreeBSD.org; Tue, 15 Oct 2019 10:56:36 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 240734] Broken Hyper-V Generation V2 Date: Tue, 15 Oct 2019 10:56:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: michael.adm@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Oct 2019 10:56:37 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D240734 --- Comment #4 from Michael --- git clone git://github.com/freebsd/freebsd.git --progress -v --single-branc= h -b master /usr/src Today did the following: root@test-freebsd-master-v2:/usr/src # git pull ... root@test-freebsd-master-v2:/usr/src # make cleanworld && make cleandir && = make -j8 buildworld && make -j8 buildkernel KERNCONF=3DGENERIC ... root@test-freebsd-master-v2:/usr/src # make installkernel KERNCONF=3DGENERIC ... root@test-freebsd-master-v2:/usr/src # make installworld ... root@test-freebsd-master-v2:/usr/src # mergemaster -Ui ... reboot - on the initial screen for selecting the boot mode, the broken view (see attachment) and keyboard does not work in hyper-v management interface of Windows 2019 Hyper-V Generation V2 virtual machine. Installation from FreeBSD-13.0-CURRENT-amd64-20191011-r353427-disc1.iso als= o - not possible. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Oct 15 22:17:21 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0EBCA155FA6 for ; Tue, 15 Oct 2019 22:17:21 +0000 (UTC) (envelope-from kiri@truefc.org) Received: from kx.truefc.org (flets-sg1026.kamome.or.jp [202.216.24.26]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp", Issuer "smtp" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 46t8tR13V4z3RJ6 for ; Tue, 15 Oct 2019 22:17:18 +0000 (UTC) (envelope-from kiri@truefc.org) Received: from kx.truefc.org (kx.truefc.org [202.216.24.26]) by kx.truefc.org (8.15.2/8.15.2) with ESMTP id x9FMH4JI051008; Wed, 16 Oct 2019 07:17:04 +0900 (JST) (envelope-from kiri@kx.truefc.org) Message-Id: <201910152217.x9FMH4JI051008@kx.truefc.org> Date: Wed, 16 Oct 2019 07:17:04 +0900 From: KIRIYAMA Kazuhiko To: KIRIYAMA Kazuhiko Cc: Simon Gusev , freebsd-virtualization@freebsd.org Subject: Re: VM freezed at booting of FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img In-Reply-To: <201910151035.x9FAZNlU043565@kx.truefc.org> References: <201910150751.x9F7p803016663@kx.truefc.org> <03057504.20191015110705@fly777.net> <201910151035.x9FAZNlU043565@kx.truefc.org> User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI/1.14.6 (Maruoka) FLIM/1.14.9 (=?ISO-8859-4?Q?Goj=F2?=) APEL/10.8 MULE XEmacs/21.4 (patch 24) (Standard C) (amd64--freebsd) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 46t8tR13V4z3RJ6 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of kiri@truefc.org has no SPF policy when checking 202.216.24.26) smtp.mailfrom=kiri@truefc.org X-Spamd-Result: default: False [-0.50 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.67)[-0.674,0]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[truefc.org]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-0.92)[-0.925,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:4704, ipnet:202.216.0.0/19, country:JP]; IP_SCORE(-0.00)[country: JP(-0.00)]; ONCE_RECEIVED(0.10)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Oct 2019 22:17:21 -0000 On Tue, 15 Oct 2019 19:35:23 +0900, KIRIYAMA Kazuhiko wrote: >=20 > On Tue, 15 Oct 2019 17:07:05 +0900, > Simon wrote: > >=20 > >=20 > >=20 > > Hi ) > > May be the same problem. > > I said about this here > > https://forums.freebsd.org/threads/freebsd-12-0-release-amd64-freeze-bo= ot-from-bhyve-uefi-bhyve_uefi-fd-uefi-gop-screen-goes-blank.69616/ > > Solution. > > Try this > > Select > > 3 -=A0[Esc]ape to loader prompt=A0 > > set boot_serial=3D"NO" > > boot >=20 > `vm install' doesn't wait boot loader. So above > manupulation could not work. I've specified it to the > bhyveload `-e' option like with `-e boot_serial=3DNO': >=20 > root@vm:~ # cat /vm/tbedfc/vm-bhyve.log > Oct 15 19:27:55: initialising > Oct 15 19:27:55: [loader: bhyveload] > Oct 15 19:27:55: [cpu: 2] > Oct 15 19:27:55: [memory: 8GB] > Oct 15 19:27:55: [hostbridge: standard] > Oct 15 19:27:55: [com ports: com1] > Oct 15 19:27:55: [uuid: 737d1159-ef36-11e9-847a-0cc47ab3cfd4] > Oct 15 19:27:55: [utctime: yes] > Oct 15 19:27:55: [debug mode: no] > Oct 15 19:27:55: [primary disk: disk0.img] > Oct 15 19:27:55: [primary disk dev: file] > Oct 15 19:27:55: generated static mac 58:9c:fc:02:46:e2 (based on 'tbedfc= :0:1571135275:0') > Oct 15 19:27:55: initialising network device tap0 > Oct 15 19:27:55: adding tap0 -> vm-local (local addm) > Oct 15 19:27:55: bring up tap0 -> vm-local (local addm) > Oct 15 19:27:55: booting > Oct 15 19:27:55: bhyveload -m 8GB -e autoboot_delay=3D3 -e boot_serial=3D= NO -d /vm/.iso/FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img tbe= dfc > Oct 15 19:27:59: [bhyve options: -c 2 -m 8GB -AHP -U 737d1159-ef36-11e9-= 847a-0cc47ab3cfd4 -u] > Oct 15 19:27:59: [bhyve devices: -s 0,hostbridge -s 31,lpc -s 4:0,virtio= -blk,/vm/tbedfc/disk0.img -s 5:0,virtio-net,tap0,mac=3D58:9c:fc:02:46:e2] > Oct 15 19:27:59: [bhyve console: -l com1,stdio] > Oct 15 19:27:59: [bhyve iso device: -s 3:0,ahci-hd,/vm/.iso/FreeBSD-13.0= -CURRENT-amd64-20191011-r353427-memstick.img] > Oct 15 19:27:59: starting bhyve (run 1) > Oct 15 19:29:54: bhyve exited with status 1 > Oct 15 19:29:54: destroying network device tap0 > Oct 15 19:29:55: stopped > root@vm:~ #=20 >=20 > but also freezed ;-( I've listed all boot variables at loader prompt: Type '?' for a list of commands, 'help' for more detailed help. OK show LINES=3D24 ansi_caption[1]=3D^[1mB^[moot Multi User ^[1m[Enter]^[m ansi_caption[2]=3DBoot ^[1mS^[mingle User ansi_caption[3]=3D^[1mEsc^[mape to loader prompt ansi_caption[5]=3DKernel: default/kernel (1 of 2) ansi_caption[5][0]=3DKernel: default/kernel (1 of 2) ansi_caption[5][1]=3DKernel: kernel.old (2 of 2) ansi_caption[6]=3DConfigure Boot ^[1mO^[mptions... autoboot_delay=3DNO beansi_bootfs=3D^[1mbootfs: ^[m beansi_current=3D^[1mActive: ^[m beansi_page=3D^[1mP^[mage:=20 beansi_pageof=3D of=20 bemenu_bootfs=3Dbootfs:=20 bemenu_current=3DActive:=20 bemenu_page=3D[P]age:=20 bemenu_pageof=3D of=20 boot_serial=3DNO bootenv_autolist=3DYES bootenv_root[2]=3D bootenvmenu_command[1]=3Dbe_draw_screen 1 goto_menu bootenvmenu_command[2]=3Dset_bootenv bootenvmenu_command[3]=3Dset_be_page beansi_bootfs=3D^[1mbootfs: ^[m beansi_current=3D^[1mActive: ^[m beansi_page=3D^[1mP^[mage:=20 beansi_pageof=3D of=20 bemenu_bootfs=3Dbootfs:=20 bemenu_current=3DActive:=20 bemenu_page=3D[P]age:=20 bemenu_pageof=3D of=20 boot_serial=3DNO bootenv_autolist=3DYES bootenv_root[2]=3D bootenvmenu_command[1]=3Dbe_draw_screen 1 goto_menu bootenvmenu_command[2]=3Dset_bootenv bootenvmenu_command[3]=3Dset_be_page bootenvmenu_init=3Dinit_bootenv =20 bootenvmenu_keycode[1]=3D8 bootenvmenu_keycode[2]=3D97 bootenvmenu_keycode[3]=3D112 bootenvmenu_options=3D4 bootenvmenu_optionstext=3DBoot Environments: bootfile=3Dkernel console=3Duserboot currdev=3Ddisk0s2a: efi_max_resolution=3D1x1 hint.acpi_throttle.0.disabled=3D1 hint.atkbd.0.at=3Datkbdc hint.atkbd.0.irq=3D1 hint.atkbdc.0.at=3Disa hint.atkbdc.0.port=3D0x060 hint.atrtc.0.at=3Disa hint.atrtc.0.irq=3D8 hint.atrtc.0.port=3D0x70 hint.attimer.0.at=3Disa hint.attimer.0.irq=3D0 hint.attimer.0.port=3D0x40 hint.fd.0.at=3Dfdc0 hint.fd.0.drive=3D0 efi_max_resolution=3D1x1 hint.acpi_throttle.0.disabled=3D1 hint.atkbd.0.at=3Datkbdc hint.atkbd.0.irq=3D1 hint.atkbdc.0.at=3Disa hint.atkbdc.0.port=3D0x060 hint.atrtc.0.at=3Disa hint.atrtc.0.irq=3D8 hint.atrtc.0.port=3D0x70 hint.attimer.0.at=3Disa hint.attimer.0.irq=3D0 hint.attimer.0.port=3D0x40 hint.fd.0.at=3Dfdc0 hint.fd.0.drive=3D0 hint.fd.1.at=3Dfdc0 =20 hint.fd.1.drive=3D1 hint.fdc.0.at=3Disa hint.fdc.0.drq=3D2 hint.fdc.0.irq=3D6 hint.fdc.0.port=3D0x3F0 hint.p4tcc.0.disabled=3D1 hint.ppc.0.at=3Disa hint.ppc.0.irq=3D7 hint.psm.0.at=3Datkbdc hint.psm.0.irq=3D12 hint.sc.0.at=3Disa hint.sc.0.flags=3D0x100 hint.uart.0.at=3Disa hint.uart.0.flags=3D0x10 hint.uart.0.irq=3D4 hint.uart.0.port=3D0x3F8 hint.uart.1.at=3Disa hint.uart.1.irq=3D3 hint.uart.1.port=3D0x2F8 interpret=3DOK kernel=3Dkernel kernel[0]=3Dkernel hint.psm.0.at=3Datkbdc hint.psm.0.irq=3D12 hint.sc.0.at=3Disa hint.sc.0.flags=3D0x100 hint.uart.0.at=3Disa hint.uart.0.flags=3D0x10 hint.uart.0.irq=3D4 hint.uart.0.port=3D0x3F8 hint.uart.1.at=3Disa hint.uart.1.irq=3D3 hint.uart.1.port=3D0x2F8 interpret=3DOK kernel=3Dkernel kernel[0]=3Dkernel kernel[1]=3Dkernel.old =20 kernel_options=3D kernels_autodetect=3DNO loaddev=3Ddisk0s2a: loader_conf_files=3D/boot/device.hints /boot/loader.conf /boot/loader.conf.= local mainansi_caption[1]=3D^[1mB^[moot Multi User ^[1m[Enter]^[m mainansi_caption[2]=3DBoot ^[1mS^[mingle User mainansi_caption[3]=3D^[1mEsc^[mape to loader prompt mainansi_caption[6]=3DConfigure Boot ^[1mO^[mptions... mainmenu_caption[1]=3DBoot Multi User [Enter] mainmenu_caption[2]=3DBoot [S]ingle User mainmenu_caption[3]=3D[Esc]ape to loader prompt mainmenu_caption[6]=3DConfigure Boot [O]ptions... mainmenu_command[1]=3Dboot mainmenu_command[2]=3Daltboot mainmenu_command[3]=3Dgoto_prompt mainmenu_command[5]=3Dcycle_kernel mainmenu_command[6]=3D2 goto_menu mainmenu_init[1]=3Dinit_boot mainmenu_init[2]=3Dinit_altboot mainmenu_kernel=3D5 mainmenu_keycode[3]=3D27 mainmenu_keycode[5]=3D107 mainmenu_caption[1]=3DBoot Multi User [Enter] mainmenu_caption[2]=3DBoot [S]ingle User mainmenu_caption[3]=3D[Esc]ape to loader prompt mainmenu_caption[6]=3DConfigure Boot [O]ptions... mainmenu_command[1]=3Dboot mainmenu_command[2]=3Daltboot mainmenu_command[3]=3Dgoto_prompt mainmenu_command[5]=3Dcycle_kernel mainmenu_command[6]=3D2 goto_menu mainmenu_init[1]=3Dinit_boot mainmenu_init[2]=3Dinit_altboot mainmenu_kernel=3D5 mainmenu_keycode[3]=3D27 mainmenu_keycode[5]=3D107 mainmenu_keycode[6]=3D111 =20 mainmenu_options=3D5 mainmenu_reboot=3D maintoggled_ansi[1]=3DBoot ^[1mS^[mingle User ^[1m[Enter]^[m maintoggled_ansi[2]=3DBoot ^[1mM^[multi User maintoggled_text[1]=3DBoot [S]ingle User [Enter] maintoggled_text[2]=3DBoot [M]ulti User menu_caption[1]=3DBoot Multi User [Enter] menu_caption[2]=3DBoot [S]ingle User menu_caption[3]=3D[Esc]ape to loader prompt menu_caption[5]=3D[K]ernel: kernel (1 of 2) menu_caption[5][0]=3D[K]ernel: kernel (1 of 2) menu_caption[5][1]=3D[K]ernel: kernel.old (2 of 2) menu_caption[6]=3DConfigure Boot [O]ptions... menu_command[1]=3Dboot menu_command[2]=3Daltboot menu_command[3]=3Dgoto_prompt menu_command[5]=3Dcycle_kernel menu_command[6]=3D2 goto_menu menu_init[1]=3Dinit_boot menu_init[2]=3Dinit_altboot menu_kernel=3D5 menu_keycode[1]=3D98 menu_caption[3]=3D[Esc]ape to loader prompt menu_caption[5]=3D[K]ernel: kernel (1 of 2) menu_caption[5][0]=3D[K]ernel: kernel (1 of 2) menu_caption[5][1]=3D[K]ernel: kernel.old (2 of 2) menu_caption[6]=3DConfigure Boot [O]ptions... menu_command[1]=3Dboot menu_command[2]=3Daltboot menu_command[3]=3Dgoto_prompt menu_command[5]=3Dcycle_kernel menu_command[6]=3D2 goto_menu menu_init[1]=3Dinit_boot menu_init[2]=3Dinit_altboot menu_kernel=3D5 menu_keycode[1]=3D98 menu_keycode[2]=3D115 =20 menu_keycode[3]=3D27 menu_keycode[5]=3D107 menu_keycode[6]=3D111 menu_options=3D5 menu_reboot=3D menu_timeout_command=3Dboot menuset_initial=3D1 menuset_name1=3Dmain menuset_name2=3Doptions menuset_name3=3Dbootenv module_blacklist=3Ddrm drm2 radeonkms i915kms amdgpu module_path=3D/boot/modules;/boot/dtb;/boot/dtb/overlays optionsansi_caption[1]=3DBack to Main Menu ^[1m[Backspace]^[m optionsansi_caption[2]=3DLoad System ^[1mD^[mefaults optionsansi_caption[3]=3D^[1mA^[mCPI Support ^[34;1mOff^[m optionsansi_caption[4]=3DSafe ^[1mM^[mode... ^[34;1mOff^[m optionsansi_caption[5]=3D^[1mS^[mingle User. ^[34;1mOff^[m optionsansi_caption[6]=3D^[1mV^[merbose..... ^[34;1mOff^[m optionsmenu_acpi=3D3 optionsmenu_caption[1]=3DBack to Main Menu [Backspace] optionsmenu_caption[2]=3DLoad System [D]efaults optionsmenu_caption[3]=3D[A]CPI Support off menuset_name2=3Doptions menuset_name3=3Dbootenv module_blacklist=3Ddrm drm2 radeonkms i915kms amdgpu module_path=3D/boot/modules;/boot/dtb;/boot/dtb/overlays optionsansi_caption[1]=3DBack to Main Menu ^[1m[Backspace]^[m optionsansi_caption[2]=3DLoad System ^[1mD^[mefaults optionsansi_caption[3]=3D^[1mA^[mCPI Support ^[34;1mOff^[m optionsansi_caption[4]=3DSafe ^[1mM^[mode... ^[34;1mOff^[m optionsansi_caption[5]=3D^[1mS^[mingle User. ^[34;1mOff^[m optionsansi_caption[6]=3D^[1mV^[merbose..... ^[34;1mOff^[m optionsmenu_acpi=3D3 optionsmenu_caption[1]=3DBack to Main Menu [Backspace] optionsmenu_caption[2]=3DLoad System [D]efaults optionsmenu_caption[3]=3D[A]CPI Support off optionsmenu_caption[4]=3DSafe [M]ode... off =20 optionsmenu_caption[5]=3D[S]ingle User. off optionsmenu_caption[6]=3D[V]erbose..... off optionsmenu_command[1]=3D1 goto_menu optionsmenu_command[2]=3Dset_default_boot_options optionsmenu_command[3]=3Dtoggle_acpi optionsmenu_command[4]=3Dtoggle_safemode optionsmenu_command[5]=3Dtoggle_singleuser optionsmenu_command[6]=3Dtoggle_verbose optionsmenu_init[4]=3Dinit_safemode optionsmenu_init[5]=3Dinit_singleuser optionsmenu_init[6]=3Dinit_verbose optionsmenu_keycode[1]=3D8 optionsmenu_keycode[2]=3D100 optionsmenu_keycode[3]=3D97 optionsmenu_keycode[4]=3D109 optionsmenu_keycode[5]=3D115 optionsmenu_keycode[6]=3D118 optionsmenu_options=3D3 optionsmenu_optionstext=3DBoot Options: optionstoggled_ansi[3]=3D^[1mA^[mCPI Support ^[32;7mOn^[m optionstoggled_ansi[4]=3DSafe ^[1mM^[mode... ^[32;7mOn^[m optionstoggled_ansi[5]=3D^[1mS^[mingle User. ^[32;7mOn^[m optionsmenu_caption[5]=3D[S]ingle User. off optionsmenu_caption[6]=3D[V]erbose..... off optionsmenu_command[1]=3D1 goto_menu optionsmenu_command[2]=3Dset_default_boot_options optionsmenu_command[3]=3Dtoggle_acpi optionsmenu_command[4]=3Dtoggle_safemode optionsmenu_command[5]=3Dtoggle_singleuser optionsmenu_command[6]=3Dtoggle_verbose optionsmenu_init[4]=3Dinit_safemode optionsmenu_init[5]=3Dinit_singleuser optionsmenu_init[6]=3Dinit_verbose optionsmenu_keycode[1]=3D8 optionsmenu_keycode[2]=3D100 optionsmenu_keycode[3]=3D97 optionsmenu_keycode[4]=3D109 optionsmenu_keycode[5]=3D115 optionsmenu_keycode[6]=3D118 optionsmenu_options=3D3 optionsmenu_optionstext=3DBoot Options: optionstoggled_ansi[3]=3D^[1mA^[mCPI Support ^[32;7mOn^[m optionstoggled_ansi[4]=3DSafe ^[1mM^[mode... ^[32;7mOn^[m optionstoggled_ansi[5]=3D^[1mS^[mingle User. ^[32;7mOn^[m optionstoggled_ansi[6]=3D^[1mV^[merbose..... ^[32;7mOn^[m=20 optionstoggled_text[3]=3D[A]CPI Support On optionstoggled_text[4]=3DSafe [M]ode... On optionstoggled_text[5]=3D[S]ingle User. On optionstoggled_text[6]=3D[V]erbose..... On prompt=3D${interpret} script.lang=3Dforth smbios.bios.vendor=3DBHYVE toggled_ansi[1]=3DBoot ^[1mS^[mingle User ^[1m[Enter]^[m toggled_ansi[2]=3DBoot ^[1mM^[multi User toggled_text[1]=3DBoot [S]ingle User [Enter] toggled_text[2]=3DBoot [M]ulti User twiddle_divisor=3D1 vfs.mountroot.timeout=3D10 zfs_be_currpage=3D1 OK=20 Surely boot_serial changed "NO", but did not booted. >=20 > > Look here > > https://lists.freebsd.org/pipermail/freebsd-virtualization/2018-Novembe= r/006944.html > > Simon. > > You wrote 15.10.2019, 10:51:08: > > > Hi, all > > > I'm managing bhyve vm by vm-bhyve-devel (1.3-devel) port > > > which I've made by github head [1]. When create 13.0-CURRENT > > > vm with FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img > > > as follows: > > > vm create -s 16GB -t tmpfile.gpWbtMxa tbedfc > > > vm install -f tbedfc > > > FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img < /dev/null > > > where /vm/.templates/tmpfile.gpWbtMxa is > > > loader=3D"bhyveload" > > > cpu=3D2 > > > memory=3D8GB > > > network0_type=3D"virtio-net" > > > network0_switch=3Dlocal > > > disk0_type=3D"virtio-blk" > > > disk0_name=3D"disk0.img" > > > storage=3D16GB > > > But in install to image, boot freezed at: > > > =A0| =A0____| =A0 =A0 =A0 =A0 =A0 =A0 | =A0_ \ / ____| =A0__ \ > > > =A0| |___ _ __ ___ =A0___ | |_) | (___ | | =A0| | > > > =A0| =A0___| '__/ _ \/ _ \| =A0_ < \___ \| | =A0| | > > > =A0| | =A0 | | | =A0__/ =A0__/| |_) |____) | |__| | > > > =A0| | =A0 | | | =A0 =A0| =A0 =A0|| =A0 =A0 | =A0 =A0 =A0| =A0 =A0 = =A0| > > > =A0|_| =A0 |_| =A0\___|\___||____/|_____/|_____/ =A0 =A0``` =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 > > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0s` `.....---.......--.``` =A0 -/ > > > =A0+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3DWelcome to FreeBSD=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D+ +o =A0 .--` =A0 =A0 =A0 =A0 /y:` +. > > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 | =A0yo`:. =A0 =A0 =A0 =A0 =A0 =A0:o =A0 `+- > > > =A0| =A01. Boot Multi User [Enter] =A0 =A0 =A0 =A0 =A0 =A0 | =A0 y/ = =A0 =A0 =A0 =A0 =A0 =A0 =A0 -/` -o/ > > > =A0| =A02. Boot [S]ingle*User =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0| = =A0.- =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0::/sy+:. > > > =A0| =A03. [Esc]ape to loader prompt =A0 =A0 =A0 =A0 =A0 | =A0/ =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 `-- =A0/ > > > =A0| =A04. Reboot =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0| `: =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 :` > > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 | `: =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 :` > > > =A0| =A0Options: =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 | =A0/ =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 > > > =A0| =A05. [K]ernel: kernel (1 of 2) =A0 =A0 =A0 =A0 =A0 | =A0.- =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0-. > > > =A0| =A06. Configure Boot [O]ptions... =A0 =A0 =A0 =A0 | =A0 -- =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 -. > > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 | =A0 =A0`:` =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 `:` > > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 | =A0 =A0 =A0.-- =A0 =A0 =A0 =A0 =A0 =A0 `--. > > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 | =A0 =A0 =A0 =A0 .---.....----. > > > =A0+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+ > > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 > > > /boot/kernel/kernel text=3D0x153f9c0 data=3D0xe0 data=3D0x8007c0 syms= =3D[0x8+0x1722d8+0x8+0x190cb2] > > > Booting... > > > - > > > Using same image, I installed my note PC successfully. In > > > above state, > > > root@vm:~ # cat /vm/tbedfc/tbedfc.conf > > > loader=3D"bhyveload" > > > cpu=3D2 > > > memory=3D8GB > > > network0_type=3D"virtio-net" > > > network0_switch=3Dlocal > > > disk0_type=3D"virtio-blk" > > > disk0_name=3D"disk0.img" > > > storage=3D16GB > > > uuid=3D"90a693df-ef1e-11e9-847a-0cc47ab3cfd4" > > > network0_mac=3D"58:9c:fc:0b:65:c9" > > > root@vm:~ # cat /vm/tbedfc/vm-bhyve.log > > > Oct 15 16:36:56: initialising > > > Oct 15 16:36:56: =A0[loader: bhyveload] > > > Oct 15 16:36:56: =A0[cpu: 2] > > > Oct 15 16:36:56: =A0[memory: 8GB] > > > Oct 15 16:36:56: =A0[hostbridge: standard] > > > Oct 15 16:36:56: =A0[com ports: com1] > > > Oct 15 16:36:56: =A0[uuid: 90a693df-ef1e-11e9-847a-0cc47ab3cfd4] > > > Oct 15 16:36:56: =A0[utctime: yes] > > > Oct 15 16:36:56: =A0[debug mode: no] > > > Oct 15 16:36:56: =A0[primary disk: disk0.img] > > > Oct 15 16:36:56: =A0[primary disk dev: file] > > > Oct 15 16:36:56: generated static mac 58:9c:fc:0b:65:c9 (based on 'tb= edfc:0:1571125016:0') > > > Oct 15 16:36:56: initialising network device tap0 > > > Oct 15 16:36:56: adding tap0 -> vm-local (local addm) > > > Oct 15 16:36:56: bring up tap0 -> vm-local (local addm) > > > Oct 15 16:36:56: booting > > > Oct 15 16:36:56: bhyveload -m 8GB -e autoboot_delay=3D3 -d > > > /vm/.iso/FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img tbe= dfc > > > Oct 15 16:37:00: =A0[bhyve options: -c 2 -m 8GB -AHP -U > > > 90a693df-ef1e-11e9-847a-0cc47ab3cfd4 -u] > > > Oct 15 16:37:00: =A0[bhyve devices: -s 0,hostbridge -s 31,lpc -s > > > 4:0,virtio-blk,/vm/tbedfc/disk0.img -s > > > 5:0,virtio-net,tap0,mac=3D58:9c:fc:0b:65:c9] > > > Oct 15 16:37:00: =A0[bhyve console: -l com1,stdio] > > > Oct 15 16:37:00: =A0[bhyve iso device: -s > > > 3:0,ahci-hd,/vm/.iso/FreeBSD-13.0-CURRENT-amd64-20191011-r353427-mems= tick.img] > > > Oct 15 16:37:00: starting bhyve (run 1) > > > root@vm:~ # uname -a > > > FreeBSD vm.truefc.org 13.0-CURRENT FreeBSD 13.0-CURRENT #0 r353025: > > > Thu Oct =A03 19:38:47 JST 2019 =A0 =A0 > > > admin@vm.truefc.org:/ds/obj/current/13.0/r353025/ds/src/current/13.0/= r353025/amd64.amd64/sys/GENERIC > > amd64 > > > root@vm:~ # ifconfig > > > igb0: flags=3D8943 me= tric 0 mtu 1500 > > > =A0 =A0 =A0 =A0 > > > > > options=3D4e523bb > > > =A0 =A0 =A0 =A0 ether 0c:c4:7a:b3:cf:d4 > > > =A0 =A0 =A0 =A0 inet xxx.xxx.xx.xx netmask 0xfffffff8 broadcast xxx.x= xx.xx.xx > > > =A0 =A0 =A0 =A0 media: Ethernet autoselect (1000baseT ) > > > =A0 =A0 =A0 =A0 status: active > > > =A0 =A0 =A0 =A0 nd6 options=3D29 > > > igb1: flags=3D8943 me= tric 0 mtu 1500 > > > =A0 =A0 =A0 =A0 > > > > > options=3D4a520b9 > > > =A0 =A0 =A0 =A0 ether 0c:c4:7a:b3:cf:d5 > > > =A0 =A0 =A0 =A0 inet 192.168.1.17 netmask 0xffffff00 broadcast 192.16= 8.1.255 > > > =A0 =A0 =A0 =A0 media: Ethernet autoselect (1000baseT ) > > > =A0 =A0 =A0 =A0 status: active > > > =A0 =A0 =A0 =A0 nd6 options=3D29 > > > lo0: flags=3D8049 metric 0 mtu 16384 > > > =A0 =A0 =A0 =A0 > > > options=3D680003 > > > =A0 =A0 =A0 =A0 inet6 ::1 prefixlen 128 > > > =A0 =A0 =A0 =A0 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 > > > =A0 =A0 =A0 =A0 inet 127.0.0.1 netmask 0xff000000 > > > =A0 =A0 =A0 =A0 groups: lo > > > =A0 =A0 =A0 =A0 nd6 options=3D21 > > > vm-public: flags=3D8843 metri= c 0 mtu 1500 > > > =A0 =A0 =A0 =A0 ether c6:ed:62:0a:b0:4e > > > =A0 =A0 =A0 =A0 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwdde= lay 15 > > > =A0 =A0 =A0 =A0 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1= 200 > > > =A0 =A0 =A0 =A0 root id 00:00:00:00:00:00 priority 32768 ifcost 0 por= t 0 > > > =A0 =A0 =A0 =A0 member: igb0 flags=3D143 > > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 ifmaxaddr 0 port 1 priority 128 path = cost 20000 > > > =A0 =A0 =A0 =A0 groups: bridge vm-switch viid-4c918@ > > > =A0 =A0 =A0 =A0 nd6 options=3D1 > > > vm-local: flags=3D8843 metric= 0 mtu 1500 > > > =A0 =A0 =A0 =A0 ether 8a:d0:25:7d:f7:51 > > > =A0 =A0 =A0 =A0 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwdde= lay 15 > > > =A0 =A0 =A0 =A0 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1= 200 > > > =A0 =A0 =A0 =A0 root id 00:00:00:00:00:00 priority 32768 ifcost 0 por= t 0 > > > =A0 =A0 =A0 =A0 member: tap0 flags=3D143 > > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 ifmaxaddr 0 port 6 priority 128 path = cost 2000000 > > > =A0 =A0 =A0 =A0 member: igb1 flags=3D143 > > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 ifmaxaddr 0 port 2 priority 128 path = cost 20000 > > > =A0 =A0 =A0 =A0 groups: bridge vm-switch viid-f5dda@ > > > =A0 =A0 =A0 =A0 nd6 options=3D1 > > > tap0: flags=3D8943 me= tric 0 mtu 1500 > > > =A0 =A0 =A0 =A0 description: vmnet-tbedfc-0-local > > > =A0 =A0 =A0 =A0 options=3D80000 > > > =A0 =A0 =A0 =A0 ether 58:9c:fc:10:ff:df > > > =A0 =A0 =A0 =A0 groups: tap vm-port > > > =A0 =A0 =A0 =A0 media: Ethernet autoselect > > > =A0 =A0 =A0 =A0 status: active > > > =A0 =A0 =A0 =A0 nd6 options=3D29 > > > =A0 =A0 =A0 =A0 Opened by PID 85496 > > > root@vm:~ # > > > Whats' wrong ? =A0BTW 12.1-PRERELEASE(r352368) and > > > 12.0-RELEASE-p10(r352368) are nothing happened. > > > [1] > > > https://github.com/TrueFC/ports/tree/master/sysutils/vm-bhyve-devel > > > --- > > > KIRIYAMA Kazuhiko > > > _______________________________________________ > > > freebsd-virtualization@freebsd.org=A0mailing list > > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > > To unsubscribe, send any mail to > > > "freebsd-virtualization-unsubscribe@freebsd.org" > >=20 > >=20 > --- > KIRIYAMA Kazuhiko >=20 --- KIRIYAMA Kazuhiko From owner-freebsd-virtualization@freebsd.org Wed Oct 16 01:02:00 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AD3B7158436 for ; Wed, 16 Oct 2019 01:02:00 +0000 (UTC) (envelope-from kiri@truefc.org) Received: from kx.truefc.org (flets-sg1026.kamome.or.jp [202.216.24.26]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp", Issuer "smtp" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 46tDXQ48ckz43L6 for ; Wed, 16 Oct 2019 01:01:57 +0000 (UTC) (envelope-from kiri@truefc.org) Received: from kx.truefc.org (kx.truefc.org [202.216.24.26]) by kx.truefc.org (8.15.2/8.15.2) with ESMTP id x9G11nWb052203; Wed, 16 Oct 2019 10:01:49 +0900 (JST) (envelope-from kiri@kx.truefc.org) Message-Id: <201910160101.x9G11nWb052203@kx.truefc.org> Date: Wed, 16 Oct 2019 10:01:49 +0900 From: KIRIYAMA Kazuhiko To: KIRIYAMA Kazuhiko Cc: Simon Gusev , freebsd-virtualization@freebsd.org Subject: Re: VM freezed at booting of FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img In-Reply-To: <201910152217.x9FMH4JI051008@kx.truefc.org> References: <201910150751.x9F7p803016663@kx.truefc.org> <03057504.20191015110705@fly777.net> <201910151035.x9FAZNlU043565@kx.truefc.org> <201910152217.x9FMH4JI051008@kx.truefc.org> User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI/1.14.6 (Maruoka) FLIM/1.14.9 (=?ISO-8859-4?Q?Goj=F2?=) APEL/10.8 MULE XEmacs/21.4 (patch 24) (Standard C) (amd64--freebsd) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 46tDXQ48ckz43L6 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of kiri@truefc.org has no SPF policy when checking 202.216.24.26) smtp.mailfrom=kiri@truefc.org X-Spamd-Result: default: False [-0.49 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.67)[-0.667,0]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[truefc.org]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-0.92)[-0.921,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:4704, ipnet:202.216.0.0/19, country:JP]; IP_SCORE(-0.00)[country: JP(-0.00)]; ONCE_RECEIVED(0.10)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Oct 2019 01:02:00 -0000 On Wed, 16 Oct 2019 07:17:04 +0900, KIRIYAMA Kazuhiko wrote: >=20 > On Tue, 15 Oct 2019 19:35:23 +0900, > KIRIYAMA Kazuhiko wrote: > >=20 > > On Tue, 15 Oct 2019 17:07:05 +0900, > > Simon wrote: > > >=20 > > >=20 > > >=20 > > > Hi ) > > > May be the same problem. > > > I said about this here > > > https://forums.freebsd.org/threads/freebsd-12-0-release-amd64-freeze-= boot-from-bhyve-uefi-bhyve_uefi-fd-uefi-gop-screen-goes-blank.69616/ > > > Solution. > > > Try this > > > Select > > > 3 -=A0[Esc]ape to loader prompt=A0 > > > set boot_serial=3D"NO" > > > boot > >=20 > > `vm install' doesn't wait boot loader. So above > > manupulation could not work. I've specified it to the > > bhyveload `-e' option like with `-e boot_serial=3DNO': > >=20 > > root@vm:~ # cat /vm/tbedfc/vm-bhyve.log > > Oct 15 19:27:55: initialising > > Oct 15 19:27:55: [loader: bhyveload] > > Oct 15 19:27:55: [cpu: 2] > > Oct 15 19:27:55: [memory: 8GB] > > Oct 15 19:27:55: [hostbridge: standard] > > Oct 15 19:27:55: [com ports: com1] > > Oct 15 19:27:55: [uuid: 737d1159-ef36-11e9-847a-0cc47ab3cfd4] > > Oct 15 19:27:55: [utctime: yes] > > Oct 15 19:27:55: [debug mode: no] > > Oct 15 19:27:55: [primary disk: disk0.img] > > Oct 15 19:27:55: [primary disk dev: file] > > Oct 15 19:27:55: generated static mac 58:9c:fc:02:46:e2 (based on 'tbed= fc:0:1571135275:0') > > Oct 15 19:27:55: initialising network device tap0 > > Oct 15 19:27:55: adding tap0 -> vm-local (local addm) > > Oct 15 19:27:55: bring up tap0 -> vm-local (local addm) > > Oct 15 19:27:55: booting > > Oct 15 19:27:55: bhyveload -m 8GB -e autoboot_delay=3D3 -e boot_serial= =3DNO -d /vm/.iso/FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img = tbedfc > > Oct 15 19:27:59: [bhyve options: -c 2 -m 8GB -AHP -U 737d1159-ef36-11e= 9-847a-0cc47ab3cfd4 -u] > > Oct 15 19:27:59: [bhyve devices: -s 0,hostbridge -s 31,lpc -s 4:0,virt= io-blk,/vm/tbedfc/disk0.img -s 5:0,virtio-net,tap0,mac=3D58:9c:fc:02:46:e2] > > Oct 15 19:27:59: [bhyve console: -l com1,stdio] > > Oct 15 19:27:59: [bhyve iso device: -s 3:0,ahci-hd,/vm/.iso/FreeBSD-13= .0-CURRENT-amd64-20191011-r353427-memstick.img] > > Oct 15 19:27:59: starting bhyve (run 1) > > Oct 15 19:29:54: bhyve exited with status 1 > > Oct 15 19:29:54: destroying network device tap0 > > Oct 15 19:29:55: stopped > > root@vm:~ #=20 > >=20 > > but also freezed ;-( >=20 > I've listed all boot variables at loader prompt: >=20 >=20 > Type '?' for a list of commands, 'help' for more detailed help. > OK show > LINES=3D24 > ansi_caption[1]=3D^[1mB^[moot Multi User ^[1m[Enter]^[m > ansi_caption[2]=3DBoot ^[1mS^[mingle User > ansi_caption[3]=3D^[1mEsc^[mape to loader prompt > ansi_caption[5]=3DKernel: default/kernel (1 of 2) > ansi_caption[5][0]=3DKernel: default/kernel (1 of 2) > ansi_caption[5][1]=3DKernel: kernel.old (2 of 2) > ansi_caption[6]=3DConfigure Boot ^[1mO^[mptions... > autoboot_delay=3DNO > beansi_bootfs=3D^[1mbootfs: ^[m > beansi_current=3D^[1mActive: ^[m > beansi_page=3D^[1mP^[mage:=20 > beansi_pageof=3D of=20 > bemenu_bootfs=3Dbootfs:=20 > bemenu_current=3DActive:=20 > bemenu_page=3D[P]age:=20 > bemenu_pageof=3D of=20 > boot_serial=3DNO > bootenv_autolist=3DYES > bootenv_root[2]=3D > bootenvmenu_command[1]=3Dbe_draw_screen 1 goto_menu > bootenvmenu_command[2]=3Dset_bootenv > bootenvmenu_command[3]=3Dset_be_page > beansi_bootfs=3D^[1mbootfs: ^[m > beansi_current=3D^[1mActive: ^[m > beansi_page=3D^[1mP^[mage:=20 > beansi_pageof=3D of=20 > bemenu_bootfs=3Dbootfs:=20 > bemenu_current=3DActive:=20 > bemenu_page=3D[P]age:=20 > bemenu_pageof=3D of=20 > boot_serial=3DNO > bootenv_autolist=3DYES > bootenv_root[2]=3D > bootenvmenu_command[1]=3Dbe_draw_screen 1 goto_menu > bootenvmenu_command[2]=3Dset_bootenv > bootenvmenu_command[3]=3Dset_be_page > bootenvmenu_init=3Dinit_bootenv =20 > bootenvmenu_keycode[1]=3D8 > bootenvmenu_keycode[2]=3D97 > bootenvmenu_keycode[3]=3D112 > bootenvmenu_options=3D4 > bootenvmenu_optionstext=3DBoot Environments: > bootfile=3Dkernel > console=3Duserboot > currdev=3Ddisk0s2a: > efi_max_resolution=3D1x1 > hint.acpi_throttle.0.disabled=3D1 > hint.atkbd.0.at=3Datkbdc > hint.atkbd.0.irq=3D1 > hint.atkbdc.0.at=3Disa > hint.atkbdc.0.port=3D0x060 > hint.atrtc.0.at=3Disa > hint.atrtc.0.irq=3D8 > hint.atrtc.0.port=3D0x70 > hint.attimer.0.at=3Disa > hint.attimer.0.irq=3D0 > hint.attimer.0.port=3D0x40 > hint.fd.0.at=3Dfdc0 > hint.fd.0.drive=3D0 > efi_max_resolution=3D1x1 > hint.acpi_throttle.0.disabled=3D1 > hint.atkbd.0.at=3Datkbdc > hint.atkbd.0.irq=3D1 > hint.atkbdc.0.at=3Disa > hint.atkbdc.0.port=3D0x060 > hint.atrtc.0.at=3Disa > hint.atrtc.0.irq=3D8 > hint.atrtc.0.port=3D0x70 > hint.attimer.0.at=3Disa > hint.attimer.0.irq=3D0 > hint.attimer.0.port=3D0x40 > hint.fd.0.at=3Dfdc0 > hint.fd.0.drive=3D0 > hint.fd.1.at=3Dfdc0 =20 > hint.fd.1.drive=3D1 > hint.fdc.0.at=3Disa > hint.fdc.0.drq=3D2 > hint.fdc.0.irq=3D6 > hint.fdc.0.port=3D0x3F0 > hint.p4tcc.0.disabled=3D1 > hint.ppc.0.at=3Disa > hint.ppc.0.irq=3D7 > hint.psm.0.at=3Datkbdc > hint.psm.0.irq=3D12 > hint.sc.0.at=3Disa > hint.sc.0.flags=3D0x100 > hint.uart.0.at=3Disa > hint.uart.0.flags=3D0x10 > hint.uart.0.irq=3D4 > hint.uart.0.port=3D0x3F8 > hint.uart.1.at=3Disa > hint.uart.1.irq=3D3 > hint.uart.1.port=3D0x2F8 > interpret=3DOK > kernel=3Dkernel > kernel[0]=3Dkernel > hint.psm.0.at=3Datkbdc > hint.psm.0.irq=3D12 > hint.sc.0.at=3Disa > hint.sc.0.flags=3D0x100 > hint.uart.0.at=3Disa > hint.uart.0.flags=3D0x10 > hint.uart.0.irq=3D4 > hint.uart.0.port=3D0x3F8 > hint.uart.1.at=3Disa > hint.uart.1.irq=3D3 > hint.uart.1.port=3D0x2F8 > interpret=3DOK > kernel=3Dkernel > kernel[0]=3Dkernel > kernel[1]=3Dkernel.old =20 > kernel_options=3D > kernels_autodetect=3DNO > loaddev=3Ddisk0s2a: > loader_conf_files=3D/boot/device.hints /boot/loader.conf /boot/loader.con= f.local > mainansi_caption[1]=3D^[1mB^[moot Multi User ^[1m[Enter]^[m > mainansi_caption[2]=3DBoot ^[1mS^[mingle User > mainansi_caption[3]=3D^[1mEsc^[mape to loader prompt > mainansi_caption[6]=3DConfigure Boot ^[1mO^[mptions... > mainmenu_caption[1]=3DBoot Multi User [Enter] > mainmenu_caption[2]=3DBoot [S]ingle User > mainmenu_caption[3]=3D[Esc]ape to loader prompt > mainmenu_caption[6]=3DConfigure Boot [O]ptions... > mainmenu_command[1]=3Dboot > mainmenu_command[2]=3Daltboot > mainmenu_command[3]=3Dgoto_prompt > mainmenu_command[5]=3Dcycle_kernel > mainmenu_command[6]=3D2 goto_menu > mainmenu_init[1]=3Dinit_boot > mainmenu_init[2]=3Dinit_altboot > mainmenu_kernel=3D5 > mainmenu_keycode[3]=3D27 > mainmenu_keycode[5]=3D107 > mainmenu_caption[1]=3DBoot Multi User [Enter] > mainmenu_caption[2]=3DBoot [S]ingle User > mainmenu_caption[3]=3D[Esc]ape to loader prompt > mainmenu_caption[6]=3DConfigure Boot [O]ptions... > mainmenu_command[1]=3Dboot > mainmenu_command[2]=3Daltboot > mainmenu_command[3]=3Dgoto_prompt > mainmenu_command[5]=3Dcycle_kernel > mainmenu_command[6]=3D2 goto_menu > mainmenu_init[1]=3Dinit_boot > mainmenu_init[2]=3Dinit_altboot > mainmenu_kernel=3D5 > mainmenu_keycode[3]=3D27 > mainmenu_keycode[5]=3D107 > mainmenu_keycode[6]=3D111 =20 > mainmenu_options=3D5 > mainmenu_reboot=3D > maintoggled_ansi[1]=3DBoot ^[1mS^[mingle User ^[1m[Enter]^[m > maintoggled_ansi[2]=3DBoot ^[1mM^[multi User > maintoggled_text[1]=3DBoot [S]ingle User [Enter] > maintoggled_text[2]=3DBoot [M]ulti User > menu_caption[1]=3DBoot Multi User [Enter] > menu_caption[2]=3DBoot [S]ingle User > menu_caption[3]=3D[Esc]ape to loader prompt > menu_caption[5]=3D[K]ernel: kernel (1 of 2) > menu_caption[5][0]=3D[K]ernel: kernel (1 of 2) > menu_caption[5][1]=3D[K]ernel: kernel.old (2 of 2) > menu_caption[6]=3DConfigure Boot [O]ptions... > menu_command[1]=3Dboot > menu_command[2]=3Daltboot > menu_command[3]=3Dgoto_prompt > menu_command[5]=3Dcycle_kernel > menu_command[6]=3D2 goto_menu > menu_init[1]=3Dinit_boot > menu_init[2]=3Dinit_altboot > menu_kernel=3D5 > menu_keycode[1]=3D98 > menu_caption[3]=3D[Esc]ape to loader prompt > menu_caption[5]=3D[K]ernel: kernel (1 of 2) > menu_caption[5][0]=3D[K]ernel: kernel (1 of 2) > menu_caption[5][1]=3D[K]ernel: kernel.old (2 of 2) > menu_caption[6]=3DConfigure Boot [O]ptions... > menu_command[1]=3Dboot > menu_command[2]=3Daltboot > menu_command[3]=3Dgoto_prompt > menu_command[5]=3Dcycle_kernel > menu_command[6]=3D2 goto_menu > menu_init[1]=3Dinit_boot > menu_init[2]=3Dinit_altboot > menu_kernel=3D5 > menu_keycode[1]=3D98 > menu_keycode[2]=3D115 =20 > menu_keycode[3]=3D27 > menu_keycode[5]=3D107 > menu_keycode[6]=3D111 > menu_options=3D5 > menu_reboot=3D > menu_timeout_command=3Dboot > menuset_initial=3D1 > menuset_name1=3Dmain > menuset_name2=3Doptions > menuset_name3=3Dbootenv > module_blacklist=3Ddrm drm2 radeonkms i915kms amdgpu > module_path=3D/boot/modules;/boot/dtb;/boot/dtb/overlays > optionsansi_caption[1]=3DBack to Main Menu ^[1m[Backspace]^[m > optionsansi_caption[2]=3DLoad System ^[1mD^[mefaults > optionsansi_caption[3]=3D^[1mA^[mCPI Support ^[34;1mOff^[m > optionsansi_caption[4]=3DSafe ^[1mM^[mode... ^[34;1mOff^[m > optionsansi_caption[5]=3D^[1mS^[mingle User. ^[34;1mOff^[m > optionsansi_caption[6]=3D^[1mV^[merbose..... ^[34;1mOff^[m > optionsmenu_acpi=3D3 > optionsmenu_caption[1]=3DBack to Main Menu [Backspace] > optionsmenu_caption[2]=3DLoad System [D]efaults > optionsmenu_caption[3]=3D[A]CPI Support off > menuset_name2=3Doptions > menuset_name3=3Dbootenv > module_blacklist=3Ddrm drm2 radeonkms i915kms amdgpu > module_path=3D/boot/modules;/boot/dtb;/boot/dtb/overlays > optionsansi_caption[1]=3DBack to Main Menu ^[1m[Backspace]^[m > optionsansi_caption[2]=3DLoad System ^[1mD^[mefaults > optionsansi_caption[3]=3D^[1mA^[mCPI Support ^[34;1mOff^[m > optionsansi_caption[4]=3DSafe ^[1mM^[mode... ^[34;1mOff^[m > optionsansi_caption[5]=3D^[1mS^[mingle User. ^[34;1mOff^[m > optionsansi_caption[6]=3D^[1mV^[merbose..... ^[34;1mOff^[m > optionsmenu_acpi=3D3 > optionsmenu_caption[1]=3DBack to Main Menu [Backspace] > optionsmenu_caption[2]=3DLoad System [D]efaults > optionsmenu_caption[3]=3D[A]CPI Support off > optionsmenu_caption[4]=3DSafe [M]ode... off =20 > optionsmenu_caption[5]=3D[S]ingle User. off > optionsmenu_caption[6]=3D[V]erbose..... off > optionsmenu_command[1]=3D1 goto_menu > optionsmenu_command[2]=3Dset_default_boot_options > optionsmenu_command[3]=3Dtoggle_acpi > optionsmenu_command[4]=3Dtoggle_safemode > optionsmenu_command[5]=3Dtoggle_singleuser > optionsmenu_command[6]=3Dtoggle_verbose > optionsmenu_init[4]=3Dinit_safemode > optionsmenu_init[5]=3Dinit_singleuser > optionsmenu_init[6]=3Dinit_verbose > optionsmenu_keycode[1]=3D8 > optionsmenu_keycode[2]=3D100 > optionsmenu_keycode[3]=3D97 > optionsmenu_keycode[4]=3D109 > optionsmenu_keycode[5]=3D115 > optionsmenu_keycode[6]=3D118 > optionsmenu_options=3D3 > optionsmenu_optionstext=3DBoot Options: > optionstoggled_ansi[3]=3D^[1mA^[mCPI Support ^[32;7mOn^[m > optionstoggled_ansi[4]=3DSafe ^[1mM^[mode... ^[32;7mOn^[m > optionstoggled_ansi[5]=3D^[1mS^[mingle User. ^[32;7mOn^[m > optionsmenu_caption[5]=3D[S]ingle User. off > optionsmenu_caption[6]=3D[V]erbose..... off > optionsmenu_command[1]=3D1 goto_menu > optionsmenu_command[2]=3Dset_default_boot_options > optionsmenu_command[3]=3Dtoggle_acpi > optionsmenu_command[4]=3Dtoggle_safemode > optionsmenu_command[5]=3Dtoggle_singleuser > optionsmenu_command[6]=3Dtoggle_verbose > optionsmenu_init[4]=3Dinit_safemode > optionsmenu_init[5]=3Dinit_singleuser > optionsmenu_init[6]=3Dinit_verbose > optionsmenu_keycode[1]=3D8 > optionsmenu_keycode[2]=3D100 > optionsmenu_keycode[3]=3D97 > optionsmenu_keycode[4]=3D109 > optionsmenu_keycode[5]=3D115 > optionsmenu_keycode[6]=3D118 > optionsmenu_options=3D3 > optionsmenu_optionstext=3DBoot Options: > optionstoggled_ansi[3]=3D^[1mA^[mCPI Support ^[32;7mOn^[m > optionstoggled_ansi[4]=3DSafe ^[1mM^[mode... ^[32;7mOn^[m > optionstoggled_ansi[5]=3D^[1mS^[mingle User. ^[32;7mOn^[m > optionstoggled_ansi[6]=3D^[1mV^[merbose..... ^[32;7mOn^[m=20 > optionstoggled_text[3]=3D[A]CPI Support On > optionstoggled_text[4]=3DSafe [M]ode... On > optionstoggled_text[5]=3D[S]ingle User. On > optionstoggled_text[6]=3D[V]erbose..... On > prompt=3D${interpret} > script.lang=3Dforth > smbios.bios.vendor=3DBHYVE > toggled_ansi[1]=3DBoot ^[1mS^[mingle User ^[1m[Enter]^[m > toggled_ansi[2]=3DBoot ^[1mM^[multi User > toggled_text[1]=3DBoot [S]ingle User [Enter] > toggled_text[2]=3DBoot [M]ulti User > twiddle_divisor=3D1 > vfs.mountroot.timeout=3D10 > zfs_be_currpage=3D1 > OK=20 >=20 > Surely boot_serial changed "NO", but did not booted. >=20 > >=20 > > > Look here > > > https://lists.freebsd.org/pipermail/freebsd-virtualization/2018-Novem= ber/006944.html > > > Simon. > > > You wrote 15.10.2019, 10:51:08: > > > > Hi, all > > > > I'm managing bhyve vm by vm-bhyve-devel (1.3-devel) port > > > > which I've made by github head [1]. When create 13.0-CURRENT > > > > vm with FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img > > > > as follows: > > > > vm create -s 16GB -t tmpfile.gpWbtMxa tbedfc > > > > vm install -f tbedfc > > > > FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img < /dev/null > > > > where /vm/.templates/tmpfile.gpWbtMxa is > > > > loader=3D"bhyveload" > > > > cpu=3D2 > > > > memory=3D8GB > > > > network0_type=3D"virtio-net" > > > > network0_switch=3Dlocal > > > > disk0_type=3D"virtio-blk" > > > > disk0_name=3D"disk0.img" > > > > storage=3D16GB > > > > But in install to image, boot freezed at: > > > > =A0| =A0____| =A0 =A0 =A0 =A0 =A0 =A0 | =A0_ \ / ____| =A0__ \ > > > > =A0| |___ _ __ ___ =A0___ | |_) | (___ | | =A0| | > > > > =A0| =A0___| '__/ _ \/ _ \| =A0_ < \___ \| | =A0| | > > > > =A0| | =A0 | | | =A0__/ =A0__/| |_) |____) | |__| | > > > > =A0| | =A0 | | | =A0 =A0| =A0 =A0|| =A0 =A0 | =A0 =A0 =A0| =A0 =A0 = =A0| > > > > =A0|_| =A0 |_| =A0\___|\___||____/|_____/|_____/ =A0 =A0``` =A0 =A0= =A0 =A0 =A0 =A0 =A0 =A0 =A0 > > > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0 =A0 =A0s` `.....---.......--.``` =A0 -/ > > > > =A0+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3DWelcome to FreeBSD=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D+ +o =A0 .--` =A0 =A0 =A0 =A0 /y:` +. > > > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 | =A0yo`:. =A0 =A0 =A0 =A0 =A0 =A0:o =A0 `+- > > > > =A0| =A01. Boot Multi User [Enter] =A0 =A0 =A0 =A0 =A0 =A0 | =A0 y/= =A0 =A0 =A0 =A0 =A0 =A0 =A0 -/` -o/ > > > > =A0| =A02. Boot [S]ingle*User =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0| = =A0.- =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0::/sy+:. > > > > =A0| =A03. [Esc]ape to loader prompt =A0 =A0 =A0 =A0 =A0 | =A0/ =A0= =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 `-- =A0/ > > > > =A0| =A04. Reboot =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0| `: =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 :` > > > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 | `: =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 :` > > > > =A0| =A0Options: =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 | =A0/ =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 > > > > =A0| =A05. [K]ernel: kernel (1 of 2) =A0 =A0 =A0 =A0 =A0 | =A0.- = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0-. > > > > =A0| =A06. Configure Boot [O]ptions... =A0 =A0 =A0 =A0 | =A0 -- =A0= =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 -. > > > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 | =A0 =A0`:` =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 `:` > > > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 | =A0 =A0 =A0.-- =A0 =A0 =A0 =A0 =A0 =A0 `--. > > > > =A0| =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 | =A0 =A0 =A0 =A0 .---.....----. > > > > =A0+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+ > > > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0 > > > > /boot/kernel/kernel text=3D0x153f9c0 data=3D0xe0 data=3D0x8007c0 sy= ms=3D[0x8+0x1722d8+0x8+0x190cb2] > > > > Booting... This is not the case for 13.0-CURRENT but also 11.3-STABLE and 12.1-PRERELEASE: root@vm:/.dake/bds # vm create -s 16GB -t tbedf tbedfc root@vm:/.dake/bds # vm install -f tbedfc FreeBSD-11.3-STABLE-amd64-2019101= 1-r353406-memstick.img ______ ____ _____ _____ =20 | ____| | _ \ / ____| __ \=20 | |___ _ __ ___ ___ | |_) | (___ | | | | | ___| '__/ _ \/ _ \| _ < \___ \| | | | | | | | | __/ __/| |_) |____) | |__| | | | | | | | || | | | |_| |_| \___|\___||____/|_____/|_____/ ``` ` s` `.....---.......--.``` -/ +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3DWelcome to FreeBSD=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D+ +o .--` /y:` +. | | yo`:. :o `+- | 1. Boot Multi User [Enter] | y/ -/` -o/ | 2. Boot [S]ingle User | .- ::/sy+:. | 3. [Esc]ape to loader prompt | / `-- / | 4. Reboot | `: :` | | `: :` | Options: | / / | 5. [K]ernel: kernel (1 of 2) | .- -. | 6. Configure Boot [O]ptions... | -- -. | | `:` `:` | | .-- `--. | | .---.....----.=20 +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+ =20 | To get back to the menu, type `menu' and press ENTER or type `boot' and press ENTER to start FreeBSD. Type '?' for a list of commands, 'help' for more detailed help. OK boot /boot/kernel/kernel text=3D0x1579008 data=3D0x145db0+0x4cdea0 syms=3D[0x8+0= x16e168+0x8+0x187010] Booting... \ root@vm:~ # cat /vm/tbedfc/vm-bhyve.log=20 Oct 16 09:34:46: initialising Oct 16 09:34:46: [loader: bhyveload] Oct 16 09:34:46: [cpu: 4] Oct 16 09:34:46: [memory: 4G] Oct 16 09:34:46: [hostbridge: standard] Oct 16 09:34:46: [com ports: com1] Oct 16 09:34:46: [uuid: b5986048-efac-11e9-847a-0cc47ab3cfd4] Oct 16 09:34:46: [utctime: yes] Oct 16 09:34:46: [debug mode: no] Oct 16 09:34:46: [primary disk: disk0.img] Oct 16 09:34:46: [primary disk dev: file] Oct 16 09:34:46: generated static mac 58:9c:fc:05:a3:5e (based on 'tbedfc:0= :1571186086:0') Oct 16 09:34:46: initialising network device tap0 Oct 16 09:34:46: adding tap0 -> vm-local (local addm) Oct 16 09:34:46: bring up tap0 -> vm-local (local addm) Oct 16 09:34:46: booting Oct 16 09:34:46: bhyveload -m 4G -e autoboot_delay=3D20 -e boot_serial=3DNO= -d /vm/.iso/FreeBSD-11.3-STABLE-amd64-20191011-r353406-memstick.img tbedfc Oct 16 09:35:21: [bhyve options: -c 4 -m 4G -AHP -U b5986048-efac-11e9-847= a-0cc47ab3cfd4 -u] Oct 16 09:35:21: [bhyve devices: -s 0,hostbridge -s 31,lpc -s 4:0,virtio-b= lk,/vm/tbedfc/disk0.img -s 5:0,virtio-net,tap0,mac=3D58:9c:fc:05:a3:5e] Oct 16 09:35:21: [bhyve console: -l com1,stdio] Oct 16 09:35:21: [bhyve iso device: -s 3:0,ahci-hd,/vm/.iso/FreeBSD-11.3-S= TABLE-amd64-20191011-r353406-memstick.img] Oct 16 09:35:21: starting bhyve (run 1) root@vm:~ # vm create -s 16GB -t tbedf tbedfc root@vm:/.dake/bds # vm install -f tbedfc FreeBSD-12.1-PRERELEASE-amd64-201= 90913-r352266-memstick.img | ______ ____ _____ _____ =20 | ____| | _ \ / ____| __ \=20 | |___ _ __ ___ ___ | |_) | (___ | | | | | ___| '__/ _ \/ _ \| _ < \___ \| | | | | | | | | __/ __/| |_) |____) | |__| | | | | | | | || | | | |_| |_| \___|\___||____/|_____/|_____/=20 ``` = ` Welcome to FreeBSD s` `.....---.......--.``` -/ +o .--` /y:` +. 1. Boot Multi user [Enter] yo`:. :o `+- 2. Boot Single user y/ -/` -o/ 3. Escape to loader prompt .- ::/sy+:. 4. Reboot / `-- / `: :` Options: `: :` 5. Kernel: default/2kernel (1 of 1) / / 6. Boot Options .- -. -- -. `:` `:` .-- `--. .---.....----. = =20 Exiting menu! Type '?' for a list of commands, 'help' for more detailed help. OK show LINES=3D24 autoboot_delay=3DNO boot_serial=3DNO bootenv_autolist=3DYES bootfile=3Dkernel console=3Duserboot currdev=3Ddisk0s2a: efi_max_resolution=3D1x1 hint.acpi_throttle.0.disabled=3D1 hint.atkbd.0.at=3Datkbdc hint.atkbd.0.irq=3D1 hint.atkbdc.0.at=3Disa hint.atkbdc.0.port=3D0x060 hint.atrtc.0.at=3Disa hint.atrtc.0.irq=3D8 hint.atrtc.0.port=3D0x70 hint.attimer.0.at=3Disa hint.attimer.0.irq=3D0 hint.attimer.0.port=3D0x40 hint.fd.0.at=3Dfdc0 hint.fd.0.drive=3D0 hint.fd.1.at=3Dfdc0 hint.fd.1.drive=3D1 hint.fdc.0.at=3Disa =20 hint.fdc.0.drq=3D2 hint.fdc.0.irq=3D6 hint.fdc.0.port=3D0x3F0 hint.p4tcc.0.disabled=3D1 hint.ppc.0.at=3Disa hint.ppc.0.irq=3D7 hint.psm.0.at=3Datkbdc hint.psm.0.irq=3D12 hint.sc.0.at=3Disa hint.sc.0.flags=3D0x100 hint.uart.0.at=3Disa hint.uart.0.flags=3D0x10 hint.uart.0.irq=3D4 hint.uart.0.port=3D0x3F8 hint.uart.1.at=3Disa hint.uart.1.irq=3D3 hint.uart.1.port=3D0x2F8 interpret=3DOK kernel=3Dkernel kernel_options=3D kernels_autodetect=3DNO loaddev=3Ddisk0s2a: loader_conf_files=3D/boot/device.hints /boot/loader.conf /boot/loader.conf.= local module_blacklist=3Ddrm drm2 radeonkms i915kms amdgpu module_path=3D/boot/modules;/boot/dtb;/boot/dtb/overlays nextboot_conf=3D/boot/nextboot.conf nextboot_enable=3DNO prompt=3D${interpret} script.lang=3Dlua smbios.bios.vendor=3DBHYVE twiddle_divisor=3D1 verbose_loading=3DNO vfs.mountroot.timeout=3D10 OK boot Loading kernel... /boot/kernel/kernel text=3D0x168eb51 data=3D0x1d0a68+0x768d80 syms=3D[0x8+0= x178b00+0x8+0x196889] Loading configured modules... can't find '/boot/entropy' - root@vm:~ # cat /vm/tbedfc/vm-bhyve.log=20 Oct 16 09:45:18: initialising Oct 16 09:45:18: [loader: bhyveload] Oct 16 09:45:18: [cpu: 4] Oct 16 09:45:18: [memory: 4G] Oct 16 09:45:18: [hostbridge: standard] Oct 16 09:45:18: [com ports: com1] Oct 16 09:45:18: [uuid: 20fbd3ef-efae-11e9-847a-0cc47ab3cfd4] Oct 16 09:45:18: [utctime: yes] Oct 16 09:45:18: [debug mode: no] Oct 16 09:45:18: [primary disk: disk0.img] Oct 16 09:45:18: [primary disk dev: file] Oct 16 09:45:18: generated static mac 58:9c:fc:01:c9:dd (based on 'tbedfc:0= :1571186718:0') Oct 16 09:45:18: initialising network device tap0 Oct 16 09:45:18: adding tap0 -> vm-local (local addm) Oct 16 09:45:18: bring up tap0 -> vm-local (local addm) Oct 16 09:45:18: booting Oct 16 09:45:18: bhyveload -m 4G -e autoboot_delay=3D20 -e boot_serial=3DNO= -d /vm/.iso/FreeBSD-12.1-PRERELEASE-amd64-20190913-r352266-memstick.img tb= edfc Oct 16 09:47:06: [bhyve options: -c 4 -m 4G -AHP -U 20fbd3ef-efae-11e9-847= a-0cc47ab3cfd4 -u] Oct 16 09:47:06: [bhyve devices: -s 0,hostbridge -s 31,lpc -s 4:0,virtio-b= lk,/vm/tbedfc/disk0.img -s 5:0,virtio-net,tap0,mac=3D58:9c:fc:01:c9:dd] Oct 16 09:47:06: [bhyve console: -l com1,stdio] Oct 16 09:47:06: [bhyve iso device: -s 3:0,ahci-hd,/vm/.iso/FreeBSD-12.1-P= RERELEASE-amd64-20190913-r352266-memstick.img] Oct 16 09:47:06: starting bhyve (run 1) Oct 16 09:47:36: bhyve exited with status 1 Oct 16 09:47:36: destroying network device tap0 Oct 16 09:47:37: stopped root@vm:~ #=20 For 11.3-STABLE, `show' in boot prompt disturb termcap and could not display loader settings. This problem cause from bhyveload options or any bugs of bhyveload ? > > > > - > > > > Using same image, I installed my note PC successfully. In > > > > above state, > > > > root@vm:~ # cat /vm/tbedfc/tbedfc.conf > > > > loader=3D"bhyveload" > > > > cpu=3D2 > > > > memory=3D8GB > > > > network0_type=3D"virtio-net" > > > > network0_switch=3Dlocal > > > > disk0_type=3D"virtio-blk" > > > > disk0_name=3D"disk0.img" > > > > storage=3D16GB > > > > uuid=3D"90a693df-ef1e-11e9-847a-0cc47ab3cfd4" > > > > network0_mac=3D"58:9c:fc:0b:65:c9" > > > > root@vm:~ # cat /vm/tbedfc/vm-bhyve.log > > > > Oct 15 16:36:56: initialising > > > > Oct 15 16:36:56: =A0[loader: bhyveload] > > > > Oct 15 16:36:56: =A0[cpu: 2] > > > > Oct 15 16:36:56: =A0[memory: 8GB] > > > > Oct 15 16:36:56: =A0[hostbridge: standard] > > > > Oct 15 16:36:56: =A0[com ports: com1] > > > > Oct 15 16:36:56: =A0[uuid: 90a693df-ef1e-11e9-847a-0cc47ab3cfd4] > > > > Oct 15 16:36:56: =A0[utctime: yes] > > > > Oct 15 16:36:56: =A0[debug mode: no] > > > > Oct 15 16:36:56: =A0[primary disk: disk0.img] > > > > Oct 15 16:36:56: =A0[primary disk dev: file] > > > > Oct 15 16:36:56: generated static mac 58:9c:fc:0b:65:c9 (based on '= tbedfc:0:1571125016:0') > > > > Oct 15 16:36:56: initialising network device tap0 > > > > Oct 15 16:36:56: adding tap0 -> vm-local (local addm) > > > > Oct 15 16:36:56: bring up tap0 -> vm-local (local addm) > > > > Oct 15 16:36:56: booting > > > > Oct 15 16:36:56: bhyveload -m 8GB -e autoboot_delay=3D3 -d > > > > /vm/.iso/FreeBSD-13.0-CURRENT-amd64-20191011-r353427-memstick.img t= bedfc > > > > Oct 15 16:37:00: =A0[bhyve options: -c 2 -m 8GB -AHP -U > > > > 90a693df-ef1e-11e9-847a-0cc47ab3cfd4 -u] > > > > Oct 15 16:37:00: =A0[bhyve devices: -s 0,hostbridge -s 31,lpc -s > > > > 4:0,virtio-blk,/vm/tbedfc/disk0.img -s > > > > 5:0,virtio-net,tap0,mac=3D58:9c:fc:0b:65:c9] > > > > Oct 15 16:37:00: =A0[bhyve console: -l com1,stdio] > > > > Oct 15 16:37:00: =A0[bhyve iso device: -s > > > > 3:0,ahci-hd,/vm/.iso/FreeBSD-13.0-CURRENT-amd64-20191011-r353427-me= mstick.img] > > > > Oct 15 16:37:00: starting bhyve (run 1) > > > > root@vm:~ # uname -a > > > > FreeBSD vm.truefc.org 13.0-CURRENT FreeBSD 13.0-CURRENT #0 r353025: > > > > Thu Oct =A03 19:38:47 JST 2019 =A0 =A0 > > > > admin@vm.truefc.org:/ds/obj/current/13.0/r353025/ds/src/current/13.= 0/r353025/amd64.amd64/sys/GENERIC > > > amd64 > > > > root@vm:~ # ifconfig > > > > igb0: flags=3D8943 = metric 0 mtu 1500 > > > > =A0 =A0 =A0 =A0 > > > > > > > options=3D4e523bb > > > > =A0 =A0 =A0 =A0 ether 0c:c4:7a:b3:cf:d4 > > > > =A0 =A0 =A0 =A0 inet xxx.xxx.xx.xx netmask 0xfffffff8 broadcast xxx= .xxx.xx.xx > > > > =A0 =A0 =A0 =A0 media: Ethernet autoselect (1000baseT ) > > > > =A0 =A0 =A0 =A0 status: active > > > > =A0 =A0 =A0 =A0 nd6 options=3D29 > > > > igb1: flags=3D8943 = metric 0 mtu 1500 > > > > =A0 =A0 =A0 =A0 > > > > > > > options=3D4a520b9 > > > > =A0 =A0 =A0 =A0 ether 0c:c4:7a:b3:cf:d5 > > > > =A0 =A0 =A0 =A0 inet 192.168.1.17 netmask 0xffffff00 broadcast 192.= 168.1.255 > > > > =A0 =A0 =A0 =A0 media: Ethernet autoselect (1000baseT ) > > > > =A0 =A0 =A0 =A0 status: active > > > > =A0 =A0 =A0 =A0 nd6 options=3D29 > > > > lo0: flags=3D8049 metric 0 mtu 16384 > > > > =A0 =A0 =A0 =A0 > > > > options=3D680003 > > > > =A0 =A0 =A0 =A0 inet6 ::1 prefixlen 128 > > > > =A0 =A0 =A0 =A0 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 > > > > =A0 =A0 =A0 =A0 inet 127.0.0.1 netmask 0xff000000 > > > > =A0 =A0 =A0 =A0 groups: lo > > > > =A0 =A0 =A0 =A0 nd6 options=3D21 > > > > vm-public: flags=3D8843 met= ric 0 mtu 1500 > > > > =A0 =A0 =A0 =A0 ether c6:ed:62:0a:b0:4e > > > > =A0 =A0 =A0 =A0 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwd= delay 15 > > > > =A0 =A0 =A0 =A0 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout= 1200 > > > > =A0 =A0 =A0 =A0 root id 00:00:00:00:00:00 priority 32768 ifcost 0 p= ort 0 > > > > =A0 =A0 =A0 =A0 member: igb0 flags=3D143 > > > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 ifmaxaddr 0 port 1 priority 128 pat= h cost 20000 > > > > =A0 =A0 =A0 =A0 groups: bridge vm-switch viid-4c918@ > > > > =A0 =A0 =A0 =A0 nd6 options=3D1 > > > > vm-local: flags=3D8843 metr= ic 0 mtu 1500 > > > > =A0 =A0 =A0 =A0 ether 8a:d0:25:7d:f7:51 > > > > =A0 =A0 =A0 =A0 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwd= delay 15 > > > > =A0 =A0 =A0 =A0 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout= 1200 > > > > =A0 =A0 =A0 =A0 root id 00:00:00:00:00:00 priority 32768 ifcost 0 p= ort 0 > > > > =A0 =A0 =A0 =A0 member: tap0 flags=3D143 > > > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 ifmaxaddr 0 port 6 priority 128 pat= h cost 2000000 > > > > =A0 =A0 =A0 =A0 member: igb1 flags=3D143 > > > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 ifmaxaddr 0 port 2 priority 128 pat= h cost 20000 > > > > =A0 =A0 =A0 =A0 groups: bridge vm-switch viid-f5dda@ > > > > =A0 =A0 =A0 =A0 nd6 options=3D1 > > > > tap0: flags=3D8943 = metric 0 mtu 1500 > > > > =A0 =A0 =A0 =A0 description: vmnet-tbedfc-0-local > > > > =A0 =A0 =A0 =A0 options=3D80000 > > > > =A0 =A0 =A0 =A0 ether 58:9c:fc:10:ff:df > > > > =A0 =A0 =A0 =A0 groups: tap vm-port > > > > =A0 =A0 =A0 =A0 media: Ethernet autoselect > > > > =A0 =A0 =A0 =A0 status: active > > > > =A0 =A0 =A0 =A0 nd6 options=3D29 > > > > =A0 =A0 =A0 =A0 Opened by PID 85496 > > > > root@vm:~ # > > > > Whats' wrong ? =A0BTW 12.1-PRERELEASE(r352368) and > > > > 12.0-RELEASE-p10(r352368) are nothing happened. > > > > [1] > > > > https://github.com/TrueFC/ports/tree/master/sysutils/vm-bhyve-devel > > > > --- > > > > KIRIYAMA Kazuhiko > > > > _______________________________________________ > > > > freebsd-virtualization@freebsd.org=A0mailing list > > > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > > > To unsubscribe, send any mail to > > > > "freebsd-virtualization-unsubscribe@freebsd.org" > > >=20 > > >=20 > > --- > > KIRIYAMA Kazuhiko > >=20 > --- > KIRIYAMA Kazuhiko >=20 From owner-freebsd-virtualization@freebsd.org Thu Oct 17 14:39:34 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 77D32153AC7 for ; Thu, 17 Oct 2019 14:39:34 +0000 (UTC) (envelope-from digunit24@gmail.com) Received: from mail-ed1-x529.google.com (mail-ed1-x529.google.com [IPv6:2a00:1450:4864:20::529]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46vBdK5Qjrz4HPH for ; Thu, 17 Oct 2019 14:39:33 +0000 (UTC) (envelope-from digunit24@gmail.com) Received: by mail-ed1-x529.google.com with SMTP id h33so1907835edh.12 for ; Thu, 17 Oct 2019 07:39:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=yPzDlgkMz43cc5prt2tsRl3CrWhcrOEWpU3NerR+ujA=; b=EdOJahTaMhjgfTl4yhCYtEDW+KMOM+4Jdbn9VxOi0nW9dbFpldc+IBbs1hVeSdyXuC P5RE6X6Sj6l1ndTMBvwPZiFTK2ZAPO3XAJNe76WmEyuTlW1pZrcTt8vzdclfkEsUNy/P hy1Ph2L/udTGb4CWY/HmMxQndmK0MQXYanTUeFkYAz6GaG8luJbplc1JnoO3vahymRXZ sTQ8k9+xO6Vifb9Wuv4SkFk1bWMdXOuh8N7yGPa7ye555Jxf1GvJVKbN1mUtXh0agDLm Zrx8YlXo1ikP8F9evLcWQHR8PoVjmnHJRJKTsUiU+cljItRSjOLGzh20LCPRRFsqBHp1 xdwg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=yPzDlgkMz43cc5prt2tsRl3CrWhcrOEWpU3NerR+ujA=; b=cb/cAdXnE3X1JWZbJ4NDmxdl48KGaQqcS70hIhCLGdaihFyKsSPkEeCAt/+5kbhGjG 0YMRqnbdYot3ZBqaIewxnqxHYizdFXbVq6ZvcXnZHExr8yp8VjaO0UtssP6fqTYVsG5b 5AJBAgexarAAx0n9s8jM7mWDCCYdWEGykT2kk2DQ3Z1j4e594pBD53iOUVRnYQk1P0GR YJK5+AoM5Jl/F6kxgtGqd/VEx8rP2HytC52HgjOyyt8L6+zOjcw8uBCbxw8jeTnzcG0S bUtrd5aeHOGsB2NNMbdINn7d2cmQJ/covDf2AxHQ4v3pqF2sHU3zxgK9JNQhupf70I23 8QiA== X-Gm-Message-State: APjAAAVV+f3G+JXw6HzJN6Idx/xuvXfLVpTEYULMn9AM7N0Kh/I/JvF1 5BNLxMGQ4Z3Wre3L4AB0KZgNXuKpYTmmN9XNWPq3QlDw+BA= X-Google-Smtp-Source: APXvYqzTruoJWruXuBxx//q5/2/SnHR/dXqflO/mLkgDjAaqFWPSXOOWrlA0grViBgsAXhirDnwUtC/3BBhponbWIBk= X-Received: by 2002:a50:9fe7:: with SMTP id c94mr4108935edf.249.1571323170589; Thu, 17 Oct 2019 07:39:30 -0700 (PDT) MIME-Version: 1.0 From: Artur Moor Date: Thu, 17 Oct 2019 16:39:19 +0200 Message-ID: Subject: Alpine Linux (alpine-virt-3.10.2) as guest in bhyve (FreeBSD 12.0-RELEASE-p10) To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 46vBdK5Qjrz4HPH X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=EdOJahTa; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of digunit24@gmail.com designates 2a00:1450:4864:20::529 as permitted sender) smtp.mailfrom=digunit24@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.00)[ip: (-9.59), ipnet: 2a00:1450::/32(-2.85), asn: 15169(-2.10), country: US(-0.05)]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; SH_EMAIL_ZRD(0.00)[192.0.0.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; SH_EMAIL_DBL_DONT_QUERY_IPS(0.00)[192.0.0.0]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; IP_SCORE_FREEMAIL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; RCVD_IN_DNSWL_NONE(0.00)[9.2.5.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Oct 2019 14:39:34 -0000 I have trouble with Alpine Linux as a guest in bhyve. When I try to start the installation 'vm install alpine alpine-virt-3.10.2-x86_64.iso' I get the following message in the console of the vm: [ 0.000000] Linux version 4.19.67-0-virt (buildozer@build-3-10-x86_64) (gcc version 8.3.0 (Alpine 8.3.0)) #1-Alpine SMP Mon Aug 19 10:05:34 UTC 2019 [ 0.000000] Command line: console=ttyS0 BOOT_IMAGE=/boot/vmlinuz-virt initrd=/boot/initramfs-virt alpine_dev=cdrom:iso9660 modules=loop,squashfs,sd-mod,usb-storage,sr-mod [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fffe] usable [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000001fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.6 present. [ 0.000000] DMI: BHYVE, BIOS 1.00 03/14/2014 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3099.325 MHz processor [ 0.000135] last_pfn = 0x20000 max_arch_pfn = 0x400000000 [ 0.000144] Disabled [ 0.000145] x86/PAT: MTRRs disabled, skipping PAT initialization too. [ 0.000147] CPU MTRRs all blank - virtualized system. [ 0.000148] x86/PAT: Configuration [0-7]: WB WT UC- UC WB WT UC- UC [ 0.000173] Using GB pages for direct mapping [ 0.000209] RAMDISK: [mem 0x02aeb000-0x02fbafff] [ 0.000219] ACPI: Early table checksum verification disabled [ 0.000239] ACPI: RSDP 0x00000000000F2400 000024 (v02 BHYVE ) [ 0.000241] ACPI: XSDT 0x00000000000F2480 000044 (v01 BHYVE BVXSDT 00000001 INTL 20181003) [ 0.000245] ACPI: APIC 0x00000000000F2500 00005A (v01 BHYVE BVMADT 00000001 INTL 20181003) [ 0.000248] ACPI: FACP 0x00000000000F2600 00010C (v05 BHYVE BVFACP 00000001 INTL 20181003) [ 0.000251] ACPI: DSDT 0x00000000000F2800 00094B (v02 BHYVE BVDSDT 00000001 INTL 20181003) [ 0.000253] ACPI: FACS 0x00000000000F27C0 000040 [ 0.000255] ACPI: FACS 0x00000000000F27C0 000040 [ 0.000257] ACPI: HPET 0x00000000000F2740 000038 (v01 BHYVE BVHPET 00000001 INTL 20181003) [ 0.000259] ACPI: MCFG 0x00000000000F2780 00003C (v01 BHYVE BVMCFG 00000001 INTL 20181003) [ 0.000264] Setting APIC routing to physical flat. [ 0.000309] Zone ranges: [ 0.000309] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000311] DMA32 [mem 0x0000000001000000-0x000000001fffffff] [ 0.000312] Normal empty [ 0.000312] Movable zone start for each node [ 0.000313] Early memory node ranges [ 0.000314] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000315] node 0: [mem 0x0000000000100000-0x000000001fffffff] [ 0.000328] Reserved but unavailable: 98 pages [ 0.000329] Initmem setup node 0 [mem 0x0000000000001000-0x000000001fffffff] [ 0.007443] ACPI: PM-Timer IO Port: 0x408 [ 0.007449] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1]) [ 0.007475] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-31 [ 0.007476] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge) [ 0.007478] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level) [ 0.007482] Using ACPI (MADT) for SMP configuration information [ 0.007483] ACPI: HPET id: 0x80860701 base: 0xfed00000 [ 0.007492] smpboot: Allowing 1 CPUs, 0 hotplug CPUs [ 0.007505] [mem 0x20000000-0xffffffff] available for PCI devices [ 0.007506] Booting paravirtualized kernel on bare hardware [ 0.007508] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns [ 0.039227] random: get_random_bytes called from start_kernel+0x8e/0x4b0 with crng_init=0 [ 0.039232] setup_percpu: NR_CPUS:32 nr_cpumask_bits:32 nr_cpu_ids:1 nr_node_ids:1 [ 0.040672] percpu: Embedded 44 pages/cpu s142104 r8192 d29928 u2097152 [ 0.040691] Built 1 zonelists, mobility grouping on. Total pages: 128905 [ 0.040693] Kernel command line: console=ttyS0 BOOT_IMAGE=/boot/vmlinuz-virt initrd=/boot/initramfs-virt alpine_dev=cdrom:iso9660 modules=loop,squashfs,sd-mod,usb-storage,sr-mod [ 0.041084] Dentry cache hash table entries: 65536 (order: 7, 524288 bytes) [ 0.041261] Inode-cache hash table entries: 32768 (order: 6, 262144 bytes) [ 0.042187] Memory: 491192K/523896K available (8204K kernel code, 731K rwdata, 2068K rodata, 1140K init, 608K bss, 32704K reserved, 0K cma-reserved) [ 0.042312] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 [ 0.042489] rcu: Hierarchical RCU implementation. [ 0.042490] rcu: RCU restricting CPUs from NR_CPUS=32 to nr_cpu_ids=1. [ 0.042492] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 [ 0.042597] NR_IRQS: 4352, nr_irqs: 256, preallocated irqs: 16 [ 0.042919] Console: colour EGA 80x25 [ 0.099439] console [ttyS0] enabled [ 0.099897] ACPI: Core revision 20180810 [ 0.100580] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 113919999973 ns [ 0.101779] APIC: Switch to symmetric I/O mode setup [ 0.103710] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.152418] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x2cacc9e0a25, max_idle_ns: 440795241691 ns [ 0.153779] Calibrating delay loop (skipped), value calculated using timer frequency.. 6198.65 BogoMIPS (lpj=30993250) [ 0.155179] pid_max: default: 32768 minimum: 301 [ 0.155830] Mount-cache hash table entries: 1024 (order: 1, 8192 bytes) [ 0.156676] Mountpoint-cache hash table entries: 1024 (order: 1, 8192 bytes) [ 0.157888] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 512 [ 0.158688] Last level dTLB entries: 4KB 1536, 2MB 1536, 4MB 768, 1GB 0 [ 0.159541] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.160636] Spectre V2 : Spectre mitigation: LFENCE not serializing, switching to generic retpoline [ 0.161800] Spectre V2 : Mitigation: Full generic retpoline [ 0.162503] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.163777] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 0.164852] Speculative Store Bypass: Vulnerable [ 0.168104] Freeing SMP alternatives memory: 24K [ 0.173772] smpboot: CPU0: AMD EPYC 7371 16-Core Processor (family: 0x17, model: 0x1, stepping: 0x2) [ 0.173772] Performance Events: PMU not available due to virtualization, using software events only. [ 0.173772] rcu: Hierarchical SRCU implementation. [ 0.173772] random: crng done (trusting CPU's manufacturer) [ 0.173772] NMI watchdog: Perf NMI watchdog permanently disabled [ 0.173772] smp: Bringing up secondary CPUs ... [ 0.173772] smp: Brought up 1 node, 1 CPU [ 0.173772] smpboot: Max logical packages: 1 [ 0.173772] ---------------- [ 0.173772] | NMI testsuite: [ 0.173772] -------------------- [ 0.173772] remote IPI: ok | [ 0.173772] local IPI: ok | [ 0.173772] -------------------- [ 0.173772] Good, all 2 testcases passed! | [ 0.173772] --------------------------------- [ 0.173779] smpboot: Total of 1 processors activated (6198.65 BogoMIPS) [ 0.174744] devtmpfs: initialized [ 0.175250] x86/mm: Memory block size: 128MB [ 0.176042] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns [ 0.177302] futex hash table entries: 256 (order: 2, 16384 bytes) [ 0.178241] NET: Registered protocol family 16 [ 0.178896] audit: initializing netlink subsys (disabled) [ 0.179724] cpuidle: using governor ladder [ 0.180267] cpuidle: using governor menu [ 0.181276] audit: type=2000 audit(1571322221.070:1): state=initialized audit_enabled=0 res=1 [ 0.182637] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.183626] ACPI: bus type PCI registered [ 0.183772] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.183907] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xe0000000-0xefffffff] (base 0xe0000000) [ 0.185106] PCI: not using MMCONFIG [ 0.185564] PCI: Using configuration type 1 for base access [ 0.186284] PCI: Using configuration type 1 for extended access [ 0.192668] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.193776] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.194758] ACPI: Added _OSI(Module Device) [ 0.195321] ACPI: Added _OSI(Processor Device) [ 0.195895] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.196506] ACPI: Added _OSI(Processor Aggregator Device) [ 0.197232] ACPI: Added _OSI(Linux-Dell-Video) [ 0.197813] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 0.198743] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.199794] ACPI: Interpreter enabled [ 0.200297] ACPI: (supports S0 S5) [ 0.200747] ACPI: Using IOAPIC for interrupt routing [ 0.201408] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xe0000000-0xefffffff] (base 0xe0000000) [ 0.202648] PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved in ACPI motherboard resources [ 0.203781] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.205787] ACPI: PCI Root Bridge [PC00] (domain 0000 [bus 00]) [ 0.206551] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 0.207620] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM [ 0.208525] PCI host bridge to bus 0000:00 [ 0.209051] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.209937] pci_bus 0000:00: root bus resource [io 0x0d00-0x1fff window] [ 0.210823] pci_bus 0000:00: root bus resource [io 0x2000-0x207f window] [ 0.211686] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xc01fffff window] [ 0.212662] pci_bus 0000:00: root bus resource [mem 0xd000000000-0xd0000fffff window] [ 0.213774] pci_bus 0000:00: root bus resource [bus 00] [ 0.217648] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 *5 6 7 9 10 11 12 14 15) [ 0.218651] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 *6 7 9 10 11 12 14 15) [ 0.219671] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 *7 9 10 11 12 14 15) [ 0.220672] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled. [ 0.221806] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled. [ 0.222926] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled. [ 0.223823] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled. [ 0.224985] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled. [ 0.226176] SCSI subsystem initialized [ 0.227134] pps_core: LinuxPPS API ver. 1 registered [ 0.227811] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.229053] PTP clock support registered [ 0.229737] PCI: Using ACPI for IRQ routing [ 0.282465] clocksource: Switched to clocksource tsc-early [ 0.283772] VFS: Disk quotas dquot_6.6.0 [ 0.283772] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.283772] pnp: PnP ACPI init [ 0.283772] system 00:02: [io 0x0220-0x0223] has been reserved [ 0.283772] system 00:02: [io 0x0224-0x0227] has been reserved [ 0.283772] system 00:02: [io 0x04d0-0x04d1] has been reserved [ 0.284356] system 00:02: [io 0x0400-0x0407] has been reserved [ 0.285134] system 00:02: [mem 0xe0000000-0xefffffff] has been reserved [ 0.286071] pnp: PnP ACPI: found 6 devices [ 0.292735] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.293934] pci 0000:00:03.0: BAR 6: assigned [mem 0xc0000800-0xc0000fff pref] [ 0.294869] pci 0000:00:04.0: BAR 6: assigned [mem 0xc0001000-0xc00017ff pref] [ 0.295823] pci 0000:00:05.0: BAR 6: assigned [mem 0xc0001800-0xc0001fff pref] [ 0.296790] pci 0000:00:1f.0: BAR 6: assigned [mem 0xc0006000-0xc00067ff pref] [ 0.297807] NET: Registered protocol family 2 [ 0.298456] tcp_listen_portaddr_hash hash table entries: 256 (order: 0, 4096 bytes) [ 0.299466] TCP established hash table entries: 4096 (order: 3, 32768 bytes) [ 0.300405] TCP bind hash table entries: 4096 (order: 4, 65536 bytes) [ 0.301290] TCP: Hash tables configured (established 4096 bind 4096) [ 0.302158] UDP hash table entries: 256 (order: 1, 8192 bytes) [ 0.302919] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes) [ 0.303767] NET: Registered protocol family 1 [ 0.304392] pci 0000:00:1f.0: Activating ISA DMA hang workarounds [ 0.305764] Unpacking initramfs... [ 0.366638] Freeing initrd memory: 4928K [ 0.367535] Initialise system trusted keyrings [ 0.368340] workingset: timestamp_bits=46 max_order=17 bucket_order=0 [ 0.371627] Key type asymmetric registered [ 0.372215] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) [ 0.373247] io scheduler noop registered [ 0.373787] io scheduler deadline registered (default) [ 0.374466] io scheduler mq-deadline registered (default) [ 0.375099] io scheduler kyber registered [ 0.375764] ERST DBG: ERST support is disabled. [ 0.376430] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 0.398514] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 0.420753] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 0.421950] VMware PVSCSI driver - version 1.0.7.0-k [ 0.422869] ahci 0000:00:03.0: SSS flag set, parallel bus scan disabled [ 0.423866] ahci 0000:00:03.0: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x1 impl SATA mode [ 0.424892] ahci 0000:00:03.0: flags: 64bit ncq sntf ilck stag pm led clo pio slum part sxs apst [ 0.426695] scsi host0: ahci [ 0.427181] scsi host1: ahci [ 0.427638] scsi host2: ahci [ 0.428102] scsi host3: ahci [ 0.428562] scsi host4: ahci [ 0.429027] scsi host5: ahci [ 0.429455] ata1: SATA max UDMA/133 abar m1024@0xc0000000 port 0xc0000100 irq 32 [ 0.430437] ata2: DUMMY [ 0.430752] ata3: DUMMY [ 0.431095] ata4: DUMMY [ 0.431426] ata5: DUMMY [ 0.431745] ata6: DUMMY [ 0.432116] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 0.433333] i8042: Warning: Keylock active [ 0.434382] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 0.435029] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 0.435771] ACPI Error: Could not enable RealTimeClock event (20180810/evxfevnt-184) [ 0.436815] ACPI Warning: Could not enable fixed event - RealTimeClock (4) (20180810/evxface-620) [ 0.438442] input: AT Raw Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 [ 0.439904] rtc_cmos 00:05: registered as rtc0 [ 0.440508] rtc_cmos 00:05: alarms up to one day, y3k, 114 bytes nvram [ 0.441413] gre: GRE over IPv4 demultiplexor driver [ 0.442040] Key type dns_resolver registered [ 0.442624] sched_clock: Marking stable (374742215, 60992938)->(563738129, -128002976) [ 0.443796] registered taskstats version 1 [ 0.444344] Loading compiled-in X.509 certificates [ 0.445222] rtc_cmos 00:05: setting system clock to 2019-10-17 14:23:41 UTC (1571322221) [ 0.775259] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 0.776094] ata1.00: ATAPI: BHYVE SATA DVD ROM, 001, max UDMA/133 [ 0.776965] ata1.00: configured for UDMA/133 [ 0.777642] scsi 0:0:0:0: CD-ROM BHYVE BHYVE DVD-ROM 001 PQ: 0 ANSI: 5 [ 0.779270] Freeing unused kernel image memory: 1140K [ 0.805193] Write protecting the kernel read-only data: 14336k [ 0.806217] Freeing unused kernel image memory: 2016K [ 0.807114] Freeing unused kernel image memory: 2028K [ 0.807779] rodata_test: all tests were successful [ 0.808405] Run /init as init process [ 0.809435] general protection fault: 0000 [#1] SMP NOPTI [ 0.810155] CPU: 0 PID: 1 Comm: init Not tainted 4.19.67-0-virt #1-Alpine [ 0.811032] Hardware name: BHYVE, BIOS 1.00 03/14/2014 [ 0.811738] RIP: 0010:switch_mm_irqs_off+0xa4/0x422 [ 0.812352] Code: 48 c1 e8 09 83 e0 01 48 09 c6 65 48 8b 05 33 24 fd 4d 48 39 c6 74 15 48 09 f0 a8 01 74 0e b9 49 00 00 00 b8 01 00 00 00 31 d2 <0f> 30 65 48 89 35 11 24 fd 4d 0f 1f 44 00 00 eb 2e 65 48 8b 05 02 [ 0.814784] RSP: 0018:ffffb0518000bcf8 EFLAGS: 00010046 [ 0.815475] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 0000000000000049 [ 0.816413] RDX: 0000000000000000 RSI: ffff9ced1e452c00 RDI: ffff9ced1e690000 [ 0.817342] RBP: ffff9ced1e452c00 R08: ffff9ced1f2221f8 R09: 0000000000000000 [ 0.818279] R10: 000000000000025e R11: ffff9ced1e690080 R12: ffff9ced1e453800 [ 0.819216] R13: ffff9ced1e690000 R14: ffff9ced1e453800 R15: ffff9ced1e452c00 [ 0.820157] FS: 00007f23ec2cdd48(0000) GS:ffff9ced1f200000(0000) knlGS:0000000000000000 [ 0.821185] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 0.821959] CR2: 00005639f0bdf8b8 CR3: 000000001eede000 CR4: 00000000000406b0 [ 0.822864] Call Trace: [ 0.823204] __schedule+0x69b/0x756 [ 0.823668] schedule+0x5b/0x6c [ 0.824090] do_wait+0x1bc/0x21e [ 0.824516] kernel_wait4+0xc0/0x115 [ 0.825009] ? __ia32_compat_sys_waitid+0x18/0x18 [ 0.825623] __se_sys_wait4+0x37/0x86 [ 0.826127] ? handle_mm_fault+0x149/0x19f [ 0.826691] ? __do_page_fault+0x36a/0x3fc [ 0.827251] do_syscall_64+0x50/0xeb [ 0.827720] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [ 0.828382] RIP: 0033:0x7f23ec290080 [ 0.828859] Code: c3 8b 07 85 c0 75 24 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 e9 a7 d3 ff ff 41 54 b8 02 00 00 00 49 89 f4 be 00 08 08 00 55 [ 0.831332] RSP: 002b:00007ffe1e68a808 EFLAGS: 00000246 ORIG_RAX: 000000000000003d [ 0.832335] RAX: ffffffffffffffda RBX: 00007f23ec2cdd48 RCX: 00007f23ec290080 [ 0.833276] RDX: 0000000000000000 RSI: 00007ffe1e68a86c RDI: ffffffffffffffff [ 0.834240] RBP: 000000000000003d R08: 0000000000000000 R09: 0000000000000000 [ 0.835161] R10: 0000000000000000 R11: 0000000000000246 R12: 00005639f10cfce0 [ 0.836069] R13: 00007ffe1e68a86c R14: 00005639f0bc3836 R15: 0000000000000000 [ 0.837030] Modules linked in: [ 0.837437] ---[ end trace f7b78a6a0742f2da ]--- [ 0.838032] RIP: 0010:switch_mm_irqs_off+0xa4/0x422 [ 0.838669] Code: 48 c1 e8 09 83 e0 01 48 09 c6 65 48 8b 05 33 24 fd 4d 48 39 c6 74 15 48 09 f0 a8 01 74 0e b9 49 00 00 00 b8 01 00 00 00 31 d2 <0f> 30 65 48 89 35 11 24 fd 4d 0f 1f 44 00 00 eb 2e 65 48 8b 05 02 [ 0.841119] RSP: 0018:ffffb0518000bcf8 EFLAGS: 00010046 [ 0.841813] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 0000000000000049 [ 0.842771] RDX: 0000000000000000 RSI: ffff9ced1e452c00 RDI: ffff9ced1e690000 [ 0.843681] RBP: ffff9ced1e452c00 R08: ffff9ced1f2221f8 R09: 0000000000000000 [ 0.844622] R10: 000000000000025e R11: ffff9ced1e690080 R12: ffff9ced1e453800 [ 0.845560] R13: ffff9ced1e690000 R14: ffff9ced1e453800 R15: ffff9ced1e452c00 [ 0.846529] FS: 00007f23ec2cdd48(0000) GS:ffff9ced1f200000(0000) knlGS:0000000000000000 [ 0.847627] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 0.848383] CR2: 00005639f0bdf8b8 CR3: 000000001eede000 CR4: 00000000000406b0 Does anyone have an idea how I can fix the problem? root@host:~ # cat /srv/vmm/alpine/vm-bhyve.log Oct 17 16:23:37: initialising Oct 17 16:23:37: [loader: grub] Oct 17 16:23:37: [cpu: 1] Oct 17 16:23:37: [memory: 512M] Oct 17 16:23:37: [hostbridge: standard] Oct 17 16:23:37: [com ports: com1] Oct 17 16:23:37: [uuid: cf6a78d4-f0d1-11e9-ab90-002590b971a4] Oct 17 16:23:37: [utctime: yes] Oct 17 16:23:37: [debug mode: no] Oct 17 16:23:37: [primary disk: disk0.img] Oct 17 16:23:37: [primary disk dev: file] Oct 17 16:23:37: initialising network device tap0 Oct 17 16:23:37: adding tap0 -> vm-public (public addm) Oct 17 16:23:37: bring up tap0 -> vm-public (public addm) Oct 17 16:23:37: booting Oct 17 16:23:37: create file /srv/vmm/alpine/device.map Oct 17 16:23:37: -> (cd0) /srv/vmm/.iso/alpine-virt-3.10.2-x86_64.iso Oct 17 16:23:37: -> (hd0) /srv/vmm/alpine/disk0.img Oct 17 16:23:37: create file /srv/vmm/alpine/grub.cfg Oct 17 16:23:37: -> timeout=3 Oct 17 16:23:37: -> menuentry 'alpine (bhyve install)' { Oct 17 16:23:37: -> root=cd0 Oct 17 16:23:37: -> linux /boot/vmlinuz-virt initrd=/boot/initramfs-virt alpine_dev=cdrom:iso9660 modules=loop,squashfs,sd-mod,usb-storage,sr-mod Oct 17 16:23:37: -> initrd /boot/initramfs-virt Oct 17 16:23:37: -> } Oct 17 16:23:37: /usr/local/sbin/grub-bhyve -c /dev/nmdm-alpine.1A -m /srv/vmm/alpine/device.map -M 512M -r host -d /srv/vmm/alpine alpine Oct 17 16:23:41: [bhyve options: -c 1 -m 512M -AHP -U cf6a78d4-f0d1-11e9-ab90-002590b971a4 -u] Oct 17 16:23:41: [bhyve devices: -s 0,hostbridge -s 31,lpc -s 4:0,virtio-blk,/srv/vmm/alpine/disk0.img -s 5:0,virtio-net,tap0,mac=58:9c:fc:03:fe:9b] Oct 17 16:23:41: [bhyve console: -l com1,/dev/nmdm-alpine.1A] Oct 17 16:23:41: [bhyve iso device: -s 3:0,ahci-cd,/srv/vmm/.iso/alpine-virt-3.10.2-x86_64.iso,ro] Oct 17 16:23:41: starting bhyve (run 1) root@host:~ # uname -a FreeBSD host.example.com 12.0-RELEASE-p10 FreeBSD 12.0-RELEASE-p10 GENERIC amd64 root@host:~ # pkg info bhyve-firmware-1.0_1 Collection of Firmware for bhyve ca_root_nss-3.46.1 Root certificate bundle from the Mozilla Project curl-7.66.0 Command line tool and library for transferring data with URLs dmidecode-3.2 Tool for dumping DMI (SMBIOS) contents in human-readable format e2fsprogs-libuuid-1.45.3 UUID library from e2fsprogs package gettext-runtime-0.20.1 GNU gettext runtime libraries and programs grub2-bhyve-0.40_7 Grub-emu loader for bhyve indexinfo-0.3.1 Utility to regenerate the GNU info page index libestr-0.1.11_1 Library for some string essentials libfastjson-0.99.8 libfastjson is a fork from json-c libffi-3.2.1_3 Foreign Function Interface libgcrypt-1.8.5 General purpose cryptographic library based on the code from GnuPG libgpg-error-1.36 Common error values for all GnuPG components liblogging-1.0.6 Easy to use system logging library libnghttp2-1.39.2 HTTP/2.0 C Library pkg-1.12.0 Package manager python-3.6_3,2 "meta-port" for the default version of Python interpreter python3-3_3 The "meta-port" for version 3 of the Python interpreter python36-3.6.9 Interpreted object-oriented programming language readline-8.0.0 Library for editing command lines as they are typed rsyslog-8.1908.0 Syslogd supporting SQL, TCP, and TLS sudo-1.8.27_1 Allow others to run commands as root uefi-edk2-bhyve-0.2_1,1 UEFI-EDK2 firmware for bhyve uefi-edk2-bhyve-csm-0.2_1,1 UEFI-EDK2 firmware for bhyve with CSM vm-bhyve-1.3.0 Management system for bhyve virtual machines root@host:~ # cat /etc/rc.conf | grep vm vm_enable="YES" vm_dir="zfs:zroot/srv/vmm" root@host:~ # kldstat Id Refs Address Size Name 1 39 0xffffffff80200000 243d228 kernel 2 1 0xffffffff8263e000 3a9a10 zfs.ko 3 2 0xffffffff829e8000 a4f0 opensolaris.ko 4 1 0xffffffff829f3000 32b88 if_bnxt.ko 5 1 0xffffffff82f12000 2678 intpm.ko 6 1 0xffffffff82f15000 b10 smbus.ko 7 1 0xffffffff82f16000 1800 uhid.ko 8 1 0xffffffff82f18000 23a8 ums.ko 9 1 0xffffffff82f1b000 537460 vmm.ko 10 1 0xffffffff83453000 b30 nmdm.ko 11 1 0xffffffff83454000 6fb3 if_bridge.ko 12 1 0xffffffff8345b000 4410 bridgestp.ko 13 1 0xffffffff83460000 2e77 if_tap.ko root@host:~ # cat /srv/vmm/alpine/alpine.conf loader="grub" cpu=1 memory=512M network0_type="virtio-net" network0_switch="public" disk0_type="virtio-blk" disk0_name="disk0.img" grub_install0="linux /boot/vmlinuz-virt initrd=/boot/initramfs-virt alpine_dev=cdrom:iso9660 modules=loop,squashfs,sd-mod,usb-storage,sr-mod" grub_install1="initrd /boot/initramfs-virt" grub_run0="linux /boot/vmlinuz-virt root=/dev/vda3 modules=ext4" grub_run1="initrd /boot/initramfs-virt" uuid="cf6a78d4-f0d1-11e9-ab90-002590b971a4" network0_mac="58:9c:fc:03:fe:9b" root@host:~ # cat /srv/vmm/alpine/device.map (cd0) /srv/vmm/.iso/alpine-virt-3.10.2-x86_64.iso (hd0) /srv/vmm/alpine/disk0.img root@host:~ # cat /srv/vmm/alpine/grub.cfg timeout=3 menuentry 'alpine (bhyve install)' { root=cd0 linux /boot/vmlinuz-virt initrd=/boot/initramfs-virt alpine_dev=cdrom:iso9660 modules=loop,squashfs,sd-mod,usb-storage,sr-mod initrd /boot/initramfs-virt } From owner-freebsd-virtualization@freebsd.org Thu Oct 17 17:54:29 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 28A50159559 for ; Thu, 17 Oct 2019 17:54:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 46vGyF0Hvmz4VFp for ; Thu, 17 Oct 2019 17:54:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 0A0DC159558; Thu, 17 Oct 2019 17:54:29 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 09CF4159557 for ; Thu, 17 Oct 2019 17:54:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46vGyD6RwMz4VFm for ; Thu, 17 Oct 2019 17:54:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C26912428A for ; Thu, 17 Oct 2019 17:54:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x9HHsSJM088956 for ; Thu, 17 Oct 2019 17:54:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x9HHsS8r088955 for virtualization@FreeBSD.org; Thu, 17 Oct 2019 17:54:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 241036] efifb console lost during install in VM in UEFI mode - switches to serial Date: Thu, 17 Oct 2019 17:54:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: emaste@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Oct 2019 17:54:29 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241036 --- Comment #5 from Ed Maste --- Which hypervisor are you using? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu Oct 17 18:09:34 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 31C51159A6D for ; Thu, 17 Oct 2019 18:09:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 46vHHf0cZ4z4W56 for ; Thu, 17 Oct 2019 18:09:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 1348E159A6C; Thu, 17 Oct 2019 18:09:34 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 130B7159A6B for ; Thu, 17 Oct 2019 18:09:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46vHHd6p4Zz4W55 for ; Thu, 17 Oct 2019 18:09:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id C8AE524499 for ; Thu, 17 Oct 2019 18:09:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x9HI9XuE018676 for ; Thu, 17 Oct 2019 18:09:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x9HI9X22018661 for virtualization@FreeBSD.org; Thu, 17 Oct 2019 18:09:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 241036] efifb console lost during install in VM in UEFI mode - switches to serial Date: Thu, 17 Oct 2019 18:09:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: mason@blisses.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Oct 2019 18:09:34 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241036 --- Comment #6 from Mason Loring Bliss --- I'm using qemu-kvm 1:2.11+dfsg-1ubuntu7.19 for this, with ovmf 0~20180205.c0d9813c-2ubuntu0.1. I can see about trying other hypervisors if this'd be useful in tracking do= wn the change, and I'm happy to help test. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu Oct 17 18:14:29 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1D30C159F1C for ; Thu, 17 Oct 2019 18:14:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 46vHPK00Pjz4Wlq for ; Thu, 17 Oct 2019 18:14:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id F1E06159F1B; Thu, 17 Oct 2019 18:14:28 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F19F8159F1A for ; Thu, 17 Oct 2019 18:14:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46vHPJ6BPvz4Wlm for ; Thu, 17 Oct 2019 18:14:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id B7FD824697 for ; Thu, 17 Oct 2019 18:14:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x9HIEShr035269 for ; Thu, 17 Oct 2019 18:14:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x9HIESiR035267 for virtualization@FreeBSD.org; Thu, 17 Oct 2019 18:14:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 241036] efifb console lost during install in VM in UEFI mode - switches to serial Date: Thu, 17 Oct 2019 18:14:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: d.scott.phillips@intel.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Oct 2019 18:14:29 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241036 D Scott Phillips changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |d.scott.phillips@intel.com --- Comment #7 from D Scott Phillips --- This sounds like another instance of the bootloader's policy of sending con= sole to serial based on the order of consoles in ConOut discussed here: https://lists.freebsd.org/pipermail/freebsd-current/2019-September/074460.h= tml --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu Oct 17 18:33:27 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 97D4015AA8B for ; Thu, 17 Oct 2019 18:33:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 46vHqC3XqMz4YSP for ; Thu, 17 Oct 2019 18:33:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 798F315AA8A; Thu, 17 Oct 2019 18:33:27 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7958C15AA89 for ; Thu, 17 Oct 2019 18:33:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46vHqC2hcYz4YSN for ; Thu, 17 Oct 2019 18:33:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 3EBC224A32 for ; Thu, 17 Oct 2019 18:33:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x9HIXRsD018508 for ; Thu, 17 Oct 2019 18:33:27 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x9HIXRAg018507 for virtualization@FreeBSD.org; Thu, 17 Oct 2019 18:33:27 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 241036] efifb console lost during install in VM in UEFI mode - switches to serial Date: Thu, 17 Oct 2019 18:33:27 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: mason@blisses.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Oct 2019 18:33:27 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241036 --- Comment #8 from Mason Loring Bliss --- Setting set boot_serial=3DNO in the loader does indeed correct this. I wonder if it might be a safe default to ignore ConOut. I suspect folks wanting serial communications during install will either expect to have to research= it or they'll already know how to get it. As things stand, the behaviour has changed from what it once was. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu Oct 17 18:35:15 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2AA9C15AB6B for ; Thu, 17 Oct 2019 18:35:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 46vHsH0PjCz4YXX for ; Thu, 17 Oct 2019 18:35:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 0BB4B15AB6A; Thu, 17 Oct 2019 18:35:15 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0B7C115AB69 for ; Thu, 17 Oct 2019 18:35:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46vHsG6J9mz4YXV for ; Thu, 17 Oct 2019 18:35:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BCA1024A4B for ; Thu, 17 Oct 2019 18:35:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x9HIZEXY020974 for ; Thu, 17 Oct 2019 18:35:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x9HIZEBk020973 for virtualization@FreeBSD.org; Thu, 17 Oct 2019 18:35:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 241036] efifb console lost during install in VM in UEFI mode - switches to serial Date: Thu, 17 Oct 2019 18:35:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: kevans@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Oct 2019 18:35:15 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241036 Kyle Evans changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |imp@FreeBSD.org --- Comment #9 from Kyle Evans --- CC imp@, who wrote the ConOut parsing bits. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu Oct 17 22:34:12 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4D12A15F328 for ; Thu, 17 Oct 2019 22:34:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 46vP901Nn6z3Kch for ; Thu, 17 Oct 2019 22:34:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 2DA7915F327; Thu, 17 Oct 2019 22:34:12 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2D69715F326 for ; Thu, 17 Oct 2019 22:34:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46vP900NXlz3Kcg for ; Thu, 17 Oct 2019 22:34:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E4BD527671 for ; Thu, 17 Oct 2019 22:34:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x9HMYBJ5097854 for ; Thu, 17 Oct 2019 22:34:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x9HMYBuI097853 for virtualization@FreeBSD.org; Thu, 17 Oct 2019 22:34:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 241036] efifb console lost during install in VM in UEFI mode - switches to serial Date: Thu, 17 Oct 2019 22:34:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: imp@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Oct 2019 22:34:12 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241036 --- Comment #10 from Warner Losh --- No, we can't ignore ConOut. That results in worse problems. We can, however, give video console priority always, rather than based on w= here it is in the order, absent other boot flags. Can you post what your various ConOut variables are? eg # efivar --device-path 8be4df61-93ca-11d2-aa0d-00e098032b8c-ConOut 8be4df61-93ca-11d2-aa0d-00e098032b8c-ConOut : PciRoot(0x0)/Pci(0x1c,0x2)/Pci(0x0,0x0)/Pci(0x0,0x0)/AcpiAdr(0x80010100),/P= ciRoot(0x0)/Pci(0x1f,0x0)/Serial(0x1)/Uart(115200,8,N,1)/UartFlowCtrl(Hardw= are)/VenVt100Plus() # --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Fri Oct 18 00:48:02 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 89E63162B55 for ; Fri, 18 Oct 2019 00:48:02 +0000 (UTC) (envelope-from edenist@edenist.net) Received: from comms.edenist.net (comms.edenist.net [59.167.191.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 46vS7N5MRkz3xQm for ; Fri, 18 Oct 2019 00:48:00 +0000 (UTC) (envelope-from edenist@edenist.net) Received: from comms.edenist.net (unknown [192.168.1.205]) by comms.edenist.net (Postfix) with ESMTP id 103C78943C; Fri, 18 Oct 2019 11:42:19 +1100 (AEDT) X-Virus-Scanned: amavisd-new at edenist.net Received: from comms.edenist.net ([192.168.1.205]) by comms.edenist.net (comms.edenist.net [192.168.1.205]) (amavisd-new, port 10024) with LMTP id uemnM45dR8Iq; Fri, 18 Oct 2019 11:40:08 +1100 (AEDT) Received: from [10.4.239.81] (e-nat-unimelb-128-250-0-49.uniaccess.unimelb.edu.au [128.250.0.49]) by comms.edenist.net (Postfix) with ESMTPSA id 74C6B8942A; Fri, 18 Oct 2019 11:40:08 +1100 (AEDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=edenist.net; s=default; t=1571359208; bh=4bekTMzy6dldBEt6AKqQILjoTnwY1MhqzEv0WKeWNc4=; h=Date:In-Reply-To:References:Subject:To:From; b=Q9HcR1l2odO+bOzs8UYF0RplvMAfOnlrc3G49qYLmd/kx80EFMntXB0k6ms2mc/7o iuG8jeltG5RSoQX42JbtQnTxBmqJamzAy9GPdq/sz33Nxvjga53h6Wz5XTrvCc0KEU PWapqtxmx0KjSS3GcT0GOa0SC8Tz30YOZX53GVUM= Date: Fri, 18 Oct 2019 11:39:53 +1100 User-Agent: K-9 Mail for Android In-Reply-To: References: Autocrypt: addr=edenist@edenist.net; keydata=mQINBF0Jtc4BEADbaPgNICL3um7QT8+ O0RNrH/kkNf9grLW+xfRqmR+YppPKV506AmQ+Lhy2EPcngCJjDU9ghkz6X4Z2nFLJFwq7S0kuX6I ZJcQ8ANrPhG++e2kmaBTFXZ3PP/HyhvLE9Q2fBFPkWN9FXjwlmNF+tYfjqVdZ9dNbf1uYkUNgt4y LNgRr3S/3teUsuL1NArd4p5Eotia4Tat39A/gPIJ7zkg5AMAtXrd9EiB9ISpVRxLQcMTepSW+ziW LQMVByyYN0UF02ffqLppxmK5CL+Y8KOuRyELIprQRtxX4uy70GYXYQ5Jb3Qlmo3rN/GseeRYu5Dz atXpqizA0mFKb9ZtyoRmRTo3GficvBY0thw0mbXj3HiEp6IT4NY3bqY+lCTrSZfLAIpl8JCUn32Z 3g5pKJvEc5AImPoVyMrfdLw4PrmsHiH1s75Eg3SO3E8bHuPhBydQChj4O0waCBHdz0ZAfE2Xxyby m5k7lxALRUun6pojwU79VK0kl2nmc4x+Yz1M0MUqCwZ2dLHrhtVoH00NVvic8I4ZFSkDhlL9aqoW /4HaB59X//JYLCgK35tIm5yq2sruDRIeB7DoJGNwnjoSa8B3M5C6snZT+Hsprb7VAYYrJVLPbsz4 yQQjBhWH7ddL5junL17ascOuTG1/4On91d+G6aihY7m4FUcvm7KiV94LutQARAQABtB1lZGVuaXN 0IDxlZGVuaXN0QGVkZW5pc3QubmV0PokCMAQTAQoAGgQLCQgHAhUKAhYBAhkBBYJdCbXOAp4BAps DAAoJED1W5YAC/kMXW4oQALVnlZeN5AIKaQOemGJ0PJwJgBfvUHj+Wyrt4lhRjhR+SQjA+vKEB0L MGZv+0kk6fm5DIPRfHIU+pNR1ZMegabsNuo7SO0b2LuA/ver+cUa1fvaKcKKzUWupfxO3l0Hc6pU T427IMeRwIyMJsz+Mn/A8PoaDU/oMRxNwnfsFKJM1vQD5K5YqUL8b4LQSax28NjCmR82JcaWzu8L dAJXBmuVHFW0EYejfbpnfUhHnfk/cfb/Y9rzZwBKz3G6W1HC3oZCXcOiXrg4N8UB+REiWQxCt12l XTQCfccKoLa63nwiYbETc6RXoyzrwSUWEvkk2UsM/PYdnBnPTo1PysDp+8qm0GY7upVN96MgGP6a V+S1xH6pjp09d5IROv10kPiGXkbdjYF+8vEvKu/JhU12yEnID3RpOR1lLfBSK7GslanaEOpD6Oxz qawQhN4y7YV9oTVQejTdlvLhRhFcK8nuzpzXPDihYKMTRSa/2IkfAvkbkfmcuhbP10d3E18J1e/6 oWVrNgXeDEiKW94ug38hV6BTEDN7J/llProF/WQx3B9654P21ZhOLl6xPjfgLTA4HEBJZhIyHD/U anTWFtnBwFtuwBoApd0kJpeB3FgBxfHbmT723QEybtEDgBkafnVE5xKGvRzZZ5LfhssxuIg+D9/y Ymw41LReUmIMyvzUFhgwXuQINBF0Jtc4BEADHGtMvrI00DYL15ddJKrdf3mqNG3usu4icUglwKWS PA4HXIGfh93nz0f46sot4eNf6lM6a3kQA7HUXyTBvjtQrqNxiJseScDGDJi2k3+UsIGeR48HYOc4 XYeb7EayIJaifSyZbtRqw4rz2Tcp3hXhYV8Rgn8x4b+MJIyvSMBWw4+JVcTXHAzpXy+0KL/iri2y iHVFyZRovcd6y9C+7loc6G5u6AMCRdQYuJcYBb1oxvQLLTXV+Aw9HT6aSzkLcxrQdLniyrVmTUjA JHhJlRNVsP8F8GhiTHke7tIlRnye2GmdxjFaiDAFlR785NTLf24whQIgRR8fy7PyjXSE/VwrIdgC oLXv4gQ7Dsl+En6xS5GRfvZ5EUGEFFkXW4Y5oaivVceZ+JxV8gbSVIXgO+g/bTNi0Diz5ZxboOHz ePn/loOA8wsV3GR+Rkf+gGPk5IwkhvGTOR2IG0+T308i62s+MZxks6H25/8rB6KTPcE81WGf2nGl DoFvt3zDbCzH7CJvLHOBCBgkkNCFsUi0aIJ3f5ho3by09n8ZaajHXfZXkiQxoxQKvJD1H9WTEvQv zBvs6wVWJ8hQpQE0UFqjSjHPQ9ZqmwL2jJHM/wOuc5YqG7TgCVkwknpA43W3ycnK0zQdU7mHpaGf acRfYF7IaH28CJuC6UjPPcNH7nQITsEZhDQARAQABiQIfBBgBCgAJBYJdCbXOApsMAAoJED1W5YA C/kMXUecP/2osKbgL3pM1V5c6hVM5P4cG/w776dCOhvfJtmMQAmuBds5gQyvGnimKILKTJdN11t0 pxv13DZpm4H4C/Rnt7VrL/BfEzfyJEctzdIVpuwVwgRpC/o5dpdhiCyHVvlV/eFpn1za9jq0nIZw 87rlrF/RIifRqA0HChOFWe2GG5uXu3oPm2sVMqpf0aK1T4C7x/2L68xc+XejKwBYB4JdO4DpOlDu VGwltBGjPV3SSLfkvPLjGOz0hgMk2zPcuWSiFZMQi1DbqmqufapZI0gE8teZh75ms7JU/w8/JZfX ikxnh99nK/bBe6PkzdCjCRaeM+WVWFQb+0V/bmsdaMRFwAQD0hsqq/3E/L5j4zx779Ss0ZWHxja6 1GsM6Km74qYpflNZF+4LK6kHZ5VexzBV7s6vD3SsxWBDuZnKEYGTMOyz1lTOQjkDr61emUKshjvn YmY5b8PTHjj62fzpX+MU+ucDGAnB8euTmREaHjxwRNUw57BihB2BNSrrCH6xCXEqw5Q+SPrzxCAT qvRjzvHj4F1uuKMgXKZKDQwbAthgk5Yw0T8T7EFId0cgjdePYQF/IHvT97g0mMojK020Q4h2exdo J/PvwhKG3eXhQruq2Yh4aiHxIZ9h22OJTi89cR8jI2ZheUilNtoT0tHHT7A9ToEgZj9hyk1rOdJV t41LP9CvR MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: multipart/signed; boundary="----C0A745GSQUGPURBB8105UWUZ3JG6TS"; protocol="application/pgp-signature"; micalg="pgp-sha512" Subject: Re: Alpine Linux (alpine-virt-3.10.2) as guest in bhyve (FreeBSD 12.0-RELEASE-p10) To: freebsd-virtualization@freebsd.org,Artur Moor From: edenist Message-ID: <970C42D5-F891-4EBC-BE29-CE8D25650C28@edenist.net> X-Rspamd-Queue-Id: 46vS7N5MRkz3xQm X-Spamd-Bar: +++++++++ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=edenist.net header.s=default header.b=Q9HcR1l2; dmarc=pass (policy=none) header.from=edenist.net; spf=pass (mx1.freebsd.org: domain of edenist@edenist.net designates 59.167.191.177 as permitted sender) smtp.mailfrom=edenist@edenist.net X-Spamd-Result: default: False [9.15 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(0.00)[+mx]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[edenist.net:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(0.00)[edenist.net,none]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.26)[asn: 4739(1.29), country: AU(0.01)]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:4739, ipnet:59.167.0.0/16, country:AU]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; SH_EMAIL_ZRD(0.00)[192.0.0.0]; ARC_NA(0.00)[]; RECEIVED_SPAMHAUS_XBL(5.00)[49.0.250.128.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.4]; R_DKIM_ALLOW(0.00)[edenist.net:s=default]; RECEIVED_SPAMHAUS_CSS(4.00)[49.0.250.128.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.3]; FROM_HAS_DN(0.00)[]; SH_EMAIL_DBL_DONT_QUERY_IPS(0.00)[192.0.0.0]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; NEURAL_SPAM_MEDIUM(0.99)[0.991,0]; BAD_REP_POLICIES(0.10)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(1.00)[0.999,0]; GREYLIST(0.00)[pass,body] X-Spam: Yes X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Oct 2019 00:48:02 -0000 ------C0A745GSQUGPURBB8105UWUZ3JG6TS Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hi Artur, I'm by no means a bhyve expert, but I have had similar kernel panics occur= on my linux VMs over the last year=2E In my experience, it is related to m= eltdown/spectre mitigations, in particular those which are using features/M= SRs implemented through microcode=2E There appears to be some confusion whe= n a linux VM expects CPU features to be available, but they aren't properly= exposed on the host=2E=20 I would recommend checking which microcode your CPU has and which features= it exposes on the host=2E Make sure you've got devcpu-data installed which= will keep your microcode up to date [if that's something you want to happe= n]=2E=20 Try disabling various mitigation features by passing the relevant kernel p= arameters at boot [on the VM]=2E They keep changing the syntax, but it will= be something like pti=3Doff, spectre_v2=3Doff etc=2E=2E=2E=2E You may be a= ble to bisect which mitigation is causing the issues=2E=20 Hope it helps! On 18 October 2019 1:39:19 am AEDT, Artur Moor wro= te: >I have trouble with Alpine Linux as a guest in bhyve=2E When I try to >start the installation 'vm install alpine >alpine-virt-3=2E10=2E2-x86_64=2Eiso' I get the following message in the >console of the vm: >[ 0=2E000000] Linux version 4=2E19=2E67-0-virt >(buildozer@build-3-10-x86_64) (gcc version 8=2E3=2E0 (Alpine 8=2E3=2E0)) >#1-Alpine SMP Mon Aug 19 10:05:34 UTC 2019 >[ 0=2E000000] Command line: console=3DttyS0 >BOOT_IMAGE=3D/boot/vmlinuz-virt initrd=3D/boot/initramfs-virt >alpine_dev=3Dcdrom:iso9660 >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod >[ 0=2E000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating >point registers' >[ 0=2E000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' >[ 0=2E000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' >[ 0=2E000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 >[ 0=2E000000] x86/fpu: Enabled xstate features 0x7, context size is >832 bytes, using 'standard' format=2E >[ 0=2E000000] BIOS-provided physical RAM map: >[ 0=2E000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fffe] >usable >[ 0=2E000000] BIOS-e820: [mem 0x0000000000100000-0x000000001fffffff] >usable >[ 0=2E000000] NX (Execute Disable) protection: active >[ 0=2E000000] SMBIOS 2=2E6 present=2E >[ 0=2E000000] DMI: BHYVE, BIOS 1=2E00 03/14/2014 >[ 0=2E000000] tsc: Fast TSC calibration using PIT >[ 0=2E000000] tsc: Detected 3099=2E325 MHz processor >[ 0=2E000135] last_pfn =3D 0x20000 max_arch_pfn =3D 0x400000000 >[ 0=2E000144] Disabled >[ 0=2E000145] x86/PAT: MTRRs disabled, skipping PAT initialization >too=2E >[ 0=2E000147] CPU MTRRs all blank - virtualized system=2E >[ 0=2E000148] x86/PAT: Configuration [0-7]: WB WT UC- UC WB WT=20 >UC- UC >[ 0=2E000173] Using GB pages for direct mapping >[ 0=2E000209] RAMDISK: [mem 0x02aeb000-0x02fbafff] >[ 0=2E000219] ACPI: Early table checksum verification disabled >[ 0=2E000239] ACPI: RSDP 0x00000000000F2400 000024 (v02 BHYVE ) >[ 0=2E000241] ACPI: XSDT 0x00000000000F2480 000044 (v01 BHYVE BVXSDT > 00000001 INTL 20181003) >[ 0=2E000245] ACPI: APIC 0x00000000000F2500 00005A (v01 BHYVE BVMADT > 00000001 INTL 20181003) >[ 0=2E000248] ACPI: FACP 0x00000000000F2600 00010C (v05 BHYVE BVFACP > 00000001 INTL 20181003) >[ 0=2E000251] ACPI: DSDT 0x00000000000F2800 00094B (v02 BHYVE BVDSDT > 00000001 INTL 20181003) >[ 0=2E000253] ACPI: FACS 0x00000000000F27C0 000040 >[ 0=2E000255] ACPI: FACS 0x00000000000F27C0 000040 >[ 0=2E000257] ACPI: HPET 0x00000000000F2740 000038 (v01 BHYVE BVHPET > 00000001 INTL 20181003) >[ 0=2E000259] ACPI: MCFG 0x00000000000F2780 00003C (v01 BHYVE BVMCFG > 00000001 INTL 20181003) >[ 0=2E000264] Setting APIC routing to physical flat=2E >[ 0=2E000309] Zone ranges: >[ 0=2E000309] DMA [mem 0x0000000000001000-0x0000000000ffffff] >[ 0=2E000311] DMA32 [mem 0x0000000001000000-0x000000001fffffff] >[ 0=2E000312] Normal empty >[ 0=2E000312] Movable zone start for each node >[ 0=2E000313] Early memory node ranges >[ 0=2E000314] node 0: [mem 0x0000000000001000-0x000000000009efff] >[ 0=2E000315] node 0: [mem 0x0000000000100000-0x000000001fffffff] >[ 0=2E000328] Reserved but unavailable: 98 pages >[ 0=2E000329] Initmem setup node 0 [mem >0x0000000000001000-0x000000001fffffff] >[ 0=2E007443] ACPI: PM-Timer IO Port: 0x408 >[ 0=2E007449] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1]) >[ 0=2E007475] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, >GSI 0-31 >[ 0=2E007476] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high >edge) >[ 0=2E007478] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low >level) >[ 0=2E007482] Using ACPI (MADT) for SMP configuration information >[ 0=2E007483] ACPI: HPET id: 0x80860701 base: 0xfed00000 >[ 0=2E007492] smpboot: Allowing 1 CPUs, 0 hotplug CPUs >[ 0=2E007505] [mem 0x20000000-0xffffffff] available for PCI devices >[ 0=2E007506] Booting paravirtualized kernel on bare hardware >[ 0=2E007508] clocksource: refined-jiffies: mask: 0xffffffff >max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns >[ 0=2E039227] random: get_random_bytes called from >start_kernel+0x8e/0x4b0 with crng_init=3D0 >[ 0=2E039232] setup_percpu: NR_CPUS:32 nr_cpumask_bits:32 >nr_cpu_ids:1 nr_node_ids:1 >[ 0=2E040672] percpu: Embedded 44 pages/cpu s142104 r8192 d29928 >u2097152 >[ 0=2E040691] Built 1 zonelists, mobility grouping on=2E Total pages: >128905 >[ 0=2E040693] Kernel command line: console=3DttyS0 >BOOT_IMAGE=3D/boot/vmlinuz-virt initrd=3D/boot/initramfs-virt >alpine_dev=3Dcdrom:iso9660 >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod >[ 0=2E041084] Dentry cache hash table entries: 65536 (order: 7, 524288 >bytes) >[ 0=2E041261] Inode-cache hash table entries: 32768 (order: 6, 262144 >bytes) >[ 0=2E042187] Memory: 491192K/523896K available (8204K kernel code, >731K rwdata, 2068K rodata, 1140K init, 608K bss, 32704K reserved, 0K >cma-reserved) >[ 0=2E042312] SLUB: HWalign=3D64, Order=3D0-3, MinObjects=3D0, CPUs=3D= 1, >Nodes=3D1 >[ 0=2E042489] rcu: Hierarchical RCU implementation=2E >[ 0=2E042490] rcu: RCU restricting CPUs from NR_CPUS=3D32 to >nr_cpu_ids=3D1=2E >[ 0=2E042492] rcu: Adjusting geometry for rcu_fanout_leaf=3D16, >nr_cpu_ids=3D1 >[ 0=2E042597] NR_IRQS: 4352, nr_irqs: 256, preallocated irqs: 16 >[ 0=2E042919] Console: colour EGA 80x25 >[ 0=2E099439] console [ttyS0] enabled >[ 0=2E099897] ACPI: Core revision 20180810 >[ 0=2E100580] clocksource: hpet: mask: 0xffffffff max_cycles: >0xffffffff, max_idle_ns: 113919999973 ns >[ 0=2E101779] APIC: Switch to symmetric I/O mode setup >[ 0=2E103710] =2E=2ETIMER: vector=3D0x30 apic1=3D0 pin1=3D2 apic2=3D-1= pin2=3D-1 >[ 0=2E152418] clocksource: tsc-early: mask: 0xffffffffffffffff >max_cycles: 0x2cacc9e0a25, max_idle_ns: 440795241691 ns >[ 0=2E153779] Calibrating delay loop (skipped), value calculated >using timer frequency=2E=2E 6198=2E65 BogoMIPS (lpj=3D30993250) >[ 0=2E155179] pid_max: default: 32768 minimum: 301 >[ 0=2E155830] Mount-cache hash table entries: 1024 (order: 1, 8192 >bytes) >[ 0=2E156676] Mountpoint-cache hash table entries: 1024 (order: 1, >8192 bytes) >[ 0=2E157888] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 512 >[ 0=2E158688] Last level dTLB entries: 4KB 1536, 2MB 1536, 4MB 768, >1GB 0 >[ 0=2E159541] Spectre V1 : Mitigation: usercopy/swapgs barriers and >__user pointer sanitization >[ 0=2E160636] Spectre V2 : Spectre mitigation: LFENCE not >serializing, switching to generic retpoline >[ 0=2E161800] Spectre V2 : Mitigation: Full generic retpoline >[ 0=2E162503] Spectre V2 : Spectre v2 / SpectreRSB mitigation: >Filling RSB on context switch >[ 0=2E163777] Spectre V2 : mitigation: Enabling conditional Indirect >Branch Prediction Barrier >[ 0=2E164852] Speculative Store Bypass: Vulnerable >[ 0=2E168104] Freeing SMP alternatives memory: 24K >[ 0=2E173772] smpboot: CPU0: AMD EPYC 7371 16-Core Processor (family: >0x17, model: 0x1, stepping: 0x2) >[ 0=2E173772] Performance Events: PMU not available due to >virtualization, using software events only=2E >[ 0=2E173772] rcu: Hierarchical SRCU implementation=2E >[ 0=2E173772] random: crng done (trusting CPU's manufacturer) >[ 0=2E173772] NMI watchdog: Perf NMI watchdog permanently disabled >[ 0=2E173772] smp: Bringing up secondary CPUs =2E=2E=2E >[ 0=2E173772] smp: Brought up 1 node, 1 CPU >[ 0=2E173772] smpboot: Max logical packages: 1 >[ 0=2E173772] ---------------- >[ 0=2E173772] | NMI testsuite: >[ 0=2E173772] -------------------- >[ 0=2E173772] remote IPI: ok | >[ 0=2E173772] local IPI: ok | >[ 0=2E173772] -------------------- >[ 0=2E173772] Good, all 2 testcases passed! | >[ 0=2E173772] --------------------------------- >[ 0=2E173779] smpboot: Total of 1 processors activated (6198=2E65 >BogoMIPS) >[ 0=2E174744] devtmpfs: initialized >[ 0=2E175250] x86/mm: Memory block size: 128MB >[ 0=2E176042] clocksource: jiffies: mask: 0xffffffff max_cycles: >0xffffffff, max_idle_ns: 19112604462750000 ns >[ 0=2E177302] futex hash table entries: 256 (order: 2, 16384 bytes) >[ 0=2E178241] NET: Registered protocol family 16 >[ 0=2E178896] audit: initializing netlink subsys (disabled) >[ 0=2E179724] cpuidle: using governor ladder >[ 0=2E180267] cpuidle: using governor menu >[ 0=2E181276] audit: type=3D2000 audit(1571322221=2E070:1): >state=3Dinitialized audit_enabled=3D0 res=3D1 >[ 0=2E182637] ACPI FADT declares the system doesn't support PCIe >ASPM, so disable it >[ 0=2E183626] ACPI: bus type PCI registered >[ 0=2E183772] acpiphp: ACPI Hot Plug PCI Controller Driver version: >0=2E5 >[ 0=2E183907] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem >0xe0000000-0xefffffff] (base 0xe0000000) >[ 0=2E185106] PCI: not using MMCONFIG >[ 0=2E185564] PCI: Using configuration type 1 for base access >[ 0=2E186284] PCI: Using configuration type 1 for extended access >[ 0=2E192668] HugeTLB registered 1=2E00 GiB page size, pre-allocated 0 >pages >[ 0=2E193776] HugeTLB registered 2=2E00 MiB page size, pre-allocated 0 >pages >[ 0=2E194758] ACPI: Added _OSI(Module Device) >[ 0=2E195321] ACPI: Added _OSI(Processor Device) >[ 0=2E195895] ACPI: Added _OSI(3=2E0 _SCP Extensions) >[ 0=2E196506] ACPI: Added _OSI(Processor Aggregator Device) >[ 0=2E197232] ACPI: Added _OSI(Linux-Dell-Video) >[ 0=2E197813] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) >[ 0=2E198743] ACPI: 1 ACPI AML tables successfully acquired and loaded >[ 0=2E199794] ACPI: Interpreter enabled >[ 0=2E200297] ACPI: (supports S0 S5) >[ 0=2E200747] ACPI: Using IOAPIC for interrupt routing >[ 0=2E201408] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem >0xe0000000-0xefffffff] (base 0xe0000000) >[ 0=2E202648] PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved >in ACPI motherboard resources >[ 0=2E203781] PCI: Using host bridge windows from ACPI; if necessary, >use "pci=3Dnocrs" and report a bug >[ 0=2E205787] ACPI: PCI Root Bridge [PC00] (domain 0000 [bus 00]) >[ 0=2E206551] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM >ClockPM Segments MSI] >[ 0=2E207620] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling >ASPM >[ 0=2E208525] PCI host bridge to bus 0000:00 >[ 0=2E209051] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 >window] >[ 0=2E209937] pci_bus 0000:00: root bus resource [io 0x0d00-0x1fff >window] >[ 0=2E210823] pci_bus 0000:00: root bus resource [io 0x2000-0x207f >window] >[ 0=2E211686] pci_bus 0000:00: root bus resource [mem >0xc0000000-0xc01fffff window] >[ 0=2E212662] pci_bus 0000:00: root bus resource [mem >0xd000000000-0xd0000fffff window] >[ 0=2E213774] pci_bus 0000:00: root bus resource [bus 00] >[ 0=2E217648] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 *5 6 7 9 10 >11 12 14 15) >[ 0=2E218651] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 *6 7 9 10 >11 12 14 15) >[ 0=2E219671] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 *7 9 10 >11 12 14 15) >[ 0=2E220672] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 11 >12 14 15) *0, disabled=2E >[ 0=2E221806] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 11 >12 14 15) *0, disabled=2E >[ 0=2E222926] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 11 >12 14 15) *0, disabled=2E >[ 0=2E223823] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 11 >12 14 15) *0, disabled=2E >[ 0=2E224985] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 11 >12 14 15) *0, disabled=2E >[ 0=2E226176] SCSI subsystem initialized >[ 0=2E227134] pps_core: LinuxPPS API ver=2E 1 registered >[ 0=2E227811] pps_core: Software ver=2E 5=2E3=2E6 - Copyright 2005-200= 7 >Rodolfo Giometti >[ 0=2E229053] PTP clock support registered >[ 0=2E229737] PCI: Using ACPI for IRQ routing >[ 0=2E282465] clocksource: Switched to clocksource tsc-early >[ 0=2E283772] VFS: Disk quotas dquot_6=2E6=2E0 >[ 0=2E283772] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 >bytes) >[ 0=2E283772] pnp: PnP ACPI init >[ 0=2E283772] system 00:02: [io 0x0220-0x0223] has been reserved >[ 0=2E283772] system 00:02: [io 0x0224-0x0227] has been reserved >[ 0=2E283772] system 00:02: [io 0x04d0-0x04d1] has been reserved >[ 0=2E284356] system 00:02: [io 0x0400-0x0407] has been reserved >[ 0=2E285134] system 00:02: [mem 0xe0000000-0xefffffff] has been >reserved >[ 0=2E286071] pnp: PnP ACPI: found 6 devices >[ 0=2E292735] clocksource: acpi_pm: mask: 0xffffff max_cycles: >0xffffff, max_idle_ns: 2085701024 ns >[ 0=2E293934] pci 0000:00:03=2E0: BAR 6: assigned [mem >0xc0000800-0xc0000fff pref] >[ 0=2E294869] pci 0000:00:04=2E0: BAR 6: assigned [mem >0xc0001000-0xc00017ff pref] >[ 0=2E295823] pci 0000:00:05=2E0: BAR 6: assigned [mem >0xc0001800-0xc0001fff pref] >[ 0=2E296790] pci 0000:00:1f=2E0: BAR 6: assigned [mem >0xc0006000-0xc00067ff pref] >[ 0=2E297807] NET: Registered protocol family 2 >[ 0=2E298456] tcp_listen_portaddr_hash hash table entries: 256 >(order: 0, 4096 bytes) >[ 0=2E299466] TCP established hash table entries: 4096 (order: 3, >32768 bytes) >[ 0=2E300405] TCP bind hash table entries: 4096 (order: 4, 65536 >bytes) >[ 0=2E301290] TCP: Hash tables configured (established 4096 bind 4096) >[ 0=2E302158] UDP hash table entries: 256 (order: 1, 8192 bytes) >[ 0=2E302919] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes) >[ 0=2E303767] NET: Registered protocol family 1 >[ 0=2E304392] pci 0000:00:1f=2E0: Activating ISA DMA hang workarounds >[ 0=2E305764] Unpacking initramfs=2E=2E=2E >[ 0=2E366638] Freeing initrd memory: 4928K >[ 0=2E367535] Initialise system trusted keyrings >[ 0=2E368340] workingset: timestamp_bits=3D46 max_order=3D17 >bucket_order=3D0 >[ 0=2E371627] Key type asymmetric registered >[ 0=2E372215] Block layer SCSI generic (bsg) driver version 0=2E4 >loaded (major 250) >[ 0=2E373247] io scheduler noop registered >[ 0=2E373787] io scheduler deadline registered (default) >[ 0=2E374466] io scheduler mq-deadline registered (default) >[ 0=2E375099] io scheduler kyber registered >[ 0=2E375764] ERST DBG: ERST support is disabled=2E >[ 0=2E376430] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled >[ 0=2E398514] 00:03: ttyS0 at I/O 0x3f8 (irq =3D 4, base_baud =3D 1152= 00) >is a 16550A >[ 0=2E420753] 00:04: ttyS1 at I/O 0x2f8 (irq =3D 3, base_baud =3D 1152= 00) >is a 16550A >[ 0=2E421950] VMware PVSCSI driver - version 1=2E0=2E7=2E0-k >[ 0=2E422869] ahci 0000:00:03=2E0: SSS flag set, parallel bus scan >disabled >[ 0=2E423866] ahci 0000:00:03=2E0: AHCI 0001=2E0300 32 slots 6 ports 6 >Gbps 0x1 impl SATA mode >[ 0=2E424892] ahci 0000:00:03=2E0: flags: 64bit ncq sntf ilck stag pm >led clo pio slum part sxs apst >[ 0=2E426695] scsi host0: ahci >[ 0=2E427181] scsi host1: ahci >[ 0=2E427638] scsi host2: ahci >[ 0=2E428102] scsi host3: ahci >[ 0=2E428562] scsi host4: ahci >[ 0=2E429027] scsi host5: ahci >[ 0=2E429455] ata1: SATA max UDMA/133 abar m1024@0xc0000000 port >0xc0000100 irq 32 >[ 0=2E430437] ata2: DUMMY >[ 0=2E430752] ata3: DUMMY >[ 0=2E431095] ata4: DUMMY >[ 0=2E431426] ata5: DUMMY >[ 0=2E431745] ata6: DUMMY >[ 0=2E432116] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] >at 0x60,0x64 irq 1,12 >[ 0=2E433333] i8042: Warning: Keylock active >[ 0=2E434382] serio: i8042 KBD port at 0x60,0x64 irq 1 >[ 0=2E435029] serio: i8042 AUX port at 0x60,0x64 irq 12 >[ 0=2E435771] ACPI Error: Could not enable RealTimeClock event >(20180810/evxfevnt-184) >[ 0=2E436815] ACPI Warning: Could not enable fixed event - >RealTimeClock (4) (20180810/evxface-620) >[ 0=2E438442] input: AT Raw Set 2 keyboard as >/devices/platform/i8042/serio0/input/input0 >[ 0=2E439904] rtc_cmos 00:05: registered as rtc0 >[ 0=2E440508] rtc_cmos 00:05: alarms up to one day, y3k, 114 bytes >nvram >[ 0=2E441413] gre: GRE over IPv4 demultiplexor driver >[ 0=2E442040] Key type dns_resolver registered >[ 0=2E442624] sched_clock: Marking stable (374742215, >60992938)->(563738129, -128002976) >[ 0=2E443796] registered taskstats version 1 >[ 0=2E444344] Loading compiled-in X=2E509 certificates >[ 0=2E445222] rtc_cmos 00:05: setting system clock to 2019-10-17 >14:23:41 UTC (1571322221) >[ 0=2E775259] ata1: SATA link up 6=2E0 Gbps (SStatus 133 SControl 300) >[ 0=2E776094] ata1=2E00: ATAPI: BHYVE SATA DVD ROM, 001, max UDMA/133 >[ 0=2E776965] ata1=2E00: configured for UDMA/133 >[ 0=2E777642] scsi 0:0:0:0: CD-ROM BHYVE BHYVE DVD-ROM > 001 PQ: 0 ANSI: 5 >[ 0=2E779270] Freeing unused kernel image memory: 1140K >[ 0=2E805193] Write protecting the kernel read-only data: 14336k >[ 0=2E806217] Freeing unused kernel image memory: 2016K >[ 0=2E807114] Freeing unused kernel image memory: 2028K >[ 0=2E807779] rodata_test: all tests were successful >[ 0=2E808405] Run /init as init process >[ 0=2E809435] general protection fault: 0000 [#1] SMP NOPTI >[ 0=2E810155] CPU: 0 PID: 1 Comm: init Not tainted 4=2E19=2E67-0-virt >#1-Alpine >[ 0=2E811032] Hardware name: BHYVE, BIOS 1=2E00 03/14/2014 >[ 0=2E811738] RIP: 0010:switch_mm_irqs_off+0xa4/0x422 >[ 0=2E812352] Code: 48 c1 e8 09 83 e0 01 48 09 c6 65 48 8b 05 33 24 >fd 4d 48 39 c6 74 15 48 09 f0 a8 01 74 0e b9 49 00 00 00 b8 01 00 00 >00 31 d2 <0f> 30 65 48 89 35 11 24 fd 4d 0f 1f 44 00 00 eb 2e 65 48 8b >05 02 >[ 0=2E814784] RSP: 0018:ffffb0518000bcf8 EFLAGS: 00010046 >[ 0=2E815475] RAX: 0000000000000001 RBX: 0000000000000000 RCX: >0000000000000049 >[ 0=2E816413] RDX: 0000000000000000 RSI: ffff9ced1e452c00 RDI: >ffff9ced1e690000 >[ 0=2E817342] RBP: ffff9ced1e452c00 R08: ffff9ced1f2221f8 R09: >0000000000000000 >[ 0=2E818279] R10: 000000000000025e R11: ffff9ced1e690080 R12: >ffff9ced1e453800 >[ 0=2E819216] R13: ffff9ced1e690000 R14: ffff9ced1e453800 R15: >ffff9ced1e452c00 >[ 0=2E820157] FS: 00007f23ec2cdd48(0000) GS:ffff9ced1f200000(0000) >knlGS:0000000000000000 >[ 0=2E821185] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[ 0=2E821959] CR2: 00005639f0bdf8b8 CR3: 000000001eede000 CR4: >00000000000406b0 >[ 0=2E822864] Call Trace: >[ 0=2E823204] __schedule+0x69b/0x756 >[ 0=2E823668] schedule+0x5b/0x6c >[ 0=2E824090] do_wait+0x1bc/0x21e >[ 0=2E824516] kernel_wait4+0xc0/0x115 >[ 0=2E825009] ? __ia32_compat_sys_waitid+0x18/0x18 >[ 0=2E825623] __se_sys_wait4+0x37/0x86 >[ 0=2E826127] ? handle_mm_fault+0x149/0x19f >[ 0=2E826691] ? __do_page_fault+0x36a/0x3fc >[ 0=2E827251] do_syscall_64+0x50/0xeb >[ 0=2E827720] entry_SYSCALL_64_after_hwframe+0x44/0xa9 >[ 0=2E828382] RIP: 0033:0x7f23ec290080 >[ 0=2E828859] Code: c3 8b 07 85 c0 75 24 49 89 fb 48 89 f0 48 89 d7 >48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 >08 0f 05 e9 a7 d3 ff ff 41 54 b8 02 00 00 00 49 89 f4 be 00 08 08 >00 55 >[ 0=2E831332] RSP: 002b:00007ffe1e68a808 EFLAGS: 00000246 ORIG_RAX: >000000000000003d >[ 0=2E832335] RAX: ffffffffffffffda RBX: 00007f23ec2cdd48 RCX: >00007f23ec290080 >[ 0=2E833276] RDX: 0000000000000000 RSI: 00007ffe1e68a86c RDI: >ffffffffffffffff >[ 0=2E834240] RBP: 000000000000003d R08: 0000000000000000 R09: >0000000000000000 >[ 0=2E835161] R10: 0000000000000000 R11: 0000000000000246 R12: >00005639f10cfce0 >[ 0=2E836069] R13: 00007ffe1e68a86c R14: 00005639f0bc3836 R15: >0000000000000000 >[ 0=2E837030] Modules linked in: >[ 0=2E837437] ---[ end trace f7b78a6a0742f2da ]--- >[ 0=2E838032] RIP: 0010:switch_mm_irqs_off+0xa4/0x422 >[ 0=2E838669] Code: 48 c1 e8 09 83 e0 01 48 09 c6 65 48 8b 05 33 24 >fd 4d 48 39 c6 74 15 48 09 f0 a8 01 74 0e b9 49 00 00 00 b8 01 00 00 >00 31 d2 <0f> 30 65 48 89 35 11 24 fd 4d 0f 1f 44 00 00 eb 2e 65 48 8b >05 02 >[ 0=2E841119] RSP: 0018:ffffb0518000bcf8 EFLAGS: 00010046 >[ 0=2E841813] RAX: 0000000000000001 RBX: 0000000000000000 RCX: >0000000000000049 >[ 0=2E842771] RDX: 0000000000000000 RSI: ffff9ced1e452c00 RDI: >ffff9ced1e690000 >[ 0=2E843681] RBP: ffff9ced1e452c00 R08: ffff9ced1f2221f8 R09: >0000000000000000 >[ 0=2E844622] R10: 000000000000025e R11: ffff9ced1e690080 R12: >ffff9ced1e453800 >[ 0=2E845560] R13: ffff9ced1e690000 R14: ffff9ced1e453800 R15: >ffff9ced1e452c00 >[ 0=2E846529] FS: 00007f23ec2cdd48(0000) GS:ffff9ced1f200000(0000) >knlGS:0000000000000000 >[ 0=2E847627] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[ 0=2E848383] CR2: 00005639f0bdf8b8 CR3: 000000001eede000 CR4: >00000000000406b0 > >Does anyone have an idea how I can fix the problem? > >root@host:~ # cat /srv/vmm/alpine/vm-bhyve=2Elog >Oct 17 16:23:37: initialising >Oct 17 16:23:37: [loader: grub] >Oct 17 16:23:37: [cpu: 1] >Oct 17 16:23:37: [memory: 512M] >Oct 17 16:23:37: [hostbridge: standard] >Oct 17 16:23:37: [com ports: com1] >Oct 17 16:23:37: [uuid: cf6a78d4-f0d1-11e9-ab90-002590b971a4] >Oct 17 16:23:37: [utctime: yes] >Oct 17 16:23:37: [debug mode: no] >Oct 17 16:23:37: [primary disk: disk0=2Eimg] >Oct 17 16:23:37: [primary disk dev: file] >Oct 17 16:23:37: initialising network device tap0 >Oct 17 16:23:37: adding tap0 -> vm-public (public addm) >Oct 17 16:23:37: bring up tap0 -> vm-public (public addm) >Oct 17 16:23:37: booting >Oct 17 16:23:37: create file /srv/vmm/alpine/device=2Emap >Oct 17 16:23:37: -> (cd0) /srv/vmm/=2Eiso/alpine-virt-3=2E10=2E2-x86_64= =2Eiso >Oct 17 16:23:37: -> (hd0) /srv/vmm/alpine/disk0=2Eimg >Oct 17 16:23:37: create file /srv/vmm/alpine/grub=2Ecfg >Oct 17 16:23:37: -> timeout=3D3 >Oct 17 16:23:37: -> menuentry 'alpine (bhyve install)' { >Oct 17 16:23:37: -> root=3Dcd0 >Oct 17 16:23:37: -> linux /boot/vmlinuz-virt >initrd=3D/boot/initramfs-virt alpine_dev=3Dcdrom:iso9660 >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod >Oct 17 16:23:37: -> initrd /boot/initramfs-virt >Oct 17 16:23:37: -> } >Oct 17 16:23:37: /usr/local/sbin/grub-bhyve -c /dev/nmdm-alpine=2E1A -m >/srv/vmm/alpine/device=2Emap -M 512M -r host -d /srv/vmm/alpine alpine >Oct 17 16:23:41: [bhyve options: -c 1 -m 512M -AHP -U >cf6a78d4-f0d1-11e9-ab90-002590b971a4 -u] >Oct 17 16:23:41: [bhyve devices: -s 0,hostbridge -s 31,lpc -s >4:0,virtio-blk,/srv/vmm/alpine/disk0=2Eimg -s >5:0,virtio-net,tap0,mac=3D58:9c:fc:03:fe:9b] >Oct 17 16:23:41: [bhyve console: -l com1,/dev/nmdm-alpine=2E1A] >Oct 17 16:23:41: [bhyve iso device: -s >3:0,ahci-cd,/srv/vmm/=2Eiso/alpine-virt-3=2E10=2E2-x86_64=2Eiso,ro] >Oct 17 16:23:41: starting bhyve (run 1) > >root@host:~ # uname -a >FreeBSD host=2Eexample=2Ecom 12=2E0-RELEASE-p10 FreeBSD 12=2E0-RELEASE-p1= 0 >GENERIC amd64 > >root@host:~ # pkg info >bhyve-firmware-1=2E0_1 Collection of Firmware for bhyve >ca_root_nss-3=2E46=2E1 Root certificate bundle from the Mozil= la >Project >curl-7=2E66=2E0 Command line tool and library for >transferring data with URLs >dmidecode-3=2E2 Tool for dumping DMI (SMBIOS) contents >in human-readable format >e2fsprogs-libuuid-1=2E45=2E3 UUID library from e2fsprogs package >gettext-runtime-0=2E20=2E1 GNU gettext runtime libraries and >programs >grub2-bhyve-0=2E40_7 Grub-emu loader for bhyve >indexinfo-0=2E3=2E1 Utility to regenerate the GNU info pag= e >index >libestr-0=2E1=2E11_1 Library for some string essentials >libfastjson-0=2E99=2E8 libfastjson is a fork from json-c >libffi-3=2E2=2E1_3 Foreign Function Interface >libgcrypt-1=2E8=2E5 General purpose cryptographic library >based on the code from GnuPG >libgpg-error-1=2E36 Common error values for all GnuPG >components >liblogging-1=2E0=2E6 Easy to use system logging library >libnghttp2-1=2E39=2E2 HTTP/2=2E0 C Library >pkg-1=2E12=2E0 Package manager >python-3=2E6_3,2 "meta-port" for the default version of >Python interpreter >python3-3_3 The "meta-port" for version 3 of the >Python interpreter >python36-3=2E6=2E9 Interpreted object-oriented programmin= g >language >readline-8=2E0=2E0 Library for editing command lines as >they are typed >rsyslog-8=2E1908=2E0 Syslogd supporting SQL, TCP, and TLS >sudo-1=2E8=2E27_1 Allow others to run commands as root >uefi-edk2-bhyve-0=2E2_1,1 UEFI-EDK2 firmware for bhyve >uefi-edk2-bhyve-csm-0=2E2_1,1 UEFI-EDK2 firmware for bhyve with CSM >vm-bhyve-1=2E3=2E0 Management system for bhyve virtual >machines > >root@host:~ # cat /etc/rc=2Econf | grep vm >vm_enable=3D"YES" >vm_dir=3D"zfs:zroot/srv/vmm" > >root@host:~ # kldstat >Id Refs Address Size Name > 1 39 0xffffffff80200000 243d228 kernel > 2 1 0xffffffff8263e000 3a9a10 zfs=2Eko > 3 2 0xffffffff829e8000 a4f0 opensolaris=2Eko > 4 1 0xffffffff829f3000 32b88 if_bnxt=2Eko > 5 1 0xffffffff82f12000 2678 intpm=2Eko > 6 1 0xffffffff82f15000 b10 smbus=2Eko > 7 1 0xffffffff82f16000 1800 uhid=2Eko > 8 1 0xffffffff82f18000 23a8 ums=2Eko > 9 1 0xffffffff82f1b000 537460 vmm=2Eko >10 1 0xffffffff83453000 b30 nmdm=2Eko >11 1 0xffffffff83454000 6fb3 if_bridge=2Eko >12 1 0xffffffff8345b000 4410 bridgestp=2Eko >13 1 0xffffffff83460000 2e77 if_tap=2Eko > >root@host:~ # cat /srv/vmm/alpine/alpine=2Econf >loader=3D"grub" >cpu=3D1 >memory=3D512M >network0_type=3D"virtio-net" >network0_switch=3D"public" >disk0_type=3D"virtio-blk" >disk0_name=3D"disk0=2Eimg" >grub_install0=3D"linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt >alpine_dev=3Dcdrom:iso9660 >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod" >grub_install1=3D"initrd /boot/initramfs-virt" >grub_run0=3D"linux /boot/vmlinuz-virt root=3D/dev/vda3 modules=3Dext4" >grub_run1=3D"initrd /boot/initramfs-virt" >uuid=3D"cf6a78d4-f0d1-11e9-ab90-002590b971a4" >network0_mac=3D"58:9c:fc:03:fe:9b" > >root@host:~ # cat /srv/vmm/alpine/device=2Emap >(cd0) /srv/vmm/=2Eiso/alpine-virt-3=2E10=2E2-x86_64=2Eiso >(hd0) /srv/vmm/alpine/disk0=2Eimg > >root@host:~ # cat /srv/vmm/alpine/grub=2Ecfg >timeout=3D3 >menuentry 'alpine (bhyve install)' { > root=3Dcd0 > linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt >alpine_dev=3Dcdrom:iso9660 >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod > initrd /boot/initramfs-virt >} >_______________________________________________ >freebsd-virtualization@freebsd=2Eorg mailing list >https://lists=2Efreebsd=2Eorg/mailman/listinfo/freebsd-virtualization >To unsubscribe, send any mail to >"freebsd-virtualization-unsubscribe@freebsd=2Eorg" --=20 edenist XMPP+OMEMO/PGP: edenist@comms=2Eedenist=2Enet PGP Key ID: 0x3D56E58002FE4317 PGP Key Fingerprint: 7240 9DD4 DB0A 953A 8F3E A8FF 3D56 E580 02FE 4317 ------C0A745GSQUGPURBB8105UWUZ3JG6TS Content-Type: application/pgp-signature; name="signature.asc" Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- iQI7BAABCgAlHhxlZGVuaXN0IDxlZGVuaXN0QGVkZW5pc3QubmV0PgUCXakJ2gAK CRA9VuWAAv5DFxPyEADE3Nq7SRPZQvYy1syB0N6zCWDHg8zE8tDC2F6EZsBTjhKl Ex6Gv1BGiQ1BW9pRj0LikFkhB79gM5dDLir8ZGoE8V/puoPrncTvXjbqbtoiWMVY owmYTGAl3kB8OlijS0ZX4IQKVwMUv5s8/G7SK54epKt9iVdqFL3OGSrpcFnWKG09 p3Uszw9FXtb0ggqgnpRCgm8ZxerjIq/8eKQ2pIcAqRAfWQYAgKr7QqNtYgE5mvTp MrXnWs0yBTPhdunQpyFEiJFogx/XifHovz2CneQTpm/30n6s0QFF5KucuDuXOOi+ ub8EAog4PI+cgPlSvMjwohAVX8HotgE1bXHKp5gzTNxQONktzVdz6phioLvykzO9 kIeT5WLL6jHWf3WlGRFZYQyI+n9OCmui8dRYS0L5IP0sUVVaFQUGAuem+sGbcLee BBsHV1yatrtzWUHdrDnoyuND58pO/g3lYxo9gK4gqrg/Si0+G8uEzv0xCXQ937/O PCAoW1htlhimgLifIphHo1cJ+cThllzDWEOmo41LRZAH7wyRaVOT1cVkz56r9eCV nzJLHQy1SZGCn9lRsnEdQ9Xp3pQM4FX7+Vn006Xe1KJnfyyZ/6WbQLZdFofr/6dF U4aHZEoxuBZF6Uo2FTnBQWl+LsP+mOq4VG4dgk2P8pVzUz6W9y6ZnHmq3c3wYg== =a35y -----END PGP SIGNATURE----- ------C0A745GSQUGPURBB8105UWUZ3JG6TS-- From owner-freebsd-virtualization@freebsd.org Fri Oct 18 08:35:06 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0574A14A0FC for ; Fri, 18 Oct 2019 08:35:06 +0000 (UTC) (envelope-from digunit24@gmail.com) Received: from mail-ed1-x532.google.com (mail-ed1-x532.google.com [IPv6:2a00:1450:4864:20::532]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46vfVJ4ypRz4JHk for ; Fri, 18 Oct 2019 08:35:04 +0000 (UTC) (envelope-from digunit24@gmail.com) Received: by mail-ed1-x532.google.com with SMTP id r18so3899619eds.13 for ; Fri, 18 Oct 2019 01:35:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=w09R/tqktuuZ1xhm7SGJORbzds0dbNNPhaABnvkzHg0=; b=UqaXqcThXqd7ggKTM3CeBxsmbIZ+4W+B4K3mex3JV0BN6JPZ1vq9FX2HTk+ZpYv96I U3EhQde77mKuw/LN7ESX21MQBkwrLmjlLPqgDorNmVKYCR1+FORu2tQpdV09jbprk5oJ 8y8Us4lwS4Cq0dZxaR1myAo+f+UKz4nhP6yZOwpWr+Xx02hGaTNVDsx01uUQQ6yCEFh6 DDCW/CmagQVnxUQjUD9Qo0fyWietJchvtz8H2FD54W/XavC0pIVU58x2JKePEz4vwQAX vbk3Gy+x65hh8GhGaTMBd4DM1/fXKDzhCe276rb4cmPHBprlpA1fNtLQfnfLhcazmvK/ t3vg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=w09R/tqktuuZ1xhm7SGJORbzds0dbNNPhaABnvkzHg0=; b=Aeu3mbR9S/nivIlE4yd248lxR+45L7FTsiVs7kc+tgJo6fBMZaxcVI/xq99hCXqDu9 0TEjJrU0jksWIh9gn1LE+IwbDagbMlEnRai4X098w7EixOFlim677zVlXvoATeuVr0xt CzIUk4Ay41bFBcyaMvmNpRc6T7O0Cpm/0eSH2LfI51qu/+Hl+j1F6CHyjOCInC9l/8J5 IJUwl2rFt4bdVeUFjFwAD7I+BlvqIvrK3aocvFw+IUGWZee18y7h1OoVve8HMkIz9JLI vvTEu3UiRzjhBERise864sjXJf4NCEmbeedJ393JltMLoBmjSgP1tNrBdY0fwaJKun3k CDxQ== X-Gm-Message-State: APjAAAW/ae1oAevVSXDQE4vgT+nPnloOkKAQMYHQD5YW5lJQapekvUTI pUDFWVKYbyBsyRPhcPf0HBv/SMmv5jPJtpk3rEm7nxYE X-Google-Smtp-Source: APXvYqzfGiKMB9va0b51RnUcgCTE1tQ1uYjBH+nerYzc0pbhSxN8B0Mqjp5VIA8Hy7wwzUUtCStazn0KDddFl6EPeIQ= X-Received: by 2002:a17:906:2410:: with SMTP id z16mr7563963eja.120.1571387702776; Fri, 18 Oct 2019 01:35:02 -0700 (PDT) MIME-Version: 1.0 References: <970C42D5-F891-4EBC-BE29-CE8D25650C28@edenist.net> In-Reply-To: <970C42D5-F891-4EBC-BE29-CE8D25650C28@edenist.net> From: Artur Moor Date: Fri, 18 Oct 2019 10:34:51 +0200 Message-ID: Subject: Re: Alpine Linux (alpine-virt-3.10.2) as guest in bhyve (FreeBSD 12.0-RELEASE-p10) To: edenist Cc: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 46vfVJ4ypRz4JHk X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=UqaXqcTh; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of digunit24@gmail.com designates 2a00:1450:4864:20::532 as permitted sender) smtp.mailfrom=digunit24@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.00)[ip: (-9.52), ipnet: 2a00:1450::/32(-2.85), asn: 15169(-2.09), country: US(-0.05)]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; SH_EMAIL_ZRD(0.00)[192.0.0.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; SH_EMAIL_DBL_DONT_QUERY_IPS(0.00)[192.0.0.0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; IP_SCORE_FREEMAIL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2.3.5.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Oct 2019 08:35:06 -0000 Hi edenist, thank you for the tip regarding the deactivation some mitigation features in the kernel of the vm. Disabling the kernel module 'spectre_v2' of the VM does not cause the kernel panic: root@host:~ # diff /srv/vmm/alpine/alpine.conf /srv/vmm/alpine/alpine.spectre_v2=3Doff.conf 8c8 < grub_install0=3D"linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt alpine_dev=3Dcdrom:iso9660 modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod" --- > grub_install0=3D"linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt s= pectre_v2=3Doff alpine_dev=3Dcdrom:iso9660 modules=3Dloop,squashfs,sd-mod,u= sb-storage,sr-mod" Am Fr., 18. Okt. 2019 um 02:42 Uhr schrieb edenist : > > Hi Artur, > > I'm by no means a bhyve expert, but I have had similar kernel panics occu= r on my linux VMs over the last year. In my experience, it is related to me= ltdown/spectre mitigations, in particular those which are using features/MS= Rs implemented through microcode. There appears to be some confusion when a= linux VM expects CPU features to be available, but they aren't properly ex= posed on the host. > > I would recommend checking which microcode your CPU has and which feature= s it exposes on the host. Make sure you've got devcpu-data installed which = will keep your microcode up to date [if that's something you want to happen= ]. > > Try disabling various mitigation features by passing the relevant kernel = parameters at boot [on the VM]. They keep changing the syntax, but it will = be something like pti=3Doff, spectre_v2=3Doff etc.... You may be able to bi= sect which mitigation is causing the issues. > > Hope it helps! > > > On 18 October 2019 1:39:19 am AEDT, Artur Moor wrot= e: > >I have trouble with Alpine Linux as a guest in bhyve. When I try to > >start the installation 'vm install alpine > >alpine-virt-3.10.2-x86_64.iso' I get the following message in the > >console of the vm: > >[ 0.000000] Linux version 4.19.67-0-virt > >(buildozer@build-3-10-x86_64) (gcc version 8.3.0 (Alpine 8.3.0)) > >#1-Alpine SMP Mon Aug 19 10:05:34 UTC 2019 > >[ 0.000000] Command line: console=3DttyS0 > >BOOT_IMAGE=3D/boot/vmlinuz-virt initrd=3D/boot/initramfs-virt > >alpine_dev=3Dcdrom:iso9660 > >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod > >[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating > >point registers' > >[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' > >[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' > >[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 > >[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is > >832 bytes, using 'standard' format. > >[ 0.000000] BIOS-provided physical RAM map: > >[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fffe] > >usable > >[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000001fffffff] > >usable > >[ 0.000000] NX (Execute Disable) protection: active > >[ 0.000000] SMBIOS 2.6 present. > >[ 0.000000] DMI: BHYVE, BIOS 1.00 03/14/2014 > >[ 0.000000] tsc: Fast TSC calibration using PIT > >[ 0.000000] tsc: Detected 3099.325 MHz processor > >[ 0.000135] last_pfn =3D 0x20000 max_arch_pfn =3D 0x400000000 > >[ 0.000144] Disabled > >[ 0.000145] x86/PAT: MTRRs disabled, skipping PAT initialization > >too. > >[ 0.000147] CPU MTRRs all blank - virtualized system. > >[ 0.000148] x86/PAT: Configuration [0-7]: WB WT UC- UC WB WT > >UC- UC > >[ 0.000173] Using GB pages for direct mapping > >[ 0.000209] RAMDISK: [mem 0x02aeb000-0x02fbafff] > >[ 0.000219] ACPI: Early table checksum verification disabled > >[ 0.000239] ACPI: RSDP 0x00000000000F2400 000024 (v02 BHYVE ) > >[ 0.000241] ACPI: XSDT 0x00000000000F2480 000044 (v01 BHYVE BVXSDT > > 00000001 INTL 20181003) > >[ 0.000245] ACPI: APIC 0x00000000000F2500 00005A (v01 BHYVE BVMADT > > 00000001 INTL 20181003) > >[ 0.000248] ACPI: FACP 0x00000000000F2600 00010C (v05 BHYVE BVFACP > > 00000001 INTL 20181003) > >[ 0.000251] ACPI: DSDT 0x00000000000F2800 00094B (v02 BHYVE BVDSDT > > 00000001 INTL 20181003) > >[ 0.000253] ACPI: FACS 0x00000000000F27C0 000040 > >[ 0.000255] ACPI: FACS 0x00000000000F27C0 000040 > >[ 0.000257] ACPI: HPET 0x00000000000F2740 000038 (v01 BHYVE BVHPET > > 00000001 INTL 20181003) > >[ 0.000259] ACPI: MCFG 0x00000000000F2780 00003C (v01 BHYVE BVMCFG > > 00000001 INTL 20181003) > >[ 0.000264] Setting APIC routing to physical flat. > >[ 0.000309] Zone ranges: > >[ 0.000309] DMA [mem 0x0000000000001000-0x0000000000ffffff] > >[ 0.000311] DMA32 [mem 0x0000000001000000-0x000000001fffffff] > >[ 0.000312] Normal empty > >[ 0.000312] Movable zone start for each node > >[ 0.000313] Early memory node ranges > >[ 0.000314] node 0: [mem 0x0000000000001000-0x000000000009efff] > >[ 0.000315] node 0: [mem 0x0000000000100000-0x000000001fffffff] > >[ 0.000328] Reserved but unavailable: 98 pages > >[ 0.000329] Initmem setup node 0 [mem > >0x0000000000001000-0x000000001fffffff] > >[ 0.007443] ACPI: PM-Timer IO Port: 0x408 > >[ 0.007449] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1]) > >[ 0.007475] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, > >GSI 0-31 > >[ 0.007476] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high > >edge) > >[ 0.007478] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low > >level) > >[ 0.007482] Using ACPI (MADT) for SMP configuration information > >[ 0.007483] ACPI: HPET id: 0x80860701 base: 0xfed00000 > >[ 0.007492] smpboot: Allowing 1 CPUs, 0 hotplug CPUs > >[ 0.007505] [mem 0x20000000-0xffffffff] available for PCI devices > >[ 0.007506] Booting paravirtualized kernel on bare hardware > >[ 0.007508] clocksource: refined-jiffies: mask: 0xffffffff > >max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns > >[ 0.039227] random: get_random_bytes called from > >start_kernel+0x8e/0x4b0 with crng_init=3D0 > >[ 0.039232] setup_percpu: NR_CPUS:32 nr_cpumask_bits:32 > >nr_cpu_ids:1 nr_node_ids:1 > >[ 0.040672] percpu: Embedded 44 pages/cpu s142104 r8192 d29928 > >u2097152 > >[ 0.040691] Built 1 zonelists, mobility grouping on. Total pages: > >128905 > >[ 0.040693] Kernel command line: console=3DttyS0 > >BOOT_IMAGE=3D/boot/vmlinuz-virt initrd=3D/boot/initramfs-virt > >alpine_dev=3Dcdrom:iso9660 > >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod > >[ 0.041084] Dentry cache hash table entries: 65536 (order: 7, 524288 > >bytes) > >[ 0.041261] Inode-cache hash table entries: 32768 (order: 6, 262144 > >bytes) > >[ 0.042187] Memory: 491192K/523896K available (8204K kernel code, > >731K rwdata, 2068K rodata, 1140K init, 608K bss, 32704K reserved, 0K > >cma-reserved) > >[ 0.042312] SLUB: HWalign=3D64, Order=3D0-3, MinObjects=3D0, CPUs=3D1= , > >Nodes=3D1 > >[ 0.042489] rcu: Hierarchical RCU implementation. > >[ 0.042490] rcu: RCU restricting CPUs from NR_CPUS=3D32 to > >nr_cpu_ids=3D1. > >[ 0.042492] rcu: Adjusting geometry for rcu_fanout_leaf=3D16, > >nr_cpu_ids=3D1 > >[ 0.042597] NR_IRQS: 4352, nr_irqs: 256, preallocated irqs: 16 > >[ 0.042919] Console: colour EGA 80x25 > >[ 0.099439] console [ttyS0] enabled > >[ 0.099897] ACPI: Core revision 20180810 > >[ 0.100580] clocksource: hpet: mask: 0xffffffff max_cycles: > >0xffffffff, max_idle_ns: 113919999973 ns > >[ 0.101779] APIC: Switch to symmetric I/O mode setup > >[ 0.103710] ..TIMER: vector=3D0x30 apic1=3D0 pin1=3D2 apic2=3D-1 pin2= =3D-1 > >[ 0.152418] clocksource: tsc-early: mask: 0xffffffffffffffff > >max_cycles: 0x2cacc9e0a25, max_idle_ns: 440795241691 ns > >[ 0.153779] Calibrating delay loop (skipped), value calculated > >using timer frequency.. 6198.65 BogoMIPS (lpj=3D30993250) > >[ 0.155179] pid_max: default: 32768 minimum: 301 > >[ 0.155830] Mount-cache hash table entries: 1024 (order: 1, 8192 > >bytes) > >[ 0.156676] Mountpoint-cache hash table entries: 1024 (order: 1, > >8192 bytes) > >[ 0.157888] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 512 > >[ 0.158688] Last level dTLB entries: 4KB 1536, 2MB 1536, 4MB 768, > >1GB 0 > >[ 0.159541] Spectre V1 : Mitigation: usercopy/swapgs barriers and > >__user pointer sanitization > >[ 0.160636] Spectre V2 : Spectre mitigation: LFENCE not > >serializing, switching to generic retpoline > >[ 0.161800] Spectre V2 : Mitigation: Full generic retpoline > >[ 0.162503] Spectre V2 : Spectre v2 / SpectreRSB mitigation: > >Filling RSB on context switch > >[ 0.163777] Spectre V2 : mitigation: Enabling conditional Indirect > >Branch Prediction Barrier > >[ 0.164852] Speculative Store Bypass: Vulnerable > >[ 0.168104] Freeing SMP alternatives memory: 24K > >[ 0.173772] smpboot: CPU0: AMD EPYC 7371 16-Core Processor (family: > >0x17, model: 0x1, stepping: 0x2) > >[ 0.173772] Performance Events: PMU not available due to > >virtualization, using software events only. > >[ 0.173772] rcu: Hierarchical SRCU implementation. > >[ 0.173772] random: crng done (trusting CPU's manufacturer) > >[ 0.173772] NMI watchdog: Perf NMI watchdog permanently disabled > >[ 0.173772] smp: Bringing up secondary CPUs ... > >[ 0.173772] smp: Brought up 1 node, 1 CPU > >[ 0.173772] smpboot: Max logical packages: 1 > >[ 0.173772] ---------------- > >[ 0.173772] | NMI testsuite: > >[ 0.173772] -------------------- > >[ 0.173772] remote IPI: ok | > >[ 0.173772] local IPI: ok | > >[ 0.173772] -------------------- > >[ 0.173772] Good, all 2 testcases passed! | > >[ 0.173772] --------------------------------- > >[ 0.173779] smpboot: Total of 1 processors activated (6198.65 > >BogoMIPS) > >[ 0.174744] devtmpfs: initialized > >[ 0.175250] x86/mm: Memory block size: 128MB > >[ 0.176042] clocksource: jiffies: mask: 0xffffffff max_cycles: > >0xffffffff, max_idle_ns: 19112604462750000 ns > >[ 0.177302] futex hash table entries: 256 (order: 2, 16384 bytes) > >[ 0.178241] NET: Registered protocol family 16 > >[ 0.178896] audit: initializing netlink subsys (disabled) > >[ 0.179724] cpuidle: using governor ladder > >[ 0.180267] cpuidle: using governor menu > >[ 0.181276] audit: type=3D2000 audit(1571322221.070:1): > >state=3Dinitialized audit_enabled=3D0 res=3D1 > >[ 0.182637] ACPI FADT declares the system doesn't support PCIe > >ASPM, so disable it > >[ 0.183626] ACPI: bus type PCI registered > >[ 0.183772] acpiphp: ACPI Hot Plug PCI Controller Driver version: > >0.5 > >[ 0.183907] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem > >0xe0000000-0xefffffff] (base 0xe0000000) > >[ 0.185106] PCI: not using MMCONFIG > >[ 0.185564] PCI: Using configuration type 1 for base access > >[ 0.186284] PCI: Using configuration type 1 for extended access > >[ 0.192668] HugeTLB registered 1.00 GiB page size, pre-allocated 0 > >pages > >[ 0.193776] HugeTLB registered 2.00 MiB page size, pre-allocated 0 > >pages > >[ 0.194758] ACPI: Added _OSI(Module Device) > >[ 0.195321] ACPI: Added _OSI(Processor Device) > >[ 0.195895] ACPI: Added _OSI(3.0 _SCP Extensions) > >[ 0.196506] ACPI: Added _OSI(Processor Aggregator Device) > >[ 0.197232] ACPI: Added _OSI(Linux-Dell-Video) > >[ 0.197813] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) > >[ 0.198743] ACPI: 1 ACPI AML tables successfully acquired and loaded > >[ 0.199794] ACPI: Interpreter enabled > >[ 0.200297] ACPI: (supports S0 S5) > >[ 0.200747] ACPI: Using IOAPIC for interrupt routing > >[ 0.201408] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem > >0xe0000000-0xefffffff] (base 0xe0000000) > >[ 0.202648] PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved > >in ACPI motherboard resources > >[ 0.203781] PCI: Using host bridge windows from ACPI; if necessary, > >use "pci=3Dnocrs" and report a bug > >[ 0.205787] ACPI: PCI Root Bridge [PC00] (domain 0000 [bus 00]) > >[ 0.206551] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM > >ClockPM Segments MSI] > >[ 0.207620] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling > >ASPM > >[ 0.208525] PCI host bridge to bus 0000:00 > >[ 0.209051] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 > >window] > >[ 0.209937] pci_bus 0000:00: root bus resource [io 0x0d00-0x1fff > >window] > >[ 0.210823] pci_bus 0000:00: root bus resource [io 0x2000-0x207f > >window] > >[ 0.211686] pci_bus 0000:00: root bus resource [mem > >0xc0000000-0xc01fffff window] > >[ 0.212662] pci_bus 0000:00: root bus resource [mem > >0xd000000000-0xd0000fffff window] > >[ 0.213774] pci_bus 0000:00: root bus resource [bus 00] > >[ 0.217648] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 *5 6 7 9 10 > >11 12 14 15) > >[ 0.218651] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 *6 7 9 10 > >11 12 14 15) > >[ 0.219671] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 *7 9 10 > >11 12 14 15) > >[ 0.220672] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 11 > >12 14 15) *0, disabled. > >[ 0.221806] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 11 > >12 14 15) *0, disabled. > >[ 0.222926] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 11 > >12 14 15) *0, disabled. > >[ 0.223823] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 11 > >12 14 15) *0, disabled. > >[ 0.224985] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 11 > >12 14 15) *0, disabled. > >[ 0.226176] SCSI subsystem initialized > >[ 0.227134] pps_core: LinuxPPS API ver. 1 registered > >[ 0.227811] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 > >Rodolfo Giometti > >[ 0.229053] PTP clock support registered > >[ 0.229737] PCI: Using ACPI for IRQ routing > >[ 0.282465] clocksource: Switched to clocksource tsc-early > >[ 0.283772] VFS: Disk quotas dquot_6.6.0 > >[ 0.283772] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 > >bytes) > >[ 0.283772] pnp: PnP ACPI init > >[ 0.283772] system 00:02: [io 0x0220-0x0223] has been reserved > >[ 0.283772] system 00:02: [io 0x0224-0x0227] has been reserved > >[ 0.283772] system 00:02: [io 0x04d0-0x04d1] has been reserved > >[ 0.284356] system 00:02: [io 0x0400-0x0407] has been reserved > >[ 0.285134] system 00:02: [mem 0xe0000000-0xefffffff] has been > >reserved > >[ 0.286071] pnp: PnP ACPI: found 6 devices > >[ 0.292735] clocksource: acpi_pm: mask: 0xffffff max_cycles: > >0xffffff, max_idle_ns: 2085701024 ns > >[ 0.293934] pci 0000:00:03.0: BAR 6: assigned [mem > >0xc0000800-0xc0000fff pref] > >[ 0.294869] pci 0000:00:04.0: BAR 6: assigned [mem > >0xc0001000-0xc00017ff pref] > >[ 0.295823] pci 0000:00:05.0: BAR 6: assigned [mem > >0xc0001800-0xc0001fff pref] > >[ 0.296790] pci 0000:00:1f.0: BAR 6: assigned [mem > >0xc0006000-0xc00067ff pref] > >[ 0.297807] NET: Registered protocol family 2 > >[ 0.298456] tcp_listen_portaddr_hash hash table entries: 256 > >(order: 0, 4096 bytes) > >[ 0.299466] TCP established hash table entries: 4096 (order: 3, > >32768 bytes) > >[ 0.300405] TCP bind hash table entries: 4096 (order: 4, 65536 > >bytes) > >[ 0.301290] TCP: Hash tables configured (established 4096 bind 4096) > >[ 0.302158] UDP hash table entries: 256 (order: 1, 8192 bytes) > >[ 0.302919] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes) > >[ 0.303767] NET: Registered protocol family 1 > >[ 0.304392] pci 0000:00:1f.0: Activating ISA DMA hang workarounds > >[ 0.305764] Unpacking initramfs... > >[ 0.366638] Freeing initrd memory: 4928K > >[ 0.367535] Initialise system trusted keyrings > >[ 0.368340] workingset: timestamp_bits=3D46 max_order=3D17 > >bucket_order=3D0 > >[ 0.371627] Key type asymmetric registered > >[ 0.372215] Block layer SCSI generic (bsg) driver version 0.4 > >loaded (major 250) > >[ 0.373247] io scheduler noop registered > >[ 0.373787] io scheduler deadline registered (default) > >[ 0.374466] io scheduler mq-deadline registered (default) > >[ 0.375099] io scheduler kyber registered > >[ 0.375764] ERST DBG: ERST support is disabled. > >[ 0.376430] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled > >[ 0.398514] 00:03: ttyS0 at I/O 0x3f8 (irq =3D 4, base_baud =3D 11520= 0) > >is a 16550A > >[ 0.420753] 00:04: ttyS1 at I/O 0x2f8 (irq =3D 3, base_baud =3D 11520= 0) > >is a 16550A > >[ 0.421950] VMware PVSCSI driver - version 1.0.7.0-k > >[ 0.422869] ahci 0000:00:03.0: SSS flag set, parallel bus scan > >disabled > >[ 0.423866] ahci 0000:00:03.0: AHCI 0001.0300 32 slots 6 ports 6 > >Gbps 0x1 impl SATA mode > >[ 0.424892] ahci 0000:00:03.0: flags: 64bit ncq sntf ilck stag pm > >led clo pio slum part sxs apst > >[ 0.426695] scsi host0: ahci > >[ 0.427181] scsi host1: ahci > >[ 0.427638] scsi host2: ahci > >[ 0.428102] scsi host3: ahci > >[ 0.428562] scsi host4: ahci > >[ 0.429027] scsi host5: ahci > >[ 0.429455] ata1: SATA max UDMA/133 abar m1024@0xc0000000 port > >0xc0000100 irq 32 > >[ 0.430437] ata2: DUMMY > >[ 0.430752] ata3: DUMMY > >[ 0.431095] ata4: DUMMY > >[ 0.431426] ata5: DUMMY > >[ 0.431745] ata6: DUMMY > >[ 0.432116] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] > >at 0x60,0x64 irq 1,12 > >[ 0.433333] i8042: Warning: Keylock active > >[ 0.434382] serio: i8042 KBD port at 0x60,0x64 irq 1 > >[ 0.435029] serio: i8042 AUX port at 0x60,0x64 irq 12 > >[ 0.435771] ACPI Error: Could not enable RealTimeClock event > >(20180810/evxfevnt-184) > >[ 0.436815] ACPI Warning: Could not enable fixed event - > >RealTimeClock (4) (20180810/evxface-620) > >[ 0.438442] input: AT Raw Set 2 keyboard as > >/devices/platform/i8042/serio0/input/input0 > >[ 0.439904] rtc_cmos 00:05: registered as rtc0 > >[ 0.440508] rtc_cmos 00:05: alarms up to one day, y3k, 114 bytes > >nvram > >[ 0.441413] gre: GRE over IPv4 demultiplexor driver > >[ 0.442040] Key type dns_resolver registered > >[ 0.442624] sched_clock: Marking stable (374742215, > >60992938)->(563738129, -128002976) > >[ 0.443796] registered taskstats version 1 > >[ 0.444344] Loading compiled-in X.509 certificates > >[ 0.445222] rtc_cmos 00:05: setting system clock to 2019-10-17 > >14:23:41 UTC (1571322221) > >[ 0.775259] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300) > >[ 0.776094] ata1.00: ATAPI: BHYVE SATA DVD ROM, 001, max UDMA/133 > >[ 0.776965] ata1.00: configured for UDMA/133 > >[ 0.777642] scsi 0:0:0:0: CD-ROM BHYVE BHYVE DVD-ROM > > 001 PQ: 0 ANSI: 5 > >[ 0.779270] Freeing unused kernel image memory: 1140K > >[ 0.805193] Write protecting the kernel read-only data: 14336k > >[ 0.806217] Freeing unused kernel image memory: 2016K > >[ 0.807114] Freeing unused kernel image memory: 2028K > >[ 0.807779] rodata_test: all tests were successful > >[ 0.808405] Run /init as init process > >[ 0.809435] general protection fault: 0000 [#1] SMP NOPTI > >[ 0.810155] CPU: 0 PID: 1 Comm: init Not tainted 4.19.67-0-virt > >#1-Alpine > >[ 0.811032] Hardware name: BHYVE, BIOS 1.00 03/14/2014 > >[ 0.811738] RIP: 0010:switch_mm_irqs_off+0xa4/0x422 > >[ 0.812352] Code: 48 c1 e8 09 83 e0 01 48 09 c6 65 48 8b 05 33 24 > >fd 4d 48 39 c6 74 15 48 09 f0 a8 01 74 0e b9 49 00 00 00 b8 01 00 00 > >00 31 d2 <0f> 30 65 48 89 35 11 24 fd 4d 0f 1f 44 00 00 eb 2e 65 48 8b > >05 02 > >[ 0.814784] RSP: 0018:ffffb0518000bcf8 EFLAGS: 00010046 > >[ 0.815475] RAX: 0000000000000001 RBX: 0000000000000000 RCX: > >0000000000000049 > >[ 0.816413] RDX: 0000000000000000 RSI: ffff9ced1e452c00 RDI: > >ffff9ced1e690000 > >[ 0.817342] RBP: ffff9ced1e452c00 R08: ffff9ced1f2221f8 R09: > >0000000000000000 > >[ 0.818279] R10: 000000000000025e R11: ffff9ced1e690080 R12: > >ffff9ced1e453800 > >[ 0.819216] R13: ffff9ced1e690000 R14: ffff9ced1e453800 R15: > >ffff9ced1e452c00 > >[ 0.820157] FS: 00007f23ec2cdd48(0000) GS:ffff9ced1f200000(0000) > >knlGS:0000000000000000 > >[ 0.821185] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > >[ 0.821959] CR2: 00005639f0bdf8b8 CR3: 000000001eede000 CR4: > >00000000000406b0 > >[ 0.822864] Call Trace: > >[ 0.823204] __schedule+0x69b/0x756 > >[ 0.823668] schedule+0x5b/0x6c > >[ 0.824090] do_wait+0x1bc/0x21e > >[ 0.824516] kernel_wait4+0xc0/0x115 > >[ 0.825009] ? __ia32_compat_sys_waitid+0x18/0x18 > >[ 0.825623] __se_sys_wait4+0x37/0x86 > >[ 0.826127] ? handle_mm_fault+0x149/0x19f > >[ 0.826691] ? __do_page_fault+0x36a/0x3fc > >[ 0.827251] do_syscall_64+0x50/0xeb > >[ 0.827720] entry_SYSCALL_64_after_hwframe+0x44/0xa9 > >[ 0.828382] RIP: 0033:0x7f23ec290080 > >[ 0.828859] Code: c3 8b 07 85 c0 75 24 49 89 fb 48 89 f0 48 89 d7 > >48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 > >08 0f 05 e9 a7 d3 ff ff 41 54 b8 02 00 00 00 49 89 f4 be 00 08 08 > >00 55 > >[ 0.831332] RSP: 002b:00007ffe1e68a808 EFLAGS: 00000246 ORIG_RAX: > >000000000000003d > >[ 0.832335] RAX: ffffffffffffffda RBX: 00007f23ec2cdd48 RCX: > >00007f23ec290080 > >[ 0.833276] RDX: 0000000000000000 RSI: 00007ffe1e68a86c RDI: > >ffffffffffffffff > >[ 0.834240] RBP: 000000000000003d R08: 0000000000000000 R09: > >0000000000000000 > >[ 0.835161] R10: 0000000000000000 R11: 0000000000000246 R12: > >00005639f10cfce0 > >[ 0.836069] R13: 00007ffe1e68a86c R14: 00005639f0bc3836 R15: > >0000000000000000 > >[ 0.837030] Modules linked in: > >[ 0.837437] ---[ end trace f7b78a6a0742f2da ]--- > >[ 0.838032] RIP: 0010:switch_mm_irqs_off+0xa4/0x422 > >[ 0.838669] Code: 48 c1 e8 09 83 e0 01 48 09 c6 65 48 8b 05 33 24 > >fd 4d 48 39 c6 74 15 48 09 f0 a8 01 74 0e b9 49 00 00 00 b8 01 00 00 > >00 31 d2 <0f> 30 65 48 89 35 11 24 fd 4d 0f 1f 44 00 00 eb 2e 65 48 8b > >05 02 > >[ 0.841119] RSP: 0018:ffffb0518000bcf8 EFLAGS: 00010046 > >[ 0.841813] RAX: 0000000000000001 RBX: 0000000000000000 RCX: > >0000000000000049 > >[ 0.842771] RDX: 0000000000000000 RSI: ffff9ced1e452c00 RDI: > >ffff9ced1e690000 > >[ 0.843681] RBP: ffff9ced1e452c00 R08: ffff9ced1f2221f8 R09: > >0000000000000000 > >[ 0.844622] R10: 000000000000025e R11: ffff9ced1e690080 R12: > >ffff9ced1e453800 > >[ 0.845560] R13: ffff9ced1e690000 R14: ffff9ced1e453800 R15: > >ffff9ced1e452c00 > >[ 0.846529] FS: 00007f23ec2cdd48(0000) GS:ffff9ced1f200000(0000) > >knlGS:0000000000000000 > >[ 0.847627] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > >[ 0.848383] CR2: 00005639f0bdf8b8 CR3: 000000001eede000 CR4: > >00000000000406b0 > > > >Does anyone have an idea how I can fix the problem? > > > >root@host:~ # cat /srv/vmm/alpine/vm-bhyve.log > >Oct 17 16:23:37: initialising > >Oct 17 16:23:37: [loader: grub] > >Oct 17 16:23:37: [cpu: 1] > >Oct 17 16:23:37: [memory: 512M] > >Oct 17 16:23:37: [hostbridge: standard] > >Oct 17 16:23:37: [com ports: com1] > >Oct 17 16:23:37: [uuid: cf6a78d4-f0d1-11e9-ab90-002590b971a4] > >Oct 17 16:23:37: [utctime: yes] > >Oct 17 16:23:37: [debug mode: no] > >Oct 17 16:23:37: [primary disk: disk0.img] > >Oct 17 16:23:37: [primary disk dev: file] > >Oct 17 16:23:37: initialising network device tap0 > >Oct 17 16:23:37: adding tap0 -> vm-public (public addm) > >Oct 17 16:23:37: bring up tap0 -> vm-public (public addm) > >Oct 17 16:23:37: booting > >Oct 17 16:23:37: create file /srv/vmm/alpine/device.map > >Oct 17 16:23:37: -> (cd0) /srv/vmm/.iso/alpine-virt-3.10.2-x86_64.iso > >Oct 17 16:23:37: -> (hd0) /srv/vmm/alpine/disk0.img > >Oct 17 16:23:37: create file /srv/vmm/alpine/grub.cfg > >Oct 17 16:23:37: -> timeout=3D3 > >Oct 17 16:23:37: -> menuentry 'alpine (bhyve install)' { > >Oct 17 16:23:37: -> root=3Dcd0 > >Oct 17 16:23:37: -> linux /boot/vmlinuz-virt > >initrd=3D/boot/initramfs-virt alpine_dev=3Dcdrom:iso9660 > >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod > >Oct 17 16:23:37: -> initrd /boot/initramfs-virt > >Oct 17 16:23:37: -> } > >Oct 17 16:23:37: /usr/local/sbin/grub-bhyve -c /dev/nmdm-alpine.1A -m > >/srv/vmm/alpine/device.map -M 512M -r host -d /srv/vmm/alpine alpine > >Oct 17 16:23:41: [bhyve options: -c 1 -m 512M -AHP -U > >cf6a78d4-f0d1-11e9-ab90-002590b971a4 -u] > >Oct 17 16:23:41: [bhyve devices: -s 0,hostbridge -s 31,lpc -s > >4:0,virtio-blk,/srv/vmm/alpine/disk0.img -s > >5:0,virtio-net,tap0,mac=3D58:9c:fc:03:fe:9b] > >Oct 17 16:23:41: [bhyve console: -l com1,/dev/nmdm-alpine.1A] > >Oct 17 16:23:41: [bhyve iso device: -s > >3:0,ahci-cd,/srv/vmm/.iso/alpine-virt-3.10.2-x86_64.iso,ro] > >Oct 17 16:23:41: starting bhyve (run 1) > > > >root@host:~ # uname -a > >FreeBSD host.example.com 12.0-RELEASE-p10 FreeBSD 12.0-RELEASE-p10 > >GENERIC amd64 > > > >root@host:~ # pkg info > >bhyve-firmware-1.0_1 Collection of Firmware for bhyve > >ca_root_nss-3.46.1 Root certificate bundle from the Mozilla > >Project > >curl-7.66.0 Command line tool and library for > >transferring data with URLs > >dmidecode-3.2 Tool for dumping DMI (SMBIOS) contents > >in human-readable format > >e2fsprogs-libuuid-1.45.3 UUID library from e2fsprogs package > >gettext-runtime-0.20.1 GNU gettext runtime libraries and > >programs > >grub2-bhyve-0.40_7 Grub-emu loader for bhyve > >indexinfo-0.3.1 Utility to regenerate the GNU info page > >index > >libestr-0.1.11_1 Library for some string essentials > >libfastjson-0.99.8 libfastjson is a fork from json-c > >libffi-3.2.1_3 Foreign Function Interface > >libgcrypt-1.8.5 General purpose cryptographic library > >based on the code from GnuPG > >libgpg-error-1.36 Common error values for all GnuPG > >components > >liblogging-1.0.6 Easy to use system logging library > >libnghttp2-1.39.2 HTTP/2.0 C Library > >pkg-1.12.0 Package manager > >python-3.6_3,2 "meta-port" for the default version of > >Python interpreter > >python3-3_3 The "meta-port" for version 3 of the > >Python interpreter > >python36-3.6.9 Interpreted object-oriented programming > >language > >readline-8.0.0 Library for editing command lines as > >they are typed > >rsyslog-8.1908.0 Syslogd supporting SQL, TCP, and TLS > >sudo-1.8.27_1 Allow others to run commands as root > >uefi-edk2-bhyve-0.2_1,1 UEFI-EDK2 firmware for bhyve > >uefi-edk2-bhyve-csm-0.2_1,1 UEFI-EDK2 firmware for bhyve with CSM > >vm-bhyve-1.3.0 Management system for bhyve virtual > >machines > > > >root@host:~ # cat /etc/rc.conf | grep vm > >vm_enable=3D"YES" > >vm_dir=3D"zfs:zroot/srv/vmm" > > > >root@host:~ # kldstat > >Id Refs Address Size Name > > 1 39 0xffffffff80200000 243d228 kernel > > 2 1 0xffffffff8263e000 3a9a10 zfs.ko > > 3 2 0xffffffff829e8000 a4f0 opensolaris.ko > > 4 1 0xffffffff829f3000 32b88 if_bnxt.ko > > 5 1 0xffffffff82f12000 2678 intpm.ko > > 6 1 0xffffffff82f15000 b10 smbus.ko > > 7 1 0xffffffff82f16000 1800 uhid.ko > > 8 1 0xffffffff82f18000 23a8 ums.ko > > 9 1 0xffffffff82f1b000 537460 vmm.ko > >10 1 0xffffffff83453000 b30 nmdm.ko > >11 1 0xffffffff83454000 6fb3 if_bridge.ko > >12 1 0xffffffff8345b000 4410 bridgestp.ko > >13 1 0xffffffff83460000 2e77 if_tap.ko > > > >root@host:~ # cat /srv/vmm/alpine/alpine.conf > >loader=3D"grub" > >cpu=3D1 > >memory=3D512M > >network0_type=3D"virtio-net" > >network0_switch=3D"public" > >disk0_type=3D"virtio-blk" > >disk0_name=3D"disk0.img" > >grub_install0=3D"linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt > >alpine_dev=3Dcdrom:iso9660 > >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod" > >grub_install1=3D"initrd /boot/initramfs-virt" > >grub_run0=3D"linux /boot/vmlinuz-virt root=3D/dev/vda3 modules=3Dext4" > >grub_run1=3D"initrd /boot/initramfs-virt" > >uuid=3D"cf6a78d4-f0d1-11e9-ab90-002590b971a4" > >network0_mac=3D"58:9c:fc:03:fe:9b" > > > >root@host:~ # cat /srv/vmm/alpine/device.map > >(cd0) /srv/vmm/.iso/alpine-virt-3.10.2-x86_64.iso > >(hd0) /srv/vmm/alpine/disk0.img > > > >root@host:~ # cat /srv/vmm/alpine/grub.cfg > >timeout=3D3 > >menuentry 'alpine (bhyve install)' { > > root=3Dcd0 > > linux /boot/vmlinuz-virt initrd=3D/boot/initramfs-virt > >alpine_dev=3Dcdrom:iso9660 > >modules=3Dloop,squashfs,sd-mod,usb-storage,sr-mod > > initrd /boot/initramfs-virt > >} > >_______________________________________________ > >freebsd-virtualization@freebsd.org mailing list > >https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > >To unsubscribe, send any mail to > >"freebsd-virtualization-unsubscribe@freebsd.org" > > -- > edenist > > XMPP+OMEMO/PGP: edenist@comms.edenist.net > PGP Key ID: 0x3D56E58002FE4317 > PGP Key Fingerprint: 7240 9DD4 DB0A 953A 8F3E A8FF 3D56 E580 02FE 4317 From owner-freebsd-virtualization@freebsd.org Sat Oct 19 06:16:32 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 041C915A613 for ; Sat, 19 Oct 2019 06:16:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 46wCMz5ppnz3Ks3 for ; Sat, 19 Oct 2019 06:16:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id C4B3215A612; Sat, 19 Oct 2019 06:16:31 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C441C15A611 for ; Sat, 19 Oct 2019 06:16:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46wCMz4qqVz3Ks2 for ; Sat, 19 Oct 2019 06:16:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8A7791E43D for ; Sat, 19 Oct 2019 06:16:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x9J6GVJ7086330 for ; Sat, 19 Oct 2019 06:16:31 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x9J6GV7D086329 for virtualization@FreeBSD.org; Sat, 19 Oct 2019 06:16:31 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 241338] [bhyve] haiku fails to boot with smp (more than one virtual core) Date: Sat, 19 Oct 2019 06:16:31 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 11.3-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: nep@packageloss.eu X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter attachments.created Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Oct 2019 06:16:32 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241338 Bug ID: 241338 Summary: [bhyve] haiku fails to boot with smp (more than one virtual core) Product: Base System Version: 11.3-RELEASE Hardware: amd64 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: bhyve Assignee: virtualization@FreeBSD.org Reporter: nep@packageloss.eu Created attachment 208414 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D208414&action= =3Dedit syslog of failed haiku boot (output of bhyve) For purposes of this bug i am mentioning a specific revision i have tested = this issue with, even though i haven't found any haiku revision this did not occ= ur on. haiku revision: hrev53541 with architecture x86_64 The 'haiku-nightly-anyboot.iso' can be obtained from https://download.haiku-os.org/nightly-images/x86_64/, or more precisely wha= t i used: https://s3.wasabisys.com/haiku-nightly/x86_64/haiku-master-hrev53546-x86_64= -anyboot.zip The file is in the archive. This is my host system: uname -a: FreeBSD sleepyprincess 11.3-RELEASE FreeBSD 11.3-RELEASE #0 r3497= 54: Fri Jul 5 04:45:24 UTC 2019=20=20=20=20 root@releng2.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 Haiku will boot here with this invocation of vmrun.sh ./vmrun.sh -c 1 -E -i -I haiku-nightly-anyboot.iso haiku But not with this one ./vmrun.sh -c 2 -E -i -I haiku-nightly-anyboot.iso haiku I am not sure if this is all information that is required, please tell me i= f i missed anything :) sysctl: hw.machine: amd64 hw.model: AMD FX(tm)-4300 Quad-Core Processor hw.ncpu: 4 hw.byteorder: 1234 hw.physmem: 4237471744 hw.usermem: 1444818944 hw.pagesize: 4096 hw.floatingpoint: 1 hw.machine_arch: amd64 hw.realmem: 4294967296 hw.vmm.npt.pmap_flags: 507 hw.vmm.svm.num_asids: 65536 hw.vmm.svm.disable_npf_assist: 0 hw.vmm.svm.features: 7423 hw.vmm.svm.vmcb_clean: 1023 hw.vmm.vmx.l1d_flush_sw: 0 hw.vmm.vmx.l1d_flush: 0 hw.vmm.vmx.vpid_alloc_failed: 0 hw.vmm.vmx.posted_interrupt_vector: -1 hw.vmm.vmx.cap.posted_interrupts: 0 hw.vmm.vmx.cap.virtual_interrupt_delivery: 0 hw.vmm.vmx.cap.invpcid: 0 hw.vmm.vmx.cap.monitor_trap: 0 hw.vmm.vmx.cap.unrestricted_guest: 0 hw.vmm.vmx.cap.pause_exit: 0 hw.vmm.vmx.cap.halt_exit: 0 hw.vmm.vmx.initialized: 0 hw.vmm.vmx.cr4_zeros_mask: 0 hw.vmm.vmx.cr4_ones_mask: 0 hw.vmm.vmx.cr0_zeros_mask: 0 hw.vmm.vmx.cr0_ones_mask: 0 hw.vmm.vmx.no_flush_rsb: 0 hw.vmm.ept.pmap_flags: 0 hw.vmm.vrtc.flag_broken_time: 1 hw.vmm.ppt.devices: 0 hw.vmm.iommu.enable: 1 hw.vmm.iommu.initialized: 0 hw.vmm.bhyve_xcpuids: 8 hw.vmm.topology.cpuid_leaf_b: 1 hw.vmm.topology.cores_per_package: 1 hw.vmm.topology.threads_per_core: 1 hw.vmm.create: beavis hw.vmm.destroy: beavis hw.vmm.trace_guest_exceptions: 0 hw.vmm.ipinum: 251 hw.vmm.halt_detection: 1 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Sat Oct 19 06:17:06 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 67A9015A65B for ; Sat, 19 Oct 2019 06:17:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 46wCNf27MVz3Kv0 for ; Sat, 19 Oct 2019 06:17:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 491AD15A65A; Sat, 19 Oct 2019 06:17:06 +0000 (UTC) Delivered-To: virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 48E3315A659 for ; Sat, 19 Oct 2019 06:17:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46wCNf1G7Mz3Kty for ; Sat, 19 Oct 2019 06:17:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 0F3F11E43E for ; Sat, 19 Oct 2019 06:17:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x9J6H5KO097784 for ; Sat, 19 Oct 2019 06:17:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x9J6H5hU097764 for virtualization@FreeBSD.org; Sat, 19 Oct 2019 06:17:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 241338] [bhyve] haiku fails to boot with smp (more than one virtual core) Date: Sat, 19 Oct 2019 06:17:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 11.3-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: nep@packageloss.eu X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Oct 2019 06:17:06 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241338 --- Comment #1 from Pascal Abresch --- Created attachment 208415 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D208415&action= =3Dedit dmesg --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Sat Oct 19 13:38:17 2019 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D579B165AD6 for ; Sat, 19 Oct 2019 13:38:17 +0000 (UTC) (envelope-from sanpei.ml@gmail.com) Received: from mail-pg1-x530.google.com (mail-pg1-x530.google.com [IPv6:2607:f8b0:4864:20::530]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46wP9h5K2Pz4G5L for ; Sat, 19 Oct 2019 13:38:16 +0000 (UTC) (envelope-from sanpei.ml@gmail.com) Received: by mail-pg1-x530.google.com with SMTP id t3so4935697pga.8 for ; Sat, 19 Oct 2019 06:38:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=1LEL2+pE3P4wLu8cnS5V8L5PzyiLGN7ZEveNe/bz63s=; b=t7gNxxWZ4epHPd7rGerW+jrPlXmhOgUD/W9ByX4QMALGBaqHLh1dM6CFhzJBT4cXrj WcWs/u/ZzM7H2fjOcQkNpLSITYT5SH7iT3Go5UmWrX0LKY44g4Ea8wUxKm/CKOCl8mOq wtAAXdEZfo376eFub0kaDKnKk+Lp1a/47DVWle/8qHN6KpXPI0BndqZpHoJdaQLdiG2q C6miR7C2YC5gHN0jSmymbjdR/8WGZ6ORqq9h8/tcPbRg+IaUez9QGfnwV1M55zNqHQ7h oDrVTD4enthY7/pBsRBc2GPGd5TDY4VCMMIBLLuyH+noLFOmbr2cIEPviQyrsYMPfs7G cBpw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=1LEL2+pE3P4wLu8cnS5V8L5PzyiLGN7ZEveNe/bz63s=; b=Lg+DqtHqOlBw/txkJAxba1QYxONkBm/ZREQkt+39v6uGTj9vYXggJgG4ZKIgN43lRD B/3qKHNtptq6ZY9fEzgkNY54mGH2wN3eXXdR42EaTf5aA6GwJrxBwwnbgDHvPiVMiv2n qtVNgTH9Pv9O/6m3py960xMgUYzl6glcIdbsBBougzGZKsmSVdHFOZ6f9TUWX3HTVh3/ NckNMlRuAjXxPfDpn8XXsA9hqGYcnynzWHJ6rLyh5AqsisgBotPFHoSGeTzj7nseWZHl tD9ebneiwbYZcsaCvVULB5rJSB30trJFEEHiEzdAr+8+MO1yMAlCJFkZnRuseIqDSSe8 WBqA== X-Gm-Message-State: APjAAAUg6ErXjn8nm16ooP4+mF2RJ4VleynPsThXPFfTLVkBz4BNYG6J j/AD2zCttQMBllbrLz5kZJ+3Knc0VH/alQpMomI75l5O X-Google-Smtp-Source: APXvYqybWap8dat61vcF6AzamassRwG8wZKeTEx9UGAU5mu49LX1GEfr0sdQheEBdM1hMHrMLVL1cXt27N48F95Tx68= X-Received: by 2002:aa7:956a:: with SMTP id x10mr12342196pfq.220.1571492293814; Sat, 19 Oct 2019 06:38:13 -0700 (PDT) MIME-Version: 1.0 From: Yoshiro MIHIRA Date: Sat, 19 Oct 2019 22:38:01 +0900 Message-ID: Subject: cannot mount root partition FreeBSD-12.1-RC1 on Oracle Cloud (PARAVIRTUALIZED mode) To: freebsd-virtualization@freebsd.org X-Rspamd-Queue-Id: 46wP9h5K2Pz4G5L X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=t7gNxxWZ; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of sanpeiml@gmail.com designates 2607:f8b0:4864:20::530 as permitted sender) smtp.mailfrom=sanpeiml@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_NONE(0.00)[]; URI_COUNT_ODD(1.00)[9]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.00)[ip: (-9.20), ipnet: 2607:f8b0::/32(-2.46), asn: 15169(-2.09), country: US(-0.05)]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; IP_SCORE_FREEMAIL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[0.3.5.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Oct 2019 13:38:17 -0000 Hi, All. I'm trying to install FreeBSD-12.0 or 12.1-RC1 on Oracle Cloud. I installed it with Emulation mode. But cannot install it with PARAVIRTUALIZED mode(see below error message) virtio_pci1: port 0xc000-0xc03f mem 0xfebf2000-0xfebf2 fff,0xfe004000-0xfe007fff irq 11 at device 4.0 on pci0 vtscsi0: on virtio_pci1 virtio_pci1: host features: 0x79000006 virtio_pci1: negotiated features: 0x10000002 virtio_pci1: attempting to allocate 4 MSI-X vectors (4 supported) msi: routing MSI-X IRQ 259 to local APIC 0 vector 56 msi: routing MSI-X IRQ 260 to local APIC 0 vector 57 msi: routing MSI-X IRQ 261 to local APIC 0 vector 58 msi: routing MSI-X IRQ 262 to local APIC 0 vector 59 virtio_pci1: using IRQs 259-262 for MSI-X virtio_pci1: using per VQ MSIX interrupts pass0 at vtscsi0 bus 0 scbus2 target 0 lun 0 pass0: Fixed Uninstalled SPC-3 SCSI device (offline) pass0: 0KB/s transfers pass0: Command Queueing enabled da0 at vtscsi0 bus 0 scbus2 target 0 lun 1 da0: Fixed Direct Access SPC-4 SCSI device da0: 300.000MB/s transfers da0: Command Queueing enabled da0: 47694MB (97677312 512 byte sectors) Trying to mount root from ufs:/dev/da0p2 []... (da0:vtscsi0:0:0:1): READ(6). CDB: 08 00 00 01 01 00 (da0:vtscsi0:0:0:1): CAM status: SCSI Status Error (da0:vtscsi0:0:0:1): SCSI status: Check Condition (da0:vtscsi0:0:0:1): Retrying command (per sense data) Root mount waiting for: usbus0 ugen0.2: at usbus0 mountroot: waiting for device /dev/da0p2... Mounting from ufs:/dev/da0p2 failed with error 19. >From Oracle Cloud document(*1), FreeBSD-12 and later could be supported with Paravirtualized mode. Bring Your Own Image (BYOI) https://docs.cloud.oracle.com/iaas/Content/Compute/References/bringyourownimage.htm Please let me know to install FreeBSD-12 with Paravirtualized mode on Oracle Cloud. all boot message (with boot -v) https://www.sanpei.org/~sanpei/tmp/Oracle-Cloud-VM.Standard2.1-FreeBSD-12.0-RELEASE-FreeBSD-12.1-RC1-amd64.vmdk P.S. I wrote some tips about Oracle Cloud/FreeBSD. https://sanpeisbllog.blogspot.com/2019/10/freebsdfreebsd-on-oracle-cloud.html Yours Yoshiro MIHIRA Tokyo, Japan.