From owner-freebsd-hackers@freebsd.org Mon Aug 14 18:43:02 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3AA7ADDCBC5; Mon, 14 Aug 2017 18:43:02 +0000 (UTC) (envelope-from paggas1@yandex.com) Received: from forward100j.mail.yandex.net (forward100j.mail.yandex.net [IPv6:2a02:6b8:0:801:2::100]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "forwards.mail.yandex.net", Issuer "Yandex CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E8910693A3; Mon, 14 Aug 2017 18:43:01 +0000 (UTC) (envelope-from paggas1@yandex.com) Received: from mxback4g.mail.yandex.net (mxback4g.mail.yandex.net [IPv6:2a02:6b8:0:1472:2741:0:8b7:165]) by forward100j.mail.yandex.net (Yandex) with ESMTP id C02E55D82666; Mon, 14 Aug 2017 21:42:58 +0300 (MSK) Received: from smtp2o.mail.yandex.net (smtp2o.mail.yandex.net [2a02:6b8:0:1a2d::26]) by mxback4g.mail.yandex.net (nwsmtp/Yandex) with ESMTP id NIvVtZV6ah-gwbe4urS; Mon, 14 Aug 2017 21:42:58 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.com; s=mail; t=1502736178; bh=PlfwI7gREOYNjoQ48LUIWSOQ2dUD1R/UIj6Kg33cyJM=; h=To:From:Subject:Message-ID:Date; b=Aa6Y8pBWGJmtep6Dpc/eA0XkyDS4u/xadTEJltpgmnPyMrzj0IGE3DVMB1b8zy4Us Ow+ZwwtuTDG6PE2KcZTT6gC+D7D4u6URiXlI1cFUTDlpk7NTt77edUll+p4U/zThCw hHE9MKj3/Fe1+pEzhzoMxmHgQ7kTRfxxSK+paAkY= Received: by smtp2o.mail.yandex.net (nwsmtp/Yandex) with ESMTPSA id 6WW1U4HRaX-gv2qCNFo; Mon, 14 Aug 2017 21:42:57 +0300 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client certificate not present) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.com; s=mail; t=1502736178; bh=PlfwI7gREOYNjoQ48LUIWSOQ2dUD1R/UIj6Kg33cyJM=; h=To:From:Subject:Message-ID:Date; b=Aa6Y8pBWGJmtep6Dpc/eA0XkyDS4u/xadTEJltpgmnPyMrzj0IGE3DVMB1b8zy4Us Ow+ZwwtuTDG6PE2KcZTT6gC+D7D4u6URiXlI1cFUTDlpk7NTt77edUll+p4U/zThCw hHE9MKj3/Fe1+pEzhzoMxmHgQ7kTRfxxSK+paAkY= Authentication-Results: smtp2o.mail.yandex.net; dkim=pass header.i=@yandex.com To: FreeBSD Current , "freebsd-hackers@freebsd.org" From: Panagiotes Mousikides Subject: Install FreeBSD from source into VM image Message-ID: <8888acfa-4dc8-a68f-8ca8-c4df84e5e74a@yandex.com> Date: Mon, 14 Aug 2017 18:42:57 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 18:43:02 -0000 Hello everybody! I am working on the FreeBSD test suite, and need to create an image file from source. How can I do that? I need to run something similar to make installkernel && make installworld with an image file as the target, such that the end result is a ready-made FreeBSD system that can be started up with bhyve. How can I do that, including creating the correct /etc files, and the correct boot code and partitioning? Following the FreeBSD handbook [0] didn't work, as that concerns updating the current system from source only. [0]: https://www.freebsd.org/doc/handbook/makeworld.html Any help would be kindly appreciated! Best regards, Panagiotes From owner-freebsd-hackers@freebsd.org Mon Aug 14 18:49:37 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7B011DDD273; Mon, 14 Aug 2017 18:49:37 +0000 (UTC) (envelope-from matt.joras@gmail.com) Received: from mail-qt0-f194.google.com (mail-qt0-f194.google.com [209.85.216.194]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 422FD69744; Mon, 14 Aug 2017 18:49:36 +0000 (UTC) (envelope-from matt.joras@gmail.com) Received: by mail-qt0-f194.google.com with SMTP id d10so10420747qtb.4; Mon, 14 Aug 2017 11:49:36 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=bRgszLATcv5yYWIJdZGI6ujptpdXwEcPjLrTvZdAsjU=; b=m9iaugAWjdLJSaFurAigP2YmkYNYVdZvdum0MJTA759owxbs6DDyAx2UQCJXOlK8jU nNpHDZ6fgZUJaeCJOmNNkcUjjZWnV17o1/QUNe2s1KwWxATfVdJkcnI7NI6PytsEwCan 2pxjKXT9Pr6hKRNPbaSs4sl0xIQO90ZKV/XcNdmpWChxAj2udaa8KZZi7sGS8YOhdFJ8 fbl7NS2hkL5+3CSQaxhHevf+GbilM97Z5dk53r4Dir+aJb2hd8x03Y4T3mUBclEwF+Oa +f4fcfXkqkxIhRecvqd8B0NkkhvR5DCaDItfTWQg4umfRpFEQ+v+XXabupEttIwkVBqQ eM4Q== X-Gm-Message-State: AHYfb5gE0u6WFvTuYTwFaBg5p2nNF/oDHmFK4jpoD05itHb+FIu2Pykj w+j8Z9FydZabStQFX7Y= X-Received: by 10.200.38.243 with SMTP id 48mr32777657qtp.130.1502736569873; Mon, 14 Aug 2017 11:49:29 -0700 (PDT) Received: from [192.168.2.122] (71-212-76-202.tukw.qwest.net. [71.212.76.202]) by smtp.gmail.com with ESMTPSA id s22sm5711944qte.92.2017.08.14.11.49.28 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 14 Aug 2017 11:49:29 -0700 (PDT) Subject: Re: Install FreeBSD from source into VM image To: Panagiotes Mousikides , FreeBSD Current , "freebsd-hackers@freebsd.org" References: <8888acfa-4dc8-a68f-8ca8-c4df84e5e74a@yandex.com> From: Matt Joras Message-ID: <97d0475c-9603-03d8-144d-dc803e5530c7@FreeBSD.org> Date: Mon, 14 Aug 2017 11:49:27 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.1.0 MIME-Version: 1.0 In-Reply-To: <8888acfa-4dc8-a68f-8ca8-c4df84e5e74a@yandex.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Content-Language: en-US X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 18:49:37 -0000 On 08/14/2017 11:42, Panagiotes Mousikides wrote: > I am working on the FreeBSD test suite, and need to create an image > file from source. How can I do that? > > I need to run something similar to make installkernel && make > installworld with an image file as the target, such that the end > result is a ready-made FreeBSD system that can be started up with > bhyve. How can I do that, including creating the correct /etc files, > and the correct boot code and partitioning? > See release(7), https://www.freebsd.org/cgi/man.cgi?release(7). The relevant section is under virtual machine disk images and the vm-image target. The VMFORMATS for bhyve is "raw". That will generate an image that "just works" with vmrun.sh Matt Joras From owner-freebsd-hackers@freebsd.org Mon Aug 14 19:12:38 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0E349DDE96E for ; Mon, 14 Aug 2017 19:12:38 +0000 (UTC) (envelope-from nbari@codigo.io) Received: from mail-wr0-x22e.google.com (mail-wr0-x22e.google.com [IPv6:2a00:1450:400c:c0c::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 98E846B10A for ; Mon, 14 Aug 2017 19:12:37 +0000 (UTC) (envelope-from nbari@codigo.io) Received: by mail-wr0-x22e.google.com with SMTP id y41so12833947wrd.3 for ; Mon, 14 Aug 2017 12:12:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=codigo.io; s=google; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=O8Js2xuiVg7LlaI3u/tNW+WD6wm+ETYyaab8640wJd0=; b=chRVl+cGzDu4KK8WIis0bl3o0dK7zQRvLsztooQufTMroANHNq2or2DI+xeSGBjaFR HQHoHr/H2FV7koGG+H5wXthtUHJewd+GIKd8rApVh82zFnu9cpgmQ3A2g195ELEaGhbZ /qInAx+P+hPCQPHFnaIpdPT4U7uxsFPZ120qOtcrKZ6SCpW7N8xAsmKCB4oENGEoeDvJ ogcnBjcONu0I6NA5072ElUzzlAxJc53hvd9V9MKEtvSOuYAVjSlvZRa+vxWh+j/Q4WqG gA30ju9CA1Agc9MymOg96+VBHbxLS24KqlE2omDoDUn6akKaRTvGu13h4LGqO5gfxYpI D4bg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tequila.io; s=google; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=O8Js2xuiVg7LlaI3u/tNW+WD6wm+ETYyaab8640wJd0=; b=E0P4GHL/JMZ2798Z+d83H7h+WI9YwLb+Ju9kT9krWDHmsrXj2YL86d0GH/jjH38g5g 3czr0Uguq4C+Hk30KWpdgHl5eIlSmcIafBtvON2eLzsIex/Cayc6zEAsHXAwbF/miehr eRhWixcmVNUN336qCoEJhoNiJHbl/jm4/T6Bit1oiZVT+vKYf4q02W9bCEXg7K7tnCHJ XZvqP3Hlr5w3S1y4thhYU3GO429O0JvJAn4T78+T2uh96NO7kxsCc3hutSF2sdma6K+P 5W+ODbRxqY0UGQ/AE5lfbqLPC7+gW+FtG9ZoslgQM6pLtS3mSkURewMN1iG7AIcUyaYB 7Guw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=O8Js2xuiVg7LlaI3u/tNW+WD6wm+ETYyaab8640wJd0=; b=uSmD9byI+toFzd988IxmBf8UODDFnF5pSnBVzsQb08wpdHnfT7ZJNgDAWaTG48678B PD6pmuFwDEjhYXBOeMHRfmGmfOmtDEr4Pq1AnCrx5cQ6kS878JiKbrfP//rjdQtkajzi uJQ1pKdT3rPEoatww97wPgPKEfdckWHVVDuHyyzAvC9L7UMz7Sfx/Ab9dGt5kuGa5PfI A/6T0HmZwFd8RbGEUNa6CH7XE8cFBG7aLQc4FZeZBsBkC8QU9L8fSCt5aqqm3WpkffPv QtfxrW7mkrLZzFMeUu4LPl8Iy0pD3nHrx5z3OPkSVM2K95tx8MoCVBV8hh0+HPAXprUk JFhw== X-Gm-Message-State: AHYfb5jaJjxSFRodXSwi+93Ch6/DajFV7ClPRf7xXJgjN0y27xQJ+V/x z4+Wh+WjoE+BObsYGf3M7wAALTB+sR5e X-Received: by 10.223.170.140 with SMTP id h12mr16140426wrc.79.1502737955774; Mon, 14 Aug 2017 12:12:35 -0700 (PDT) MIME-Version: 1.0 Sender: nbari@codigo.io Received: by 10.223.146.161 with HTTP; Mon, 14 Aug 2017 12:12:35 -0700 (PDT) X-Originating-IP: [91.64.191.181] In-Reply-To: <8888acfa-4dc8-a68f-8ca8-c4df84e5e74a@yandex.com> References: <8888acfa-4dc8-a68f-8ca8-c4df84e5e74a@yandex.com> From: Nicolas Embriz Date: Mon, 14 Aug 2017 21:12:35 +0200 X-Google-Sender-Auth: P2fMcU9byy2CslrxqywfkVtyC7E Message-ID: Subject: Re: Install FreeBSD from source into VM image To: Panagiotes Mousikides Cc: FreeBSD Current , "freebsd-hackers@freebsd.org" Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 19:12:38 -0000 Hi, maybe this can help you to start https://fabrik.red, https://github.com/fabrik-red/images a set of scripts to create an image. regards. On Mon, Aug 14, 2017 at 8:42 PM, Panagiotes Mousikides wrote: > Hello everybody! > > I am working on the FreeBSD test suite, and need to create an image file > from source. How can I do that? > > I need to run something similar to make installkernel && make installworld > with an image file as the target, such that the end result is a ready-made > FreeBSD system that can be started up with bhyve. How can I do that, > including creating the correct /etc files, and the correct boot code and > partitioning? > > Following the FreeBSD handbook [0] didn't work, as that concerns updating > the current system from source only. > > [0]: https://www.freebsd.org/doc/handbook/makeworld.html > > Any help would be kindly appreciated! > > Best regards, > Panagiotes > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > From owner-freebsd-hackers@freebsd.org Tue Aug 15 04:26:40 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 13BACDDE5D4 for ; Tue, 15 Aug 2017 04:26:40 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: from asp.reflexion.net (outbound-mail-210-82.reflexion.net [208.70.210.82]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B849982670 for ; Tue, 15 Aug 2017 04:26:38 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: (qmail 15817 invoked from network); 15 Aug 2017 04:24:56 -0000 Received: from unknown (HELO mail-cs-02.app.dca.reflexion.local) (10.81.19.2) by 0 (rfx-qmail) with SMTP; 15 Aug 2017 04:24:56 -0000 Received: by mail-cs-02.app.dca.reflexion.local (Reflexion email security v8.40.2) with SMTP; Tue, 15 Aug 2017 00:19:57 -0400 (EDT) Received: (qmail 11288 invoked from network); 15 Aug 2017 04:19:57 -0000 Received: from unknown (HELO iron2.pdx.net) (69.64.224.71) by 0 (rfx-qmail) with (AES256-SHA encrypted) SMTP; 15 Aug 2017 04:19:57 -0000 Received: from [192.168.1.26] (c-76-115-7-162.hsd1.or.comcast.net [76.115.7.162]) by iron2.pdx.net (Postfix) with ESMTPSA id ED45CEC7B2C; Mon, 14 Aug 2017 21:19:56 -0700 (PDT) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: poudriere use vs. later having debug information and source around in case of problems Message-Id: Date: Mon, 14 Aug 2017 21:19:56 -0700 To: Bryan Drewery , FreeBSD Toolchain , freebsd-hackers X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Aug 2017 04:26:40 -0000 I've been exploring ports-mgmt/poudriere-devel use, not for building all the ports or huge sets of them but for building those comparatively few that I normally build and install because I use them. Historically I have used: portmaster -DK to leave source code and build materials around for reference in case of problems, leaving them where the debug information then indicates. (Of course more is left around than may be needed but I have the storage space to allow this.) I've also built with debug information (but avoiding disabling optimizations). Currently I do this via adding to /usr/ports/Mk/bsd.port.mk a: ALLOW_OPTIMIZATIONS_FOR_WITH_DEBUG to control the behavior and avoiding WITH_DEBUG for ports that give it problematical alternate interpretations ( webkit-qt5* back when I was using it and llvm* ). In /etc/make.conf this use looks like: #From a local /usr/ports/Mk/bsd.port.mk extension: ALLOW_OPTIMIZATIONS_FOR_WITH_DEBUG= # .if ${.CURDIR:M*/devel/llvm*} #WITH_DEBUG= .elif ${.CURDIR:M*/www/webkit-qt5*} #WITH_DEBUG= .else WITH_DEBUG= .endif MALLOC_PRODUCTION= In bsd.port.mk it looks like: # svnlite diff /usr/ports/Mk/bsd.port.mk Index: /usr/ports/Mk/bsd.port.mk =================================================================== --- /usr/ports/Mk/bsd.port.mk (revision 447082) +++ /usr/ports/Mk/bsd.port.mk (working copy) @@ -1645,7 +1645,11 @@ STRIP_CMD= ${TRUE} .endif DEBUG_FLAGS?= -g +.if defined(ALLOW_OPTIMIZATIONS_FOR_WITH_DEBUG) +CFLAGS:= ${CFLAGS} ${DEBUG_FLAGS} +.else CFLAGS:= ${CFLAGS:N-O*:N-fno-strict*} ${DEBUG_FLAGS} +.endif .if defined(INSTALL_TARGET) INSTALL_TARGET:= ${INSTALL_TARGET:S/^install-strip$/install/g} .endif (Noted just to give an idea of the context.) So far I do not see a way of using poudriere to leave the material in place to support debug activity and source inspections and the like if a program later fails. (Note this is not about build-time failures.) Have I missed something? Are there any hooks for doing such? === Mark Millard markmi at dsl-only.net From owner-freebsd-hackers@freebsd.org Wed Aug 16 03:38:27 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2274DDE3742 for ; Wed, 16 Aug 2017 03:38:27 +0000 (UTC) (envelope-from list@execve.net) Received: from lax012.relay.arandomserver.com (lax012.relay.arandomserver.com [198.252.106.48]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E671E6D72B for ; Wed, 16 Aug 2017 03:38:26 +0000 (UTC) (envelope-from list@execve.net) Received: from sng001.hawkhost.com ([119.81.196.36]) by se003.arandomserver.com with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.89) (envelope-from ) id 1dhp9q-0005DG-1P for freebsd-hackers@freebsd.org; Tue, 15 Aug 2017 22:38:20 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=execve.net; s=default; h=Content-Type:Cc:To:Subject:Message-ID:Date:From:References: In-Reply-To:MIME-Version:Sender:Reply-To:Content-Transfer-Encoding:Content-ID :Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To: Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe :List-Post:List-Owner:List-Archive; bh=2YKvwr+FYwdq35Ewu3rjBXP2K4WfDBmVFxYD40d66IQ=; b=n+mqRxQvf7jAsy29Gc/ZEJb9Mg nTQGHapRxr8Y0pEWcb25gVrUf5lYAEGYi39lBN0TXbdDn0sgj11DTGBxRJj3JrjSFyVYI7L61v9lZ vVhff15wY73f9CiwTF38Eo2xU; Received: from mail-yw0-f169.google.com ([209.85.161.169]:33790) by sng001.hawkhost.com with esmtpsa (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128) (Exim 4.89) (envelope-from ) id 1dhp9m-002WiT-W3 for freebsd-hackers@freebsd.org; Wed, 16 Aug 2017 11:38:11 +0800 Received: by mail-yw0-f169.google.com with SMTP id p68so15716963ywg.0 for ; Tue, 15 Aug 2017 20:38:10 -0700 (PDT) X-Gm-Message-State: AHYfb5gxd+VrwbBGHsHKtRANbxENcANegiRLtYjXFv485yP32sfQMvEW hH3nDOOEdIkh4oWfSVMwnEV8zvFIAA== X-Received: by 10.129.166.130 with SMTP id d124mr248448ywh.342.1502854689406; Tue, 15 Aug 2017 20:38:09 -0700 (PDT) MIME-Version: 1.0 Received: by 10.37.20.135 with HTTP; Tue, 15 Aug 2017 20:38:08 -0700 (PDT) In-Reply-To: References: <598ADB65.8060701@grosbein.net> From: Gautam Date: Wed, 16 Aug 2017 09:08:08 +0530 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Freebsd 11.0 - system freeze on intensive I/O To: Warner Losh Cc: freebsd-hackers X-Originating-IP: 119.81.196.36 X-SpamExperts-Domain: sng001.hawkhost.com X-SpamExperts-Username: relay Authentication-Results: arandomserver.com; auth=pass (login) smtp.auth=relay@sng001.hawkhost.com X-SpamExperts-Outgoing-Class: ham X-SpamExperts-Outgoing-Evidence: Combined (0.06) X-Recommended-Action: accept X-Filter-ID: PqwsvolAWURa0gwxuN3S5YEa3T7JuZT23fGO2rGt3ZiEh/Q2y0dK8jSMLTE55fwqH0Nprjby6XDb qzVlIOQ03kAwPN4M+BNtq20Hh3O6Az9ismS84NPFas3IWADbmzJ9CZryIsNFvaBrlzs70sT7iKmx j3Zz/WM/IwRyPjIHIwDyYBCz7y6+JbUXRmxDo5gVYAaY7Fh7D0FeMimNXOyfBh5e973vehgRRMJd d1x498Qq4U4e8tvTFrEqtdOukU7DGzcWMr0czofRVh8rMXrt/SyLxLEJIkbWABkyXJwBVLal3W+/ PI81P534n3yak4n7EfJL2hMI4yCDSSr/HxDyN5bD8YyxjFtJAz2loLb4we0tFPPhpWPZ07PAOr0y wYIXuCj9wj08m7429e2ZOl/ZXvNM2/zURZVxzSV/eszOttj6AVIvY+ILsI7br1ka/ZVMCHna6kKG M93r44iJ/OLHS8Ir9uceKeUgExm45FTVrVmVu34H+eqH7iWBpUrKGrffGcXZKnwjnRMG9jJ/knTt +XiA50wwIMuM3BDtnoPm4HpIizaH26GaoEDwTtnQE6q4ZRNP3CPS3YZT5ODGEA+uOpLZY+4z/dwR ocCZGdc1cl9f9x/pKLS918QV+MmO1bAAEgjXIny51RJ3yyIOVX71wEukYspuIwswojsoiyB8OuXo nV+E7OMXRvgtdyMlnmWi9uF4/xGeHumbSXx1nykjkg3q5Go+y6UPrDLg9O+nbQGGK6KbSnjG5GpR nEf9H5gqQnTIgDfxZ2/WGqYvyOVteVOdo6Dvr8fbMJVJ9/erL6/4IvMfhB2h/z0m0D607pH+pWX8 JH76UCDHe+VBXhtjrZr9RUQzcLUz45TvUuLctG5L8ZHLV0zHQOMuxVjpDkV6 X-Report-Abuse-To: spam@se001.arandomserver.com Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Aug 2017 03:38:27 -0000 Hi, On Sat, Aug 12, 2017 at 8:53 PM, Warner Losh wrote: > > > On Fri, Aug 11, 2017 at 11:17 PM, Gautam wrote: > >> > =E2=80=8BOne update on this one. I installed a custom stable/11 kernel= and world >> (sched =3D 4BSD was the only change), and the problem >> is no longer seen. From my untrained eyes, it looks like some kind of sw= ap >> request starvation causing a hang when ULE is in use.=E2=80=8B >> > > I did some patches a few years ago that separated out geom requests into > their own uma map, if you wanted and hacked the swap pager to use that to > ensure that it always had BIOs available to do it's I/O. Maybe I should > dust them off and see if they help you. They didn't seem to help me too > much, but didn't hurt too much either. > > There's still the issue of some drivers not pre-allocating requests, whic= h > is what makes the deadlock possible in the first place. > > Warner > > I would be willing to try the patches and report back - although my understanding of FreeBSD inter=E2=80=8Bnals is next to zero; but can surely= try. =E2=80=8BThanks, Gautam =E2=80=8B From owner-freebsd-hackers@freebsd.org Wed Aug 16 12:57:31 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 88F8FDDA6B9; Wed, 16 Aug 2017 12:57:31 +0000 (UTC) (envelope-from paggas1@yandex.com) Received: from forward102j.mail.yandex.net (forward102j.mail.yandex.net [IPv6:2a02:6b8:0:801:2::102]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "forwards.mail.yandex.net", Issuer "Yandex CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 403C6822CE; Wed, 16 Aug 2017 12:57:31 +0000 (UTC) (envelope-from paggas1@yandex.com) Received: from mxback5g.mail.yandex.net (mxback5g.mail.yandex.net [IPv6:2a02:6b8:0:1472:2741:0:8b7:166]) by forward102j.mail.yandex.net (Yandex) with ESMTP id 42A0156039FD; Wed, 16 Aug 2017 15:57:27 +0300 (MSK) Received: from smtp2p.mail.yandex.net (smtp2p.mail.yandex.net [2a02:6b8:0:1472:2741:0:8b6:7]) by mxback5g.mail.yandex.net (nwsmtp/Yandex) with ESMTP id 34GbflkV8K-vRoCI82p; Wed, 16 Aug 2017 15:57:27 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.com; s=mail; t=1502888247; bh=NkwE5CrTfie/hITH7u+LgZQ9tTX/QWJM03tMQFxHSeo=; h=Subject:To:References:From:Message-ID:Date:In-Reply-To; b=VPDL3mbK9EkyeLScmLcA47K/mAFi0FZ2GVC3sfx62bekgBjllMOUQF7oN1YAiSENI R1BneKa+BkBOz+yo2yfAQsSzUYC+M68TVfR4zG/hd1m1Cn84d2nFoU7hgwZPN1Qgod 10XoY5bQjDofmIWqtGJeFvzwTzyj/bgud1brvx0I= Received: by smtp2p.mail.yandex.net (nwsmtp/Yandex) with ESMTPSA id 4Z2x1DThGp-vQdWHAlZ; Wed, 16 Aug 2017 15:57:26 +0300 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client certificate not present) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.com; s=mail; t=1502888246; bh=NkwE5CrTfie/hITH7u+LgZQ9tTX/QWJM03tMQFxHSeo=; h=Subject:To:References:From:Message-ID:Date:In-Reply-To; b=dXxjTTkIGnnCUbMjZjajoaGycrphAjNwfUt1qbK8u+73R/Cq5pnIhva5H9EYAksaf yFVtK31h56jvwE09hQdl4nom5npYuBvYhhlkT72iXHoLPic8nxQQ+Vd7m2fsmf3fAz M9zn4AHxvBxnXd9MgjabX8+gQtD4iuEnEjOtMHHM= Authentication-Results: smtp2p.mail.yandex.net; dkim=pass header.i=@yandex.com Subject: Re: Install FreeBSD from source into VM image To: Matt Joras , FreeBSD Current , "freebsd-hackers@freebsd.org" References: <8888acfa-4dc8-a68f-8ca8-c4df84e5e74a@yandex.com> <97d0475c-9603-03d8-144d-dc803e5530c7@FreeBSD.org> From: Panagiotes Mousikides Message-ID: <9152fc29-125d-1c01-ecfa-740a1cfcaadd@yandex.com> Date: Wed, 16 Aug 2017 12:57:25 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: <97d0475c-9603-03d8-144d-dc803e5530c7@FreeBSD.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Aug 2017 12:57:31 -0000 Den 2017-08-14 kl. 18:49, skrev Matt Joras: > On 08/14/2017 11:42, Panagiotes Mousikides wrote: >> I am working on the FreeBSD test suite, and need to create an image >> file from source. How can I do that? >> >> I need to run something similar to make installkernel && make >> installworld with an image file as the target, such that the end >> result is a ready-made FreeBSD system that can be started up with >> bhyve. How can I do that, including creating the correct /etc files, >> and the correct boot code and partitioning? >> > See release(7), https://www.freebsd.org/cgi/man.cgi?release(7). The > relevant section is under virtual machine disk images and the vm-image > target. The VMFORMATS for bhyve is "raw". That will generate an image > that "just works" with vmrun.sh > > Matt Joras > Hi Matt! Thank you so much for the tip! I tried what you recommended, the command I ran specifically was (inside release/) sudo make vm-image WITH_VMIMAGES=1 VMBASE=aaaa VMSIZE=2G VMFORMATS=raw VMSIZE=2G vm-image followed by sudo sh /usr/share/examples/bhyve/vmrun.sh -d aaaa.raw vm-aaaa but apparently the image generated doesn't work. The error I'm getting after hitting "1" at the boot screen is Error return from kevent monitor: Not permitted in capability mode repeatedly cascading through the screen. Any ideas? I would greatly appreciate your help! Best regards, Panagiotes From owner-freebsd-hackers@freebsd.org Wed Aug 16 18:39:06 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4CF0DDC7FE7 for ; Wed, 16 Aug 2017 18:39:06 +0000 (UTC) (envelope-from otacilio.neto@bsd.com.br) Received: from mail-qk0-x232.google.com (mail-qk0-x232.google.com [IPv6:2607:f8b0:400d:c09::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 10EEF6A547 for ; Wed, 16 Aug 2017 18:39:05 +0000 (UTC) (envelope-from otacilio.neto@bsd.com.br) Received: by mail-qk0-x232.google.com with SMTP id z18so25031190qka.4 for ; Wed, 16 Aug 2017 11:39:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsd.com.br; s=capeta; h=to:from:subject:message-id:date:user-agent:mime-version :content-transfer-encoding; bh=Hm797aw1iBGuOHh93qr0+1EKx5iDsRVeY4SIRnb4y+w=; b=XvKAQ3Fl5itOIXgSPLgg2ud+GqA3QYQJQAD2mOGwIJYfaO2QfMEzKNsYO9CY+vZvfA XUvhc1QLwC1u5P6kyabA+zWcl3OuLrQEQqCDjQvVNUoV8N38x4dGCU0YovmLTglnpsY6 uZKEhSk/hr1MophMPhKDCGOV0mAwGYOFkQ7cU= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version:content-transfer-encoding; bh=Hm797aw1iBGuOHh93qr0+1EKx5iDsRVeY4SIRnb4y+w=; b=r5WbrwJJ2fPABSm0BzyG3TVYXtnMXQJt6Scoawk3775Ivf08mq7seLZJxWkZf710bb jnaHD1effhuml7d1Nci3iBG2v8jVEBfDxMfr2MQ5x7jMgVICTJLmCebbdpPtCW3hbcaY DxRwDz3WcVq3f9BrpFuK9aeyIzMCgTpTleIRRR7TovIr85guylJHqg70qUqRTkN0aWj+ gaEwk7vevX6tAd8+98CED1p91OKOM0N4xzdtc7rpEaBWW4XlodzLfPks0kncCT72buAm bYkzak4tGGm9zZ7ZOAEde3SHdceiPWJEnqbCQuO7GJ4RMgtO6Mc8z9zcNXlOZiDf8G6E 6Gbw== X-Gm-Message-State: AHYfb5gXJXYnK61UKqyIBQAD0ptGQ4MD6hDYt1p6RvBa7GwNy6Zqxshe 5yO6f/l3UEnOguv3SmE= X-Received: by 10.55.170.77 with SMTP id t74mr3341271qke.201.1502908744361; Wed, 16 Aug 2017 11:39:04 -0700 (PDT) Received: from [10.51.217.220] ([177.20.157.69]) by smtp.googlemail.com with ESMTPSA id f187sm893470qkb.97.2017.08.16.11.39.00 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 16 Aug 2017 11:39:03 -0700 (PDT) To: "freebsd-hackers@freebsd.org" From: =?UTF-8?B?T3RhY8OtbGlv?= Subject: apropos: dbm_map(mandoc.db): Obsolete format based on SQLite 3 Message-ID: <4d591335-3b4a-45d1-ea21-34cb924a59e4@bsd.com.br> Date: Wed, 16 Aug 2017 15:38:56 -0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Aug 2017 18:39:06 -0000 Hello Every time I run the apropos on aFreeBSD 11.1 machine I'm getting this error message before informing whether or not something appropriate exists. apropos: dbm_map (mandoc.db): Obsolete format based on SQLite 3 apropos: /usr/local/man/mandoc.db: Inappropriate file type or format This machine was upgraded from FreeBSD 11. In a other machine, FreeBSD 10.3, I do not get this error message. Does anyone know how to solve this? []'s -Otacilio From owner-freebsd-hackers@freebsd.org Wed Aug 16 20:31:35 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6087FDCF06E for ; Wed, 16 Aug 2017 20:31:35 +0000 (UTC) (envelope-from mpp302@gmail.com) Received: from mail-lf0-f43.google.com (mail-lf0-f43.google.com [209.85.215.43]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E648B6E93D for ; Wed, 16 Aug 2017 20:31:34 +0000 (UTC) (envelope-from mpp302@gmail.com) Received: by mail-lf0-f43.google.com with SMTP id t128so21590337lff.2 for ; Wed, 16 Aug 2017 13:31:34 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:cc:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=iHWhqI/JchkgaqZhmxiDZ9ECphQnCdg1dzsHUk7MKMA=; b=Ae3P6tZUFLwddh3wuNmdoo5i6Fo/7RB5uHMVv3uKsuE1HzVmhBZiDJvyW3qdeOAHSk DkV6PnBg6gYUnoATDRVr6Pz70yj8woNOKofu5wvk1jQD6PYFbV5rEBvpjqGu2tXNzOGW sMtGoct+m24gXetfbGd7fhcPYn+S3terhtnXYrwwieropw6Hu0KaVm/iOYxBf1yyccIG wPoao2A1dBblcvhOTGw1XxDttFx8EpV17szl20wzjlpWDp1ocqE6XRY7xMfXwdB+plbt lKBx+Q9dvu0kxBADFo/HHMreovBv/82vK413XdrxO1K8u/ALb/A8BC0IkwYV/1jbxHyK IV+A== X-Gm-Message-State: AHYfb5jdiIRN8FAdsYzVD6gg0aGCgHUJnF1YCwpZOnIcM5D3LI3VpXMi 6h9Ce6Z7eu4+nzK+dJ8= X-Received: by 10.25.151.209 with SMTP id z200mr1145967lfd.198.1502913605663; Wed, 16 Aug 2017 13:00:05 -0700 (PDT) Received: from [192.168.1.105] (89-76-8-18.dynamic.chello.pl. [89.76.8.18]) by smtp.gmail.com with ESMTPSA id u78sm393721lfg.93.2017.08.16.13.00.04 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 16 Aug 2017 13:00:05 -0700 (PDT) Subject: Re: apropos: dbm_map(mandoc.db): Obsolete format based on SQLite 3 To: freebsd-hackers@freebsd.org References: <4d591335-3b4a-45d1-ea21-34cb924a59e4@bsd.com.br> From: Mateusz Piotrowski <0mp@FreeBSD.org> Cc: otacilio.neto@bsd.com.br Message-ID: <8fef3223-3e5e-3d13-7025-c44dbf131f30@FreeBSD.org> Date: Wed, 16 Aug 2017 22:00:04 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: <4d591335-3b4a-45d1-ea21-34cb924a59e4@bsd.com.br> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Aug 2017 20:31:35 -0000 Hi, On 16/08/17 20:38, Otacílio wrote: > This machine was upgraded from FreeBSD 11. In a other machine, FreeBSD > 10.3, I do not get this error message. Does anyone know how to solve > this? I had a similar problem with `apropos`, `man -k` and `whatis`. The solution was to run makewhatis(1). The "freebsd-update and whatis" thread on the FreeBSD forums [1] was particularly useful to me. Cheers, Mateusz [1]: https://forums.freebsd.org/threads/53194/ From owner-freebsd-hackers@freebsd.org Wed Aug 16 22:41:52 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6F572DD7087; Wed, 16 Aug 2017 22:41:52 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from mail.baldwin.cx (bigwig.baldwin.cx [96.47.65.170]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4622472D35; Wed, 16 Aug 2017 22:41:51 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from ralph.baldwin.cx (c-73-231-226-104.hsd1.ca.comcast.net [73.231.226.104]) by mail.baldwin.cx (Postfix) with ESMTPSA id 0394510AF07; Wed, 16 Aug 2017 18:41:49 -0400 (EDT) From: John Baldwin To: freebsd-current@freebsd.org Cc: Panagiotes Mousikides , Matt Joras , "freebsd-hackers@freebsd.org" , allanjude@freebsd.org, "Peter Grehan (grehan@freebsd.org)" Subject: Re: Install FreeBSD from source into VM image Date: Wed, 16 Aug 2017 15:40:33 -0700 Message-ID: <25569442.iT463nDDSg@ralph.baldwin.cx> User-Agent: KMail/4.14.10 (FreeBSD/11.1-STABLE; KDE/4.14.30; amd64; ; ) In-Reply-To: <9152fc29-125d-1c01-ecfa-740a1cfcaadd@yandex.com> References: <8888acfa-4dc8-a68f-8ca8-c4df84e5e74a@yandex.com> <97d0475c-9603-03d8-144d-dc803e5530c7@FreeBSD.org> <9152fc29-125d-1c01-ecfa-740a1cfcaadd@yandex.com> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (mail.baldwin.cx); Wed, 16 Aug 2017 18:41:49 -0400 (EDT) X-Virus-Scanned: clamav-milter 0.99.2 at mail.baldwin.cx X-Virus-Status: Clean X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Aug 2017 22:41:52 -0000 On Wednesday, August 16, 2017 12:57:25 PM Panagiotes Mousikides wrote: > Den 2017-08-14 kl. 18:49, skrev Matt Joras: > > On 08/14/2017 11:42, Panagiotes Mousikides wrote: > >> I am working on the FreeBSD test suite, and need to create an image > >> file from source. How can I do that? > >> > >> I need to run something similar to make installkernel && make > >> installworld with an image file as the target, such that the end > >> result is a ready-made FreeBSD system that can be started up with > >> bhyve. How can I do that, including creating the correct /etc files, > >> and the correct boot code and partitioning? > >> > > See release(7), https://www.freebsd.org/cgi/man.cgi?release(7). The > > relevant section is under virtual machine disk images and the vm-image > > target. The VMFORMATS for bhyve is "raw". That will generate an image > > that "just works" with vmrun.sh > > > > Matt Joras > > > Hi Matt! > > Thank you so much for the tip! I tried what you recommended, the > command I ran specifically was (inside release/) > > sudo make vm-image WITH_VMIMAGES=1 VMBASE=aaaa VMSIZE=2G > VMFORMATS=raw VMSIZE=2G vm-image > > followed by > > sudo sh /usr/share/examples/bhyve/vmrun.sh -d aaaa.raw vm-aaaa > > but apparently the image generated doesn't work. The error I'm getting > after hitting "1" at the boot screen is > > Error return from kevent monitor: Not permitted in capability mode > > repeatedly cascading through the screen. Any ideas? I would greatly > appreciate your help! This sounds like an issue with the bhyve capsicum work. I've cc'd Allan and Peter who might be able to help track that down. It might be useful if you can run bhyve under ktrace, e.g.: sudo ktrace -i -t p sh /usr/share/examples/bhyve/vmrun.sh -d aaaa.raw vm-aaaa And then post the output of 'sudo kdump' -- John Baldwin From owner-freebsd-hackers@freebsd.org Wed Aug 16 23:40:37 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B9F2EDDA829 for ; Wed, 16 Aug 2017 23:40:37 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 78E0A74D1D for ; Wed, 16 Aug 2017 23:40:37 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id 2B47920ADBEF for ; Thu, 17 Aug 2017 09:40:30 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 20456281F28 for ; Thu, 17 Aug 2017 09:40:30 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id kvUZUEqhqcyc for ; Thu, 17 Aug 2017 09:40:29 +1000 (AEST) Received: from Peters-MacBook-Pro-2.local (96-82-80-65-static.hfc.comcastbusiness.net [96.82.80.65]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id C98E128099E; Thu, 17 Aug 2017 09:40:26 +1000 (AEST) Subject: Re: Install FreeBSD from source into VM image To: John Baldwin , freebsd-current@freebsd.org Cc: Panagiotes Mousikides , Matt Joras , "freebsd-hackers@freebsd.org" , allanjude@freebsd.org References: <8888acfa-4dc8-a68f-8ca8-c4df84e5e74a@yandex.com> <97d0475c-9603-03d8-144d-dc803e5530c7@FreeBSD.org> <9152fc29-125d-1c01-ecfa-740a1cfcaadd@yandex.com> <25569442.iT463nDDSg@ralph.baldwin.cx> From: Peter Grehan Message-ID: Date: Wed, 16 Aug 2017 16:40:23 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: <25569442.iT463nDDSg@ralph.baldwin.cx> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.2 cv=XKlAcUpE c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=mwgbnDbW7alINpy3vhoKyg==:17 a=IkcTkHD0fZMA:10 a=KeKAF7QvOSUA:10 a=a-xowN3dLo-_p0TWiDMA:9 a=QEXdDO2ut3YA:10 wl=host:3 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Aug 2017 23:40:37 -0000 >> Error return from kevent monitor: Not permitted in capability mode ... > This sounds like an issue with the bhyve capsicum work. I've cc'd Allan > and Peter who might be able to help track that down. It might be useful > if you can run bhyve under ktrace, e.g.: > > sudo ktrace -i -t p sh /usr/share/examples/bhyve/vmrun.sh -d aaaa.raw vm-aaaa > > And then post the output of 'sudo kdump' I think this is the error now returned when a file doesn't exist or can't be accessed - the code probably needs to be reworked to test for existence before entering capability mode to make the error more meaningful. later, Peter. From owner-freebsd-hackers@freebsd.org Thu Aug 17 07:16:52 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DB963DD2006 for ; Thu, 17 Aug 2017 07:16:52 +0000 (UTC) (envelope-from fernando.apesteguia@gmail.com) Received: from mail-lf0-x22a.google.com (mail-lf0-x22a.google.com [IPv6:2a00:1450:4010:c07::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5ECAD655FD for ; Thu, 17 Aug 2017 07:16:52 +0000 (UTC) (envelope-from fernando.apesteguia@gmail.com) Received: by mail-lf0-x22a.google.com with SMTP id y15so25765512lfd.5 for ; Thu, 17 Aug 2017 00:16:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=abom8GePp1zGEzGRPxC/PdohFV+xqMOVsIje2LLeCgA=; b=Zpgd1ZdUcMU5gglAbArXTJgkkoRb2lB+PASdkHFNmmF3Xu6s1SiOLnLDvXD6hpLINI Ks8IKKk9ZEdrFwhIL2T542UhUOU/25/O9M3t8IVJ7A2MAyvLqOlXe+HyS20l8/IiCOg5 ZzoLiDTGsHbAn/4rMCS7J21eVEOW6SwN02h7FZW5SEH4SGma0+PN3C/KLqEXOKPUa3P5 A4wnmkUP2bfP9YoyfWL+XA7s3rXXG4Fs85m62LCKwNptxJ5akwQvreQxc25Vz4ErA8s1 2T4tMgFNAAQFJyR+vTDpRkq0STM4TU+qFO0bibmysk6uEdcNPfNhiYTtD2T0l+pLzvRR pIoA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=abom8GePp1zGEzGRPxC/PdohFV+xqMOVsIje2LLeCgA=; b=lnmCaRwvctqFM+Fn/NLhbYciSnRYHRpRmO0s+aDt690AxeWd4WNApokx5Zne2TcOXK W9K7vQBAAGsRZecT2AUtdxpmdXTtu4O5MuuWJhdfQD4WKiOaxOiLlG34uVw0MqUNBCPu 30GB7pQlY6AJR/GS/FC3ILbPjyQ68EUdSbRx/uHRX/QheJGtujtFmPp9RpFeFG3JFS3X HWJ0mxJNZNv7NnmH8ufk4WTppJo6o5V7464gHzTk5M5jRpZwxrpcdj6w3ztxu7U7eqrB jaJ2FSTOmw2kIf1O50rsSGpGc+LaMyXfzX5S5/D0bLQQGoZ5sbt8QWZuXFlvOiuF6e+X JwYQ== X-Gm-Message-State: AHYfb5iMyDOS5AqE5MooXSujjKskcMDdeJ4mV5UgoufoJyy/fjEN1v04 tcxY8ELfrBGDjOvlcxk5pipuVRDOGA== X-Received: by 10.25.18.81 with SMTP id h78mr1593159lfi.142.1502954210072; Thu, 17 Aug 2017 00:16:50 -0700 (PDT) MIME-Version: 1.0 Received: by 10.25.229.2 with HTTP; Thu, 17 Aug 2017 00:16:49 -0700 (PDT) Received: by 10.25.229.2 with HTTP; Thu, 17 Aug 2017 00:16:49 -0700 (PDT) In-Reply-To: References: From: =?UTF-8?Q?Fernando_Apestegu=C3=ADa?= Date: Thu, 17 Aug 2017 09:16:49 +0200 Message-ID: Subject: Clang crashes on -CURRENT while compiling port To: FreeBSD Hackers Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Aug 2017 07:16:53 -0000 One of my ports (cad/openvsp) fails to compile in -CURRENT. The port only compiles with gcc on < 12. As part of the debugging I changed to compile with clang. The compiler crashed while compiling the port with the following error: fatal error: error in backend: No open frame c++: error: clang frontend command failed with exit code 70 Compiler version is: freebsd clang version 5.0.0 (brances/release_50 309439) I can send the as_callfunc* upon request. How to reproduce: Change compiler:gcc-c++11-lib to compiler:c++14-lang in port's Makefile Change src/external/glfont2/CMakeLists.txt and add /usr/local/include (for some reason clang doesn't find GL/gl.h while gcc does...) I can open a PR if necessary. Cheers P.S: I don't know if this belongs to freebsd-hackers@ since it is related to -CURRENT or if it belongs to freebsd-ports@ From owner-freebsd-hackers@freebsd.org Thu Aug 17 09:41:15 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 94E64DD790C for ; Thu, 17 Aug 2017 09:41:15 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from tensor.andric.com (tensor.andric.com [87.251.56.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "tensor.andric.com", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 56E6569BB2 for ; Thu, 17 Aug 2017 09:41:14 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from [10.42.0.10] (springbank.echomania.com [149.210.134.147]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by tensor.andric.com (Postfix) with ESMTPSA id C3B70233F9; Thu, 17 Aug 2017 11:41:05 +0200 (CEST) From: Dimitry Andric Message-Id: Content-Type: multipart/signed; boundary="Apple-Mail=_038B7387-928E-4163-BD54-55685B7782A7"; protocol="application/pgp-signature"; micalg=pgp-sha1 Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: Clang crashes on -CURRENT while compiling port Date: Thu, 17 Aug 2017 11:41:04 +0200 In-Reply-To: Cc: FreeBSD Hackers To: =?utf-8?Q?Fernando_Apestegu=C3=ADa?= References: X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Aug 2017 09:41:15 -0000 --Apple-Mail=_038B7387-928E-4163-BD54-55685B7782A7 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 On 17 Aug 2017, at 09:16, Fernando Apestegu=C3=ADa = wrote: >=20 > One of my ports (cad/openvsp) fails to compile in -CURRENT. The port > only compiles with gcc on < 12. As part of the debugging I changed to > compile with clang. >=20 > The compiler crashed while compiling the port with the following = error: >=20 > fatal error: error in backend: No open frame > c++: error: clang frontend command failed with exit code 70 >=20 > Compiler version is: >=20 > freebsd clang version 5.0.0 (brances/release_50 309439) >=20 > I can send the as_callfunc* upon request. Please create a PR, and attach the two files (.cpp and .sh) it drops in = /tmp. -Dimitry --Apple-Mail=_038B7387-928E-4163-BD54-55685B7782A7 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.1 iF0EARECAB0WIQR6tGLSzjX8bUI5T82wXqMKLiCWowUCWZVksAAKCRCwXqMKLiCW o2KPAJ9rZDybFs2fyxKG3U3d69OMTCmuYwCg2CvN/CxgOYvmFMoHYcYkt/k1JVo= =EGsY -----END PGP SIGNATURE----- --Apple-Mail=_038B7387-928E-4163-BD54-55685B7782A7-- From owner-freebsd-hackers@freebsd.org Thu Aug 17 11:44:30 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E3537DDCF02; Thu, 17 Aug 2017 11:44:30 +0000 (UTC) (envelope-from paggas1@yandex.com) Received: from forward104j.mail.yandex.net (forward104j.mail.yandex.net [5.45.198.247]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "forwards.mail.yandex.net", Issuer "Yandex CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 79EE06DD0C; Thu, 17 Aug 2017 11:44:30 +0000 (UTC) (envelope-from paggas1@yandex.com) Received: from mxback9o.mail.yandex.net (mxback9o.mail.yandex.net [IPv6:2a02:6b8:0:1a2d::23]) by forward104j.mail.yandex.net (Yandex) with ESMTP id 7071A42CAA; Thu, 17 Aug 2017 14:44:19 +0300 (MSK) Received: from smtp1o.mail.yandex.net (smtp1o.mail.yandex.net [2a02:6b8:0:1a2d::25]) by mxback9o.mail.yandex.net (nwsmtp/Yandex) with ESMTP id 4UhX5cV8DM-iJMur3Ro; Thu, 17 Aug 2017 14:44:19 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.com; s=mail; t=1502970259; bh=lyP/w+o89DIhmpQ1vPHjQ3Dh7rKg462qr6xrptsUMro=; h=Subject:To:Cc:References:From:Message-ID:Date:In-Reply-To; b=Uflf5kHMNvR8OW2EWIVNGWxkvpppC1c2pyfJ1MuGJq6R57/ODHgpE+qrtgZcrh7dT wtUsx7ZC2TlrMgExJqNQDk8KjZOT9aO1eCHsJGeYXMgmg6dvFnOk/9fvsI9Z/1ImCU R5wffHxiutGhm8PozeQT12/gup7VgXvUd1SKjmKI= Received: by smtp1o.mail.yandex.net (nwsmtp/Yandex) with ESMTPSA id d3gXdrmb2x-iI1SYplq; Thu, 17 Aug 2017 14:44:18 +0300 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client certificate not present) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.com; s=mail; t=1502970258; bh=lyP/w+o89DIhmpQ1vPHjQ3Dh7rKg462qr6xrptsUMro=; h=Subject:To:Cc:References:From:Message-ID:Date:In-Reply-To; b=yEpw5HdyMfa0Vn8VN9d6IvnVXmpIftz6GK0hABSK5t04dNLKSgzzzL4KFfVEiHBG2 Xqm2paepjoQdfKdS81AO4+p+OYGMzQfH17Et51rfWbQjn0prI++2vhulAxQGqiSkNC QvSyxQgubjCzwd5XKnZpSUrVcdfla3yYSoju1k+I= Authentication-Results: smtp1o.mail.yandex.net; dkim=pass header.i=@yandex.com Subject: Re: Install FreeBSD from source into VM image To: Peter Grehan , John Baldwin , freebsd-current@freebsd.org Cc: Matt Joras , "freebsd-hackers@freebsd.org" , allanjude@freebsd.org References: <8888acfa-4dc8-a68f-8ca8-c4df84e5e74a@yandex.com> <97d0475c-9603-03d8-144d-dc803e5530c7@FreeBSD.org> <9152fc29-125d-1c01-ecfa-740a1cfcaadd@yandex.com> <25569442.iT463nDDSg@ralph.baldwin.cx> From: Panagiotes Mousikides Message-ID: Date: Thu, 17 Aug 2017 11:44:17 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/mixed; boundary="------------BAA8B4F0B7A6DEFF0798B875" Content-Language: en-US X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Aug 2017 11:44:31 -0000 This is a multi-part message in MIME format. --------------BAA8B4F0B7A6DEFF0798B875 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Den 2017-08-16 kl. 23:40, skrev Peter Grehan: >>> Error return from kevent monitor: Not permitted in capability >>> mode > ... >> This sounds like an issue with the bhyve capsicum work. I've cc'd Allan >> and Peter who might be able to help track that down. It might be useful >> if you can run bhyve under ktrace, e.g.: >> >> sudo ktrace -i -t p sh /usr/share/examples/bhyve/vmrun.sh -d >> aaaa.raw vm-aaaa >> >> And then post the output of 'sudo kdump' > > I think this is the error now returned when a file doesn't exist or > can't be accessed - the code probably needs to be reworked to test for > existence before entering capability mode to make the error more > meaningful. > > later, > > Peter. > I did run it with ktrace, which generates a ktrace.out of around 4KB. Needed to kill the VM with bhyvectl --destroy afterwards. But kdump doesn't print anything afterwards! Any ideas? I'm attaching ktrace.out. Best regards, Panagiotes --------------BAA8B4F0B7A6DEFF0798B875 Content-Type: application/octet-stream; name="ktrace.out" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="ktrace.out" BAAAAAoArd6/UAAAa3RyYWNlAAAAAAAAAAAAAAAAAACbgJVZAAAAAL4mCAAAAAAAmYkBAAAA AAAJAgUABAAAAAoArd6/UAAAc2gAAAAAAAAAAAAAAAAAAAAAAACbgJVZAAAAAG4nCAAAAAAA mYkBAAAAAAAJAgUABAAAAAoArd7AUAAAc2gAAAAAAAAAAAAAAAAAAAAAAACbgJVZAAAAADYs CAAAAAAAmIkBAAAAAAAJAgUABAAAAAoArd7AUAAAaWQAAAAAAAAAAAAAAAAAAAAAAACbgJVZ AAAAAJcsCAAAAAAAmIkBAAAAAAAJAgUAAAAAAAsArd7AUAAAaWQAAAAAAAAAAAAAAAAAAAAA AACbgJVZAAAAABQvCAAAAAAAmIkBAAAAAAAEAAAACgCt3sFQAABzaAAAAAAAAAAAAAAAAAAA AAAAAJuAlVkAAAAApC8IAAAAAACYiQEAAAAAAAkCBQAEAAAACgCt3sFQAABrbGRzdGF0AAAA AAAAAAAAAAAAAJuAlVkAAAAAhTAIAAAAAACYiQEAAAAAAAkCBQAAAAAACwCt3sFQAABrbGRz dGF0AAAAAAAAAAAAAAAAAJuAlVkAAAAAMzMIAAAAAACYiQEAAAAAAAQAAAAKAK3ewlAAAHNo AAAAAAAAAAAAAAAAAAAAAAAAm4CVWQAAAACgNAgAAAAAAJiJAQAAAAAACQIFAAQAAAAKAK3e wlAAAGJoeXZlY3RsAAAAAAAAAAAAAAAAm4CVWQAAAACGNQgAAAAAAJiJAQAAAAAACQIFAAAA AAALAK3ewlAAAGJoeXZlY3RsAAAAAAAAAAAAAAAAm4CVWQAAAACZOAgAAAAAAJiJAQAAAAAA BAAAAAoArd7DUAAAc2gAAAAAAAAAAAAAAAAAAAAAAACbgJVZAAAAAI45CAAAAAAAmIkBAAAA AAAJAgUABAAAAAoArd7EUAAAc2gAAAAAAAAAAAAAAAAAAAAAAACbgJVZAAAAAC86CAAAAAAA iIkBAAAAAAAJAgUABAAAAAoArd7EUAAAZ3JlcAAAAAAAAAAAAAAAAAAAAACbgJVZAAAAABs7 CAAAAAAAiIkBAAAAAAAJAgUABAAAAAoArd7DUAAAZmlsZQAAAAAAAAAAAAAAAAAAAACbgJVZ AAAAAK47CAAAAAAAmIkBAAAAAAAJAgUAAAAAAAsArd7EUAAAZ3JlcAAAAAAAAAAAAAAAAAAA AACbgJVZAAAAAJxKCAAAAAAAiIkBAAAAAAAAAAAACwCt3sNQAABmaWxlAAAAAAAAAAAAAAAA AAAAAJuAlVkAAAAAZksIAAAAAACYiQEAAAAAAAQAAAAKAK3exVAAAHNoAAAAAAAAAAAAAAAA AAAAAAAAm4CVWQAAAAAETAgAAAAAAJiJAQAAAAAACQIFAAQAAAAKAK3exVAAAGJoeXZlbG9h ZAAAAAAAAAAAAAAAm4CVWQAAAABrTAgAAAAAAJiJAQAAAAAACQIFAAAAAAALAK3exVAAAGJo eXZlbG9hZAAAAAAAAAAAAAAAnICVWQAAAABnSQoAAAAAAJiJAQAAAAAABAAAAAoArd7PUAAA c2gAAAAAAAAAAAAAAAAAAAAAAACcgJVZAAAAADxKCgAAAAAAmIkBAAAAAAAJAgUABAAAAAoA rd7PUAAAYmh5dmUAAAAAAAAAAAAAAAAAAACcgJVZAAAAAL1KCgAAAAAAmIkBAAAAAAAJAgUA BAAAAAoArd7RUAAAYmh5dmUAAAAAAAAAAAAAAAAAAACcgJVZAAAAAEpaCgAAAAAA9YkBAAAA AAAJAgUABAAAAAoArd7RUAAAc2gAAAAAAAAAAAAAAAAAAAAAAACcgJVZAAAAALBaCgAAAAAA 9YkBAAAAAAAJAgUABAAAAAoArd7RUAAAc2gAAAAAAAAAAAAAAAAAAAAAAACcgJVZAAAAAK9f CgAAAAAA9YkBAAAAAAAJAgUABAAAAAoArd7RUAAAaWFzbAAAAAAAAAAAAAAAAAAAAACcgJVZ AAAAAG1kCgAAAAAA9YkBAAAAAAAJAgUAAAAAAAsArd7RUAAAaWFzbAAAAAAAAAAAAAAAAAAA AACcgJVZAAAAAKFqCgAAAAAA9YkBAAAAAAAEAAAACgCt3tNQAABiaHl2ZQAAAAAAAAAAAAAA AAAAAJyAlVkAAAAANmwKAAAAAAD1iQEAAAAAAAkCBQAEAAAACgCt3tNQAABzaAAAAAAAAAAA AAAAAAAAAAAAAJyAlVkAAAAAj2wKAAAAAAD1iQEAAAAAAAkCBQAEAAAACgCt3tNQAABzaAAA AAAAAAAAAAAAAAAAAAAAAJyAlVkAAAAAaHEKAAAAAAD1iQEAAAAAAAkCBQAEAAAACgCt3tNQ AABpYXNsAAAAAAAAAAAAAAAAAAAAAJyAlVkAAAAAOXYKAAAAAAD1iQEAAAAAAAkCBQAAAAAA CwCt3tNQAABpYXNsAAAAAAAAAAAAAAAAAAAAAJyAlVkAAAAA73wKAAAAAAD1iQEAAAAAAAQA AAAKAK3e1lAAAGJoeXZlAAAAAAAAAAAAAAAAAAAAnICVWQAAAABvfgoAAAAAAPWJAQAAAAAA CQIFAAQAAAAKAK3e1lAAAHNoAAAAAAAAAAAAAAAAAAAAAAAAnICVWQAAAADIfgoAAAAAAPWJ AQAAAAAACQIFAAQAAAAKAK3e1lAAAHNoAAAAAAAAAAAAAAAAAAAAAAAAnICVWQAAAACggwoA AAAAAPWJAQAAAAAACQIFAAQAAAAKAK3e1lAAAGlhc2wAAAAAAAAAAAAAAAAAAAAAnICVWQAA AABsiAoAAAAAAPWJAQAAAAAACQIFAAAAAAALAK3e1lAAAGlhc2wAAAAAAAAAAAAAAAAAAAAA nICVWQAAAABnjgoAAAAAAPWJAQAAAAAABAAAAAoArd7YUAAAYmh5dmUAAAAAAAAAAAAAAAAA AACcgJVZAAAAANGPCgAAAAAA9YkBAAAAAAAJAgUABAAAAAoArd7YUAAAc2gAAAAAAAAAAAAA AAAAAAAAAACcgJVZAAAAAC6QCgAAAAAA9YkBAAAAAAAJAgUABAAAAAoArd7YUAAAc2gAAAAA AAAAAAAAAAAAAAAAAACcgJVZAAAAAPiUCgAAAAAA9YkBAAAAAAAJAgUABAAAAAoArd7YUAAA aWFzbAAAAAAAAAAAAAAAAAAAAACcgJVZAAAAAKCZCgAAAAAA9YkBAAAAAAAJAgUAAAAAAAsA rd7YUAAAaWFzbAAAAAAAAAAAAAAAAAAAAACcgJVZAAAAACigCgAAAAAA9YkBAAAAAAAEAAAA CgCt3tlQAABiaHl2ZQAAAAAAAAAAAAAAAAAAAJyAlVkAAAAAkaEKAAAAAAD1iQEAAAAAAAkC BQAEAAAACgCt3tlQAABzaAAAAAAAAAAAAAAAAAAAAAAAAJyAlVkAAAAA5aEKAAAAAAD1iQEA AAAAAAkCBQAEAAAACgCt3tlQAABzaAAAAAAAAAAAAAAAAAAAAAAAAJyAlVkAAAAAn6YKAAAA AAD1iQEAAAAAAAkCBQAEAAAACgCt3tlQAABpYXNsAAAAAAAAAAAAAAAAAAAAAJyAlVkAAAAA SasKAAAAAAD1iQEAAAAAAAkCBQAAAAAACwCt3tlQAABpYXNsAAAAAAAAAAAAAAAAAAAAAJyA lVkAAAAAIrQKAAAAAAD1iQEAAAAAAAQAAAAKAK3e21AAAGJoeXZlAAAAAAAAAAAAAAAAAAAA nICVWQAAAACJtQoAAAAAAPWJAQAAAAAACQIFAAQAAAAKAK3e21AAAHNoAAAAAAAAAAAAAAAA AAAAAAAAnICVWQAAAADitQoAAAAAAPWJAQAAAAAACQIFAAQAAAAKAK3e21AAAHNoAAAAAAAA AAAAAAAAAAAAAAAAnICVWQAAAACwugoAAAAAAPWJAQAAAAAACQIFAAQAAAAKAK3e21AAAGlh c2wAAAAAAAAAAAAAAAAAAAAAnICVWQAAAAB6vwoAAAAAAPWJAQAAAAAACQIFAAAAAAALAK3e 21AAAGlhc2wAAAAAAAAAAAAAAAAAAAAAnICVWQAAAACexQoAAAAAAPWJAQAAAAAABAAAAAoA rd7cUAAAYmh5dmUAAAAAAAAAAAAAAAAAAACcgJVZAAAAAATHCgAAAAAA9YkBAAAAAAAJAgUA BAAAAAoArd7cUAAAc2gAAAAAAAAAAAAAAAAAAAAAAACcgJVZAAAAAFnHCgAAAAAA9YkBAAAA AAAJAgUABAAAAAoArd7cUAAAc2gAAAAAAAAAAAAAAAAAAAAAAACcgJVZAAAAAPnLCgAAAAAA 9YkBAAAAAAAJAgUABAAAAAoArd7cUAAAaWFzbAAAAAAAAAAAAAAAAAAAAACcgJVZAAAAAJjQ CgAAAAAA9YkBAAAAAAAJAgUAAAAAAAsArd7cUAAAaWFzbAAAAAAAAAAAAAAAAAAAAACcgJVZ AAAAAJTWCgAAAAAA9YkBAAAAAAAEAAAACgCt3t5QAABiaHl2ZQAAAAAAAAAAAAAAAAAAAJyA lVkAAAAAD9gKAAAAAAD1iQEAAAAAAAkCBQAEAAAACgCt3t5QAABzaAAAAAAAAAAAAAAAAAAA AAAAAJyAlVkAAAAAYdgKAAAAAAD1iQEAAAAAAAkCBQAEAAAACgCt3t5QAABzaAAAAAAAAAAA AAAAAAAAAAAAAJyAlVkAAAAAJN0KAAAAAAD1iQEAAAAAAAkCBQAEAAAACgCt3t5QAABpYXNs AAAAAAAAAAAAAAAAAAAAAJyAlVkAAAAAveEKAAAAAAD1iQEAAAAAAAkCBQAAAAAACwCt3t5Q AABpYXNsAAAAAAAAAAAAAAAAAAAAAJyAlVkAAAAAwucKAAAAAAD1iQEAAAAAAAQAAAAKAK3e 31AAAGJoeXZlAAAAAAAAAAAAAAAAAAAAnICVWQAAAAB66goAAAAAAPWJAQAAAAAACQIFAAQA AAAKAK3e31AAAHNoAAAAAAAAAAAAAAAAAAAAAAAAnICVWQAAAADF6goAAAAAAPWJAQAAAAAA CQIFAAQAAAAKAK3e31AAAHNoAAAAAAAAAAAAAAAAAAAAAAAAnICVWQAAAABx7woAAAAAAPWJ AQAAAAAACQIFAAQAAAAKAK3e31AAAGlhc2wAAAAAAAAAAAAAAAAAAAAAnICVWQAAAAAZ9AoA AAAAAPWJAQAAAAAACQIFAAAAAAALAK3e31AAAGlhc2wAAAAAAAAAAAAAAAAAAAAAnICVWQAA AADeBwsAAAAAAPWJAQAAAAAAAAAAAAsArd7PUAAAdmNwdSAxAAAAAAAAAAAAAAAAAAChgJVZ AAAAAOKkAgAAAAAAwowBAAAAAAAEAAAACgCt3jpRAABzaAAAAAAAAAAAAAAAAAAAAAAAAKGA lVkAAAAAzqUCAAAAAADCjAEAAAAAAAkCBQAEAAAACgCt3jpRAABiaHl2ZWN0bAAAAAAAAAAA AAAAAKGAlVkAAAAAq6YCAAAAAADCjAEAAAAAAAkCBQAAAAAACwCt3jpRAABiaHl2ZWN0bAAA AAAAAAAAAAAAAKGAlVkAAAAA9KkCAAAAAADCjAEAAAAAAAAAAAALAK3ev1AAAHNoAAAAAAAA AAAAAAAAAAAAAAAAoYCVWQAAAADAqgIAAAAAAJmJAQAAAAAA --------------BAA8B4F0B7A6DEFF0798B875-- From owner-freebsd-hackers@freebsd.org Thu Aug 17 13:13:34 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A03B8DE1620 for ; Thu, 17 Aug 2017 13:13:34 +0000 (UTC) (envelope-from fernando.apesteguia@gmail.com) Received: from mail-lf0-x231.google.com (mail-lf0-x231.google.com [IPv6:2a00:1450:4010:c07::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2C001713DD; Thu, 17 Aug 2017 13:13:33 +0000 (UTC) (envelope-from fernando.apesteguia@gmail.com) Received: by mail-lf0-x231.google.com with SMTP id y15so29355327lfd.5; Thu, 17 Aug 2017 06:13:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=Wxi+oisN7zPBoMegPQT+qi9geUIgpFoHCWC0HyzfbBI=; b=e29VeNZtdVd5kYL9/pteIHwsVX73VesykuwtxdL2GDZDQL817bfx9JCAxFbFtuNX1r bEpT/vXzykI9YmvXh87ST+5T2Ryk/dHpGwwA65h59pIyuARuephBow/OTWKUEgAUVZxx RO1OZ+gBCRXiiFlmP9EUUyPZouzJQhK369rOR9KWmQcC+n7J0OrpVAqDMl3Qq/SQnqOB tOSHXC6msZRz0q8ONlmG0BBa8xKLYEcZhw6q1bIip98bjUC0/nslYC8/Os0lfyTIME3u Yq6vz9juHQEhmsw8NtOcg6uCjQdjpllCWDQe1BepxJ+hFqxlijxjBAs4sHzqr6y/Ai0Y nt5w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=Wxi+oisN7zPBoMegPQT+qi9geUIgpFoHCWC0HyzfbBI=; b=SROvr8z5rcDcP/hPUDnujZikUZyL+XKzhRh09EvQbbqjg5169NND51X+3NTOObQfac 6ZOqJ/5xwUGwcEfqURipOg9YuGjlIkXrrMjx6Su9BTg45V8DRwQwPeygh4U0Ne/sMo/x ZDnvufsIKZ8z6U2V09qjdOjiZjEp0r0q4X3vJkJe5/CubirYssZdAYOEVLRJjHNoe6qI 2mRsN4OAVuW9FMwtEzDmPgUP1W1UfbIOKG1XyiAwD8U4LcDCdHRgF0TmzbDHjlpF03Hw Pb43qM9/3ohBKa7vq8xXbpetrFtxibvul3p90UDdi7GKNUJ7B+wAPDLubVR3Z1X01dJf JDeA== X-Gm-Message-State: AHYfb5g0vpxWfEWZ4He8/M01qf7uceXuU5PxWz/fI20FykUyg70RYiNx FzMJlrkXYGATfgSzegw3loROWjwJOJh0 X-Received: by 10.25.209.148 with SMTP id i142mr1706141lfg.135.1502975610438; Thu, 17 Aug 2017 06:13:30 -0700 (PDT) MIME-Version: 1.0 Received: by 10.25.229.15 with HTTP; Thu, 17 Aug 2017 06:13:29 -0700 (PDT) In-Reply-To: References: From: =?UTF-8?Q?Fernando_Apestegu=C3=ADa?= Date: Thu, 17 Aug 2017 15:13:29 +0200 Message-ID: Subject: Re: Clang crashes on -CURRENT while compiling port To: Dimitry Andric Cc: FreeBSD Hackers Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Aug 2017 13:13:34 -0000 On Thu, Aug 17, 2017 at 11:41 AM, Dimitry Andric wrote: > On 17 Aug 2017, at 09:16, Fernando Apestegu=C3=ADa wrote: >> >> One of my ports (cad/openvsp) fails to compile in -CURRENT. The port >> only compiles with gcc on < 12. As part of the debugging I changed to >> compile with clang. >> >> The compiler crashed while compiling the port with the following error: >> >> fatal error: error in backend: No open frame >> c++: error: clang frontend command failed with exit code 70 >> >> Compiler version is: >> >> freebsd clang version 5.0.0 (brances/release_50 309439) >> >> I can send the as_callfunc* upon request. > > Please create a PR, and attach the two files (.cpp and .sh) it drops in /= tmp. Done. https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D221588 Thanks! > > -Dimitry > From owner-freebsd-hackers@freebsd.org Sat Aug 19 09:38:48 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DC86BDDD8EF for ; Sat, 19 Aug 2017 09:38:48 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: from asp.reflexion.net (outbound-mail-211-182.reflexion.net [208.70.211.182]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8F6966D6A0 for ; Sat, 19 Aug 2017 09:38:47 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: (qmail 29454 invoked from network); 19 Aug 2017 09:38:46 -0000 Received: from unknown (HELO mail-cs-01.app.dca.reflexion.local) (10.81.19.1) by 0 (rfx-qmail) with SMTP; 19 Aug 2017 09:38:46 -0000 Received: by mail-cs-01.app.dca.reflexion.local (Reflexion email security v8.40.2) with SMTP; Sat, 19 Aug 2017 05:38:46 -0400 (EDT) Received: (qmail 22680 invoked from network); 19 Aug 2017 09:38:46 -0000 Received: from unknown (HELO iron2.pdx.net) (69.64.224.71) by 0 (rfx-qmail) with (AES256-SHA encrypted) SMTP; 19 Aug 2017 09:38:46 -0000 Received: from [192.168.1.109] (c-67-170-167-181.hsd1.or.comcast.net [67.170.167.181]) by iron2.pdx.net (Postfix) with ESMTPSA id A7362EC8697; Sat, 19 Aug 2017 02:38:45 -0700 (PDT) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Disabling kernel hw-thread migration/stealing policies allows Ryzen to build lang/ghc (finally!) Message-Id: <818D4BF7-481A-4031-8EEE-0971738268CC@dsl-only.net> Date: Sat, 19 Aug 2017 02:38:45 -0700 To: freebsd-hackers , freebsd-amd64@freebsd.org X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Aug 2017 09:38:49 -0000 [This test was suggesetd by Don Lewis's comment 73 for buugzilla 221029.] I finally got a Ryzen based build of lang/ghc : # pkg search ghc ghc-8.0.2_1 Compiler for the functional language Haskell This used as a kernel context with: sysctl kern.sched.balance=0 sysctl kern.sched.steal_idle=0 and a poudriere context of: PARALLEL_JOBS=1 ALLOW_MAKE_JOBS=no and ALLOW_MAKE_JOBS_PACKAGES not having a match for lang/ghc The Ryzen was not otherwise loaded with activity (beyond normal background stuff in a simple configuration). (This means that kern.sched.balance=1 might have worked as it had nothing to do. In fact I have that test running now.) By contrast for the kernel context: sysctl kern.sched.balance=1 sysctl kern.sched.steal_idle=1 the lang/ghc build fails quickly compared to the somewhat over 1.5 hours it took for a build to complete. The detailed build step for the failure tends to vary from build attempt to build attempt. But they tend to involve Bus Errors for the failures. My context here is actually FreeBSD running as a guest in a VirtualBox virtual machine --that is running under Windows 10 Pro . The Ryzen has all 16 threads enabled but Virtual Box is set to supply 8 "processors" to the virtual machine (in VirtualBox terminology). But Poudriere is set to avoid parallel builds. Also: Prior build attempts had already built packages for lang/ghc's prerequisites. So the experiments here are just for the lang/ghc related build activity. === Mark Millard markmi at dsl-only.net From owner-freebsd-hackers@freebsd.org Sat Aug 19 11:22:05 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 61F90DE336C for ; Sat, 19 Aug 2017 11:22:05 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: from asp.reflexion.net (outbound-mail-211-183.reflexion.net [208.70.211.183]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 160E470AC0 for ; Sat, 19 Aug 2017 11:22:04 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: (qmail 26056 invoked from network); 19 Aug 2017 11:15:23 -0000 Received: from unknown (HELO mail-cs-02.app.dca.reflexion.local) (10.81.19.2) by 0 (rfx-qmail) with SMTP; 19 Aug 2017 11:15:23 -0000 Received: by mail-cs-02.app.dca.reflexion.local (Reflexion email security v8.40.2) with SMTP; Sat, 19 Aug 2017 07:15:23 -0400 (EDT) Received: (qmail 16981 invoked from network); 19 Aug 2017 11:15:22 -0000 Received: from unknown (HELO iron2.pdx.net) (69.64.224.71) by 0 (rfx-qmail) with (AES256-SHA encrypted) SMTP; 19 Aug 2017 11:15:22 -0000 Received: from [192.168.1.109] (c-67-170-167-181.hsd1.or.comcast.net [67.170.167.181]) by iron2.pdx.net (Postfix) with ESMTPSA id 167F7EC8877; Sat, 19 Aug 2017 04:15:22 -0700 (PDT) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: Disabling kernel hw-thread migration/stealing policies allows Ryzen to build lang/ghc (finally!) Date: Sat, 19 Aug 2017 04:15:21 -0700 References: <818D4BF7-481A-4031-8EEE-0971738268CC@dsl-only.net> To: freebsd-hackers , freebsd-amd64@freebsd.org In-Reply-To: <818D4BF7-481A-4031-8EEE-0971738268CC@dsl-only.net> Message-Id: <66044D90-E5C9-4855-B358-4083A82590CE@dsl-only.net> X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Aug 2017 11:22:05 -0000 On 2017-Aug-19, at 2:38 AM, Mark Millard wrote: > [This test was suggesetd by Don Lewis's comment 73 > for buugzilla 221029.] > > I finally got a Ryzen based build of lang/ghc : > > # pkg search ghc > ghc-8.0.2_1 Compiler for the functional language Haskell > > This used as a kernel context with: > > sysctl kern.sched.balance=0 > sysctl kern.sched.steal_idle=0 > > and a poudriere context of: > > PARALLEL_JOBS=1 > ALLOW_MAKE_JOBS=no > > and ALLOW_MAKE_JOBS_PACKAGES not having a match > for lang/ghc > > The Ryzen was not otherwise loaded with activity > (beyond normal background stuff in a simple > configuration). > > (This means that kern.sched.balance=1 might > have worked as it had nothing to do. In fact > I have that test running now.) > > By contrast for the kernel context: > > sysctl kern.sched.balance=1 > sysctl kern.sched.steal_idle=1 > > the lang/ghc build fails quickly compared to > the somewhat over 1.5 hours it took for a > build to complete. > > The detailed build step for the failure tends to > vary from build attempt to build attempt. But they > tend to involve Bus Errors for the failures. > > > My context here is actually FreeBSD > running as a guest in a VirtualBox > virtual machine --that is running under > Windows 10 Pro . The Ryzen has all 16 > threads enabled but Virtual Box is set > to supply 8 "processors" to the virtual > machine (in VirtualBox terminology). > But Poudriere is set to avoid parallel > builds. > > Also: Prior build attempts had already > built packages for lang/ghc's > prerequisites. So the experiments here > are just for the lang/ghc related > build activity. sysctl kern.sched.balance=0 sysctl kern.sched.steal_idle=0 with: #PARALLEL_JOBS=1 ALLOW_MAKE_JOBS=yes and ALLOW_MAKE_JOBS_PACKAGES having a match for lang/ghc also makes it to completion for building lang/ghc . (Much of the time 8 hw-threads being busy.) Ryzen has problems with some aspect(s) of how FreeBSD migrates work between threads. May be some stronger form of barrier(s) or some such would sidestep the issue(s) but be less drastic than use of: sysctl kern.sched.balance=0 sysctl kern.sched.steal_idle=0 === Mark Millard markmi at dsl-only.net