From owner-freebsd-stable@freebsd.org Sun Jun 21 12:11:30 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4304234C445 for ; Sun, 21 Jun 2020 12:11:30 +0000 (UTC) (envelope-from trashcan@ellael.org) Received: from mx2.enfer-du-nord.net (mx2.enfer-du-nord.net [87.98.149.189]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49qWc06Kzzz3ZX7 for ; Sun, 21 Jun 2020 12:11:28 +0000 (UTC) (envelope-from trashcan@ellael.org) From: Michael Grimm X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.102.3 at mail.enfer-du-nord.net Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.80.23.2.2\)) Subject: Buildworld and buildkernel with very slow compilation, recently Message-Id: <2D4CD117-99D0-4A03-8FBC-002CDFFE64F9@ellael.org> Date: Sun, 21 Jun 2020 14:11:15 +0200 To: FreeBSD-STABLE Mailing List X-Mailer: Apple Mail (2.3608.80.23.2.2) X-Spam-Status: No, score=0.40 X-Rspamd-Queue-Id: 49qWc06Kzzz3ZX7 X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of trashcan@ellael.org has no SPF policy when checking 87.98.149.189) smtp.mailfrom=trashcan@ellael.org X-Spamd-Result: default: False [3.35 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[ellael.org]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.81)[0.809]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_ALL(0.00)[]; NEURAL_SPAM_LONG(1.00)[1.005]; NEURAL_SPAM_SHORT(0.14)[0.138]; R_SPF_NA(0.00)[no SPF record]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16276, ipnet:87.98.128.0/17, country:FR]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Jun 2020 12:11:30 -0000 Hi, I am following FreeBSD 12.1-STABLE.=20 Clang has been upgraded to version 10.0.0 on May, 1st, and ever since = that time, I do observe a dramatic increase in compilation times of = building world, kernel and ports. I didn't benchmark the exact times, = but compilation times are at least increased by a factor of 1.5. Nothing = has changed of the last month besides upgrading 12.1-Stable every other = week. Has anyone else been bitten by this? Regards, Michael= From owner-freebsd-stable@freebsd.org Sun Jun 21 12:26:06 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 305D034D5A0 for ; Sun, 21 Jun 2020 12:26:06 +0000 (UTC) (envelope-from yuripv@yuripv.dev) Received: from wout1-smtp.messagingengine.com (wout1-smtp.messagingengine.com [64.147.123.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49qWws4s1Wz3c97 for ; Sun, 21 Jun 2020 12:26:05 +0000 (UTC) (envelope-from yuripv@yuripv.dev) Received: from compute2.internal (compute2.nyi.internal [10.202.2.42]) by mailout.west.internal (Postfix) with ESMTP id 858E6229B; Sun, 21 Jun 2020 08:20:01 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute2.internal (MEProxy); Sun, 21 Jun 2020 08:20:01 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yuripv.dev; h= subject:to:references:from:message-id:date:mime-version :in-reply-to:content-type:content-transfer-encoding; s=fm1; bh=8 aIEQ4M3syXlvk16Lax3HcQFyhx5iveADAYsoRqFeg0=; b=Cl2+wuvrY9wxQwucv On6pzq1Knk/0+2BFTXDAsKdYSG4YoRr8QPbUsgXlZeqLgvpVHGJv+6ER0mAy46tN 9asUPF8QUohFXRzKaWzwubUChNjkxQAtNV2gk/ct1q4iZe1bbmKfjHtUe/Ta7KRR 1N1G66zqKWthVgYGthBuRkiVb4vbL50Uu4OTlkGKJHcdMGH3Vj8KRpO3PjA6nWus Kse7LOdWKfb6nBpXlQe9dE8D5fFsQCwc1OumNCgXdCEyp2obICn5tX6m+tzvj712 NkUGr9eThJa0zWcxXqTkdUXPzd4cEuBZWtHxjdOm/pMinnCOwvbisTZxZUytlVIt UTR+A== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; bh=8aIEQ4M3syXlvk16Lax3HcQFyhx5iveADAYsoRqFe g0=; b=k873hlLaHvog4RMK6AChPkxO195dazZaDXuMrwkwxJANkOGVTZHFuJt1q JnSAWiDgaYwWvUsR/GDn0e+V3KSEEgPEwjEORruxAe+wYZ0FAZGldpdWkvyRw+BU Oamg2Mw/6PDTpGl7AYoytRiXytCdmbeDiVtG4/WCjFjhG6deKTsGcGm7lbVaalsi CO2uqSW6x6g7XbrpTkqIk/GGeVY4nUHjZB1yPTBHbb7y4ni66iO8elTIbaTuOihe nLpYsylcCNT2ZBeHxQUpokcYBrBo7ScOh4PABnui942pZ692lbbJ9STz0N4pFpus oOavt07OitISQTarp8+qUbish87mg== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduhedrudektddgheegucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepuffvfhfhkffffgggjggtgfesthejredttdefjeenucfhrhhomhepjghurhhi ucfrrghnkhhovhcuoeihuhhrihhpvheshihurhhiphhvrdguvghvqeenucggtffrrghtth gvrhhnpeffhedvkeegieejveelvdffgfevueevgffgjefhleeuueevtedvvddvgfeiteff teenucfkphepledurddvgedtrdduvdegrddufeejnecuvehluhhsthgvrhfuihiivgeptd enucfrrghrrghmpehmrghilhhfrhhomhephihurhhiphhvseihuhhrihhpvhdruggvvh X-ME-Proxy: Received: from [192.168.1.6] (unknown [91.240.124.137]) by mail.messagingengine.com (Postfix) with ESMTPA id 3C9263066DA5; Sun, 21 Jun 2020 08:20:00 -0400 (EDT) Subject: Re: Buildworld and buildkernel with very slow compilation, recently To: Michael Grimm , FreeBSD-STABLE Mailing List References: <2D4CD117-99D0-4A03-8FBC-002CDFFE64F9@ellael.org> From: Yuri Pankov Message-ID: <1dcc9b3a-9d03-887c-3b21-e05820992a3c@yuripv.dev> Date: Sun, 21 Jun 2020 15:19:59 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 In-Reply-To: <2D4CD117-99D0-4A03-8FBC-002CDFFE64F9@ellael.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 49qWws4s1Wz3c97 X-Spamd-Bar: ++++ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yuripv.dev header.s=fm1 header.b=Cl2+wuvr; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=k873hlLa; dmarc=none; spf=pass (mx1.freebsd.org: domain of yuripv@yuripv.dev designates 64.147.123.24 as permitted sender) smtp.mailfrom=yuripv@yuripv.dev X-Spamd-Result: default: False [4.88 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(0.00)[yuripv.dev:s=fm1,messagingengine.com:s=fm3]; GREYLIST(0.00)[pass,body]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(0.00)[+ip4:64.147.123.24:c]; RECEIVED_SPAMHAUS_XBL(5.00)[91.240.124.137:received]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[yuripv.dev]; NEURAL_HAM_MEDIUM(-0.61)[-0.607]; BAD_REP_POLICIES(0.10)[]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yuripv.dev:+,messagingengine.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_LONG(0.52)[0.519]; NEURAL_SPAM_SHORT(0.07)[0.068]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_VERYGOOD(0.00)[64.147.123.24:from]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.24:from] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Jun 2020 12:26:06 -0000 Michael Grimm wrote: > Hi, > > I am following FreeBSD 12.1-STABLE. > > Clang has been upgraded to version 10.0.0 on May, 1st, and ever since that time, I do observe a dramatic increase in compilation times of building world, kernel and ports. I didn't benchmark the exact times, but compilation times are at least increased by a factor of 1.5. Nothing has changed of the last month besides upgrading 12.1-Stable every other week. Not seeing this after clang update to 10 on both stable/12 and head. I'd check if you are excessively swapping now as (not sure about that, just guessing) newer clang/llvm could consume more memory during compilation, and possibly reducing the make jobs number. From owner-freebsd-stable@freebsd.org Sun Jun 21 12:36:35 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BCD8234DDB6 for ; Sun, 21 Jun 2020 12:36:35 +0000 (UTC) (envelope-from cnehren@pobox.com) Received: from pb-smtp20.pobox.com (pb-smtp20.pobox.com [173.228.157.52]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49qX8y69jrz3dFK for ; Sun, 21 Jun 2020 12:36:34 +0000 (UTC) (envelope-from cnehren@pobox.com) Received: from pb-smtp20.pobox.com (unknown [127.0.0.1]) by pb-smtp20.pobox.com (Postfix) with ESMTP id 5DC73C892A for ; Sun, 21 Jun 2020 08:36:33 -0400 (EDT) (envelope-from cnehren@pobox.com) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=pobox.com; h=from:to :subject:date:message-id:in-reply-to:references:mime-version :content-transfer-encoding:content-type; s=sasl; bh=Xz6WZgtG3155 ZAw7Y7vlOkFbUWQ=; b=L4oIMkDO7FDUyMINIz1pCWoMK87dy7XJUn4NDRtTccZ8 jt3FDLFn2LBhhR8bPx3FSQpi1v3ye+xGJGBa+soYhd3nIdn71r7a53T9yvabnsMh /jES1/N3FQ1umVfTn2k/kEHDdnqY4Tc10rsHPaqsJuebq9aUwR47hjU3cSJehDo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=pobox.com; h=from:to:subject :date:message-id:in-reply-to:references:mime-version :content-transfer-encoding:content-type; q=dns; s=sasl; b=c0hXsr eBVk+M6tGjnU2Kq3Aw2xyCJduRfqA7ggSRD6ikSn55QN+v0OfSj641n32bXxQcEx 26pJi79Lvn0fNg+CXDF0gSQAt+h4WeT1K8IwrXctUlpXzny814T9VNKFi3HRPi/m Xj7E7zm2hIs+jANPDfLzazjSxkJc3RkPbnfIg= Received: from pb-smtp20.sea.icgroup.com (unknown [127.0.0.1]) by pb-smtp20.pobox.com (Postfix) with ESMTP id 56EF8C8929 for ; Sun, 21 Jun 2020 08:36:33 -0400 (EDT) (envelope-from cnehren@pobox.com) Received: from behemoth.lan (unknown [100.19.36.83]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by pb-smtp20.pobox.com (Postfix) with ESMTPSA id 67A08C8927 for ; Sun, 21 Jun 2020 08:36:30 -0400 (EDT) (envelope-from cnehren@pobox.com) From: Chris Nehren To: freebsd-stable@freebsd.org Subject: Re: Buildworld and buildkernel with very slow compilation, recently Date: Sun, 21 Jun 2020 08:36:27 -0400 Message-ID: <5403888.XOh7uYVVfo@behemoth.lan> In-Reply-To: <2D4CD117-99D0-4A03-8FBC-002CDFFE64F9@ellael.org> References: <2D4CD117-99D0-4A03-8FBC-002CDFFE64F9@ellael.org> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="UTF-8" X-Pobox-Relay-ID: D52DBE60-B3BB-11EA-B361-B0405B776F7B-49531120!pb-smtp20.pobox.com X-Rspamd-Queue-Id: 49qX8y69jrz3dFK X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=pobox.com header.s=sasl header.b=L4oIMkDO; dmarc=pass (policy=none) header.from=pobox.com; spf=pass (mx1.freebsd.org: domain of cnehren@pobox.com designates 173.228.157.52 as permitted sender) smtp.mailfrom=cnehren@pobox.com X-Spamd-Result: default: False [-2.93 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[pobox.com:s=sasl]; RECEIVED_SPAMHAUS_PBL(0.00)[100.19.36.83:received]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[pobox.com:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:173.228.157.0/24]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.04)[-1.041]; RCVD_COUNT_THREE(0.00)[4]; NEURAL_HAM_MEDIUM(-1.03)[-1.034]; DKIM_TRACE(0.00)[pobox.com:+]; DMARC_POLICY_ALLOW(-0.50)[pobox.com,none]; NEURAL_HAM_SHORT(-0.26)[-0.259]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; CTE_CASE(0.50)[]; ASN(0.00)[asn:11403, ipnet:173.228.157.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[173.228.157.52:from] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Jun 2020 12:36:35 -0000 On Sunday, June 21, 2020 8:11:15 AM EDT Michael Grimm wrote: > Hi, > > I am following FreeBSD 12.1-STABLE. > > Clang has been upgraded to version 10.0.0 on May, 1st, and ever since that > time, I do observe a dramatic increase in compilation times of building > world, kernel and ports. I didn't benchmark the exact times, but > compilation times are at least increased by a factor of 1.5. Nothing has > changed of the last month besides upgrading 12.1-Stable every other week. > > Has anyone else been bitten by this? I don't have measurements to corroborate this, but here's a mailing list thread where folks are talking about it (split across two URLs, the OP posted in April and then there was a followup in May): http://lists.llvm.org/pipermail/llvm-dev/2020-April/140938.html https://lists.llvm.org/pipermail/llvm-dev/2020-May/141482.html So there definitely seems to be *something* going on, and you are indeed not crazy. :) From owner-freebsd-stable@freebsd.org Sun Jun 21 12:48:57 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1D73B34E06E for ; Sun, 21 Jun 2020 12:48:57 +0000 (UTC) (envelope-from ronald-lists@klop.ws) Received: from smtp-relay-int.realworks.nl (smtp-relay-int.realworks.nl [194.109.157.24]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49qXRC5bGZz3f3w for ; Sun, 21 Jun 2020 12:48:55 +0000 (UTC) (envelope-from ronald-lists@klop.ws) Date: Sun, 21 Jun 2020 14:48:51 +0200 (CEST) From: Ronald Klop To: Michael Grimm , FreeBSD-STABLE Mailing List Message-ID: <816278512.11586.1592743731465@localhost> In-Reply-To: <2D4CD117-99D0-4A03-8FBC-002CDFFE64F9@ellael.org> Subject: Re: Buildworld and buildkernel with very slow compilation, recently MIME-Version: 1.0 X-Mailer: Realworks (511.27.bc2762ad9c4) Importance: Normal X-Priority: 3 (Normal) X-Rspamd-Queue-Id: 49qXRC5bGZz3f3w X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of ronald-lists@klop.ws designates 194.109.157.24 as permitted sender) smtp.mailfrom=ronald-lists@klop.ws X-Spamd-Result: default: False [-2.39 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.96)[-0.964]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:194.109.157.0/24]; NEURAL_HAM_LONG(-1.02)[-1.023]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[klop.ws]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.61)[-0.606]; RCPT_COUNT_TWO(0.00)[2]; HAS_X_PRIO_THREE(0.00)[3]; RCVD_IN_DNSWL_NONE(0.00)[194.109.157.24:from]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3265, ipnet:194.109.0.0/16, country:NL]; MID_RHS_NOT_FQDN(0.50)[]; RWL_MAILSPIKE_VERYGOOD(0.00)[194.109.157.24:from] Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Jun 2020 12:48:57 -0000 Building ports/pkgs is also significantly slower on 13 (new clang) than on 12.1. http://thunderx1.nyi.freebsd.org/ 13 = 140 hours12.1 = 103 hoursFor roughly the same amount of ports. Regards, Ronald Van: Michael Grimm Datum: 21 juni 2020 14:12 Aan: FreeBSD-STABLE Mailing List Onderwerp: Buildworld and buildkernel with very slow compilation, recently > > > Hi, > > I am following FreeBSD 12.1-STABLE. > > Clang has been upgraded to version 10.0.0 on May, 1st, and ever since that time, I do observe a dramatic increase in compilation times of building world, kernel and ports. I didn't benchmark the exact times, but compilation times are at least increased by a factor of 1.5. Nothing has changed of the last month besides upgrading 12.1-Stable every other week. > > Has anyone else been bitten by this? > > Regards, > Michael > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > > > > From owner-freebsd-stable@freebsd.org Sun Jun 21 13:02:40 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EE9C634EE3E for ; Sun, 21 Jun 2020 13:02:40 +0000 (UTC) (envelope-from yasu@utahime.org) Received: from gate.utahime.jp (gate.utahime.jp [183.180.29.210]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49qXl25rvRz3gTL for ; Sun, 21 Jun 2020 13:02:37 +0000 (UTC) (envelope-from yasu@utahime.org) Received: from eastasia.home.utahime.org (eastasia.home.utahime.org [192.168.174.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by gate.utahime.jp (Postfix) with ESMTPS id 607888C3; Sun, 21 Jun 2020 22:02:27 +0900 (JST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=utahime.org; s=maybe2019112701; t=1592744547; bh=f5VwrM5i6n986N4v+5PQFPhGpIGadomeBl4ywdBy5fI=; h=Date:To:Cc:Subject:From:In-Reply-To:References; b=u2dgypHDt3WPUx3p1BeRoqgIXmMAsAJM+EG69bLZ67s93yTC2qPZ1sA6A/geVov8Y JZ6vT9/cFbcwDmzJBSmj3CgPlXD/Qijd5UgFyAZ9mc7hc0C6qanv/qFU/79sM1ZEgL 3M8sV+tM+8brPSiJvI/qBbT2P7S4lYKSjvQsqi/g5sS6RYHY+1pd/ksuq0OG8M8m59 0p30fAkQ+zMwZksKTp6rWVTRTTIa7ZHf68ejoC53bFtT6GRXBlHQgFsOcv+miTa6Bh WRKK/YGixt3Z5WT5zdxnehuU+u56kJ9KShxrwke6h6XEljTD+9objYTf/j6cV3JEUZ hd7x3CzDMNy4A== Received: from localhost (rolling.home.utahime.org [192.168.174.11]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by eastasia.home.utahime.org (Postfix) with ESMTPSA id DD54F4A21E; Sun, 21 Jun 2020 22:02:25 +0900 (JST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.102.3 at eastasia.home.utahime.org Date: Sun, 21 Jun 2020 22:00:20 +0900 (JST) Message-Id: <20200621.220020.1916748464498392515.yasu@utahime.org> To: ronald-lists@klop.ws Cc: trashcan@ellael.org, freebsd-stable@freebsd.org Subject: Re: Buildworld and buildkernel with very slow compilation, recently From: Yasuhiro KIMURA In-Reply-To: <816278512.11586.1592743731465@localhost> References: <2D4CD117-99D0-4A03-8FBC-002CDFFE64F9@ellael.org> <816278512.11586.1592743731465@localhost> X-Mailer: Mew version 6.8 on Emacs 26.3 Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 49qXl25rvRz3gTL X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=utahime.org header.s=maybe2019112701 header.b=u2dgypHD; dmarc=none; spf=pass (mx1.freebsd.org: domain of yasu@utahime.org designates 183.180.29.210 as permitted sender) smtp.mailfrom=yasu@utahime.org X-Spamd-Result: default: False [-2.22 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[utahime.org:s=maybe2019112701]; NEURAL_HAM_MEDIUM(-1.02)[-1.021]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+a:spf-authorized.utahime.org]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[utahime.org]; NEURAL_HAM_LONG(-1.04)[-1.037]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[utahime.org:+]; NEURAL_HAM_SHORT(-1.16)[-1.163]; MID_CONTAINS_FROM(1.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:2519, ipnet:183.180.0.0/16, country:JP]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Jun 2020 13:02:41 -0000 From: Ronald Klop Subject: Re: Buildworld and buildkernel with very slow compilation, recently Date: Sun, 21 Jun 2020 14:48:51 +0200 (CEST) > Building ports/pkgs is also significantly slower on 13 (new clang) > than on 12.1. > http://thunderx1.nyi.freebsd.org/ > 13 = 140 hours12.1 = 103 hoursFor roughly the same amount of ports. >From /usr/src/UPDATING of head: NOTE TO PEOPLE WHO THINK THAT FreeBSD 13.x IS SLOW: FreeBSD 13.x has many debugging features turned on, in both the kernel and userland. These features attempt to detect incorrect use of system primitives, and encourage loud failure through extra sanity checking and fail stop semantics. They also substantially impact system performance. If you want to do performance measurement, benchmarking, and optimization, you'll want to turn them off. This includes various WITNESS- related kernel options, INVARIANTS, malloc debugging flags in userland, and various verbose features in the kernel. Many developers choose to disable these features on build machines to maximize performance. (To completely disable malloc debugging, define MALLOC_PRODUCTION in /etc/make.conf, or to merely disable the most expensive debugging functionality run "ln -s 'abort:false,junk:false' /etc/malloc.conf".) --- Yasuhiro KIMURA From owner-freebsd-stable@freebsd.org Sun Jun 21 13:03:53 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3DE5E34EE71 for ; Sun, 21 Jun 2020 13:03:53 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49qXmR5Gjnz3gZb for ; Sun, 21 Jun 2020 13:03:51 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id 05LD3OZS017189 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sun, 21 Jun 2020 16:03:27 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua 05LD3OZS017189 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id 05LD3Nss017188; Sun, 21 Jun 2020 16:03:23 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sun, 21 Jun 2020 16:03:23 +0300 From: Konstantin Belousov To: Ronald Klop Cc: Michael Grimm , FreeBSD-STABLE Mailing List Subject: Re: Buildworld and buildkernel with very slow compilation, recently Message-ID: <20200621130323.GL45690@kib.kiev.ua> References: <2D4CD117-99D0-4A03-8FBC-002CDFFE64F9@ellael.org> <816278512.11586.1592743731465@localhost> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <816278512.11586.1592743731465@localhost> X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on tom.home X-Rspamd-Queue-Id: 49qXmR5Gjnz3gZb X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=gmail.com (policy=none); spf=softfail (mx1.freebsd.org: 2001:470:d5e7:1::1 is neither permitted nor denied by domain of kostikbel@gmail.com) smtp.mailfrom=kostikbel@gmail.com X-Spamd-Result: default: False [0.94 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; NEURAL_SPAM_MEDIUM(0.40)[0.404]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.34)[-0.338]; NEURAL_SPAM_LONG(0.87)[0.873]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; FREEMAIL_ENVFROM(0.00)[gmail.com]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Jun 2020 13:03:53 -0000 On Sun, Jun 21, 2020 at 02:48:51PM +0200, Ronald Klop wrote: > Building ports/pkgs is also significantly slower on 13 (new clang) than on 12.1. > http://thunderx1.nyi.freebsd.org/ > 13 = 140 hours12.1 = 103 hoursFor roughly the same amount of ports. If you use stock HEAD GENERIC kernel config and stock-built libc, it is expected. Both kernel and jemalloc has extensive debugging turned on, on HEAD. > > Regards, Ronald > > Van: Michael Grimm > Datum: 21 juni 2020 14:12 > Aan: FreeBSD-STABLE Mailing List > Onderwerp: Buildworld and buildkernel with very slow compilation, recently > > > > > > > Hi, > > > > I am following FreeBSD 12.1-STABLE. > > > > Clang has been upgraded to version 10.0.0 on May, 1st, and ever since that time, I do observe a dramatic increase in compilation times of building world, kernel and ports. I didn't benchmark the exact times, but compilation times are at least increased by a factor of 1.5. Nothing has changed of the last month besides upgrading 12.1-Stable every other week. > > > > Has anyone else been bitten by this? > > > > Regards, > > Michael > > _______________________________________________ > > freebsd-stable@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > > > > > > > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@freebsd.org Sun Jun 21 20:56:22 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ECDDC332CA2 for ; Sun, 21 Jun 2020 20:56:22 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49qlFf5zfCz4bkG; Sun, 21 Jun 2020 20:56:22 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from tensor.andric.com (tensor.andric.com [IPv6:2001:470:7a58:1::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "tensor.andric.com", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: dim) by smtp.freebsd.org (Postfix) with ESMTPSA id AFC752B354; Sun, 21 Jun 2020 20:56:22 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from [10.10.153.99] (227.31.12.93.rev.sfr.net [93.12.31.227]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by tensor.andric.com (Postfix) with ESMTPSA id 501E15647C; Sun, 21 Jun 2020 22:56:21 +0200 (CEST) From: Dimitry Andric Message-Id: Content-Type: multipart/signed; boundary="Apple-Mail=_14FB8FB1-8FDC-40F6-B043-0D6624BE7F73"; protocol="application/pgp-signature"; micalg=pgp-sha1 Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.14\)) Subject: Re: Buildworld and buildkernel with very slow compilation, recently Date: Sun, 21 Jun 2020 22:56:11 +0200 In-Reply-To: <5403888.XOh7uYVVfo@behemoth.lan> Cc: freebsd-stable@freebsd.org To: Chris Nehren References: <2D4CD117-99D0-4A03-8FBC-002CDFFE64F9@ellael.org> <5403888.XOh7uYVVfo@behemoth.lan> X-Mailer: Apple Mail (2.3445.104.14) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Jun 2020 20:56:23 -0000 --Apple-Mail=_14FB8FB1-8FDC-40F6-B043-0D6624BE7F73 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii On 21 Jun 2020, at 14:36, Chris Nehren wrote: >=20 > On Sunday, June 21, 2020 8:11:15 AM EDT Michael Grimm wrote: >> Hi, >>=20 >> I am following FreeBSD 12.1-STABLE. >>=20 >> Clang has been upgraded to version 10.0.0 on May, 1st, and ever since = that >> time, I do observe a dramatic increase in compilation times of = building >> world, kernel and ports. I didn't benchmark the exact times, but >> compilation times are at least increased by a factor of 1.5. Nothing = has >> changed of the last month besides upgrading 12.1-Stable every other = week. >>=20 >> Has anyone else been bitten by this? >=20 > I don't have measurements to corroborate this, but here's a mailing = list > thread where folks are talking about it (split across two URLs, the OP = posted > in April and then there was a followup in May): >=20 > http://lists.llvm.org/pipermail/llvm-dev/2020-April/140938.html > https://lists.llvm.org/pipermail/llvm-dev/2020-May/141482.html >=20 > So there definitely seems to be *something* going on, and you are = indeed not > crazy. :) Indeed, there is some upstream discussion going on about this issue. There are some scenarios where people see non-negligible performance loss, but apparently not everybody suffers from it. If you build the whole ports collection, it is rather likely you may bump into it. I have personally not seen much performance difference in building world, kernel etc. One of the upstream problems is that there is not really any authoritative performance regression log being built up, so it is hard to see where such regressions were introduced. Somebody then has to spend a lot of time tracking down each and every regression, and then attempt to untangle it from the dozens of commits made around the same time. :) In any case, there is at least some attention on it now, so hopefully this will improve again. I don't think such fixes will be trivial though, so it is not likely they will land in 10.0.1. -Dimitry --Apple-Mail=_14FB8FB1-8FDC-40F6-B043-0D6624BE7F73 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.2 iF0EARECAB0WIQR6tGLSzjX8bUI5T82wXqMKLiCWowUCXu/JawAKCRCwXqMKLiCW o0YAAJ40Wqs+7gwLpPT3iPNOhbxJ2Mfs5ACeMKWYrlGLYOc4/FtfWu1Kflk1U/A= =zFw1 -----END PGP SIGNATURE----- --Apple-Mail=_14FB8FB1-8FDC-40F6-B043-0D6624BE7F73-- From owner-freebsd-stable@freebsd.org Mon Jun 22 13:19:00 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D4DE534B4B6 for ; Mon, 22 Jun 2020 13:19:00 +0000 (UTC) (envelope-from trashcan@ellael.org) Received: from mx1.enfer-du-nord.net (mx1.enfer-du-nord.net [IPv6:2001:41d0:302:1100::e:1def]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49r93R5F9Pz4mnP for ; Mon, 22 Jun 2020 13:18:59 +0000 (UTC) (envelope-from trashcan@ellael.org) From: Michael Grimm X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.102.3 at mail.enfer-du-nord.net Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.80.23.2.2\)) Subject: Re: Buildworld and buildkernel with very slow compilation, recently Date: Mon, 22 Jun 2020 15:18:42 +0200 References: <2D4CD117-99D0-4A03-8FBC-002CDFFE64F9@ellael.org> <5403888.XOh7uYVVfo@behemoth.lan> To: FreeBSD-STABLE Mailing List In-Reply-To: Message-Id: <7D2B7FF1-831E-4958-812F-B5501148C57F@ellael.org> X-Mailer: Apple Mail (2.3608.80.23.2.2) X-Rspamd-Queue-Id: 49r93R5F9Pz4mnP X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of trashcan@ellael.org has no SPF policy when checking 2001:41d0:302:1100::e:1def) smtp.mailfrom=trashcan@ellael.org X-Spamd-Result: default: False [3.44 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[ellael.org]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.83)[0.834]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_ALL(0.00)[]; NEURAL_SPAM_LONG(1.02)[1.021]; NEURAL_SPAM_SHORT(0.18)[0.184]; R_SPF_NA(0.00)[no SPF record]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16276, ipnet:2001:41d0::/32, country:FR]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Jun 2020 13:19:00 -0000 Dimitry Andric wrote: >=20 > On 21 Jun 2020, at 14:36, Chris Nehren wrote: >> On Sunday, June 21, 2020 8:11:15 AM EDT Michael Grimm wrote: >>> Hi, >>>=20 >>> I am following FreeBSD 12.1-STABLE. >>>=20 >>> Clang has been upgraded to version 10.0.0 on May, 1st, and ever = since that >>> time, I do observe a dramatic increase in compilation times of = building >>> world, kernel and ports. I didn't benchmark the exact times, but >>> compilation times are at least increased by a factor of 1.5. Nothing = has >>> changed of the last month besides upgrading 12.1-Stable every other = week. >>>=20 >>> Has anyone else been bitten by this? >>=20 >> I don't have measurements to corroborate this, but here's a mailing = list >> thread where folks are talking about it (split across two URLs, the = OP posted >> in April and then there was a followup in May): >>=20 >> http://lists.llvm.org/pipermail/llvm-dev/2020-April/140938.html >> https://lists.llvm.org/pipermail/llvm-dev/2020-May/141482.html >>=20 >> So there definitely seems to be *something* going on, and you are = indeed not >> crazy. :) >=20 > Indeed, there is some upstream discussion going on about this issue. > There are some scenarios where people see non-negligible performance > loss, but apparently not everybody suffers from it. If you build the > whole ports collection, it is rather likely you may bump into it. I = have > personally not seen much performance difference in building world, > kernel etc. >=20 > One of the upstream problems is that there is not really any > authoritative performance regression log being built up, so it is hard > to see where such regressions were introduced. Somebody then has to > spend a lot of time tracking down each and every regression, and then > attempt to untangle it from the dozens of commits made around the same > time. :) >=20 > In any case, there is at least some attention on it now, so hopefully > this will improve again. I don't think such fixes will be trivial > though, so it is not likely they will land in 10.0.1. >=20 > -Dimitry ok, so others see some performance loss as well. In the meantime I activated META_MODE and hope, that will speed-up my = weekly compilations. Thanks to all who answered, and regards, Michael From owner-freebsd-stable@freebsd.org Mon Jun 22 14:57:04 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A1FC834E277 for ; Mon, 22 Jun 2020 14:57:04 +0000 (UTC) (envelope-from abrancatelli@schema31.it) Received: from titanio.schema31.it (titanio.schema31.it [62.77.63.156]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "titanio.pomona.schema31.it", Issuer "titanio.pomona.schema31.it" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 49rCDX37Zvz3RlC for ; Mon, 22 Jun 2020 14:57:00 +0000 (UTC) (envelope-from abrancatelli@schema31.it) Received: from smtp.schema31.it (localhost [127.0.0.1]) by titanio.pomona.schema31.it (8.15.2/8.15.2) with ESMTP id 05MEukSS048631 for ; Mon, 22 Jun 2020 16:56:47 +0200 (CEST) (envelope-from abrancatelli@schema31.it) MIME-Version: 1.0 Date: Mon, 22 Jun 2020 16:56:41 +0200 From: Andrea Brancatelli To: freebsd-stable@freebsd.org Subject: Problem with Sendmail Mailertable Organization: Schema31 s.r.l. Message-ID: X-Sender: abrancatelli@schema31.it User-Agent: Roundcube Webmail/1.3.10 X-Rspamd-Queue-Id: 49rCDX37Zvz3RlC X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.35 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.03)[-1.033]; R_DKIM_ALLOW(-0.20)[schema31.it:s=gCloud]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:62.77.63.156/28]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; HAS_ORG_HEADER(0.00)[]; DKIM_TRACE(0.00)[schema31.it:+]; DMARC_POLICY_ALLOW(-0.50)[schema31.it,quarantine]; NEURAL_HAM_SHORT(-0.29)[-0.293]; NEURAL_HAM_LONG(-1.02)[-1.024]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:20746, ipnet:62.77.32.0/19, country:IT]; MID_RHS_MATCH_FROM(0.00)[] Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Jun 2020 14:57:04 -0000 Hello everybody, Disclaimer: I'm not very sure this is the best place to ask, in case feel free to point me in the right direction. Given this, I have an old 10.3 machine with sendmail 8.15.2 that's been working ok for a long time. We have a simple mailterable rule that looks like: schema31.it dbmail-lmtpd[10.33.whatever] That we use to forward mail in LMTP from sendmail to another machine where dbmail is working. Everything works as supposed but today after years of service someone realized the syntax user+mailbox@schema31.it doesn't work as expected. I did a bit of research and debugging and whatever and found out that when a "+" is involved in the mail address mailertable's lookups doesn't seem to work and the mail gets sent to local mailer. I tried even something fancy like .schema31.it dbmail-lmtpd[10.33.whatever] Or even the plain all catchall . dbmail-lmtpd[10.33.whatever] But nothing works. Anybody ever stepped on this and got it working? Please, please, please, avoid the "drop sendmail and switch to " replies, if I could I would already done it ;-) Thanks a lot. -- Andrea Brancatelli From owner-freebsd-stable@freebsd.org Mon Jun 22 14:57:59 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 649E134EC06 for ; Mon, 22 Jun 2020 14:57:59 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:c2c:26d8::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 49rCFd48TZz3RxP; Mon, 22 Jun 2020 14:57:57 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id 05MEvoGJ012053 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 22 Jun 2020 14:57:52 GMT (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: dim@FreeBSD.org Received: from [10.58.0.10] (dadvw [10.58.0.10]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id 05MEvj9C031903 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Mon, 22 Jun 2020 21:57:45 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: Buildworld and buildkernel with very slow compilation, recently To: Dimitry Andric , Chris Nehren References: <2D4CD117-99D0-4A03-8FBC-002CDFFE64F9@ellael.org> <5403888.XOh7uYVVfo@behemoth.lan> Cc: freebsd-stable@freebsd.org From: Eugene Grosbein Message-ID: <22433b0e-b951-346d-d902-fb608c0c5c7b@grosbein.net> Date: Mon, 22 Jun 2020 21:57:39 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record * -0.0 SPF_PASS SPF: sender matches SPF record * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: 49rCFd48TZz3RxP X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=permerror (mx1.freebsd.org: domain of eugen@grosbein.net uses mechanism not recognized by this client) smtp.mailfrom=eugen@grosbein.net X-Spamd-Result: default: False [-2.60 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.86)[-0.860]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.85)[-0.851]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[grosbein.net]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_PERMFAIL(0.00)[empty SPF record]; NEURAL_HAM_SHORT(-0.79)[-0.792]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Jun 2020 14:57:59 -0000 22.06.2020 3:56, Dimitry Andric wrote: > One of the upstream problems is that there is not really any > authoritative performance regression log being built up, so it is hard > to see where such regressions were introduced. Somebody then has to > spend a lot of time tracking down each and every regression, and then > attempt to untangle it from the dozens of commits made around the same > time. :) Such project as FreeBSD could become valuable source of information to track such an issue and it's easy to obtain, for example: make buildworld 2>&1 | logger -t buildworld -p user.info This generates timestamps for every line called in process with help of syslogd. It should be easy to compare outputs obtained with same FreeBSD revision but different clang versions, calculate time diffs and sort by diffs descending :-) Same for ports builds, maybe even quicker. From owner-freebsd-stable@freebsd.org Mon Jun 22 15:14:30 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9894234F4C7 for ; Mon, 22 Jun 2020 15:14:30 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:c2c:26d8::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 49rCck04wPz3TLT for ; Mon, 22 Jun 2020 15:14:29 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id 05MFEPtk012198 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 22 Jun 2020 15:14:26 GMT (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: abrancatelli@schema31.it Received: from [10.58.0.10] (dadvw [10.58.0.10]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id 05MFEMYl032108 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Mon, 22 Jun 2020 22:14:22 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: Problem with Sendmail Mailertable To: Andrea Brancatelli , freebsd-stable@freebsd.org References: From: Eugene Grosbein Message-ID: Date: Mon, 22 Jun 2020 22:14:15 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record * -0.0 SPF_PASS SPF: sender matches SPF record * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: 49rCck04wPz3TLT X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=permerror (mx1.freebsd.org: domain of eugen@grosbein.net uses mechanism not recognized by this client) smtp.mailfrom=eugen@grosbein.net X-Spamd-Result: default: False [-2.52 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.90)[-0.901]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.85)[-0.850]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[grosbein.net]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_PERMFAIL(0.00)[empty SPF record]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.67)[-0.671]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Jun 2020 15:14:30 -0000 22.06.2020 21:56, Andrea Brancatelli via freebsd-stable wrote: > I have an old 10.3 machine with sendmail 8.15.2 that's been working ok > for a long time. > > We have a simple mailterable rule that looks like: > > schema31.it dbmail-lmtpd[10.33.whatever] > > That we use to forward mail in LMTP from sendmail to another machine > where dbmail is working. Everything works as supposed but today after > years of service someone realized the syntax user+mailbox@schema31.it > doesn't work as expected. > > I did a bit of research and debugging and whatever and found out that > when a "+" is involved in the mail address mailertable's lookups doesn't > seem to work and the mail gets sent to local mailer. > > I tried even something fancy like > > .schema31.it dbmail-lmtpd[10.33.whatever] > > Or even the plain all catchall > > . dbmail-lmtpd[10.33.whatever] > > But nothing works. > > Anybody ever stepped on this and got it working? > > Please, please, please, avoid the "drop sendmail and switch to > " replies, if I could I would already done it ;-) This feature works for me but I use FEATURE(virtusertable) instead of mailertable to pass mail to my custom mailer: #virtusertable # the following rule diverts mail to "plussed" (and only plussed) destination addresses to custom mailer ++@realdomain.net %1%3@realdomain.net.pseudodomain #EOF (mailer definition has CPpseudodomain for this to work). Maybe it works for mailertable too, try it. From owner-freebsd-stable@freebsd.org Mon Jun 22 15:17:48 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6E65734FAA3 for ; Mon, 22 Jun 2020 15:17:48 +0000 (UTC) (envelope-from DutchDaemon@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49rChX29RVz3TWV for ; Mon, 22 Jun 2020 15:17:48 +0000 (UTC) (envelope-from DutchDaemon@FreeBSD.org) Received: from [10.255.0.22] (ansible.tepucom.nl [91.190.105.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: dutchdaemon/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 1473B33B66 for ; Mon, 22 Jun 2020 15:17:47 +0000 (UTC) (envelope-from DutchDaemon@FreeBSD.org) Subject: Re: Problem with Sendmail Mailertable To: freebsd-stable@freebsd.org References: From: DutchDaemon - FreeBSD Forums Administrator Autocrypt: addr=DutchDaemon@FreeBSD.org; keydata= mQINBFzVrs4BEADBxTfsrhISlpGxuyBslg1ALG9m7fNwVR2C8i3/6j9bgbb4jXsHoGfLECwa qfVyPn6tdHYAQmbWBnTXzZy/bzUlFoCmeNZUbQ2WXvO2s9WXMblZ6nersNt7EPfBMl+1JMLr UU2/B8rA9bUkXF7Bs2OXdJsVE4N1JnIc4S6xhemSh3p+ldJAoIr2snG2fxWqM8ILtkvFpg8I k7vpS2Dy24FeRTAenG6tKGOsKs/pvPVOaPa5DrVhw8N+XlZ+fsxlABt7BjDeKl4JsO3oQibL 7ZtN0Fkrno/Oi/wYPBMPdUL9Cnz2eWGoDjTw+SltsGQsTf0L8CyjuIRzW7G8spR7ilI9cPBX LmBGszEse4GhBHxxboRgdZsgJSIgevG932f2qiL2J/NmFdfdObI5oDMTDvczSYcUssko1S9H N05SKGLj1Mi8a5w7cJ9lIZzYdcfQZJLHjwGe0BTiAGt9kWbBvdyopw0Pe95EH+gBX0PcLZHY eDDznoQEgN2tKkblNFcqbq7iTgz1ux/mXvsbQOf4yhOo+40SDU3MHY/Vi/w8pth3DF/kv+T/ 1QS134zUkl5lKeeogX+wVz8w8p6xq8YPFIP/tUaI3moxLH8tIICL4G6Tx07yyv29e84vaW7z 2GH9iype6Lphm+LwtuH5JE9omXgR+5UMHmwFRCy/HyU9IIdsoQARAQABtEREdXRjaERhZW1v biAtIEZyZWVCU0QgRm9ydW1zIEFkbWluaXN0cmF0b3IgPER1dGNoRGFlbW9uQEZyZWVCU0Qu b3JnPokCVwQTAQgAQQIbIwUJCWYBgAULCQgHAgYVCgkICwIEFgIDAQIeAQIXgBYhBPQFlL3G bv5Tua98GdEdnm9HMmuoBQJdaC6xAhkBAAoJENEdnm9HMmuolcwQAKJoShuB0IRRxH7NlfI5 rVgcSeWBlwwrS5b/Oja96gEu5BqoPq59so8rRjcmU+7Z4mC3ryZAYeDvq7/qGQ4pC9G3P9N+ 13Cg1+vqaXkmuxq6Daj+FWKE1XCNQI+dbUC4zLS2+glCujSdFw4ce75DGFlCErcJC75xbKMj swqL92C/I94vClO/DGbLIbohIEQljqB4GY42geqUgWMtr+ZKPj7yGEieVvaytu7+bV3oX0WL 9viP14lnO47mDr3YmnsqxjJXDDQet45evhZ6iGY4iWyUM1xn7LHN8CZ6GJPcwu/Od/GhG0h7 96jE49fuM51UPSnAu/NAu1megpgThyjikWJBLoGYx+WYi9ri/LzmTQWPn3m+Y/whS06ZDn7v Q2nyrmCBbM/Rk1Jj71cqsohhCJC4MbkLXquXmAaWz3/zzwnSmMN8AFL8YmLoR9WJzwSx2W8l q8kacLhm97h/qxXyZJFCoZQwd6nKJlNm2QNhXkAotbrPHKZ71OJPI7bu78Q3JjQwAVRNgqqz UQk2Ydduw1CKF6XBIhRauKKSIRxfIHBSpphXmMrIpaFeK4MH+ePslV1rD9DfFto4nDzTT8fz 7Kw1FejR5iOoi51i1SnXnttiJf9FPj6j1i7QS78zZpvdgm1S1MN+jzH3HV1x+2F+F2O0BpQM 6hyBU2BYl7xw7PKLuQINBFzVrs4BEACY/uqLL8YtKIDa1z3kg+S7IVPDTKbkCeFb7p8cUSJv Mq32kyndxWjulsZGigDoBBvj7mjqzhbUwrpvioNRytKoxF850/gxjqipcjvrQ2vawhX/VbkA LA8+Ml04iLD9Cb6k8cyODwyNq0BQpThrHTfogcSpEQ15BvHSfw4t6w9dL3bEn2G/kpzajcLO CQQH8uZRFzKL5cTcT418DkrVoqvPj+KO+5iKVrmE2ug65qjW+9frgZRfW/HJa0XTFXnfhrUS /q7JtpbJlBDmiP/yXvl75mXrOTtcGN59dXSU7Zj3AVowCmDtOqA6Ckm2TblrrW/fEeTkJ/AW qWHe+H2KNN/AdkTjxAQO63rcDNKHEquz6JfKxH5UTe0dk0xhUswbFcNfUAAwk4kKR05IiZoY 2h26p9d1Q+q5kKmp0fEW0kJO/OzPunmlqTPnZ/rw9ec7alNlMc67Zp52ggYG66fG/Jvm9RrR gthFnJYigQQDW0WzuLtYmM4LJt6FEw5mlEXYds4Ep9UqhPID4BGoNT8Zk4X9b6iNFaIRU7Mt 9qOKbAc6VD1L1gQLGiTq/l+Zvt0DL1nQXyXoGodlR4a2mtL+93lC23DW8cmzwcgFXJUV9UBo 5a6tmdnF/k5dF1BRUgjMvBYlxxnDcFx1lYdJ9EZNqpACajd7/7dGJp9/6c0xZMQVmwARAQAB iQI8BBgBCAAmFiEE9AWUvcZu/lO5r3wZ0R2eb0cya6gFAlzVrs4CGwwFCQlmAYAACgkQ0R2e b0cya6j1SQ//Qr7J5meamYGTJwmguFXu3HTNZeKVZRC6yjYqfoG5tbb/fOhPPLdfkcwIrIFO Wzx5vao+i66XmktpqTIdVaVDwIlS9yoXpEMRM1TstiK7usoNGztGYejQfRvxOVJIwgwCBnfs FApYGfD2BHm6yhiny0Kmp3wIF66Xe0GNN3eVqcKe3F9DrDl1nwcYGldD7ImsbwvCayqfGq0H 3UJRw3HwVZl0+8N/TPJ7O/aFPGOxCkRK2LNgLE93qX0RnWj1iYRAA2aFPngrufTJUjCj5ME6 dAmsS+iZKr0Swx+q/hCrHNzNeOsimARWF8yPxTE5f6qDMyXGkb1dp+IV1qbJaKBH1dUoHp2R 2Zmhubp1B9uipqJDolpEP7TwDpxRW9blOuyMuRMjcpvluqnUCIMtRW5BtKRM0/OQuwhLjFjL 0fm3KH/3h3SiS1s21mhFwbd02x3YrQUbypyEiS6V68fVsaAsi2GcL3NiePDCrcyjMwClivXi 34sMjL+GVBIFdvcgxEMii8MC0U5hnWRxG6uKlJ5jJWvuu/KmDx32GW8NpuaadxuqWloMHf/J jfFlwCm6XAyoYSTN/5rE2qtzgCIgzOGNUSRBYfnCmUD1WS8D5Cm1FDBKSUL2PZ64vyIQBX2O cQ7571C00BqMxqiTopGbh85U/jL6FWJbq2YWxftW7HF81eM= Organization: The FreeBSD Forums Message-ID: <5d20fbcd-7ca0-9bcc-2ffc-d562b50bad1a@FreeBSD.org> Date: Mon, 22 Jun 2020 17:17:45 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="iQ0gar9ZVubZSWG9vY73YJz685xRHvRdF" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Jun 2020 15:17:48 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --iQ0gar9ZVubZSWG9vY73YJz685xRHvRdF Content-Type: multipart/mixed; boundary="xkuck59kfHuroHoUs3SZVqEImFzK7nGkR" --xkuck59kfHuroHoUs3SZVqEImFzK7nGkR Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Content-Language: nl On 2020-06-22 16:56, Andrea Brancatelli via freebsd-stable wrote: > Hello everybody,=20 > > Disclaimer:=20 > > I'm not very sure this is the best place to ask, in case feel free to > point me in the right direction.=20 > > Given this,=20 > > I have an old 10.3 machine with sendmail 8.15.2 that's been working ok > for a long time.=20 > > We have a simple mailterable rule that looks like:=20 > > schema31.it dbmail-lmtpd[10.33.whatever]=20 AFAICT, you're missimg a colon here. Try: schema31.it dbmail-lmtpd:[10.33.whatever]=20 --xkuck59kfHuroHoUs3SZVqEImFzK7nGkR-- --iQ0gar9ZVubZSWG9vY73YJz685xRHvRdF Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEE9AWUvcZu/lO5r3wZ0R2eb0cya6gFAl7wy5kACgkQ0R2eb0cy a6gTohAAkNZivEuEk03iULOmQ1JkmcY+J0O7G/XgT6cDh0D+tUFmwNPAUXgStDjE JQ/jIhq+rNXihBlf767neFpV/2pe7byG/SYQ6kyrDh9VsZd4pJjJvG4KIHhUhb0+ yYHfRXG1OKLXUs65NTngYtQ8fPLWZMrGaZ1sW1BbflxS3oYGwqvVKstp4wlEiOBe YFcuFtEFHrU68CTlIthFfCnadsJZRNHu/jkIE1RuztnW+xKxTeYSSVX17ag5RPJw we+29+ngTcz0c6jCzoUoGJqQ8Oaqe++ooAOrEK2+ei22zNfIt/rhQsVMdGk/dqa5 yRPwggBJSAQy/8gD5UMI0fcabYnTFv4cm8cJSA9aDQhNCcWAJCHmaXtaXlv2FXZg 50CDhekifrX6gtEF6R9lrdi7ONI5z5i054wtwiS1fa6oqHAOzobar0//zZslRq8s Bcj4fzRYUMfljwm6DqZjvHusC3t661L/pUVw0PuOAtR4jM1T7MrxgEgmXvPEqtur RzVne56qhaST/8Hl4DKn06iHRaT12uGN4C0o+/t2NUglyUZeSibE2AWJXQfntkCQ JZ5PVE5Nornn89KYoo2xgXlgd4VeWS9dsuJkFkvJ8Ey9aqNOw3kTLBaKE1oDfrFz Isenb8zu5sn3PycJwdrwYpRsoIiseNPBylkzKnjBWUeC0NM8kFM= =zAuD -----END PGP SIGNATURE----- --iQ0gar9ZVubZSWG9vY73YJz685xRHvRdF-- From owner-freebsd-stable@freebsd.org Mon Jun 22 15:45:46 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8F085330AA5 for ; Mon, 22 Jun 2020 15:45:46 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: from mail-lj1-x232.google.com (mail-lj1-x232.google.com [IPv6:2a00:1450:4864:20::232]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49rDJn5qdzz3X27 for ; Mon, 22 Jun 2020 15:45:45 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: by mail-lj1-x232.google.com with SMTP id y11so19881109ljm.9 for ; Mon, 22 Jun 2020 08:45:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to:cc; bh=/6juimptoMMtP48zI2c4D0+m851jP3ciHVUpHlrbuFM=; b=sbgSLSYi3t9NNmP2zwkOe83dh0KiT+KHH3zibcWhPJ39SGKIryecZ/qRdJZeJXYR1B Jyli6LVn6K3e4Ej5YiVNTy5iGle/tPD0uP3sQR2SV2R93WLpbNh4m2kmnhzr7epDfvSN PYX+kN4njk7nmnZUQKNSz9qJmuwbecW2j9kRcWWH3IX6QdUsvSQNej6fOJ6L/48SPaWV zVsz4SFFkj9sRsXxgyodFd5JSlIGy/dvVN+cm5ckMIBZ4KB+WB0WedTja2uWHY3WV89Q doJY3eiroaFlMRs954X1Iwk9vZVTCUzeA8zjVvcGhY6FlNIOsCHgzLx9i7sfQTXB+ZNj BYEQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc; bh=/6juimptoMMtP48zI2c4D0+m851jP3ciHVUpHlrbuFM=; b=uP7yupRMyGYKWF6XYmU+rUFB2zMVAroQXT3NqRcykFle7idOfx5m9zEDEHrOU6DNLy ZWhlpqnmSKD0A3Z50+ZGlkQ62lgRqb4VR3l19DXCh79Lxkn4q/95as+Vqo/8rLUs2qB2 qIbruaUofbSJj7Q/M6adE1/QfiBoiqI2GCjK9I2moAv6ky6fj8hPD5sGhlt15hRCplso WuPpAXhBWKZBkvDveIaXHFto8q3ufhTdYXUpTnwmQklWBk4PLPx51bsPlBW9YvB2Ok7P yEUEQKoeyCZF/Vt0gXcE6iz3QfRXybwLpVMu1TGVpo8BfmzxzFs5ELbSZlduZPJzEIJP AIiw== X-Gm-Message-State: AOAM531bihtj+S0QIXnAkZXKIT+lgPohsAE4a4AbP/NVRntUOj3Kpxbd P2HtCxbuGYRassVpqCFw+9PZji3qicnlfgtfWYt1JGAE X-Google-Smtp-Source: ABdhPJwPizZrmXRsjq+JFFJp5ySKUGjZPuivakX3TD/Jtfl/o0DF5iXKKYjEWuwJSYNZw2qz5LQddC9FGxdBdq3d+70= X-Received: by 2002:a05:651c:1126:: with SMTP id e6mr8773112ljo.123.1592840742623; Mon, 22 Jun 2020 08:45:42 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:4703:0:0:0:0:0 with HTTP; Mon, 22 Jun 2020 08:45:41 -0700 (PDT) Reply-To: dwilde1@gmail.com In-Reply-To: <22433b0e-b951-346d-d902-fb608c0c5c7b@grosbein.net> References: <2D4CD117-99D0-4A03-8FBC-002CDFFE64F9@ellael.org> <5403888.XOh7uYVVfo@behemoth.lan> <22433b0e-b951-346d-d902-fb608c0c5c7b@grosbein.net> From: Donald Wilde Date: Mon, 22 Jun 2020 08:45:41 -0700 Message-ID: Subject: Re: Buildworld and buildkernel with very slow compilation, recently To: Eugene Grosbein Cc: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 49rDJn5qdzz3X27 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=sbgSLSYi; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of dwilde1@gmail.com designates 2a00:1450:4864:20::232 as permitted sender) smtp.mailfrom=dwilde1@gmail.com X-Spamd-Result: default: False [-3.12 / 15.00]; HAS_REPLYTO(0.00)[dwilde1@gmail.com]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; REPLYTO_ADDR_EQ_FROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.10)[-0.096]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.01)[-1.012]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.01)[-1.015]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_REPLYTO(0.00)[gmail.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::232:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Jun 2020 15:45:46 -0000 On 6/22/20, Eugene Grosbein wrote: > 22.06.2020 3:56, Dimitry Andric wrote: > >> One of the upstream problems is that there is not really any >> authoritative performance regression log being built up, so it is hard >> to see where such regressions were introduced. Somebody then has to >> spend a lot of time tracking down each and every regression, and then >> attempt to untangle it from the dozens of commits made around the same >> time. :) > > Such project as FreeBSD could become valuable source of information to track > such an issue > and it's easy to obtain, for example: > > make buildworld 2>&1 | logger -t buildworld -p user.info > > This generates timestamps for every line called in process with help of > syslogd. > It should be easy to compare outputs obtained with same FreeBSD revision > but different clang versions, calculate time diffs and sort by diffs > descending :-) Eugene, I have noticed (though quite anecdotally) a real slowdown, so I'd like to help. My mule is not busy at this time so if you have a place to put these output files, I'll be glad to crunch some over the next few days. My mule is only an i3 with 4GB with 40G of swap and an active ccache, but I should be able to run any variant of tests you need to see. I'm on 12-STABLE and I now am doing a fresh base/stable/12 pull. I have _not_ deleted my /usr/src.bak copy, although I didn't stash a copy of the old ports tree before updating it. I use tcsh everywhere, but I should be able to do what you intend (hey, it's been a loooong time since I tried to speak csh!) and if you'd like me to do deltas with LLVM80 vs LLVM90 vs. LLVM100, etc, I can do this. Just tell me exactly what you want to see. -- Don Wilde **************************************************** * What is the Internet of Things but a system * * of systems including humans? * **************************************************** From owner-freebsd-stable@freebsd.org Tue Jun 23 19:29:39 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 238AF3368DE; Tue, 23 Jun 2020 19:29:39 +0000 (UTC) (envelope-from lwhsu@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49rxDg056mz419w; Tue, 23 Jun 2020 19:29:39 +0000 (UTC) (envelope-from lwhsu@freebsd.org) Received: by freefall.freebsd.org (Postfix, from userid 1129) id DF649D370; Tue, 23 Jun 2020 19:29:38 +0000 (UTC) Date: Tue, 23 Jun 2020 19:29:38 +0000 From: Li-Wen Hsu To: freebsd-testing@freebsd.org Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: FreeBSD CI Weekly Report 2020-06-21 Message-ID: <20200623192938.GA23070@freefall.freebsd.org> Reply-To: freebsd-testing@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 Jun 2020 19:29:39 -0000 (Please send the followup to freebsd-testing@ and note Reply-To is set.) FreeBSD CI Weekly Report 2020-06-21 =================================== Here is a summary of the FreeBSD Continuous Integration results for the period from 2020-06-15 to 2020-06-21. During this period, we have: * 2272 builds (93.9% (+3.9) passed, 6.1% (-3.9) failed) of buildworld and buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11 branches. * 268 test runs (79.8% (+1.9) passed, 13.1% (-7.5) unstable, 7.1% (+5.6) exception) were executed on amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches. * 100.0 doc and www builds (100% (+3.4) passed) Test case status (on 2020-06-21 23:59): | Branch/Architecture | Total | Pass | Fail | Skipped | | ------------------- | --------- | --------- | ------ | -------- | | head/amd64 | 7863 (0) | 7764 (-9) | 0 (0) | 99 (+9) | | head/i386 | 7861 (0) | 7756 (-6) | 0 (0) | 105 (+6) | | 12-STABLE/amd64 | 7591 (+4) | 7532 (+4) | 0 (0) | 59 (0) | | 12-STABLE/i386 | 7589 (+4) | 7525 (+4) | 0 (0) | 64 (0) | | 11-STABLE/amd64 | 6887 (+2) | 6834 (0) | 0 (-1) | 53 (+3) | | 11-STABLE/i386 | 6885 (+2) | 6833 (+3) | 0 (-1) | 52 (0) | (The statistics from experimental jobs are omitted) If any of the issues found by CI are in your area of interest or expertise please investigate the PRs listed below. The latest web version of this report is available at https://hackmd.io/@FreeBSD-CI/report-20200621 and archive is available at https://hackmd.io/@FreeBSD-CI/ , any help is welcome. ## Failing jobs * https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/ ``` /usr/local/bin/x86_64-unknown-freebsd12.1-ld: /tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o): in function `curses::Window::Box(unsigned int, unsigned int)': /workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361: undefined reference to `box' /usr/local/bin/x86_64-unknown-freebsd12.1-ld: /workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361: undefined reference to `box' collect2: error: ld returned 1 exit status ``` ## Regressions * lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 after r360915 https://bugs.freebsd.org/246537 * (head, stable/12, stable/11) 2 tests start failing after llvm10 import * lib.msun.ctrig_test.test_inf_inputs https://bugs.freebsd.org/244732 * (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d https://bugs.freebsd.org/244823 * Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386 https://bugs.freebsd.org/244163 Discovered by newly endabled sys.net.* tests. ([r357857](https://svnweb.freebsd.org/changeset/base/357857)) * sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel https://bugs.freebsd.org/244168 Discovered by newly endabled sys.net.* tests. ([r357857](https://svnweb.freebsd.org/changeset/base/357857)) Fix in review: https://reviews.freebsd.org/D25284 ## Failing and Flaky tests (from experimental jobs) * https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/ * cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d * https://bugs.freebsd.org/237641 * cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d * https://bugs.freebsd.org/244823 * https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/ * There are ~13 failing and ~109 skipped cases, including flakey ones, see https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/ for more details * Work for cleaning these failing cass are in progress * https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/ * Total 3749 tests, 2277 success, 646 failures, 826 skipped ## Disabled Tests * sys.fs.tmpfs.mount_test.large https://bugs.freebsd.org/212862 * sys.fs.tmpfs.link_test.kqueue https://bugs.freebsd.org/213662 * sys.kqueue.libkqueue.kqueue_test.main https://bugs.freebsd.org/233586 * sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop https://bugs.freebsd.org/220841 * lib.libc.regex.exhaust_test.regcomp_too_big (i386 only) https://bugs.freebsd.org/237450 * sys.netinet.socket_afinet.socket_afinet_bind_zero https://bugs.freebsd.org/238781 * sys.netpfil.pf.names.names * sys.netpfil.pf.synproxy.synproxy https://bugs.freebsd.org/238870 * sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger https://bugs.freebsd.org/239292 * sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger https://bugs.freebsd.org/239397 * sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger https://bugs.freebsd.org/239399 * sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger https://bugs.freebsd.org/239425 * lib.libc.gen.getmntinfo_test.getmntinfo_test https://bugs.freebsd.org/240049 * sys.sys.qmath_test.qdivq_s64q https://bugs.freebsd.org/240219 * sys.kern.ptrace_test.ptrace__getppid https://bugs.freebsd.org/240510 * lib.libc.sys.stat_test.stat_socket https://bugs.freebsd.org/240621 * lib.libarchive.functional_test.test_write_filter_zstd https://bugs.freebsd.org/240683 * lib.libcasper.services.cap_dns.dns_test.main https://bugs.freebsd.org/241435 * local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386 https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/ * sys.kern.ptrace_test.ptrace__procdesc_reparent_wait_child https://bugs.freebsd.org/243605 * sys.kern.ptrace_test.ptrace__parent_wait_after_attach https://bugs.freebsd.org/244055 * sys.kern.ptrace_test.ptrace__parent_exits_before_child https://bugs.freebsd.org/244056 * sys.net.if_lagg_test.witness (i386) https://bugs.freebsd.org/244163 * PipePdfork.WildcardWait in sys.capsicum.capsicum-test.main https://bugs.freebsd.org/244165 * sys.net.if_lagg_test.lacp_linkstate_destroy_stress (i386) https://bugs.freebsd.org/244168 * sys.netinet6.frag6.frag6_07.frag6_07 https://bugs.freebsd.org/244170 * sys.netinet.fibs_test.udp_dontroute6 https://bugs.freebsd.org/244172 * sys.netpfil.pf.nat.exhaust https://bugs.freebsd.org/244703 ## Issues ### Cause build fails * https://bugs.freebsd.org/233735 Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: machine/endian.h: No such file or directory * https://bugs.freebsd.org/233769 Possible build race: ld: error: unable to find library -lgcc_s ### Cause kernel panics * https://bugs.freebsd.org/238870 sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic ### Open * https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be converted to Python3 * https://bugs.freebsd.org/237641 Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d * https://bugs.freebsd.org/237656 "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of memory." seen when running sys/netipsec tests * https://bugs.freebsd.org/238781 sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when mac_portacl(4) loaded * https://bugs.freebsd.org/239292 Flakey test case: sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger * https://bugs.freebsd.org/239397 Flakey test case: sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger * https://bugs.freebsd.org/239399 Flakey test case: sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger * https://bugs.freebsd.org/239425 Flakey test case: sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger * https://bugs.freebsd.org/241662 Flakey test case: lib.libarchive.functional_test.test_fuzz_iso9660 * https://bugs.freebsd.org/246443 sys.net.if_clone_test.epair_stress sometimes exceeds timeout limit but not caught by kyua ### Others * [Tickets related to testing@](https://preview.tinyurl.com/y9maauwg) From owner-freebsd-stable@freebsd.org Wed Jun 24 16:36:26 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E8635352E98 for ; Wed, 24 Jun 2020 16:36:26 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: from mail-lj1-x234.google.com (mail-lj1-x234.google.com [IPv6:2a00:1450:4864:20::234]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49sTLK5xF6z4NC9 for ; Wed, 24 Jun 2020 16:36:25 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: by mail-lj1-x234.google.com with SMTP id i27so3239750ljb.12 for ; Wed, 24 Jun 2020 09:36:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:from:date:message-id:subject:to; bh=Lxz7xEBSzC0MmAOR5xr6kkAWH3g0R4gKnL6QGatqE/4=; b=pBF+FXn19rz6oEYOVrHNruHm2Hf8lD2XpRdIVeVBAwn+VbMQQNdHk6Drz/7gdgBmW1 B/SJXPa5QkiXXgBbiLlvL61S+FdQOCu8qKoUU9v+ukAurGeou5/fg8ggMu0SUbyAgjWV g6VB84Rn3Bf9wFlFMrJ1GqkNR2+Vg93DJQeuTNlpgNqMLGGT8ak+ek5ChzuxjS1VTu1+ wWCav8qP3AUs1BYSXKa3z1I1VZ4lr2b2B8q1FKyu85/WiAEK7D9KodsZehaehskCFMfJ ws4k/rqSg07Fwag08PDr0b9HcnD0qDe/YJENixFbbqDsjUdC+1oKazMsTtwGEwKIkn4/ qOyA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:from:date:message-id :subject:to; bh=Lxz7xEBSzC0MmAOR5xr6kkAWH3g0R4gKnL6QGatqE/4=; b=IqeuPE+i5XoNk/uKiJfZjI4rcZ0CcEf+WnDSGXSTkpqi6iYDcYk2/Kg4lpTtPgzUpA tvnudNpxxuy59oXutW+pzeccScYdh4cnkfnQKCyRe1bIIUmbD4UoeJncmz4qJsVOMxpj xGJYVXheJS7sgx1D8cardaupuHnptgDLQhFgvO9RtuY+Q3MB0hIMr2w5H1tv1e5kJNLF l0OecjWf/cPPdBQCQ8wrUC+NOrP37I/SEF9FkrnXRzIYUj2DDTVTLxIrF4udHad6V3k/ SOTcEr6XMNwdItZ0HwEzzHAgf8I7ttuYwPpY0bUzTBPLAaUzOgkhP+Oi2zJCY7QReCpV LJVA== X-Gm-Message-State: AOAM533HFTOUGMU0rsJKbMwEdc9Ro9lPuZxHEQd8I4kR0vzLAgezjmHm 2HeZZqwcG6GuXQoAQsFtI6ZVQDfPLyQUMDyTU7kUwI9t X-Google-Smtp-Source: ABdhPJwQQXooWhFcgitB1XKXsLRB0fEngXsFAFiVPDBnFf4BPqnsSonTVoY2i69Gw+ejOrpDXXghU8CmRdldidJqLHU= X-Received: by 2002:a2e:9316:: with SMTP id e22mr5785202ljh.357.1593016583635; Wed, 24 Jun 2020 09:36:23 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:4703:0:0:0:0:0 with HTTP; Wed, 24 Jun 2020 09:36:23 -0700 (PDT) Reply-To: dwilde1@gmail.com From: Donald Wilde Date: Wed, 24 Jun 2020 09:36:23 -0700 Message-ID: Subject: swap space issues To: freebsd-stable Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 49sTLK5xF6z4NC9 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=pBF+FXn1; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of dwilde1@gmail.com designates 2a00:1450:4864:20::234 as permitted sender) smtp.mailfrom=dwilde1@gmail.com X-Spamd-Result: default: False [-2.15 / 15.00]; HAS_REPLYTO(0.00)[dwilde1@gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; REPLYTO_ADDR_EQ_FROM(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.62)[-0.621]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.91)[-0.907]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_REPLYTO(0.00)[gmail.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_SHORT(0.38)[0.376]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::234:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Jun 2020 16:36:27 -0000 All, I recently upgraded my 12-STABLE system to the latest, and now my swap subsystems aren't working. I deliberately set up a 40GB partition for swap, and when I do 'top -t' I am only seeing 7906M total. When using synth, it shows swap usage of < 2%, but then it gives the 'out of swap' complaint and tosses all my users out into neverland. My /boot/loader.conf has: kern.maxproc=75000 kern.maxswzone=17200000 ... but those are no longer effective. What has changed, and what do I need to do to rectify this? -- Don Wilde **************************************************** * What is the Internet of Things but a system * * of systems including humans? * **************************************************** From owner-freebsd-stable@freebsd.org Wed Jun 24 18:48:08 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 96DE6340841 for ; Wed, 24 Jun 2020 18:48:08 +0000 (UTC) (envelope-from freebsd-stable@dino.sk) Received: from mailhost.netlabit.sk (mailhost.netlabit.sk [84.245.65.72]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49sXGH2bXLz3ycs for ; Wed, 24 Jun 2020 18:48:06 +0000 (UTC) (envelope-from freebsd-stable@dino.sk) Received: from vinq4.dino.sk (a181.b2.elvisdk.sk [85.248.26.181]) (AUTH: LOGIN milan, TLS: TLSv1/SSLv3,256bits,AES256-SHA) by mailhost.netlabit.sk with ESMTPSA; Wed, 24 Jun 2020 20:47:59 +0200 id 00F3A9DF.5EF39FDF.000178D4 Date: Wed, 24 Jun 2020 20:29:21 +0200 From: Milan Obuch To: freebsd-stable@freebsd.org Subject: HP Business PC - NMI problem Message-ID: <20200624202335.05314a6a@vinq4.dino.sk> X-Mailer: Claws Mail 3.17.5 (GTK+ 2.24.32; i386-portbld-freebsd12.1) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 49sXGH2bXLz3ycs X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of freebsd-stable@dino.sk designates 84.245.65.72 as permitted sender) smtp.mailfrom=freebsd-stable@dino.sk X-Spamd-Result: default: False [-0.78 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.47)[-0.469]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[dino.sk]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.39)[-0.395]; NEURAL_SPAM_SHORT(0.38)[0.382]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16160, ipnet:84.245.64.0/18, country:SK]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Jun 2020 18:48:09 -0000 Hi, today I installed FreeBSD 12,1 on HP 260 G1 DM Business PC. There were no troubles in install phase, but after rebooting into newly installed system I am getting repeating messages on console NMI/cpu0. When system loads up to login prompt, everything seems working, I can Alt-F2 switch to another screen and login, install a port (or do it through network), just on console/first screen much messages are being output, which is annoying and makes one screen unusable. Sometimes it looks like boot process stops/hangs, then one must press power to shutdown the box, then start it again. =46rom log: kernel: NMI/cpu0 ... going to debugger kernel: NMI ISA 3c, EISA ff (number changes sometimes to 2c, less frequently compared to 3c) Has anybody any hint how to solve this issue? Regards, Milan From owner-freebsd-stable@freebsd.org Wed Jun 24 19:00:14 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0273234100C for ; Wed, 24 Jun 2020 19:00:14 +0000 (UTC) (envelope-from "") Received: from mout01.posteo.de (mout01.posteo.de [185.67.36.141]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.posteo.de", Issuer "StartCom Class 3 Primary Intermediate Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 49sXXF2963z403R for ; Wed, 24 Jun 2020 19:00:13 +0000 (UTC) (envelope-from "") Received: from submission (posteo.de [89.146.220.130]) by mout01.posteo.de (Postfix) with ESMTPS id 9A2C0160060 for ; Wed, 24 Jun 2020 21:00:10 +0200 (CEST) Received: from customer (localhost [127.0.0.1]) by submission (posteo.de) with ESMTPSA id 49sXX96JPtz6tmD; Wed, 24 Jun 2020 21:00:09 +0200 (CEST) From: Walter von Entferndt To: freebsd-stable@freebsd.org, freebsd-stable@freebsd.org Cc: Milan Obuch , Milan Obuch Subject: Re: HP Business PC - NMI problem Date: Wed, 24 Jun 2020 20:59:59 +0200 Message-ID: <5265782.8gLySxXtyI@t450s.local.lan> In-Reply-To: <20200624202335.05314a6a@vinq4.dino.sk> References: <20200624202335.05314a6a@vinq4.dino.sk> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Rspamd-Queue-Id: 49sXXF2963z403R X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=posteo.de (policy=none); spf=none (mx1.freebsd.org: domain of mout01.posteo.de has no SPF policy when checking 185.67.36.141) smtp.helo=mout01.posteo.de X-Spamd-Result: default: False [-1.88 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.96)[-0.963]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; NEURAL_HAM_MEDIUM(-0.96)[-0.964]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[185.67.36.141:from]; NEURAL_HAM_SHORT(-0.25)[-0.252]; R_SPF_NA(0.00)[no SPF record]; R_DKIM_NA(0.00)[]; CTE_CASE(0.50)[]; ASN(0.00)[asn:8495, ipnet:185.67.36.0/23, country:DE]; MIME_TRACE(0.00)[0:+]; FROM_NEQ_ENVFROM(0.00)[walter.von.entferndt@posteo.de,]; DMARC_POLICY_SOFTFAIL(0.10)[posteo.de : No valid SPF, No valid DKIM,none] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Jun 2020 19:00:14 -0000 > today I installed FreeBSD 12,1 on HP 260 G1 DM Business PC. There were > [...] > kernel: NMI ISA 3c, EISA ff EISA? How old is that machine? Is that a i386 machine? You could try to boot with safe settings and/or disable ACPI. -- =|o) "Stell' Dir vor es geht und keiner kriegt's hin." (Wolfgang Neuss) From owner-freebsd-stable@freebsd.org Wed Jun 24 19:23:42 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ACBF53413ED for ; Wed, 24 Jun 2020 19:23:42 +0000 (UTC) (envelope-from freebsd-stable@dino.sk) Received: from mailhost.netlabit.sk (mailhost.netlabit.sk [84.245.65.72]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49sY3K5rFJz41Xq for ; Wed, 24 Jun 2020 19:23:41 +0000 (UTC) (envelope-from freebsd-stable@dino.sk) Received: from vinq4.dino.sk (a181.b2.elvisdk.sk [85.248.26.181]) (AUTH: LOGIN milan, TLS: TLSv1/SSLv3,256bits,AES256-SHA) by mailhost.netlabit.sk with ESMTPSA; Wed, 24 Jun 2020 21:23:39 +0200 id 00F3A9D4.5EF3A83B.00017D3B Date: Wed, 24 Jun 2020 21:02:26 +0200 From: Milan Obuch To: freebsd-stable@freebsd.org Subject: Re: HP Business PC - NMI problem Message-ID: <20200624210226.0c797b2e@vinq4.dino.sk> In-Reply-To: <5265782.8gLySxXtyI@t450s.local.lan> References: <20200624202335.05314a6a@vinq4.dino.sk> <5265782.8gLySxXtyI@t450s.local.lan> X-Mailer: Claws Mail 3.17.5 (GTK+ 2.24.32; i386-portbld-freebsd12.1) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 49sY3K5rFJz41Xq X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of freebsd-stable@dino.sk designates 84.245.65.72 as permitted sender) smtp.mailfrom=freebsd-stable@dino.sk X-Spamd-Result: default: False [-0.82 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.50)[-0.498]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[dino.sk]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.40)[-0.404]; NEURAL_SPAM_SHORT(0.38)[0.383]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16160, ipnet:84.245.64.0/18, country:SK]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Jun 2020 19:23:42 -0000 On Wed, 24 Jun 2020 20:59:59 +0200 Walter von Entferndt wrote: > > today I installed FreeBSD 12,1 on HP 260 G1 DM Business PC. There > > were [...] > > kernel: NMI ISA 3c, EISA ff > EISA? How old is that machine? Is that a i386 machine? > > You could try to boot with safe settings and/or disable ACPI. No, this is 64bit CPU, system installed with UEFI boot. Actually the problem is gone now - BIOS was from year 2014, we found new one quite recent (May 2020), upgrade helped. After disabling secure boot in newer BIOS everything seems to work OK. Sorry for the noise. Milan From owner-freebsd-stable@freebsd.org Wed Jun 24 20:23:17 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 749FD342B70 for ; Wed, 24 Jun 2020 20:23:17 +0000 (UTC) (envelope-from "") Received: from mout02.posteo.de (mout02.posteo.de [185.67.36.142]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.posteo.de", Issuer "StartCom Class 3 Primary Intermediate Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 49sZN44nY2z44VK for ; Wed, 24 Jun 2020 20:23:16 +0000 (UTC) (envelope-from "") Received: from submission (posteo.de [89.146.220.130]) by mout02.posteo.de (Postfix) with ESMTPS id 9357C2400FB for ; Wed, 24 Jun 2020 22:23:14 +0200 (CEST) Received: from customer (localhost [127.0.0.1]) by submission (posteo.de) with ESMTPSA id 49sZN15PgBz6tmF for ; Wed, 24 Jun 2020 22:23:13 +0200 (CEST) From: Walter von Entferndt To: freebsd-stable@freebsd.org Subject: suspend/resume (was: Re: HP Business PC - NMI problem) Date: Wed, 24 Jun 2020 22:22:47 +0200 Message-ID: <5318026.mMMZhaHaU6@t450s.local.lan> In-Reply-To: <20200624210226.0c797b2e@vinq4.dino.sk> References: <20200624202335.05314a6a@vinq4.dino.sk> <5265782.8gLySxXtyI@t450s.local.lan> <20200624210226.0c797b2e@vinq4.dino.sk> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Rspamd-Queue-Id: 49sZN44nY2z44VK X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=posteo.de (policy=none); spf=none (mx1.freebsd.org: domain of mout02.posteo.de has no SPF policy when checking 185.67.36.142) smtp.helo=mout02.posteo.de X-Spamd-Result: default: False [-0.50 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.60)[-0.604]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-0.32)[-0.315]; NEURAL_SPAM_SHORT(0.12)[0.124]; RCVD_IN_DNSWL_MED(-0.20)[185.67.36.142:from]; R_SPF_NA(0.00)[no SPF record]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8495, ipnet:185.67.36.0/23, country:DE]; FROM_NEQ_ENVFROM(0.00)[walter.von.entferndt@posteo.de,]; CTE_CASE(0.50)[]; DMARC_POLICY_SOFTFAIL(0.10)[posteo.de : No valid SPF, No valid DKIM,none] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Jun 2020 20:23:17 -0000 Dektop & Laptop users with UEFI may want to enable suspend/resume/hibernate to an "Intel Rapid Start Technology" partition with the my HOWTO on https:// forums.freebsd.org/threads/suspend-resume-to-disk-iffs-irst-partition-intel- fast-flash-intel-rapid-start-technology.75860/ Please leave some kind of feedback, if it works for others it can be polished and go into the FBSD wiki. -- =|o) "Stell' Dir vor es geht und keiner kriegt's hin." (Wolfgang Neuss) From owner-freebsd-stable@freebsd.org Thu Jun 25 00:04:18 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B8C03346AE7 for ; Thu, 25 Jun 2020 00:04:18 +0000 (UTC) (envelope-from grog@lemis.com) Received: from lax.lemis.com (www.lemis.com [45.32.70.18]) by mx1.freebsd.org (Postfix) with ESMTP id 49sgH55Jw5z4GH7 for ; Thu, 25 Jun 2020 00:04:17 +0000 (UTC) (envelope-from grog@lemis.com) Received: from eureka.lemis.com (aussie-gw.lemis.com [167.179.139.35]) by lax.lemis.com (Postfix) with ESMTP id 220C5280D0; Thu, 25 Jun 2020 00:04:11 +0000 (UTC) Received: by eureka.lemis.com (Postfix, from userid 1004) id 571CF263599; Thu, 25 Jun 2020 10:04:10 +1000 (AEST) Date: Thu, 25 Jun 2020 10:04:10 +1000 From: Greg 'groggy' Lehey To: Donald Wilde Cc: freebsd-stable Subject: Re: swap space issues Message-ID: <20200625000410.GA10210@eureka.lemis.com> References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="tThc/1wpZn/ma/RB" Content-Disposition: inline In-Reply-To: Organization: The FreeBSD Project Phone: +61-3-5309-0418 Mobile: +61-490-494-038. Use only as instructed. WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 9A1B 8202 BCCE B846 F92F 09AC 22E6 F290 507A 4223 User-Agent: Mutt/1.6.1 (2016-04-27) X-Rspamd-Queue-Id: 49sgH55Jw5z4GH7 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of grog@lemis.com designates 45.32.70.18 as permitted sender) smtp.mailfrom=grog@lemis.com X-Spamd-Result: default: False [-4.26 / 15.00]; ARC_NA(0.00)[]; FORGED_SENDER(0.30)[grog@FreeBSD.org,grog@lemis.com]; NEURAL_HAM_MEDIUM(-0.90)[-0.905]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a:www.lemis.com]; NEURAL_HAM_LONG(-1.00)[-1.004]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; DMARC_NA(0.00)[FreeBSD.org]; HAS_ORG_HEADER(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.36)[-0.356]; RCPT_COUNT_TWO(0.00)[2]; SIGNED_PGP(-2.00)[]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:20473, ipnet:45.32.64.0/19, country:US]; FROM_NEQ_ENVFROM(0.00)[grog@FreeBSD.org,grog@lemis.com] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 00:04:18 -0000 --tThc/1wpZn/ma/RB Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Wednesday, 24 June 2020 at 9:36:23 -0700, Donald Wilde wrote: > All, > > I recently upgraded my 12-STABLE system to the latest, and now my > swap subsystems aren't working. I deliberately set up a 40GB > partition for swap, and when I do 'top -t' I am only seeing 7906M > total. That looks suspiciously like the difference from 32 GB. Could it be numeric overflow? And if so, where? What does pstat -s say? > When using synth, it shows swap usage of < 2%, but then it gives the > 'out of swap' complaint and tosses all my users out into neverland. Unless this also causes kernel messages to that effect, this, too, could be an issue with synth. Greg -- Sent from my desktop computer. Finger grog@FreeBSD.org for PGP public key. See complete headers for address and phone numbers. This message is digitally signed. If your Microsoft mail program reports problems, please read http://lemis.com/broken-MUA --tThc/1wpZn/ma/RB Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iEYEARECAAYFAl7z6foACgkQIubykFB6QiNTgwCfWAudMqtjkRh+gQzbSig3BitQ dH4An0qTqL9Tdidni9pGysoOH9XeJT8I =ES5J -----END PGP SIGNATURE----- --tThc/1wpZn/ma/RB-- From owner-freebsd-stable@freebsd.org Thu Jun 25 01:36:52 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C87D1348DC3 for ; Thu, 25 Jun 2020 01:36:52 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: from mail-lj1-x229.google.com (mail-lj1-x229.google.com [IPv6:2a00:1450:4864:20::229]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49sjKv6BKsz4LC4 for ; Thu, 25 Jun 2020 01:36:51 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: by mail-lj1-x229.google.com with SMTP id s9so4652541ljm.11 for ; Wed, 24 Jun 2020 18:36:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to; bh=EVK9MaM0ZiqL5Fp8kpWTIHRMF9I5a5Jjjh7rxvKu/Q4=; b=kPo5VJqnOzhhILhlHj/TJN4mSPHTsm93S+JJdMKe0Tky8NB2l3lp2Qt0HTylfqVvlj EiK3VayrAX2ZLNRilGTeEBhawqcCq2KsTlw5zVWDrHEPYd8kE576q4gA+WkIGqdOp7H5 DGLfoAsklSVVgPWQVKCi0IKZ8C4m2HKmkcA5iSKqctGSeyxQkMSJhlDHJtnAXhAlCkEh Z8EOqQ9TJfJMImmK1t5W+0SjfHwpJOhHAxUMordIHEM1/7z9I20agLjLb2poVThPGlfX sXEFrxndRUTavECNOyxz6bGM8Jmj6tDJ03pEW3ZpiGd5LCeL66lt2VPFrObu186RbG3g dMjw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to; bh=EVK9MaM0ZiqL5Fp8kpWTIHRMF9I5a5Jjjh7rxvKu/Q4=; b=puG2/G3qiSKL6O3Iyx8sefAWhGtux3lmkxIGSPF4wq08xEB8NW5uu1JR5e1hjQduP6 8Lp/UD+JAC8IV8KhDZmibBsp6AoJMb503UMeaTVNgzKpnToeMpCny8BSnOw5v3ev3CkS fVsh8+3knGXsWOJJTQSmUlW9HEoRi9SYzcLiaL8+GlrL+XbZEEK9RZpcmazRH9LJrs45 y6cB390p/FKuMcZlJ6xy89wGwO93dodoGxhzhOTyX56EZycx6Sz24K683Zcu4rZaQ36D JhGTq5R2bdKOqoGiQJ7FQJPjlZdx3ATQdMxFRcijp8BJBd3SaLNzA+Vl5mv/1HlMu1Jh 8Lew== X-Gm-Message-State: AOAM531wpu35TlPxofKLUBFvtzX21TFFOMOt+e1YpBkCiaOCKibRNKTv Y+zPhviJ98BCLQFT4CZ3R5HHMuRkRx2e5iZF1ILbPxSy X-Google-Smtp-Source: ABdhPJwVFA5MEtWsPJ+crRrCingVAq0szjYpw3eYN/mj+bkz6qsSU5aZdYbhLptAP+bpNvR+3DbLRRijC9e4d/Q7aac= X-Received: by 2002:a05:651c:2cc:: with SMTP id f12mr14678016ljo.329.1593049009033; Wed, 24 Jun 2020 18:36:49 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:4703:0:0:0:0:0 with HTTP; Wed, 24 Jun 2020 18:36:48 -0700 (PDT) Reply-To: dwilde1@gmail.com In-Reply-To: References: From: Donald Wilde Date: Wed, 24 Jun 2020 18:36:48 -0700 Message-ID: Subject: Re: swap space issues To: freebsd-stable Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 49sjKv6BKsz4LC4 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=kPo5VJqn; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of dwilde1@gmail.com designates 2a00:1450:4864:20::229 as permitted sender) smtp.mailfrom=dwilde1@gmail.com X-Spamd-Result: default: False [-2.83 / 15.00]; HAS_REPLYTO(0.00)[dwilde1@gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; REPLYTO_ADDR_EQ_FROM(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.27)[-0.268]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.65)[-0.650]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.91)[-0.912]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_REPLYTO(0.00)[gmail.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::229:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 01:36:52 -0000 On 6/24/20, Donald Wilde wrote: > All, > > I recently upgraded my 12-STABLE system to the latest, and now my swap > subsystems aren't working. I deliberately set up a 40GB partition for > swap, and when I do 'top -t' I am only seeing 7906M total. > > When using synth, it shows swap usage of < 2%, but then it gives the > 'out of swap' complaint and tosses all my users out into neverland. > > My /boot/loader.conf has: > > kern.maxproc=75000 > kern.maxswzone=17200000 > > ... but those are no longer effective. > > What has changed, and what do I need to do to rectify this? I thought I had it running well... 3 tasks and max 8 builders / task. It was sitting at 0.0 - 1% swap. Perking right along. Looked away to another bit of work and it has blyecch'd again. Rebooted, starting it again. It does seem to start over from where it crashed, which is good. I'm not in any way saying that this is a bad tool, just trying to figure out why it crashes even with all the resources I've given it. Building math/openblas and devel/llvm90 simultaneously, so it's obvious what put it over the top! Sigh... barfed again, but at least this time it marked those as failed and started on new ports. I guess if I keep repeating the process it'll get through them all. :D -- Don Wilde **************************************************** * What is the Internet of Things but a system * * of systems including humans? * **************************************************** From owner-freebsd-stable@freebsd.org Thu Jun 25 01:51:07 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CA9853492E6 for ; Thu, 25 Jun 2020 01:51:07 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: from mail-lj1-x243.google.com (mail-lj1-x243.google.com [IPv6:2a00:1450:4864:20::243]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49sjfM3YRQz4LnV; Thu, 25 Jun 2020 01:51:07 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: by mail-lj1-x243.google.com with SMTP id x18so4730857lji.1; Wed, 24 Jun 2020 18:51:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to:cc; bh=7UH9abthNsFFkI/ncONRTJ1qoL+Lqdm2cMmieopDgoo=; b=dhvqg2bbOlD5kmdEY+/8Q0vreAoMCZnOeSOdUl1bRSiAgwMj8ExA84YWihKnOTZeaV Ol/PJpGIiIDwlvw2B2+AhaiB6qr0aZevYpGNd3nafRT+v2IFD9z64uVLTLWby8ukEAfW aKQA6EerJYCf0bqNbu9kD/yrLkxVsCv+cqDkV6H3ptWEL6QKdJ7S9E/qKX2ei6StIy0Q d6KP/uHHV4QXZN10QN2jVmqvTyy4DNZ541S8f9GV3Jee/Whv0OPp5jkmpGjeWQnzf4MD 0IRltmWYEOuXJMif06PlYVzFI6B8ILrDuyb98a48dvExdNsJ7lULhRJWBtgySrWmzXpL c8jA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc; bh=7UH9abthNsFFkI/ncONRTJ1qoL+Lqdm2cMmieopDgoo=; b=PiRSyh+QOJrwgDtovf7bhT3YeGzyt3hg3rKzj4OmFhGpfOXrWX00aIFGFui7haU/wR zJTNZ+s4nCvumutP0d631L4fiQFZyDf1V2HOuYrX1jgExzJ4UiEUiA3IZwH0+WADFV5c ycmXNVeMFvJAXzVjYDeCVU8fICQEYPbDEowbuC2zA5mEw5mUBKVn+aBZzTKZnCAlXvau pQA+yQ8t+r9WnlhQPoSTo+Xa1C2e8Bn6ty/0yCUPCkH5xG+4LIuzzgfD3NFD4D4+hueO b1irYQdN5b9gqnp2R80qmKOMUd8Js4aIB+xzv9yv4i/1HxM9NiWNZk6OO4zSPczl/LoI trFQ== X-Gm-Message-State: AOAM533ll3ddN3NAl92Lvm3lO0VFd6/iFU2ldAFC/FPBBWUZoI2B1GGB JFk/JnI9cdo1gsSrvU3a0AeamS3BJEx814+WwhyKcGOQ X-Google-Smtp-Source: ABdhPJw18YfM4pgcQMly0R1Uc2pQOB6IUmu4h+4IeUIsYpF9VLugqcDveTu2VX5/QCaM76qekkYSt6oq2tCsLYjOlt4= X-Received: by 2002:a2e:90c6:: with SMTP id o6mr3125132ljg.330.1593049865337; Wed, 24 Jun 2020 18:51:05 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:4703:0:0:0:0:0 with HTTP; Wed, 24 Jun 2020 18:51:04 -0700 (PDT) Reply-To: dwilde1@gmail.com In-Reply-To: <20200625000410.GA10210@eureka.lemis.com> References: <20200625000410.GA10210@eureka.lemis.com> From: Donald Wilde Date: Wed, 24 Jun 2020 18:51:04 -0700 Message-ID: Subject: Re: swap space issues To: "Greg 'groggy' Lehey" Cc: freebsd-stable Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 49sjfM3YRQz4LnV X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; REPLY(-4.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 01:51:07 -0000 On 6/24/20, Greg 'groggy' Lehey wrote: > On Wednesday, 24 June 2020 at 9:36:23 -0700, Donald Wilde wrote: >> All, >> >> I recently upgraded my 12-STABLE system to the latest, and now my >> swap subsystems aren't working. I deliberately set up a 40GB >> partition for swap, and when I do 'top -t' I am only seeing 7906M >> total. > > That looks suspiciously like the difference from 32 GB. Could it be > numeric overflow? And if so, where? What does pstat -s say? > Well, hi Greg! LTNT2! pstat -shm: /dev/ada0s1b 65536 (1M blocks), Used: 1.5G, Avail: 63G, Capacity: 2% This is while synth is still running on openblas and openjdk8. >> When using synth, it shows swap usage of < 2%, but then it gives the >> 'out of swap' complaint and tosses all my users out into neverland. > > Unless this also causes kernel messages to that effect, this, too, > could be an issue with synth. I believe the messages about 'out of swap' were from the kernel as it died, not synth. As I say, it killed all my active users, both root and non-root. Why does _top_ show the 7906M number? I suspect that it's deeper than just synth. What else can I share to help diagnose this? > > Greg > -- > Sent from my desktop computer. [snip] -- Don Wilde **************************************************** * What is the Internet of Things but a system * * of systems including humans? * **************************************************** From owner-freebsd-stable@freebsd.org Thu Jun 25 02:22:39 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 70DC734A0CF for ; Thu, 25 Jun 2020 02:22:39 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: from mail-lf1-x142.google.com (mail-lf1-x142.google.com [IPv6:2a00:1450:4864:20::142]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49skLk277cz4NZ6; Thu, 25 Jun 2020 02:22:38 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: by mail-lf1-x142.google.com with SMTP id g2so2364257lfb.0; Wed, 24 Jun 2020 19:22:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to:cc; bh=vpCS37103n78GpHjD0G+6P5PxLH4Y9egBfA6EWB1k2g=; b=pAqsxaqzygAqljUu4YuKbGQhCe5FnnsTnrZjLYWlOP4N139oY9V9y/rDJo+jpCBgMT czdNmVg1ScI0e/db1z/VgMdeZNSbldLOaviaQNIVoEwRUAMH8U+P7Mj64bvcHY5yrpa1 bdHCC8CSG9mQwq8jM4vGI4/726I8nqbrNMLrOskvWSqBzlwfFbXnfOtesHlj/t95oYrV QCfw7XEqTGz2l36ljaBGMR/LMakxUmW5nb42NIGW7hk9sU2+suCwSvJAl7MTZz2chKUs bt07vpfTnLVzH+db2I9JLHC3f09C1RpqrG0ZxuF62qyU13M3hjAK7z7nFy/lT9VAwdO9 tB/A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc; bh=vpCS37103n78GpHjD0G+6P5PxLH4Y9egBfA6EWB1k2g=; b=Wy7SVU6pjTbkvbv1IQ7bP9ZUNaPE8ZFBiPrfku+xvd4vf/N886TOf1rr+WsGPmIWon KJjLUDox5DcbliTxn+55lJy/2BFiPmdzVDrTkFfjCZvqIF0VhZIGGeOhnpBn964aHedH RlHSv4RFM6lSSVY875NwGs2cGK42TEb0RlOGdNIaAMI7Wc+Ij45mgqcPNEwVGzgmAtwa taR1CTgw1qUPzx0Ae3btQREFPko3mhivVd6S36wcW/jZIgynGYeDo8/CT4nwFFxOfjHQ XeEhSjEclVVHUwsjYONEVFOqxpAhMAo0Nc91Pj59O63y6fcreGTrVzzx2FAvOqObc1q/ YSwg== X-Gm-Message-State: AOAM5303khqXdLB6fEiqcQsGYRAoBjeI/MfUxXif/RZFG29FPpU+PceF 37KXwQD9iJMm3b+OJkrhEFB95guwwbKYoXrBpcIWQiJb X-Google-Smtp-Source: ABdhPJymudfk1zq1kowwyoAzA/B4G9dZIp7J5jgcrO4opoezNVp0tMin8jRVb/BzJqkW/ApURdbYuZP89Va6IMQBtH0= X-Received: by 2002:ac2:5a01:: with SMTP id q1mr17417630lfn.182.1593051756363; Wed, 24 Jun 2020 19:22:36 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:4703:0:0:0:0:0 with HTTP; Wed, 24 Jun 2020 19:22:35 -0700 (PDT) Reply-To: dwilde1@gmail.com In-Reply-To: References: <20200625000410.GA10210@eureka.lemis.com> From: Donald Wilde Date: Wed, 24 Jun 2020 19:22:35 -0700 Message-ID: Subject: Re: swap space issues To: "Greg 'groggy' Lehey" Cc: freebsd-stable Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 49skLk277cz4NZ6 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=pAqsxaqz; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of dwilde1@gmail.com designates 2a00:1450:4864:20::142 as permitted sender) smtp.mailfrom=dwilde1@gmail.com X-Spamd-Result: default: False [-3.27 / 15.00]; ARC_NA(0.00)[]; HAS_REPLYTO(0.00)[dwilde1@gmail.com]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-0.93)[-0.934]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_REPLYTO(0.00)[gmail.com]; REPLYTO_ADDR_EQ_FROM(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.98)[-0.983]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::142:from]; NEURAL_HAM_SHORT(-0.35)[-0.354]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 02:22:39 -0000 On 6/24/20, Donald Wilde wrote: > On 6/24/20, Greg 'groggy' Lehey wrote: >> On Wednesday, 24 June 2020 at 9:36:23 -0700, Donald Wilde wrote: >>> All, >>> >>> I recently upgraded my 12-STABLE system to the latest, and now my >>> swap subsystems aren't working. I deliberately set up a 40GB >>> partition for swap, and when I do 'top -t' I am only seeing 7906M >>> total. >> >> That looks suspiciously like the difference from 32 GB. Could it be >> numeric overflow? And if so, where? What does pstat -s say? >> > > Well, hi Greg! LTNT2! > > pstat -shm: > > /dev/ada0s1b 65536 (1M blocks), Used: 1.5G, Avail: 63G, Capacity: 2% > > This is while synth is still running on openblas and openjdk8. > >>> When using synth, it shows swap usage of < 2%, but then it gives the >>> 'out of swap' complaint and tosses all my users out into neverland. >> >> Unless this also causes kernel messages to that effect, this, too, >> could be an issue with synth. > > I believe the messages about 'out of swap' were from the kernel as it > died, not synth. As I say, it killed all my active users, both root > and non-root. > > Why does _top_ show the 7906M number? I suspect that it's deeper than > just synth. > > What else can I share to help diagnose this? Let me try this: I can reduce kern.maxswzone to a number lower than 32G. That won't _solve_ the underlying problem, but we can see if it impacts both top and synth. I just did portsnap fetch update and it came up with 300 patches, so that should give us a good run! [snip] -- Don Wilde **************************************************** * What is the Internet of Things but a system * * of systems including humans? * **************************************************** From owner-freebsd-stable@freebsd.org Thu Jun 25 02:52:51 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DECAB34B3E5 for ; Thu, 25 Jun 2020 02:52:51 +0000 (UTC) (envelope-from grog@lemis.com) Received: from lax.lemis.com (www.lemis.com [45.32.70.18]) by mx1.freebsd.org (Postfix) with ESMTP id 49sl1Z4lMJz4QH9 for ; Thu, 25 Jun 2020 02:52:50 +0000 (UTC) (envelope-from grog@lemis.com) Received: from eureka.lemis.com (aussie-gw.lemis.com [167.179.139.35]) by lax.lemis.com (Postfix) with ESMTP id 3B209280B8; Thu, 25 Jun 2020 02:52:49 +0000 (UTC) Received: by eureka.lemis.com (Postfix, from userid 1004) id 2B228263599; Thu, 25 Jun 2020 12:52:48 +1000 (AEST) Date: Thu, 25 Jun 2020 12:52:48 +1000 From: Greg 'groggy' Lehey To: Donald Wilde Cc: freebsd-stable Subject: Re: swap space issues Message-ID: <20200625025248.GB10210@eureka.lemis.com> References: <20200625000410.GA10210@eureka.lemis.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="CUfgB8w4ZwR/yMy5" Content-Disposition: inline In-Reply-To: Organization: The FreeBSD Project Phone: +61-3-5309-0418 Mobile: +61-490-494-038. Use only as instructed. WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 9A1B 8202 BCCE B846 F92F 09AC 22E6 F290 507A 4223 User-Agent: Mutt/1.6.1 (2016-04-27) X-Rspamd-Queue-Id: 49sl1Z4lMJz4QH9 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of grog@lemis.com designates 45.32.70.18 as permitted sender) smtp.mailfrom=grog@lemis.com X-Spamd-Result: default: False [-4.55 / 15.00]; ARC_NA(0.00)[]; FORGED_SENDER(0.30)[grog@FreeBSD.org,grog@lemis.com]; NEURAL_HAM_MEDIUM(-0.90)[-0.904]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a:www.lemis.com]; NEURAL_HAM_LONG(-1.00)[-1.004]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; DMARC_NA(0.00)[FreeBSD.org]; HAS_ORG_HEADER(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.64)[-0.640]; RCPT_COUNT_TWO(0.00)[2]; SIGNED_PGP(-2.00)[]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:20473, ipnet:45.32.64.0/19, country:US]; FROM_NEQ_ENVFROM(0.00)[grog@FreeBSD.org,grog@lemis.com] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 02:52:51 -0000 --CUfgB8w4ZwR/yMy5 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Wednesday, 24 June 2020 at 18:51:04 -0700, Donald Wilde wrote: > On 6/24/20, Greg 'groggy' Lehey wrote: >> On Wednesday, 24 June 2020 at 9:36:23 -0700, Donald Wilde wrote: >>> All, >>> >>> I recently upgraded my 12-STABLE system to the latest, and now my >>> swap subsystems aren't working. I deliberately set up a 40GB >>> partition for swap, and when I do 'top -t' I am only seeing 7906M >>> total. >> >> That looks suspiciously like the difference from 32 GB. Could it be >> numeric overflow? And if so, where? What does pstat -s say? > > Well, hi Greg! LTNT2! Indeed. > pstat -shm: > > /dev/ada0s1b 65536 (1M blocks), Used: 1.5G, Avail: 63G, Capacity: 2% Now that's really puzzling. Why does it say 64 G when you said 40 G, and the error from top tends to confirm it? How big is the partition (gpart output)? >>> When using synth, it shows swap usage of < 2%, but then it gives the >>> 'out of swap' complaint and tosses all my users out into neverland. >> >> Unless this also causes kernel messages to that effect, this, too, >> could be an issue with synth. > > I believe the messages about 'out of swap' were from the kernel as > it died, not synth. As I say, it killed all my active users, both > root and non-root. Hmm. > Why does _top_ show the 7906M number? I suspect that it's deeper > than just synth. If top counts swap in a form that overflows at 32 GB, 40 GB could show up as 8 GB. > What else can I share to help diagnose this? Background, maybe? You say that you upgraded your system. Did you change the swap size when you did? What were swap and RAM sizes before and after? FWIW, I've had a very large number of issues with -STABLE in recent months, though not this one. I should send a separate message. Greg -- Sent from my desktop computer. Finger grog@FreeBSD.org for PGP public key. See complete headers for address and phone numbers. This message is digitally signed. If your Microsoft mail program reports problems, please read http://lemis.com/broken-MUA --CUfgB8w4ZwR/yMy5 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iEYEARECAAYFAl70EYAACgkQIubykFB6QiO6lQCfetXkTxpAV3elwPJklKZiPRBs /OwAn1Jh7GNJwQocaEG+PwreiHSvmNkN =N9aJ -----END PGP SIGNATURE----- --CUfgB8w4ZwR/yMy5-- From owner-freebsd-stable@freebsd.org Thu Jun 25 03:34:28 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 709A534CE6A for ; Thu, 25 Jun 2020 03:34:28 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: from mail-lj1-x243.google.com (mail-lj1-x243.google.com [IPv6:2a00:1450:4864:20::243]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49slxb70Xbz4T6G; Thu, 25 Jun 2020 03:34:27 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: by mail-lj1-x243.google.com with SMTP id x18so4899848lji.1; Wed, 24 Jun 2020 20:34:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to:cc; bh=NzbuGkCZa3S7fj2WOuebOQdlySGfg4gVjwaulxZLc8E=; b=MqwLI4LFbjmN5IDKlWZ3+kb+lLU/9dI8dSBrKPNxCbQFqBhyNPuaPK4AORR5wLeeC1 /Ynv+ZJ7unUUnUy6gmURwEIUNJeeG8JQENSDrIPcjL2qABnLqJIuVGNGlbVnIp86XnJX mdKteoJXKQXyJFppUpj/qavtwH9/HechgAEh5GtS0AXGwVRF6SV/Wa+YyOfTROljXRzL UegUpf9NfUE8jwgeWxqM8fMqAMB2QVuHDzDS6xPjzfc2AhSd/SLqSwfy5yUFgjRJKwJN PLxpy9SWV2UBSKLVh1mgL8tFmIiULtC8v0xEpzlhG7T7DY7Zxh/uIEVyPc6HMVxLCCWs zovg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc; bh=NzbuGkCZa3S7fj2WOuebOQdlySGfg4gVjwaulxZLc8E=; b=Edb6hzhsL6vA1z+lW7UkGtbcMgLIfuusjXxr1mgsTYhr8rlaosUig6UryboPxSIMLC EoIyPaz1vWm7CcEzO6sUEf2VvnLdzcLqP1289pbqciIuIuZUBtMqiigGQyPokO9ZDud7 YUvBDJjE8aqNUXsR4fbzzVWxbmHbdw4o3FSbDX0fhzVy7ursYjdYxaQ2k4yjpVWXX/DL mtQ7ZmQ01AMg83rKc10mClR/Mf9oEy7PA05udKQUW0KDM3Wgt5cF/KcP8MlhGYRdFeF/ vI5vIBd6lNZWB7+y5f+xCf21dA+p/9cibXx5k1Tfh+X1XuHX+Ryyju59qHrbjefVBt+s fgfA== X-Gm-Message-State: AOAM533bbxge8AlAWejx3LDfFMhi3MRag8zYL8cPsmBn0wsH5dU34krW gTslVmDzWMILiNqMImIfo+ZzxSjzY7zfMz+zRNZr6RP5 X-Google-Smtp-Source: ABdhPJzPd5k4AzG8LO6BhygLW+FtJ+XOFKTE9THqcvKqwW3tgHmrxn3mBfwFg4S4LWaUsT5+7Tobh0tqlhnSEk/M+A8= X-Received: by 2002:a2e:90c6:: with SMTP id o6mr3273665ljg.330.1593056065777; Wed, 24 Jun 2020 20:34:25 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:4703:0:0:0:0:0 with HTTP; Wed, 24 Jun 2020 20:34:24 -0700 (PDT) Reply-To: dwilde1@gmail.com In-Reply-To: <20200625025248.GB10210@eureka.lemis.com> References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> From: Donald Wilde Date: Wed, 24 Jun 2020 20:34:24 -0700 Message-ID: Subject: Re: swap space issues To: "Greg 'groggy' Lehey" Cc: freebsd-stable Content-Type: multipart/mixed; boundary="000000000000e88f4e05a8e044e5" X-Rspamd-Queue-Id: 49slxb70Xbz4T6G X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 03:34:28 -0000 --000000000000e88f4e05a8e044e5 Content-Type: text/plain; charset="UTF-8" On 6/24/20, Greg 'groggy' Lehey wrote: > On Wednesday, 24 June 2020 at 18:51:04 -0700, Donald Wilde wrote: >> On 6/24/20, Greg 'groggy' Lehey wrote: >>> On Wednesday, 24 June 2020 at 9:36:23 -0700, Donald Wilde wrote: >>>> All, >>>> >>>> I recently upgraded my 12-STABLE system to the latest, and now my >>>> swap subsystems aren't working. I deliberately set up a 40GB >>>> partition for swap, and when I do 'top -t' I am only seeing 7906M >>>> total. >>> >>> That looks suspiciously like the difference from 32 GB. Could it be >>> numeric overflow? And if so, where? What does pstat -s say? >> >> Well, hi Greg! LTNT2! > > Indeed. > >> pstat -shm: >> >> /dev/ada0s1b 65536 (1M blocks), Used: 1.5G, Avail: 63G, Capacity: 2% > > Now that's really puzzling. Why does it say 64 G when you said 40 G, > and the error from top tends to confirm it? How big is the partition > (gpart output)? Attached 'gpart list' output Reduced kern.maxswzone to 9999999. Is it decimal or unlabeled hex? 'top' now shows 4597M total swap. > >>>> When using synth, it shows swap usage of < 2%, but then it gives the >>>> 'out of swap' complaint and tosses all my users out into neverland. >>> >>> Unless this also causes kernel messages to that effect, this, too, >>> could be an issue with synth. >> >> I believe the messages about 'out of swap' were from the kernel as >> it died, not synth. As I say, it killed all my active users, both >> root and non-root. Okay, I've now got data on that. It crashed again. :-\ First, the kernel killed init-spawned PIDs up into the 12000s: 'out of swap space'. Next, I get the following 5 times, boldface (this is console, not a GUI): swblk zone ok swap blk zone exhausted, increase kern.maxswzone Back to normal font, the kernel killed four cron-job PIDs, 'out of swap space' At this point, if I hit a , I get a login prompt. > > Hmm. > >> Why does _top_ show the 7906M number? I suspect that it's deeper >> than just synth. > > If top counts swap in a form that overflows at 32 GB, 40 GB could show > up as 8 GB. > >> What else can I share to help diagnose this? > > Background, maybe? You say that you upgraded your system. Did you > change the swap size when you did? What were swap and RAM sizes > before and after? Meant that I upgraded from 12.1-RELEASE to 12-STABLE. When I configured the -RELEASE install, I manually messed with the MBR disk partitions. This is nominally a half-TB HDD which showed up as a total of 446 G available (IIRC, gpart should show it's actual size). I did auto partitioning, looked at the sizes, and manually set my partitions to give me 40G of swap instead of the auto-generated size of 4G. This is an old Dell i3 laptop. It's really generic, picked specifically as something I could use for Ubuntu or FreeBSD. Dell SERVICE TAG is 5K8W162, but it's a generic i3 with 4G of RAM. I'm developing a multi-server application for my cousin, so I'm using this as a mule to work my way through some of the issues involved in that project, from FreeBSD itself through NGINX and Lua, etc. > > FWIW, I've had a very large number of issues with -STABLE in recent > months, though not this one. I should send a separate message. > I guess I've been fortunate, then. Most of my issues have been with re-learning FreeBSD. :D -- Don Wilde **************************************************** * What is the Internet of Things but a system * * of systems including humans? * **************************************************** --000000000000e88f4e05a8e044e5 Content-Type: text/plain; charset="US-ASCII"; name="gpart_list.txt" Content-Disposition: attachment; filename="gpart_list.txt" Content-Transfer-Encoding: base64 X-Attachment-Id: file0 R2VvbSBuYW1lOiBhZGEwCm1vZGlmaWVkOiBmYWxzZQpzdGF0ZTogT0sKZndoZWFkczogMTYKZndz ZWN0b3JzOiA2MwpsYXN0OiA5NzY3NzMxNjcKZmlyc3Q6IDYzCmVudHJpZXM6IDQKc2NoZW1lOiBN QlIKUHJvdmlkZXJzOgoxLiBOYW1lOiBhZGEwczEKICAgTWVkaWFzaXplOiA1MDAxMDc4MjkyNDgg KDQ2NkcpCiAgIFNlY3RvcnNpemU6IDUxMgogICBTdHJpcGVzaXplOiA0MDk2CiAgIFN0cmlwZW9m ZnNldDogMAogICBNb2RlOiByMncyZTMKICAgZWZpbWVkaWE6IEhEKDEsTUJSLDB4OTA5MDkwOTAs MHg0MCwweDNhMzg1ZmYwKQogICBhdHRyaWI6IGFjdGl2ZQogICByYXd0eXBlOiAxNjUKICAgbGVu Z3RoOiA1MDAxMDc4MjkyNDgKICAgb2Zmc2V0OiAzMjc2OAogICB0eXBlOiBmcmVlYnNkCiAgIGlu ZGV4OiAxCiAgIGVuZDogOTc2NzczMTY3CiAgIHN0YXJ0OiA2NApDb25zdW1lcnM6CjEuIE5hbWU6 IGFkYTAKICAgTWVkaWFzaXplOiA1MDAxMDc4NjIwMTYgKDQ2NkcpCiAgIFNlY3RvcnNpemU6IDUx MgogICBTdHJpcGVzaXplOiA0MDk2CiAgIFN0cmlwZW9mZnNldDogMAogICBNb2RlOiByMncyZTUK Ckdlb20gbmFtZTogYWRhMHMxCm1vZGlmaWVkOiBmYWxzZQpzdGF0ZTogT0sKZndoZWFkczogMTYK ZndzZWN0b3JzOiA2MwpsYXN0OiA5NzY3NzMxMDMKZmlyc3Q6IDAKZW50cmllczogOApzY2hlbWU6 IEJTRApQcm92aWRlcnM6CjEuIE5hbWU6IGFkYTBzMWEKICAgTWVkaWFzaXplOiA0Mjk0OTY3Mjk2 MDAgKDQwMEcpCiAgIFNlY3RvcnNpemU6IDUxMgogICBTdHJpcGVzaXplOiA0MDk2CiAgIFN0cmlw ZW9mZnNldDogMAogICBNb2RlOiByMXcxZTEKICAgcmF3dHlwZTogNwogICBsZW5ndGg6IDQyOTQ5 NjcyOTYwMAogICBvZmZzZXQ6IDAKICAgdHlwZTogZnJlZWJzZC11ZnMKICAgaW5kZXg6IDEKICAg ZW5kOiA4Mzg4NjA3OTkKICAgc3RhcnQ6IDAKMi4gTmFtZTogYWRhMHMxYgogICBNZWRpYXNpemU6 IDcwNjExMDk5NjQ4ICg2NkcpCiAgIFNlY3RvcnNpemU6IDUxMgogICBTdHJpcGVzaXplOiA0MDk2 CiAgIFN0cmlwZW9mZnNldDogMAogICBNb2RlOiByMXcxZTAKICAgcmF3dHlwZTogMQogICBsZW5n dGg6IDcwNjExMDk5NjQ4CiAgIG9mZnNldDogNDI5NDk2NzI5NjAwCiAgIHR5cGU6IGZyZWVic2Qt c3dhcAogICBpbmRleDogMgogICBlbmQ6IDk3Njc3MzEwMwogICBzdGFydDogODM4ODYwODAwCkNv bnN1bWVyczoKMS4gTmFtZTogYWRhMHMxCiAgIE1lZGlhc2l6ZTogNTAwMTA3ODI5MjQ4ICg0NjZH KQogICBTZWN0b3JzaXplOiA1MTIKICAgU3RyaXBlc2l6ZTogNDA5NgogICBTdHJpcGVvZmZzZXQ6 IDAKICAgTW9kZTogcjJ3MmUzCgo= --000000000000e88f4e05a8e044e5-- From owner-freebsd-stable@freebsd.org Thu Jun 25 05:29:52 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D08C5351280 for ; Thu, 25 Jun 2020 05:29:52 +0000 (UTC) (envelope-from grog@lemis.com) Received: from lax.lemis.com (www.lemis.com [45.32.70.18]) by mx1.freebsd.org (Postfix) with ESMTP id 49spVl52jRz4blf for ; Thu, 25 Jun 2020 05:29:51 +0000 (UTC) (envelope-from grog@lemis.com) Received: from eureka.lemis.com (aussie-gw.lemis.com [167.179.139.35]) by lax.lemis.com (Postfix) with ESMTP id 0BB5828089; Thu, 25 Jun 2020 05:29:50 +0000 (UTC) Received: by eureka.lemis.com (Postfix, from userid 1004) id 1ED24263599; Thu, 25 Jun 2020 15:29:49 +1000 (AEST) Date: Thu, 25 Jun 2020 15:29:49 +1000 From: Greg 'groggy' Lehey To: Donald Wilde Cc: freebsd-stable Subject: Re: swap space issues Message-ID: <20200625052949.GC10210@eureka.lemis.com> References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="6zdv2QT/q3FMhpsV" Content-Disposition: inline In-Reply-To: Organization: The FreeBSD Project Phone: +61-3-5309-0418 Mobile: +61-490-494-038. Use only as instructed. WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 9A1B 8202 BCCE B846 F92F 09AC 22E6 F290 507A 4223 User-Agent: Mutt/1.6.1 (2016-04-27) X-Rspamd-Queue-Id: 49spVl52jRz4blf X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of grog@lemis.com designates 45.32.70.18 as permitted sender) smtp.mailfrom=grog@lemis.com X-Spamd-Result: default: False [-4.05 / 15.00]; ARC_NA(0.00)[]; FORGED_SENDER(0.30)[grog@FreeBSD.org,grog@lemis.com]; NEURAL_HAM_MEDIUM(-0.90)[-0.904]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a:www.lemis.com]; NEURAL_HAM_LONG(-1.00)[-1.005]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; DMARC_NA(0.00)[FreeBSD.org]; HAS_ORG_HEADER(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.14)[-0.138]; RCPT_COUNT_TWO(0.00)[2]; SIGNED_PGP(-2.00)[]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:20473, ipnet:45.32.64.0/19, country:US]; FROM_NEQ_ENVFROM(0.00)[grog@FreeBSD.org,grog@lemis.com] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 05:29:52 -0000 --6zdv2QT/q3FMhpsV Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Wednesday, 24 June 2020 at 20:34:24 -0700, Donald Wilde wrote: > On 6/24/20, Greg 'groggy' Lehey wrote: >> On Wednesday, 24 June 2020 at 18:51:04 -0700, Donald Wilde wrote: >>> On 6/24/20, Greg 'groggy' Lehey wrote: >>>> On Wednesday, 24 June 2020 at 9:36:23 -0700, Donald Wilde wrote: >>>>> All, >>>>> >>>>> I recently upgraded my 12-STABLE system to the latest, and now my >>>>> swap subsystems aren't working. I deliberately set up a 40GB >>>>> partition for swap, and when I do 'top -t' I am only seeing 7906M >>>>> total. >>>> >>>> That looks suspiciously like the difference from 32 GB. Could it be >>>> numeric overflow? And if so, where? What does pstat -s say? >>> >>> Well, hi Greg! LTNT2! >> >> Indeed. >> >>> pstat -shm: >>> >>> /dev/ada0s1b 65536 (1M blocks), Used: 1.5G, Avail: 63G, Capacity: 2% >> >> Now that's really puzzling. Why does it say 64 G when you said 40 G, >> and the error from top tends to confirm it? How big is the partition >> (gpart output)? > > Attached 'gpart list' output FWIW, gpart show would have done the job. But what I see there is Yet Another swap partition size, 66 GB. So so far we have various parts reporting 8 GB, 40 GB, 64 GB and 66 GB. > Reduced kern.maxswzone to 9999999. Is it decimal or unlabeled hex? It'll be decimal, but it refers to the number of swblk structures assigned in memory, and after reading the code I'm still not 100% in the clear how this relates to the size of swap, if at all. > 'top' now shows 4597M total swap. ... and 4.6 GB. 5 different sizes. You really shouldn't be relying on top for swap info. It's a third party program that demonstrably shows incorrect results (though I believe that the maintainer would be very interested to know why and to fix it). But pstat -s (without any further options) should show what the kernel thinks. >>> What else can I share to help diagnose this? >> >> Background, maybe? You say that you upgraded your system. Did you >> change the swap size when you did? What were swap and RAM sizes >> before and after? > > Meant that I upgraded from 12.1-RELEASE to 12-STABLE. When I > configured the -RELEASE install, I manually messed with the MBR disk > partitions. This is nominally a half-TB HDD which showed up as a total > of 446 G available (IIRC, gpart should show it's actual size). I did > auto partitioning, looked at the sizes, and manually set my partitions > to give me 40G of swap instead of the auto-generated size of 4G. That's really puzzling. It seems that it gave you much more than you asked for. Try this in single user mode: modify the size of the swap partition to 30 GB. I haven't used MBR partitions for years now, but I believe that 'bsdlabel -e' will do the trick. Just shorten the length of the b partition. You may need to 'mount -u /'. If you do it right (check!), this won't harm any of the other partitions: it'll just leave 26 GB free between the swap partition and the next partition. Greg -- Sent from my desktop computer. Finger grog@FreeBSD.org for PGP public key. See complete headers for address and phone numbers. This message is digitally signed. If your Microsoft mail program reports problems, please read http://lemis.com/broken-MUA --6zdv2QT/q3FMhpsV Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iEYEARECAAYFAl70Nk0ACgkQIubykFB6QiOjDwCgsGC8glQIvy8Q8W12SnSidgXT B94An2ByDZFPiujorOriW/e7BzvLqJan =AcdP -----END PGP SIGNATURE----- --6zdv2QT/q3FMhpsV-- From owner-freebsd-stable@freebsd.org Thu Jun 25 06:27:45 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8339B352D87 for ; Thu, 25 Jun 2020 06:27:45 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-oi1-x234.google.com (mail-oi1-x234.google.com [IPv6:2607:f8b0:4864:20::234]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49sqnY1SRbz4fdt; Thu, 25 Jun 2020 06:27:44 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: by mail-oi1-x234.google.com with SMTP id w10so531378oih.0; Wed, 24 Jun 2020 23:27:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=0dXdsuv/G/FJAocWfHE1Gpnj7BpSsG1z+uWp9OJZ1xU=; b=lNlK16YES9WE27Jgd0L+xgcz+Hr/ZMMCixQ1E0Lo2SW0P9PDZs1cFdTbxeLRME0ani FXKkWQTEIarREKDB+cngHn74b4UJbNkXF4v9AdFyp6nPDkXdQR7temDDkb72O2Se1AIc 8ZXUYqtHCxgptNqjGetBUSVjp00z0QNDODWMa43LLNV8c+H6pqcPMGRqWA3unvbBitgD JmMJWNzatVJFWkHqiVQ1O+QrMB26lcoC1pTAZjeH0dAlCuSrdy6rroZLmy4rVJdwo64B LMGTQTmzMIFiPwvRMbciSpHjU8KDJcMhsp1oGu01V1BFZfT/ro39Fhxp1g/iTN7e1Fd3 5wbw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=0dXdsuv/G/FJAocWfHE1Gpnj7BpSsG1z+uWp9OJZ1xU=; b=Ars1oBXrMeTWGclVkP3Dche7FeWJUFRkyBldPsmp35iXN6i66M9Hng2qcXBpmzxdcG VLLGjB9f2+QPTy1SD6s+8r2tcL5stwq0Vl2gW2xkM0c7I+CQuSkW2vEeGNJkKzejg60u wqDj1+FajfybMLb9zT4D/OX4twCCy2/0VCFw+qp9nfjSxjoCJ7rNtUBjbDQn7DZn0ucV kkjeVZekWOMyNiN0Cx7kMIyew7mIqElZlG5Q2ABDRs4xWYoe/7LAN36bTdwKPixwYxjm lFO3KoTcqoZw/nBwuGFnUXx1BV1dTilo6u8KJch+SggD32jBArnsh1wUc3VZbNBXcG1k qjLQ== X-Gm-Message-State: AOAM531VJGX1XMrZTyJjqTsFnWgeq6iAuAI/QzL2nnjeXpvU1b6pPko6 AvWkSTf0HsK/1zbXZVPzgSfSsFOapd2xaQH9mKgvVb97OUc= X-Google-Smtp-Source: ABdhPJy/cpKRy5qujvTOoOyvzcoyo6PuOS0pbqjYrf1QDsqMkymgMq6YiVt5kGbLx3WeIosfZQwfgaeIUZJYerD33/Q= X-Received: by 2002:aca:df04:: with SMTP id w4mr1017426oig.27.1593066463455; Wed, 24 Jun 2020 23:27:43 -0700 (PDT) MIME-Version: 1.0 References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <20200625052949.GC10210@eureka.lemis.com> In-Reply-To: <20200625052949.GC10210@eureka.lemis.com> From: Kevin Oberman Date: Wed, 24 Jun 2020 23:27:27 -0700 Message-ID: Subject: Re: swap space issues To: "Greg 'groggy' Lehey" Cc: Donald Wilde , freebsd-stable X-Rspamd-Queue-Id: 49sqnY1SRbz4fdt X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 06:27:45 -0000 On Wed, Jun 24, 2020 at 10:30 PM Greg 'groggy' Lehey wrote: > On Wednesday, 24 June 2020 at 20:34:24 -0700, Donald Wilde wrote: > > On 6/24/20, Greg 'groggy' Lehey wrote: > >> On Wednesday, 24 June 2020 at 18:51:04 -0700, Donald Wilde wrote: > >>> On 6/24/20, Greg 'groggy' Lehey wrote: > >>>> On Wednesday, 24 June 2020 at 9:36:23 -0700, Donald Wilde wrote: > >>>>> All, > >>>>> > >>>>> I recently upgraded my 12-STABLE system to the latest, and now my > >>>>> swap subsystems aren't working. I deliberately set up a 40GB > >>>>> partition for swap, and when I do 'top -t' I am only seeing 7906M > >>>>> total. > >>>> > >>>> That looks suspiciously like the difference from 32 GB. Could it be > >>>> numeric overflow? And if so, where? What does pstat -s say? > >>> > >>> Well, hi Greg! LTNT2! > >> > >> Indeed. > >> > >>> pstat -shm: > >>> > >>> /dev/ada0s1b 65536 (1M blocks), Used: 1.5G, Avail: 63G, Capacity: 2% > >> > >> Now that's really puzzling. Why does it say 64 G when you said 40 G, > >> and the error from top tends to confirm it? How big is the partition > >> (gpart output)? > > > > Attached 'gpart list' output > > FWIW, gpart show would have done the job. But what I see there is Yet > Another swap partition size, 66 GB. So so far we have various parts > reporting 8 GB, 40 GB, 64 GB and 66 GB. > > > Reduced kern.maxswzone to 9999999. Is it decimal or unlabeled hex? > > It'll be decimal, but it refers to the number of swblk structures > assigned in memory, and after reading the code I'm still not 100% in > the clear how this relates to the size of swap, if at all. > > > 'top' now shows 4597M total swap. > > ... and 4.6 GB. 5 different sizes. > > You really shouldn't be relying on top for swap info. It's a third > party program that demonstrably shows incorrect results (though I > believe that the maintainer would be very interested to know why and > to fix it). But pstat -s (without any further options) should show > what the kernel thinks. > > >>> What else can I share to help diagnose this? > >> > >> Background, maybe? You say that you upgraded your system. Did you > >> change the swap size when you did? What were swap and RAM sizes > >> before and after? > > > > Meant that I upgraded from 12.1-RELEASE to 12-STABLE. When I > > configured the -RELEASE install, I manually messed with the MBR disk > > partitions. This is nominally a half-TB HDD which showed up as a total > > of 446 G available (IIRC, gpart should show it's actual size). I did > > auto partitioning, looked at the sizes, and manually set my partitions > > to give me 40G of swap instead of the auto-generated size of 4G. > > That's really puzzling. It seems that it gave you much more than you > asked for. > > Try this in single user mode: modify the size of the swap partition to > 30 GB. I haven't used MBR partitions for years now, but I believe > that 'bsdlabel -e' will do the trick. Just shorten the length of the > b partition. You may need to 'mount -u /'. If you do it right > (check!), this won't harm any of the other partitions: it'll just > leave 26 GB free between the swap partition and the next partition. > gpart(8) works just fine on MBR drives and partitions/slices and has a much friendlier user interface. "gpart resize" is the command you want. -- Kevin Oberman, Part time kid herder and retired Network Engineer E-mail: rkoberman@gmail.com PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683 From owner-freebsd-stable@freebsd.org Thu Jun 25 11:42:13 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B4EF93589AD for ; Thu, 25 Jun 2020 11:42:13 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: from mail-lj1-x242.google.com (mail-lj1-x242.google.com [IPv6:2a00:1450:4864:20::242]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49symN5qyyz3yf6; Thu, 25 Jun 2020 11:42:12 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: by mail-lj1-x242.google.com with SMTP id n24so6112098lji.10; Thu, 25 Jun 2020 04:42:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to:cc; bh=WaGCHoBa6SKk6tV1G1/k0a1T/RnBuRSVlQhSGUHq9C4=; b=Kh3Uh6wa8cOxdhpkr4bLpYryrh9iITcjhcrHNKia8s6IjmxBlsojUFj1DuuAZFK/pr /KmkgSMmRiiF9/vCzPtXITKiZ+A7xvXq5x86OQw/O9WP36ZqdS3iEX201yUBVLZUAH3r ul5PtB/nWvyQor+COved6CfIsLw0sAUGYhrPIlQ3iT6xhAdL3aAaKbkUufliH77lta+w 1+ggoFgbWKOKPNtvXF9+inqgc6Y3bHFeuAJ5PqtYMlnzNpr5b16EMB7XPF9Dy7RNKvef SZcB6WBpACNjUmS5TUXaa+yZqZWdSHcFuzK/5IL8w9oLCb7YnJTOaNDJRFO+S9yfgRMW 4HHQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc; bh=WaGCHoBa6SKk6tV1G1/k0a1T/RnBuRSVlQhSGUHq9C4=; b=BbW3jZPxHwCBAQbHuxZ/V6WUNEbbrEq6Vy8ljb1CWT1gbtevuVsvObal9J1fXBGKdX sHqe9T99SZ52YS8PcZRP0g8KCCZeaeDwI5jjl5lRXkGZl/GdrGKmey8k3glD3IB+X2bY x49lu1FjC7p0xow0tLp68P81RJzuHb+8f66gcSS0vQArs5PmnfF1oPFVWhcAajwytWEl 1e20h0QiGhNeVYMdq8UIaqhKvJKGc7Er2xbLEX9CrJZcAJdUEwg1ALfRYR/RyfaX5rwh Unvthxyg/JQpxSz0boib+aWdDQQd6rIA9nh7BjOcl8Mj/yXyCle/Nvo6dpRVPt40kJtv g2Pg== X-Gm-Message-State: AOAM533kMntsKRgO/qFXDxJNEy9it47E6KyIJv+lSQAJUU6emko5ahNh xP9Kt0zI9+Ndp1sHZ6OUlqbgpaga86tFZ+JUvKw= X-Google-Smtp-Source: ABdhPJyZ+u8QoS+KQhra5nyTwh2qLracscB2w/X+L6RacOJE/1K8H/4o8gGXR3zqgTILhLz2tw3yZMQRtuF4gfK73po= X-Received: by 2002:a2e:9316:: with SMTP id e22mr7986237ljh.357.1593085327825; Thu, 25 Jun 2020 04:42:07 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:4703:0:0:0:0:0 with HTTP; Thu, 25 Jun 2020 04:42:07 -0700 (PDT) Reply-To: dwilde1@gmail.com In-Reply-To: References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <20200625052949.GC10210@eureka.lemis.com> From: Donald Wilde Date: Thu, 25 Jun 2020 04:42:07 -0700 Message-ID: Subject: Re: swap space issues To: Kevin Oberman Cc: "Greg 'groggy' Lehey" , freebsd-stable Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 49symN5qyyz3yf6 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=Kh3Uh6wa; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of dwilde1@gmail.com designates 2a00:1450:4864:20::242 as permitted sender) smtp.mailfrom=dwilde1@gmail.com X-Spamd-Result: default: False [-2.84 / 15.00]; HAS_REPLYTO(0.00)[dwilde1@gmail.com]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; REPLYTO_ADDR_EQ_FROM(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.96)[-0.959]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_SPAM_SHORT(0.12)[0.117]; NEURAL_HAM_LONG(-1.00)[-1.002]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_REPLYTO(0.00)[gmail.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::242:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 11:42:13 -0000 On 6/24/20, Kevin Oberman wrote: > On Wed, Jun 24, 2020 at 10:30 PM Greg 'groggy' Lehey > wrote: > >> On Wednesday, 24 June 2020 at 20:34:24 -0700, Donald Wilde wrote: >> > On 6/24/20, Greg 'groggy' Lehey wrote: >> >> On Wednesday, 24 June 2020 at 18:51:04 -0700, Donald Wilde wrote: >> >>> On 6/24/20, Greg 'groggy' Lehey wrote: >> >>>> On Wednesday, 24 June 2020 at 9:36:23 -0700, Donald Wilde wrote: >> >>>>> All, >> >>>>> >> >>>>> I recently upgraded my 12-STABLE system to the latest, and now my >> >>>>> swap subsystems aren't working. I deliberately set up a 40GB >> >>>>> partition for swap, and when I do 'top -t' I am only seeing 7906M >> >>>>> total. >> >>>> >> >>>> That looks suspiciously like the difference from 32 GB. Could it be >> >>>> numeric overflow? And if so, where? What does pstat -s say? >> >>> >> >>> Well, hi Greg! LTNT2! >> >> >> >> Indeed. >> >> >> >>> pstat -shm: >> >>> >> >>> /dev/ada0s1b 65536 (1M blocks), Used: 1.5G, Avail: 63G, Capacity: 2% >> >> >> >> Now that's really puzzling. Why does it say 64 G when you said 40 G, >> >> and the error from top tends to confirm it? How big is the partition >> >> (gpart output)? >> > >> > Attached 'gpart list' output >> >> FWIW, gpart show would have done the job. But what I see there is Yet >> Another swap partition size, 66 GB. So so far we have various parts >> reporting 8 GB, 40 GB, 64 GB and 66 GB. >> >> > Reduced kern.maxswzone to 9999999. Is it decimal or unlabeled hex? >> >> It'll be decimal, but it refers to the number of swblk structures >> assigned in memory, and after reading the code I'm still not 100% in >> the clear how this relates to the size of swap, if at all. >> >> > 'top' now shows 4597M total swap. >> >> ... and 4.6 GB. 5 different sizes. >> >> You really shouldn't be relying on top for swap info. It's a third >> party program that demonstrably shows incorrect results (though I I was continuing to reference it because its 'incorrect results' might flag where we need to see things working. When 'top' shows the right results, we've fixed the right thing. >> believe that the maintainer would be very interested to know why and >> to fix it). But pstat -s (without any further options) should show >> what the kernel thinks. Here's what I see immediately following shutdown -r and boot: Device 1K-blocks Used Avail Capacity /dev/ada0s1b 67108864 0 67108864 0% >> >> >>> What else can I share to help diagnose this? >> >> >> >> Background, maybe? You say that you upgraded your system. Did you >> >> change the swap size when you did? What were swap and RAM sizes >> >> before and after? >> > >> > Meant that I upgraded from 12.1-RELEASE to 12-STABLE. When I >> > configured the -RELEASE install, I manually messed with the MBR disk >> > partitions. This is nominally a half-TB HDD which showed up as a total >> > of 446 G available (IIRC, gpart should show it's actual size). I did >> > auto partitioning, looked at the sizes, and manually set my partitions >> > to give me 40G of swap instead of the auto-generated size of 4G. >> >> That's really puzzling. It seems that it gave you much more than you >> asked for. >> >> Try this in single user mode: modify the size of the swap partition to >> 30 GB. I haven't used MBR partitions for years now, but I believe >> that 'bsdlabel -e' will do the trick. Just shorten the length of the >> b partition. You may need to 'mount -u /'. If you do it right >> (check!), this won't harm any of the other partitions: it'll just >> leave 26 GB free between the swap partition and the next partition. Thanks again, Greg! >> > gpart(8) works just fine on MBR drives and partitions/slices and has a much > friendlier user interface. "gpart resize" is the command you want. > -- > Kevin Oberman, Part time kid herder and retired Network Engineer Thanks, Kevin! My laptop's BIOS is old enough that it balked when I tried to boot from a GPT setup of 12.1R. One Of These Days I'll fix that but the MBR works and I needed to move on. We'll get there! :D -- Don Wilde **************************************************** * What is the Internet of Things but a system * * of systems including humans? * **************************************************** From owner-freebsd-stable@freebsd.org Thu Jun 25 12:13:43 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 970A1359770 for ; Thu, 25 Jun 2020 12:13:43 +0000 (UTC) (envelope-from ali.abdallah@suse.com) Received: from mx2.suse.de (mx2.suse.de [195.135.220.15]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.suse.de", Issuer "DigiCert SHA2 High Assurance Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 49szSk3t0yz41JG for ; Thu, 25 Jun 2020 12:13:42 +0000 (UTC) (envelope-from ali.abdallah@suse.com) X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.221.27]) by mx2.suse.de (Postfix) with ESMTP id 0FB80AC85; Thu, 25 Jun 2020 12:13:40 +0000 (UTC) Date: Thu, 25 Jun 2020 14:13:39 +0200 From: Ali Abdallah To: Walter von Entferndt Cc: freebsd-stable@freebsd.org Subject: Re: suspend/resume (was: Re: HP Business PC - NMI problem) Message-ID: <20200625121339.k75mhcawcgg3sdfz@frix230> References: <20200624202335.05314a6a@vinq4.dino.sk> <5265782.8gLySxXtyI@t450s.local.lan> <20200624210226.0c797b2e@vinq4.dino.sk> <5318026.mMMZhaHaU6@t450s.local.lan> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="yu3oi3vxok7fsrf2" Content-Disposition: inline In-Reply-To: <5318026.mMMZhaHaU6@t450s.local.lan> X-Rspamd-Queue-Id: 49szSk3t0yz41JG X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of ali.abdallah@suse.com designates 195.135.220.15 as permitted sender) smtp.mailfrom=ali.abdallah@suse.com X-Spamd-Result: default: False [-4.38 / 15.00]; MID_RHS_NOT_FQDN(0.50)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.03)[-1.027]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[195.135.220.15:from]; R_SPF_ALLOW(-0.20)[+ip4:195.135.220.15]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; DMARC_NA(0.00)[suse.com]; NEURAL_HAM_LONG(-0.97)[-0.973]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[195.135.220.15:from]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.28)[-0.282]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:29298, ipnet:195.135.220.0/22, country:DE]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 12:13:43 -0000 --yu3oi3vxok7fsrf2 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 24.06.2020 22:22, Walter von Entferndt wrote: > Dektop & Laptop users with UEFI may want to enable suspend/resume/hiberna= te to=20 > an "Intel Rapid Start Technology" partition with the my HOWTO on https:// > forums.freebsd.org/threads/suspend-resume-to-disk-iffs-irst-partition-int= el- > fast-flash-intel-rapid-start-technology.75860/ >=20 > Please leave some kind of feedback, if it works for others it can be poli= shed=20 > and go into the FBSD wiki. Just sharing my experience. I have the above IRST setup on my Thinkpad x230 since last year with FreeBSD 12.0/12.1, and it works beautifully! It is nice because I no longer have to make sure to have enough battery when putting the laptop on S3, because after a configurable time in the it will save everything to the irst parition and shuts down. This is the only one thing preventing me from flashing coreboot on my FreeBSD laptop. > --=20 > =3D|o) "Stell' Dir vor es geht und keiner kriegt's hin." (Wolfgang Neuss) >=20 >=20 > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >=20 --=20 Ali Abdallah GPG fingerprint: 51A0 F4A0 C8CF C98F 842E A9A8 B945 56F8 1C85 D0D5 --yu3oi3vxok7fsrf2 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEUaD0oMjPyY+ELqmouUVW+ByF0NUFAl70lOsACgkQuUVW+ByF 0NXvFQ/+P9GDZoKFGv4vjJKE75lZo1nGqWlyEXR3ubBcqcVKzdJLsyDdt+rh+a+T gWsYMTepuTcgvhcYk/AqlTjWD4/HzJk0I/JV/PJGQeUHB+QaHkB9SoIBUEmJ6eef EzmnbrnIqop+gIsh9Zp58FhXSxlJjQCNxfcKKrEQ3/x8E2ce7nYdS4iiYTFqDWEK fsePI9TSfxcasXqteAytOD1K26VzaG/oKWBQZuu3H+yQ4xdK2E8htHY4mrBc7qTx NEejh8N+QmsDR0f/61wF1r1qrZ0Kr9mPCBm/MMYeW+oGjplXs1iUsBcU69vEPR4f fH7YIoz/gCmPEPJpsCMRHnmrIe8syfPx917/BdQgH5cNf1ssH5wYh4nk/v4GBObY qafttt36Nv6sm3eFxo47/Fz5EufEeUdpQlebmqDXgtLb9HEdv7D8iPgaW7hfsKG2 Vqej3YsAEnFJ4fjFZ8F5Ech8KCNU4WEu0mXuZIyd/evdwkQ1WyqmTgxBu+WwLOqW Rh4AuYq/I1LcaP1t3seeu6mEAcNsv71PW9aEZAGIhAab2ELV3ffuAPKESQLZt+pW LFM999UgLj4hKerwkcfVS/krY1rtSdet5J+mG7R1wAYRavFqgI7bx1sXWWlQZYs5 0LlcOvdtdD0VWroe5W5OByL2+0nq9UxwqIHjEZSclQzmuyN7m5U= =Mx7A -----END PGP SIGNATURE----- --yu3oi3vxok7fsrf2-- From owner-freebsd-stable@freebsd.org Thu Jun 25 14:35:04 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 69DED35C25C for ; Thu, 25 Jun 2020 14:35:04 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-ot1-x32f.google.com (mail-ot1-x32f.google.com [IPv6:2607:f8b0:4864:20::32f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49t2bq4cqjz489N; Thu, 25 Jun 2020 14:35:03 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: by mail-ot1-x32f.google.com with SMTP id u23so5423521otq.10; Thu, 25 Jun 2020 07:35:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=HyhY2TP2N0SWcQRVj/dWlGdbtJ0PCyLv1AzpgoVV2oU=; b=kTqy81gYR9p77ffRnpqzN5jgCHkCTHUbx/9DvM4d7KwmPLOXdexCRXQYufemPOuYM3 sISrM3dtba2mmsXZnAWdusL1iypF9gpdWsPDpTcI2OKbhay8v5AIDtxjpdwySOfyrDwK +APl3nLvVuz0m3j2vZYd+IcskWF3N39jrg0ZmhRoAtHvRG7jj47m3+DUovnBRBfQ8OIx zjFs8rZcOHpCtC3n2Xu4l+FYbVR98fqDfPKyER02Vamji6GToWiUMvOO7cHXW9AahRdT Y0CwWxgWtI0d4gjfvrx36vbPWxF9JJqYKOA0syU9siNgBE0u1bbG5RT69ugRevB+v7mm DM7g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=HyhY2TP2N0SWcQRVj/dWlGdbtJ0PCyLv1AzpgoVV2oU=; b=G3DcQvs7h0V6vMefLZuVeOod0I57D1xVGvhPI0N5w9M++PgWRkiDLG2QuVA9SnK0Ze 6pLg7N7NLHtA5uKpk1QN8Jexv4iM2ywh7Mm+3mugrvIdtJ7XMXM6hiwRhPRUhYFPxF78 jE2g4st62iTCGtMAhlwsZ8nrOsw+rhO7+w1wW0LXeipzgjfnlAg/WPG5oCIaFD/LU37W niLveuEkcuKw2gJwcmqqF7hgiBKFIfGnH/NrBKuDGJq05whQ3jxSVsnXlhjOIgab1R9u +MXvfSwPbcePqiHFV+9M8QagLuN+TWIK47IV8lBDHGnS7GTfdB/PppCryoL0M6TWGE2N 94Tw== X-Gm-Message-State: AOAM530//rg084GtIdH63eXaFanI6amRBIQpUNeq8GntK1ddgaAzyKFo YFu6otmwi4ASTVi/jLtZUjT2hzVfoAAF1ANGuSI= X-Google-Smtp-Source: ABdhPJzp7NxkMGkV0HFEbeMA9Sx54YycvV8ax3S/kCYgV1gHCNbsdJyvi8zCuAIab8q1/WwTYJ6ltRoPym2dtNHTJRU= X-Received: by 2002:a4a:97cc:: with SMTP id x12mr27361493ooi.70.1593095702445; Thu, 25 Jun 2020 07:35:02 -0700 (PDT) MIME-Version: 1.0 References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <20200625052949.GC10210@eureka.lemis.com> In-Reply-To: From: Kevin Oberman Date: Thu, 25 Jun 2020 07:34:46 -0700 Message-ID: Subject: Re: swap space issues To: Donald Wilde Cc: "Greg 'groggy' Lehey" , freebsd-stable X-Rspamd-Queue-Id: 49t2bq4cqjz489N X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=kTqy81gY; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of kob6558@gmail.com designates 2607:f8b0:4864:20::32f as permitted sender) smtp.mailfrom=kob6558@gmail.com X-Spamd-Result: default: False [-3.02 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.97)[-0.975]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; NEURAL_HAM_LONG(-1.02)[-1.022]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::32f:from]; NEURAL_HAM_SHORT(-0.33)[-0.326]; FREEMAIL_TO(0.00)[gmail.com]; FORGED_SENDER(0.30)[rkoberman@gmail.com,kob6558@gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[rkoberman@gmail.com,kob6558@gmail.com]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 14:35:04 -0000 On Thu, Jun 25, 2020 at 4:42 AM Donald Wilde wrote: > On 6/24/20, Kevin Oberman wrote: > > On Wed, Jun 24, 2020 at 10:30 PM Greg 'groggy' Lehey > > wrote: > > > >> On Wednesday, 24 June 2020 at 20:34:24 -0700, Donald Wilde wrote: > >> > On 6/24/20, Greg 'groggy' Lehey wrote: > >> >> On Wednesday, 24 June 2020 at 18:51:04 -0700, Donald Wilde wrote: > >> >>> On 6/24/20, Greg 'groggy' Lehey wrote: > >> >>>> On Wednesday, 24 June 2020 at 9:36:23 -0700, Donald Wilde wrote: > >> >>>>> All, > >> >>>>> > >> >>>>> I recently upgraded my 12-STABLE system to the latest, and now my > >> >>>>> swap subsystems aren't working. I deliberately set up a 40GB > >> >>>>> partition for swap, and when I do 'top -t' I am only seeing 7906M > >> >>>>> total. > >> >>>> > >> >>>> That looks suspiciously like the difference from 32 GB. Could it > be > >> >>>> numeric overflow? And if so, where? What does pstat -s say? > >> >>> > >> >>> Well, hi Greg! LTNT2! > >> >> > >> >> Indeed. > >> >> > >> >>> pstat -shm: > >> >>> > >> >>> /dev/ada0s1b 65536 (1M blocks), Used: 1.5G, Avail: 63G, Capacity: > 2% > >> >> > >> >> Now that's really puzzling. Why does it say 64 G when you said 40 G, > >> >> and the error from top tends to confirm it? How big is the partition > >> >> (gpart output)? > >> > > >> > Attached 'gpart list' output > >> > >> FWIW, gpart show would have done the job. But what I see there is Yet > >> Another swap partition size, 66 GB. So so far we have various parts > >> reporting 8 GB, 40 GB, 64 GB and 66 GB. > >> > >> > Reduced kern.maxswzone to 9999999. Is it decimal or unlabeled hex? > >> > >> It'll be decimal, but it refers to the number of swblk structures > >> assigned in memory, and after reading the code I'm still not 100% in > >> the clear how this relates to the size of swap, if at all. > >> > >> > 'top' now shows 4597M total swap. > >> > >> ... and 4.6 GB. 5 different sizes. > >> > >> You really shouldn't be relying on top for swap info. It's a third > >> party program that demonstrably shows incorrect results (though I > > I was continuing to reference it because its 'incorrect results' might > flag where we need to see things working. When 'top' shows the right > results, we've fixed the right thing. > > >> believe that the maintainer would be very interested to know why and > >> to fix it). But pstat -s (without any further options) should show > >> what the kernel thinks. > > Here's what I see immediately following shutdown -r and boot: > > Device 1K-blocks Used Avail Capacity > /dev/ada0s1b 67108864 0 67108864 0% > > >> > >> >>> What else can I share to help diagnose this? > >> >> > >> >> Background, maybe? You say that you upgraded your system. Did you > >> >> change the swap size when you did? What were swap and RAM sizes > >> >> before and after? > >> > > >> > Meant that I upgraded from 12.1-RELEASE to 12-STABLE. When I > >> > configured the -RELEASE install, I manually messed with the MBR disk > >> > partitions. This is nominally a half-TB HDD which showed up as a total > >> > of 446 G available (IIRC, gpart should show it's actual size). I did > >> > auto partitioning, looked at the sizes, and manually set my partitions > >> > to give me 40G of swap instead of the auto-generated size of 4G. > >> > >> That's really puzzling. It seems that it gave you much more than you > >> asked for. > >> > >> Try this in single user mode: modify the size of the swap partition to > >> 30 GB. I haven't used MBR partitions for years now, but I believe > >> that 'bsdlabel -e' will do the trick. Just shorten the length of the > >> b partition. You may need to 'mount -u /'. If you do it right > >> (check!), this won't harm any of the other partitions: it'll just > >> leave 26 GB free between the swap partition and the next partition. > > Thanks again, Greg! > > >> > > gpart(8) works just fine on MBR drives and partitions/slices and has a > much > > friendlier user interface. "gpart resize" is the command you want. > > -- > > Kevin Oberman, Part time kid herder and retired Network Engineer > > Thanks, Kevin! My laptop's BIOS is old enough that it balked when I > tried to boot from a GPT setup of 12.1R. One Of These Days I'll fix > that but the MBR works and I needed to move on. > > We'll get there! :D > I think a lot of people miss the point that the fact that gpart was written primarily to provide support GPT partitioning, it also supports MBR and bsdlabel is really obsolete. gpart(8) supports 7 different partitioning schemes including the old RAW scheme, GPT and MBR. I still have an MBR disk on my near decade old laptop and I use gpart on it. -- Kevin Oberman, Part time kid herder and retired Network Engineer E-mail: rkoberman@gmail.com PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683 From owner-freebsd-stable@freebsd.org Thu Jun 25 15:04:55 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 75C2535CAE3 for ; Thu, 25 Jun 2020 15:04:55 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: from mail-lf1-x133.google.com (mail-lf1-x133.google.com [IPv6:2a00:1450:4864:20::133]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49t3GG4w2fz49lY; Thu, 25 Jun 2020 15:04:54 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: by mail-lf1-x133.google.com with SMTP id y18so3384425lfh.11; Thu, 25 Jun 2020 08:04:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to:cc; bh=ed0S/BDaZnf/mYrtTKnXRGtsa73PpKKtiL+vok8M83w=; b=d7w8f9ttV4WFhOvng21R1QuB8eMCmF3GkUL1oSOOWnzqlyffyi8366fIqTyJOKnwnE 8YP8UZnGeHTdIQbIjY1FksYE0xIe74gf2Q5KvzSyms0Wvw65fDnZs4SjwtEBqbav2FBR 6TnZ8JhfojeNEGHhKfk+S1PXt6MGEg0xO6rVhGzV6zk+9OCN3mQcREPzlauJ85PnMw14 5YwFAfsHUgpPI/MJrjwmnXJu25SEXxRdKQgBOCaNmRIOY0RPHLCQPLGtvN5zd1y/zepA hQqPTrEAuWfXRPJ9a63jj/wLASd/AHDLnqqrJ9dWnE+QHtq9ViIU31Heslx+3WCCfQRh 3Rqg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc; bh=ed0S/BDaZnf/mYrtTKnXRGtsa73PpKKtiL+vok8M83w=; b=mqtTopfxH3eFTPqR8eVsJMhLWb/yVC4oGIuHVenufhUiWJCd8Y+SRrEXDr1r/vHbNy NmU6vnfYbL7Eu3Pf7ddIdxVoy9sL+EqyDskzephUqkeib/r1Y8HU7ztFbwV92aU+/1Gw GBbXosdnVw0Zzbd614qgX7WrOnz7s88vl7V323czN7dMFlMUUAJ/fgG/Q6GLj3YFm8ys yUfrmCihQYFOOVeBxJFolOopETiqXzRPM9daX0Jtfpk5Yi0vdjwAiBtqfICkvO8ovxvB aahMlEofA6ndX0ttDI7dnBF6POhkV3V3qdz+XMEE69Zq8u/QwkHcCWjGKS6HVT6e/0Dl RJ1g== X-Gm-Message-State: AOAM533nBmSxIfMttnlECpMV2flZzr7covhXO+ITjdKdzZEvInXGbOy+ voHW/L3zJY0RIEgCOnHKHhnRlR7gsHMpB/85oew= X-Google-Smtp-Source: ABdhPJweuEFX1ZizWt7+qqWXI293qSPyFIcJNA7QtL7cvSbQE27CiSmBlQo47V4pEeXTfRG1Vs3HOiT92JmVriINF1E= X-Received: by 2002:ac2:52af:: with SMTP id r15mr16212076lfm.24.1593097492285; Thu, 25 Jun 2020 08:04:52 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:4703:0:0:0:0:0 with HTTP; Thu, 25 Jun 2020 08:04:51 -0700 (PDT) Reply-To: dwilde1@gmail.com In-Reply-To: References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <20200625052949.GC10210@eureka.lemis.com> From: Donald Wilde Date: Thu, 25 Jun 2020 08:04:51 -0700 Message-ID: Subject: Re: swap space issues To: Kevin Oberman Cc: "Greg 'groggy' Lehey" , freebsd-stable Content-Type: multipart/mixed; boundary="0000000000001ee02305a8e9ea09" X-Rspamd-Queue-Id: 49t3GG4w2fz49lY X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=d7w8f9tt; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of dwilde1@gmail.com designates 2a00:1450:4864:20::133 as permitted sender) smtp.mailfrom=dwilde1@gmail.com X-Spamd-Result: default: False [-1.62 / 15.00]; HAS_REPLYTO(0.00)[dwilde1@gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; HAS_ATTACHMENT(0.00)[]; REPLYTO_ADDR_EQ_FROM(0.00)[]; MIME_BASE64_TEXT_BOGUS(1.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MIME_BASE64_TEXT(0.10)[]; CTYPE_MIXED_BOGUS(1.00)[]; NEURAL_HAM_SHORT(-0.71)[-0.709]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.985]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.02)[-1.023]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; FREEMAIL_REPLYTO(0.00)[gmail.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::133:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 15:04:55 -0000 --0000000000001ee02305a8e9ea09 Content-Type: text/plain; charset="UTF-8" On 6/25/20, Kevin Oberman wrote: > On Thu, Jun 25, 2020 at 4:42 AM Donald Wilde wrote: > >> On 6/24/20, Kevin Oberman wrote: >> > On Wed, Jun 24, 2020 at 10:30 PM Greg 'groggy' Lehey >> > wrote: >> > >> >> On Wednesday, 24 June 2020 at 20:34:24 -0700, Donald Wilde wrote: >> >> > On 6/24/20, Greg 'groggy' Lehey wrote: >> >> >> On Wednesday, 24 June 2020 at 18:51:04 -0700, Donald Wilde wrote: >> >> >>> On 6/24/20, Greg 'groggy' Lehey wrote: >> >> >>>> On Wednesday, 24 June 2020 at 9:36:23 -0700, Donald Wilde wrote: >> >> >>>>> All, >> >> >>>>> >> >> >>>>> I recently upgraded my 12-STABLE system to the latest, and now >> >> >>>>> my >> >> >>>>> swap subsystems aren't working. I deliberately set up a 40GB >> >> >>>>> partition for swap, and when I do 'top -t' I am only seeing >> >> >>>>> 7906M >> >> >>>>> total. >> >> >>>> >> >> >>>> That looks suspiciously like the difference from 32 GB. Could it >> be >> >> >>>> numeric overflow? And if so, where? What does pstat -s say? >> >> >>> >> >> >>> Well, hi Greg! LTNT2! >> >> >> >> >> >> Indeed. >> >> >> >> >> >>> pstat -shm: >> >> >>> >> >> >>> /dev/ada0s1b 65536 (1M blocks), Used: 1.5G, Avail: 63G, Capacity: >> 2% >> >> >> >> >> >> Now that's really puzzling. Why does it say 64 G when you said 40 >> >> >> G, >> >> >> and the error from top tends to confirm it? How big is the >> >> >> partition >> >> >> (gpart output)? >> >> > >> >> > Attached 'gpart list' output >> >> >> >> FWIW, gpart show would have done the job. But what I see there is Yet >> >> Another swap partition size, 66 GB. So so far we have various parts >> >> reporting 8 GB, 40 GB, 64 GB and 66 GB. >> >> >> >> > Reduced kern.maxswzone to 9999999. Is it decimal or unlabeled hex? >> >> >> >> It'll be decimal, but it refers to the number of swblk structures >> >> assigned in memory, and after reading the code I'm still not 100% in >> >> the clear how this relates to the size of swap, if at all. >> >> >> >> > 'top' now shows 4597M total swap. >> >> >> >> ... and 4.6 GB. 5 different sizes. >> >> >> >> You really shouldn't be relying on top for swap info. It's a third >> >> party program that demonstrably shows incorrect results (though I >> >> I was continuing to reference it because its 'incorrect results' might >> flag where we need to see things working. When 'top' shows the right >> results, we've fixed the right thing. >> >> >> believe that the maintainer would be very interested to know why and >> >> to fix it). But pstat -s (without any further options) should show >> >> what the kernel thinks. >> >> Here's what I see immediately following shutdown -r and boot: >> >> Device 1K-blocks Used Avail Capacity >> /dev/ada0s1b 67108864 0 67108864 0% >> >> >> >> >> >>> What else can I share to help diagnose this? >> >> >> >> >> >> Background, maybe? You say that you upgraded your system. Did you >> >> >> change the swap size when you did? What were swap and RAM sizes >> >> >> before and after? >> >> > >> >> > Meant that I upgraded from 12.1-RELEASE to 12-STABLE. When I >> >> > configured the -RELEASE install, I manually messed with the MBR disk >> >> > partitions. This is nominally a half-TB HDD which showed up as a >> >> > total >> >> > of 446 G available (IIRC, gpart should show it's actual size). I did >> >> > auto partitioning, looked at the sizes, and manually set my >> >> > partitions >> >> > to give me 40G of swap instead of the auto-generated size of 4G. >> >> >> >> That's really puzzling. It seems that it gave you much more than you >> >> asked for. >> >> >> >> Try this in single user mode: modify the size of the swap partition to >> >> 30 GB. I haven't used MBR partitions for years now, but I believe >> >> that 'bsdlabel -e' will do the trick. Just shorten the length of the >> >> b partition. You may need to 'mount -u /'. If you do it right >> >> (check!), this won't harm any of the other partitions: it'll just >> >> leave 26 GB free between the swap partition and the next partition. >> >> Thanks again, Greg! >> >> >> >> > gpart(8) works just fine on MBR drives and partitions/slices and has a >> much >> > friendlier user interface. "gpart resize" is the command you want. >> > -- >> > Kevin Oberman, Part time kid herder and retired Network Engineer >> >> Thanks, Kevin! My laptop's BIOS is old enough that it balked when I >> tried to boot from a GPT setup of 12.1R. One Of These Days I'll fix >> that but the MBR works and I needed to move on. >> >> We'll get there! :D >> > > I think a lot of people miss the point that the fact that gpart was written > primarily to provide support GPT partitioning, it also supports MBR and > bsdlabel is really obsolete. gpart(8) supports 7 different partitioning > schemes including the old RAW scheme, GPT and MBR. I still have an MBR disk > on my near decade old laptop and I use gpart on it. I have been bouncing around between gpart and geom, seeking to understand them better. The man page is... obtuse... but I'm understanding more of it now. geom and gpart seem to be rather self-referential. Here's /etc/fstab: # Device Mountpoint FStype Options Dump Pass# /dev/ada0s1a / ufs rw 1 1 /dev/ada0s1b none swap sw 0 0 /dev/ada0s1d none swap sw 0 0 fdesc /dev/fd fdescfs rw 0 0 proc /proc procfs rw 0 0 Here's /boot/loader.conf: security.bsd.allow_destructive_dtrace=0 loader_logo="beastie" kern.maxproc=75000 kern.maxswzone=25600001 Attached is 'gpart list' output. top is still not happy, but it now shows 11G. I think I'm ready to try synth again. :D I also think it's time for a new thread, because I still have one niggling issue. Thanks for all your help, guys! :D [end thread] -- Don Wilde **************************************************** * What is the Internet of Things but a system * * of systems including humans? * **************************************************** --0000000000001ee02305a8e9ea09 Content-Type: text/plain; charset="US-ASCII"; name="gpart_list.txt" Content-Disposition: attachment; filename="gpart_list.txt" Content-Transfer-Encoding: base64 X-Attachment-Id: file0 R2VvbSBuYW1lOiBhZGEwCm1vZGlmaWVkOiBmYWxzZQpzdGF0ZTogT0sKZndoZWFkczogMTYKZndz ZWN0b3JzOiA2MwpsYXN0OiA5NzY3NzMxNjcKZmlyc3Q6IDYzCmVudHJpZXM6IDQKc2NoZW1lOiBN QlIKUHJvdmlkZXJzOgoxLiBOYW1lOiBhZGEwczEKICAgTWVkaWFzaXplOiA1MDAxMDc4MjkyNDgg KDQ2NkcpCiAgIFNlY3RvcnNpemU6IDUxMgogICBTdHJpcGVzaXplOiA0MDk2CiAgIFN0cmlwZW9m ZnNldDogMAogICBNb2RlOiByM3czZTQKICAgZWZpbWVkaWE6IEhEKDEsTUJSLDB4OTA5MDkwOTAs MHg0MCwweDNhMzg1ZmYwKQogICBhdHRyaWI6IGFjdGl2ZQogICByYXd0eXBlOiAxNjUKICAgbGVu Z3RoOiA1MDAxMDc4MjkyNDgKICAgb2Zmc2V0OiAzMjc2OAogICB0eXBlOiBmcmVlYnNkCiAgIGlu ZGV4OiAxCiAgIGVuZDogOTc2NzczMTY3CiAgIHN0YXJ0OiA2NApDb25zdW1lcnM6CjEuIE5hbWU6 IGFkYTAKICAgTWVkaWFzaXplOiA1MDAxMDc4NjIwMTYgKDQ2NkcpCiAgIFNlY3RvcnNpemU6IDUx MgogICBTdHJpcGVzaXplOiA0MDk2CiAgIFN0cmlwZW9mZnNldDogMAogICBNb2RlOiByM3czZTcK Ckdlb20gbmFtZTogYWRhMHMxCm1vZGlmaWVkOiBmYWxzZQpzdGF0ZTogT0sKZndoZWFkczogMTYK ZndzZWN0b3JzOiA2MwpsYXN0OiA5NzY3NzMxMDMKZmlyc3Q6IDAKZW50cmllczogOApzY2hlbWU6 IEJTRApQcm92aWRlcnM6CjEuIE5hbWU6IGFkYTBzMWEKICAgTWVkaWFzaXplOiA0Mjk0OTY3Mjk2 MDAgKDQwMEcpCiAgIFNlY3RvcnNpemU6IDUxMgogICBTdHJpcGVzaXplOiA0MDk2CiAgIFN0cmlw ZW9mZnNldDogMAogICBNb2RlOiByMXcxZTEKICAgcmF3dHlwZTogNwogICBsZW5ndGg6IDQyOTQ5 NjcyOTYwMAogICBvZmZzZXQ6IDAKICAgdHlwZTogZnJlZWJzZC11ZnMKICAgaW5kZXg6IDEKICAg ZW5kOiA4Mzg4NjA3OTkKICAgc3RhcnQ6IDAKMi4gTmFtZTogYWRhMHMxYgogICBNZWRpYXNpemU6 IDM0MzU5NzM4MzY4ICgzMkcpCiAgIFNlY3RvcnNpemU6IDUxMgogICBTdHJpcGVzaXplOiA0MDk2 CiAgIFN0cmlwZW9mZnNldDogMAogICBNb2RlOiByMXcxZTAKICAgcmF3dHlwZTogMQogICBsZW5n dGg6IDM0MzU5NzM4MzY4CiAgIG9mZnNldDogNDI5NDk2NzI5NjAwCiAgIHR5cGU6IGZyZWVic2Qt c3dhcAogICBpbmRleDogMgogICBlbmQ6IDkwNTk2OTY2MwogICBzdGFydDogODM4ODYwODAwCjMu IE5hbWU6IGFkYTBzMWQKICAgTWVkaWFzaXplOiAzNDM1OTczODM2OCAoMzJHKQogICBTZWN0b3Jz aXplOiA1MTIKICAgU3RyaXBlc2l6ZTogNDA5NgogICBTdHJpcGVvZmZzZXQ6IDAKICAgTW9kZTog cjF3MWUwCiAgIHJhd3R5cGU6IDEKICAgbGVuZ3RoOiAzNDM1OTczODM2OAogICBvZmZzZXQ6IDQ2 Mzg1NjQ2Nzk2OAogICB0eXBlOiBmcmVlYnNkLXN3YXAKICAgaW5kZXg6IDQKICAgZW5kOiA5NzMw Nzg1MjcKICAgc3RhcnQ6IDkwNTk2OTY2NAo0LiBOYW1lOiBhZGEwczFlCiAgIE1lZGlhc2l6ZTog MTg5MTYyMjkxMiAoMS44RykKICAgU2VjdG9yc2l6ZTogNTEyCiAgIFN0cmlwZXNpemU6IDQwOTYK ICAgU3RyaXBlb2Zmc2V0OiAwCiAgIE1vZGU6IHIwdzBlMAogICByYXd0eXBlOiA3CiAgIGxlbmd0 aDogMTg5MTYyMjkxMgogICBvZmZzZXQ6IDQ5ODIxNjIwNjMzNgogICB0eXBlOiBmcmVlYnNkLXVm cwogICBpbmRleDogNQogICBlbmQ6IDk3Njc3MzEwMwogICBzdGFydDogOTczMDc4NTI4CkNvbnN1 bWVyczoKMS4gTmFtZTogYWRhMHMxCiAgIE1lZGlhc2l6ZTogNTAwMTA3ODI5MjQ4ICg0NjZHKQog ICBTZWN0b3JzaXplOiA1MTIKICAgU3RyaXBlc2l6ZTogNDA5NgogICBTdHJpcGVvZmZzZXQ6IDAK ICAgTW9kZTogcjN3M2U0Cgo= --0000000000001ee02305a8e9ea09-- From owner-freebsd-stable@freebsd.org Thu Jun 25 15:06:34 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1347B35CA6A for ; Thu, 25 Jun 2020 15:06:34 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:c2c:26d8::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 49t3J85KNkz4BDt for ; Thu, 25 Jun 2020 15:06:32 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id 05PF6P4K058489 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 25 Jun 2020 15:06:28 GMT (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: dwilde1@gmail.com Received: from [10.58.0.10] (dadvw [10.58.0.10]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id 05PF6Lof066767 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Thu, 25 Jun 2020 22:06:21 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: swap space issues To: dwilde1@gmail.com References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <20200625052949.GC10210@eureka.lemis.com> Cc: freebsd-stable From: Eugene Grosbein Message-ID: <6a288c68-81be-228c-b4b0-1cb04c85e7f1@grosbein.net> Date: Thu, 25 Jun 2020 22:06:13 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.0 SPF_PASS SPF: sender matches SPF record * 0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: 49t3J85KNkz4BDt X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=permerror (mx1.freebsd.org: domain of eugen@grosbein.net uses mechanism not recognized by this client) smtp.mailfrom=eugen@grosbein.net X-Spamd-Result: default: False [-0.16 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.50)[-0.504]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[grosbein.net]; NEURAL_SPAM_MEDIUM(0.46)[0.461]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_PERMFAIL(0.00)[empty SPF record]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.01)[-0.012]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 15:06:34 -0000 25.06.2020 18:42, Donald Wilde wrote: > Thanks, Kevin! My laptop's BIOS is old enough that it balked when I > tried to boot from a GPT setup of 12.1R. One Of These Days I'll fix > that but the MBR works and I needed to move on. > > We'll get there! :D gpart is not for GPT, it is for "GEOM Partitioning". gpart manages all kind of partitioning in FreeBSD, including swap partitions. From owner-freebsd-stable@freebsd.org Thu Jun 25 17:27:04 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8E80435FA6A for ; Thu, 25 Jun 2020 17:27:04 +0000 (UTC) (envelope-from paul@gromit.dlib.vt.edu) Received: from gromit.dlib.vt.edu (gromit.dlib.vt.edu [128.173.49.70]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "gromit.dlib.vt.edu", Issuer "Chumby Certificate Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 49t6QH52Mkz4MQB; Thu, 25 Jun 2020 17:27:03 +0000 (UTC) (envelope-from paul@gromit.dlib.vt.edu) Received: from mather.gromit23.net (c-98-244-101-97.hsd1.va.comcast.net [98.244.101.97]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by gromit.dlib.vt.edu (Postfix) with ESMTPSA id 68BDD39B; Thu, 25 Jun 2020 13:26:57 -0400 (EDT) From: Paul Mather Message-Id: Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.14\)) Subject: Re: swap space issues Date: Thu, 25 Jun 2020 13:26:56 -0400 In-Reply-To: Cc: Greg 'groggy' Lehey , freebsd-stable To: dwilde1@gmail.com References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> X-Mailer: Apple Mail (2.3445.104.14) X-Rspamd-Queue-Id: 49t6QH52Mkz4MQB X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=vt.edu (policy=none); spf=none (mx1.freebsd.org: domain of paul@gromit.dlib.vt.edu has no SPF policy when checking 128.173.49.70) smtp.mailfrom=paul@gromit.dlib.vt.edu X-Spamd-Result: default: False [0.22 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; FROM_HAS_DN(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_SPAM_MEDIUM(0.09)[0.090]; RECEIVED_SPAMHAUS_PBL(0.00)[98.244.101.97:received]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.48)[-0.478]; NEURAL_SPAM_LONG(0.11)[0.106]; R_SPF_NA(0.00)[no SPF record]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:1312, ipnet:128.173.0.0/16, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DMARC_POLICY_SOFTFAIL(0.10)[vt.edu : No valid SPF, No valid DKIM,none] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 17:27:04 -0000 On Jun 24, 2020, at 11:34 PM, Donald Wilde wrote: > Meant that I upgraded from 12.1-RELEASE to 12-STABLE. When I > configured the -RELEASE install, I manually messed with the MBR disk > partitions. This is nominally a half-TB HDD which showed up as a total > of 446 G available (IIRC, gpart should show it's actual size). I did > auto partitioning, looked at the sizes, and manually set my partitions > to give me 40G of swap instead of the auto-generated size of 4G. >=20 > This is an old Dell i3 laptop. It's really generic, picked > specifically as something I could use for Ubuntu or FreeBSD. Dell > SERVICE TAG is 5K8W162, but it's a generic i3 with 4G of RAM. I think I've missed in this thread where you said which FreeBSD arch you = are running: is it FreeBSD/amd64 or FreeBSD/i386? (With an "old" = machine, 4 GB RAM, and an install still using MBR, it could potentially = be FreeBSD/i386.) If it is FreeBSD/i386, there is a precedent for it having problems with = configuring large amounts of swap. However, it is usually related to = having relatively little RAM, too (large amounts of swap space means the = OS needs to use more RAM to keep track of it). Cheers, Paul. From owner-freebsd-stable@freebsd.org Thu Jun 25 18:30:35 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C37043414B3 for ; Thu, 25 Jun 2020 18:30:35 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: from mail-lf1-x142.google.com (mail-lf1-x142.google.com [IPv6:2a00:1450:4864:20::142]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49t7qb0Mgrz4QN2 for ; Thu, 25 Jun 2020 18:30:34 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: by mail-lf1-x142.google.com with SMTP id y18so3738203lfh.11 for ; Thu, 25 Jun 2020 11:30:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to:cc; bh=M/pW/xaAzYwLXtzVm8WnNaWOVrHKo2Dt5mCurJz3YlA=; b=g1EHlH3XkV1zUqYNXFq+4w+7DcwtPg6Ce2ljNhfu4367s6gqwLviR8CEYXfVZnXB+3 XtcbntETNTZ8Ow3jHCgvbN/ZzBM9d93UmpjxNnH9Zub66+stWJdFOc49nLAoYbyakWNf r519BWpxvvrKyOa+FpesCHjH3x98ds9pIRvotu+hjV/WlrvBKESYCHFdaT2weEYZVdnW cRcKIz5vCcBHYpiC7yKcJtqPR96+hinYXsvcBgprxtyHHDAV0TZm6jQv5nwFbrd/XP07 vgqc+rUw55dFWGYSd4uTCoMnCSUBWeHjxXBh/6eYI58CzsTo6QkoXfSlP29ofW6tcmKt x0og== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc; bh=M/pW/xaAzYwLXtzVm8WnNaWOVrHKo2Dt5mCurJz3YlA=; b=I2nbQ2De7jf6inEUAV6f7uYQ0G9kdAOHAwVevhojs4ewCa9J6ajCNvE9JI3O8pcD0N Ub3sNW09tHzr0YzbMax2n9KlPnmpCq40MwHml9A4yOO5cz/m2TsZqWhINVNFd+Yg+IsX 3cWQDhuu7Szdw8DjpcfbsAjAMXio2K9I13nFY8fYYW+RzJ+udCszSyL54JFS/oSi8tCv NAdNembyIV27SUQIX9W9ZlLj8roM00eGOFpHLgcD2eh/PbD3xHiSkuOSXzKhdaf2VwFG dSP0VwNGZ5ckk9+VGqiT2sWYSCTqveSn5GZI7qn0mGWEQyeqBRyxXukXszOb4RbbNEnz nsgg== X-Gm-Message-State: AOAM531j18i4140hzsVrzDd+ZC5jnmAVTx2zWkWjDMFwMDt0MbYKfXnk p6K4Rt3sYqwMFU5YTcnmEqUZOPuosBf5QkXg0Qo2hHUh X-Google-Smtp-Source: ABdhPJzr59//fbxxEeyzR7nQM1ICIeqGbT85+jQm0HxBYWC5FkaFxDx3gY9rt21lVDjutxEOC03mMBhjU0Kry/o8aqc= X-Received: by 2002:ac2:5a01:: with SMTP id q1mr19477036lfn.182.1593109832141; Thu, 25 Jun 2020 11:30:32 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:4703:0:0:0:0:0 with HTTP; Thu, 25 Jun 2020 11:30:31 -0700 (PDT) Reply-To: dwilde1@gmail.com In-Reply-To: References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> From: Donald Wilde Date: Thu, 25 Jun 2020 11:30:31 -0700 Message-ID: Subject: Re: swap space issues To: Paul Mather Cc: freebsd-stable Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 49t7qb0Mgrz4QN2 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=g1EHlH3X; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of dwilde1@gmail.com designates 2a00:1450:4864:20::142 as permitted sender) smtp.mailfrom=dwilde1@gmail.com X-Spamd-Result: default: False [-3.36 / 15.00]; HAS_REPLYTO(0.00)[dwilde1@gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; REPLYTO_ADDR_EQ_FROM(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.37)[-0.374]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.97)[-0.975]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.01)[-1.010]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_REPLYTO(0.00)[gmail.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::142:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 18:30:35 -0000 On 6/25/20, Paul Mather wrote: > On Jun 24, 2020, at 11:34 PM, Donald Wilde wrote: > > > I think I've missed in this thread where you said which FreeBSD arch you are > running: is it FreeBSD/amd64 or FreeBSD/i386? (With an "old" machine, 4 GB > RAM, and an install still using MBR, it could potentially be FreeBSD/i386.) > Sorry, Paul. You're right, I didn't say. amd64. Here's 'uname -a' FreeBSD Synergy000010 12.1-STABLE FreeBSD 12.1-STABLE r362500 LIBERTYSERVER amd64 > If it is FreeBSD/i386, there is a precedent for it having problems with > configuring large amounts of swap. However, it is usually related to having > relatively little RAM, too (large amounts of swap space means the OS needs > to use more RAM to keep track of it). > That's good to know, Paul. I am once again doing embedded work, which means I will be coding 32-bit ARM M7's soon enough. Here's 'pstat -s' on the i3 (which registers as cpu HAMMER): Device 1K-blocks Used Avail Capacity /dev/ada0s1b 33554432 0 33554432 0% /dev/ada0s1d 33554432 0 33554432 0% Total 67108864 0 67108864 0% -- Don Wilde **************************************************** * What is the Internet of Things but a system * * of systems including humans? * **************************************************** From owner-freebsd-stable@freebsd.org Thu Jun 25 18:55:55 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 257F5342501 for ; Thu, 25 Jun 2020 18:55:55 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:c2c:26d8::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 49t8Np0Zq2z4RdK for ; Thu, 25 Jun 2020 18:55:53 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id 05PItgHd060594 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 25 Jun 2020 18:55:44 GMT (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: dwilde1@gmail.com Received: from [10.58.0.10] (dadvw [10.58.0.10]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id 05PItcqM068462 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Fri, 26 Jun 2020 01:55:38 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: swap space issues To: dwilde1@gmail.com References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> Cc: freebsd-stable From: Eugene Grosbein Message-ID: <9fdb4d52-abb7-bc80-8dc1-1315cf01175b@grosbein.net> Date: Fri, 26 Jun 2020 01:55:29 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.0 SPF_PASS SPF: sender matches SPF record * 0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: 49t8Np0Zq2z4RdK X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=permerror (mx1.freebsd.org: domain of eugen@grosbein.net uses mechanism not recognized by this client) smtp.mailfrom=eugen@grosbein.net X-Spamd-Result: default: False [-0.22 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.53)[-0.532]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[grosbein.net]; NEURAL_SPAM_MEDIUM(0.46)[0.465]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_PERMFAIL(0.00)[empty SPF record]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.05)[-0.050]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 18:55:55 -0000 26.06.2020 1:30, Donald Wilde wrote: > Here's 'pstat -s' on the i3 (which registers as cpu HAMMER): > > Device 1K-blocks Used Avail Capacity > /dev/ada0s1b 33554432 0 33554432 0% > /dev/ada0s1d 33554432 0 33554432 0% > Total 67108864 0 67108864 0% "pstat -s" may also be invoked as "swapinfo" or better "swapinfo -h". From owner-freebsd-stable@freebsd.org Fri Jun 26 01:37:08 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AAE7834A079 for ; Fri, 26 Jun 2020 01:37:08 +0000 (UTC) (envelope-from grog@lemis.com) Received: from lax.lemis.com (www.lemis.com [45.32.70.18]) by mx1.freebsd.org (Postfix) with ESMTP id 49tKHl5L6Tz3cGp for ; Fri, 26 Jun 2020 01:37:07 +0000 (UTC) (envelope-from grog@lemis.com) Received: from eureka.lemis.com (aussie-gw.lemis.com [167.179.139.35]) by lax.lemis.com (Postfix) with ESMTP id F1FBC2804C; Fri, 26 Jun 2020 01:37:00 +0000 (UTC) Received: by eureka.lemis.com (Postfix, from userid 1004) id 278C8263599; Fri, 26 Jun 2020 11:37:00 +1000 (AEST) Date: Fri, 26 Jun 2020 11:37:00 +1000 From: Greg 'groggy' Lehey To: Eugene Grosbein Cc: dwilde1@gmail.com, freebsd-stable Subject: Re: swap space issues Message-ID: <20200626013700.GA79048@eureka.lemis.com> References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <9fdb4d52-abb7-bc80-8dc1-1315cf01175b@grosbein.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="rwEMma7ioTxnRzrJ" Content-Disposition: inline In-Reply-To: <9fdb4d52-abb7-bc80-8dc1-1315cf01175b@grosbein.net> Organization: The FreeBSD Project Phone: +61-3-5309-0418 Mobile: +61-490-494-038. Use only as instructed. WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 9A1B 8202 BCCE B846 F92F 09AC 22E6 F290 507A 4223 User-Agent: Mutt/1.6.1 (2016-04-27) X-Rspamd-Queue-Id: 49tKHl5L6Tz3cGp X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of grog@lemis.com designates 45.32.70.18 as permitted sender) smtp.mailfrom=grog@lemis.com X-Spamd-Result: default: False [-4.99 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.04)[-1.037]; RCVD_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+a:www.lemis.com]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; DMARC_NA(0.00)[FreeBSD.org]; NEURAL_HAM_LONG(-1.02)[-1.023]; HAS_ORG_HEADER(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.93)[-0.926]; SIGNED_PGP(-2.00)[]; FORGED_SENDER(0.30)[grog@FreeBSD.org,grog@lemis.com]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:20473, ipnet:45.32.64.0/19, country:US]; FROM_NEQ_ENVFROM(0.00)[grog@FreeBSD.org,grog@lemis.com]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Jun 2020 01:37:08 -0000 --rwEMma7ioTxnRzrJ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Friday, 26 June 2020 at 1:55:29 +0700, Eugene Grosbein wrote: > 26.06.2020 1:30, Donald Wilde wrote: > >> Here's 'pstat -s' on the i3 (which registers as cpu HAMMER): >> >> Device 1K-blocks Used Avail Capacity >> /dev/ada0s1b 33554432 0 33554432 0% >> /dev/ada0s1d 33554432 0 33554432 0% >> Total 67108864 0 67108864 0% > > "pstat -s" may also be invoked as "swapinfo" That's no shorter. > or better "swapinfo -h". "Better" is in the eye of the beholder. I find -h extremely irritating. Greg -- Sent from my desktop computer. Finger grog@FreeBSD.org for PGP public key. See complete headers for address and phone numbers. This message is digitally signed. If your Microsoft mail program reports problems, please read http://lemis.com/broken-MUA --rwEMma7ioTxnRzrJ Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iEYEARECAAYFAl71UTwACgkQIubykFB6QiOuXQCeMPq8apAM8xoLmd3kCsIvTumo LVwAoJ4hgAFjGYoMDmbGtrheFPbpQtk3 =q52A -----END PGP SIGNATURE----- --rwEMma7ioTxnRzrJ-- From owner-freebsd-stable@freebsd.org Fri Jun 26 01:39:08 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 070F834A7C0 for ; Fri, 26 Jun 2020 01:39:08 +0000 (UTC) (envelope-from grog@lemis.com) Received: from lax.lemis.com (www.lemis.com [45.32.70.18]) by mx1.freebsd.org (Postfix) with ESMTP id 49tKL3362hz3cSp for ; Fri, 26 Jun 2020 01:39:07 +0000 (UTC) (envelope-from grog@lemis.com) Received: from eureka.lemis.com (aussie-gw.lemis.com [167.179.139.35]) by lax.lemis.com (Postfix) with ESMTP id A5BC428104; Fri, 26 Jun 2020 01:39:06 +0000 (UTC) Received: by eureka.lemis.com (Postfix, from userid 1004) id 9E3B9263599; Fri, 26 Jun 2020 11:39:05 +1000 (AEST) Date: Fri, 26 Jun 2020 11:39:05 +1000 From: Greg 'groggy' Lehey To: Kevin Oberman Cc: Donald Wilde , freebsd-stable Subject: Re: swap space issues Message-ID: <20200626013905.GB79048@eureka.lemis.com> References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <20200625052949.GC10210@eureka.lemis.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="hQiwHBbRI9kgIhsi" Content-Disposition: inline In-Reply-To: Organization: The FreeBSD Project Phone: +61-3-5309-0418 Mobile: +61-490-494-038. Use only as instructed. WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 9A1B 8202 BCCE B846 F92F 09AC 22E6 F290 507A 4223 User-Agent: Mutt/1.6.1 (2016-04-27) X-Rspamd-Queue-Id: 49tKL3362hz3cSp X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of grog@lemis.com designates 45.32.70.18 as permitted sender) smtp.mailfrom=grog@lemis.com X-Spamd-Result: default: False [-4.69 / 15.00]; ARC_NA(0.00)[]; FORGED_SENDER(0.30)[grog@FreeBSD.org,grog@lemis.com]; RCVD_COUNT_TWO(0.00)[2]; NEURAL_HAM_MEDIUM(-1.04)[-1.035]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+a:www.lemis.com:c]; NEURAL_HAM_LONG(-1.02)[-1.018]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; DMARC_NA(0.00)[FreeBSD.org]; HAS_ORG_HEADER(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.64)[-0.641]; SIGNED_PGP(-2.00)[]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:20473, ipnet:45.32.64.0/19, country:US]; FROM_NEQ_ENVFROM(0.00)[grog@FreeBSD.org,grog@lemis.com]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Jun 2020 01:39:08 -0000 --hQiwHBbRI9kgIhsi Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Wednesday, 24 June 2020 at 23:27:27 -0700, Kevin Oberman wrote, without trimming: > On Wed, Jun 24, 2020 at 10:30 PM Greg 'groggy' Lehey > wrote: > >> On Wednesday, 24 June 2020 at 20:34:24 -0700, Donald Wilde wrote: >>> On 6/24/20, Greg 'groggy' Lehey wrote: >>>> On Wednesday, 24 June 2020 at 18:51:04 -0700, Donald Wilde wrote: >>>>> On 6/24/20, Greg 'groggy' Lehey wrote: >>>>>> On Wednesday, 24 June 2020 at 9:36:23 -0700, Donald Wilde wrote: >>>>>>> All, ... This would be much more readable if you trimmed unrelated content. >> That's really puzzling. It seems that it gave you much more than you >> asked for. >> >> Try this in single user mode: modify the size of the swap partition to >> 30 GB. I haven't used MBR partitions for years now, but I believe >> that 'bsdlabel -e' will do the trick. Just shorten the length of the >> b partition. You may need to 'mount -u /'. If you do it right >> (check!), this won't harm any of the other partitions: it'll just >> leave 26 GB free between the swap partition and the next partition. >> > gpart(8) works just fine on MBR drives and partitions/slices and has a much > friendlier user interface. "gpart resize" is the command you want. Thanks. I try to offer suggestions that I've tried, and offer an example. I haven't tried 'gpart resize', but it looks much easier. Greg -- Sent from my desktop computer. Finger grog@FreeBSD.org for PGP public key. See complete headers for address and phone numbers. This message is digitally signed. If your Microsoft mail program reports problems, please read http://lemis.com/broken-MUA --hQiwHBbRI9kgIhsi Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iEYEARECAAYFAl71UbkACgkQIubykFB6QiMGLwCfQxvksUHA6dTtKmecMeS2Imor zeIAn3xegNrJzMo8WCcY3VFSXTNUF8Et =j2wM -----END PGP SIGNATURE----- --hQiwHBbRI9kgIhsi-- From owner-freebsd-stable@freebsd.org Fri Jun 26 02:31:38 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EE63834B8A6 for ; Fri, 26 Jun 2020 02:31:38 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: from mail-lj1-x231.google.com (mail-lj1-x231.google.com [IPv6:2a00:1450:4864:20::231]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49tLVf4g3Qz3fjB; Fri, 26 Jun 2020 02:31:38 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: by mail-lj1-x231.google.com with SMTP id h22so1549449lji.9; Thu, 25 Jun 2020 19:31:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to:cc; bh=sMUpofhvkCdTp669Zbk7XoYbcMj0oAzV0iUFz4OuYwU=; b=Bj7Q3sKnZU5G457K+YCKZTJakEFEznLOkF70GpSSU5VCG/SUwQf9nSMJtHDm4lceT/ tYLq+4/X1usLTN1a21p4d6Ui3dZ7D1/1tdTG36weuSvtGKBvKnR6HZw6ZJM2Y6oGbgEK aBE5UHJJLYhfVlNrvdDdu0A3RYxBFV3OgdrMsB5AxBfdOEwsvmozuClqPxv5gWuesajA hsmHvdNTrtZh7JbSc0zCH16GXzuKKsNjMOa/6KfECDSpFXLAczCMRuT85yfzCD3Qqj8a t1f05ZVV3EEA0J5GG9Nj0Xa4t2/+Jz5d2S+7eC6GB8HaUW+F9UOVT9lFHWOZchYPqDVc SHzA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc; bh=sMUpofhvkCdTp669Zbk7XoYbcMj0oAzV0iUFz4OuYwU=; b=qTOFn+McZiuoL/MN/4LQYxLQ8i2RBtzvEKrKnx1tskzH72V4jAJL1lvdgO7Z5EjD3a bB8zqp0t62xbGzVWd9VPPnJP4GbV70RdWPh+BsPzbQYLk1K1ejZFBDHwRWQjHF/WIq/7 azfc3g92rpp5lbz22YiUIySvqgw3bzonyN4Z45HFPY5aRCB/OTkFLPZQSYTz+CctTXXf iC3bUs5EMXPAGno2OYrHFeTrdigme06dS5h6x7+j4uSfuBpUduh4L1J+by5OVOrgHrWE TSDJF1EGVqoC0TRpZnU8Si45yA0Bo6/ubqRN+uPcvLIEalbo0yZxT+y2G9owdNVbQedk Xsyg== X-Gm-Message-State: AOAM531R/okAp+AfjmZfXGBncQtmOB9SUztLjqWnszsFrNEpZVWg9DUM SjEunw5T0H5mskxNZ0hRaHXGCT2r36I6xZUHzFjkVygK X-Google-Smtp-Source: ABdhPJzs676DjDVDu8s0gaXv4wMWG5cSgjmDYHdFzSa4E1XrEdlr6T1YLmb7lAiDGQWA1k5O0+hPD5BCXm8zEboBT0s= X-Received: by 2002:a2e:90c6:: with SMTP id o6mr290185ljg.330.1593138695184; Thu, 25 Jun 2020 19:31:35 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:4703:0:0:0:0:0 with HTTP; Thu, 25 Jun 2020 19:31:34 -0700 (PDT) Reply-To: dwilde1@gmail.com In-Reply-To: <20200626013905.GB79048@eureka.lemis.com> References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <20200625052949.GC10210@eureka.lemis.com> <20200626013905.GB79048@eureka.lemis.com> From: Donald Wilde Date: Thu, 25 Jun 2020 19:31:34 -0700 Message-ID: Subject: Re: swap space issues To: "Greg 'groggy' Lehey" Cc: Kevin Oberman , freebsd-stable Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 49tLVf4g3Qz3fjB X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; REPLY(-4.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Jun 2020 02:31:39 -0000 On 6/25/20, Greg 'groggy' Lehey wrote: > On Wednesday, 24 June 2020 at 23:27:27 -0700, Kevin Oberman wrote, > without trimming: > >> On Wed, Jun 24, 2020 at 10:30 PM Greg 'groggy' Lehey >> wrote: > >> gpart(8) works just fine on MBR drives and partitions/slices and has a >> much >> friendlier user interface. "gpart resize" is the command you want. > > Thanks. I try to offer suggestions that I've tried, and offer an > example. I haven't tried 'gpart resize', but it looks much easier. > 'gpart resize' did work well, although the man page for gpart assumes way too much. I was able to successfully work my way through and create ('gpart add') and mount not just one but two 32G swap partitions. -- Don Wilde **************************************************** * What is the Internet of Things but a system * * of systems including humans? * **************************************************** From owner-freebsd-stable@freebsd.org Fri Jun 26 04:48:13 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8389434E194 for ; Fri, 26 Jun 2020 04:48:13 +0000 (UTC) (envelope-from grog@lemis.com) Received: from lax.lemis.com (www.lemis.com [45.32.70.18]) by mx1.freebsd.org (Postfix) with ESMTP id 49tPXD1Zdnz43Lp for ; Fri, 26 Jun 2020 04:48:11 +0000 (UTC) (envelope-from grog@lemis.com) Received: from eureka.lemis.com (aussie-gw.lemis.com [167.179.139.35]) by lax.lemis.com (Postfix) with ESMTP id 07A5927FF6; Fri, 26 Jun 2020 04:48:11 +0000 (UTC) Received: by eureka.lemis.com (Postfix, from userid 1004) id 9DD94263599; Fri, 26 Jun 2020 14:48:07 +1000 (AEST) Date: Fri, 26 Jun 2020 14:48:04 +1000 From: Greg 'groggy' Lehey To: Donald Wilde Cc: freebsd-stable Subject: Re: swap space issues Message-ID: <20200626044804.GC79048@eureka.lemis.com> References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <20200625052949.GC10210@eureka.lemis.com> <20200626013905.GB79048@eureka.lemis.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="5QAgd0e35j3NYeGe" Content-Disposition: inline In-Reply-To: Organization: The FreeBSD Project Phone: +61-3-5309-0418 Mobile: +61-490-494-038. Use only as instructed. WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 9A1B 8202 BCCE B846 F92F 09AC 22E6 F290 507A 4223 User-Agent: Mutt/1.6.1 (2016-04-27) X-Rspamd-Queue-Id: 49tPXD1Zdnz43Lp X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of grog@lemis.com designates 45.32.70.18 as permitted sender) smtp.mailfrom=grog@lemis.com X-Spamd-Result: default: False [-4.14 / 15.00]; ARC_NA(0.00)[]; FORGED_SENDER(0.30)[grog@FreeBSD.org,grog@lemis.com]; NEURAL_HAM_MEDIUM(-1.03)[-1.029]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a:www.lemis.com]; NEURAL_HAM_LONG(-1.02)[-1.023]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; DMARC_NA(0.00)[FreeBSD.org]; HAS_ORG_HEADER(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.09)[-0.086]; RCPT_COUNT_TWO(0.00)[2]; SIGNED_PGP(-2.00)[]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:20473, ipnet:45.32.64.0/19, country:US]; FROM_NEQ_ENVFROM(0.00)[grog@FreeBSD.org,grog@lemis.com]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Jun 2020 04:48:13 -0000 --5QAgd0e35j3NYeGe Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Thursday, 25 June 2020 at 19:31:34 -0700, Donald Wilde wrote: > On 6/25/20, Greg 'groggy' Lehey wrote: >> On Wednesday, 24 June 2020 at 23:27:27 -0700, Kevin Oberman wrote, >> without trimming: >> >>> On Wed, Jun 24, 2020 at 10:30 PM Greg 'groggy' Lehey >>> wrote: >> >>> gpart(8) works just fine on MBR drives and partitions/slices and >>> has a much friendlier user interface. "gpart resize" is the >>> command you want. >> >> Thanks. I try to offer suggestions that I've tried, and offer an >> example. I haven't tried 'gpart resize', but it looks much easier. > > 'gpart resize' did work well, Yes, I saw that from the gpart output you posted. > although the man page for gpart assumes way too much. I was able to > successfully work my way through and create ('gpart add') and mount > not just one but two 32G swap partitions. Yes, I saw that too. Not quite what I was suggesting: I suspected some overflow issue, so the partitions should really have been a little shy of 32 GB. And at least for the start you should only mount one of them. In the unlikely event that it should threaten to fill up, you can still mount the other one without rebooting (swapon(1)). How are things looking now? Greg -- Sent from my desktop computer. Finger grog@FreeBSD.org for PGP public key. See complete headers for address and phone numbers. This message is digitally signed. If your Microsoft mail program reports problems, please read http://lemis.com/broken-MUA --5QAgd0e35j3NYeGe Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iEYEARECAAYFAl71fgMACgkQIubykFB6QiOY3wCffxHMaIlWdcbfA0T8H9TkL/eX wFEAoKazB77kxjusRHUepN+5owViEHCY =CKhs -----END PGP SIGNATURE----- --5QAgd0e35j3NYeGe-- From owner-freebsd-stable@freebsd.org Fri Jun 26 10:23:49 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 57342354067 for ; Fri, 26 Jun 2020 10:23:49 +0000 (UTC) (envelope-from peter@rulingia.com) Received: from vtr.rulingia.com (vtr.rulingia.com [IPv6:2001:19f0:5801:ebe:5400:1ff:fe53:30fd]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "vtr.rulingia.com", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49tXzS1qG4z4QR7 for ; Fri, 26 Jun 2020 10:23:47 +0000 (UTC) (envelope-from peter@rulingia.com) Received: from server.rulingia.com (ppp239-208.static.internode.on.net [59.167.239.208]) by vtr.rulingia.com (8.15.2/8.15.2) with ESMTPS id 05QANbYE034263 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Fri, 26 Jun 2020 20:23:43 +1000 (AEST) (envelope-from peter@rulingia.com) X-Bogosity: Ham, spamicity=0.000000 Received: from server.rulingia.com (localhost.rulingia.com [127.0.0.1]) by server.rulingia.com (8.15.2/8.15.2) with ESMTPS id 05QANVG6009034 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Fri, 26 Jun 2020 20:23:32 +1000 (AEST) (envelope-from peter@server.rulingia.com) Received: (from peter@localhost) by server.rulingia.com (8.15.2/8.15.2/Submit) id 05QANVOi009033; Fri, 26 Jun 2020 20:23:31 +1000 (AEST) (envelope-from peter) Date: Fri, 26 Jun 2020 20:23:31 +1000 From: Peter Jeremy To: Donald Wilde Cc: Paul Mather , freebsd-stable Subject: Re: swap space issues Message-ID: <20200626102331.GA6406@server.rulingia.com> References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="Qxx1br4bt0+wmkIi" Content-Disposition: inline In-Reply-To: X-PGP-Key: http://www.rulingia.com/keys/peter.pgp X-Rspamd-Queue-Id: 49tXzS1qG4z4QR7 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of peter@rulingia.com designates 2001:19f0:5801:ebe:5400:1ff:fe53:30fd as permitted sender) smtp.mailfrom=peter@rulingia.com X-Spamd-Result: default: False [-4.91 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.02)[-1.020]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.03)[-1.032]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; DMARC_NA(0.00)[rulingia.com]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.46)[-0.461]; SIGNED_PGP(-2.00)[]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:20473, ipnet:2001:19f0:5800::/38, country:US]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Jun 2020 10:23:49 -0000 --Qxx1br4bt0+wmkIi Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2020-Jun-25 11:30:31 -0700, Donald Wilde wrote: >Here's 'pstat -s' on the i3 (which registers as cpu HAMMER): > >Device 1K-blocks Used Avail Capacity >/dev/ada0s1b 33554432 0 33554432 0% >/dev/ada0s1d 33554432 0 33554432 0% >Total 67108864 0 67108864 0% I strongly suggest you don't have more than one swap device on spinning rust - the VM system will stripe I/O across the available devices and that will give particularly poor results when it has to seek between the partitions. Also, you can't actually use 64GB swap with 4GB RAM. If you look back through your boot messages, I expect you'll find messages like: warning: total configured swap (524288 pages) exceeds maximum recommended a= mount (498848 pages). warning: increase kern.maxswzone or reduce amount of swap. or maybe: WARNING: reducing swap size to maximum of xxxxMB per unit The absolute limit on swap space is vm.swap_maxpages pages but the realistic limit is about half that. By default the realistic limit is about 4=D7RAM = (on 64-bit architectures), but this can be adjusted via kern.maxswzone (which defines the #bytes of RAM to allocate to swzone structures - the actual space allocated is vm.swzone). As a further piece of arcana, vm.pageout_oom_seq is a count that controls the number of passes before the pageout daemon gives up and starts killing processes when it can't free up enough RAM. "out of swap space" messages generally mean that this number is too low, rather than there being a shortage of swap - particularly if your swap device is rather slow. --=20 Peter Jeremy --Qxx1br4bt0+wmkIi Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE2M6l8vfIeOACl4uUHZIUommfjLIFAl71zJVfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEQ4 Q0VBNUYyRjdDODc4RTAwMjk3OEI5NDFEOTIxNEEyNjk5RjhDQjIACgkQHZIUommf jLIBGg/+M/QMpqdHrXkKWEseuc4T8URFNbrJJc/gIJGvUZ7d7yKawYRnZvdy3LcS AkCKFougUF5NEPa4XcDs/Mz1PRX0shaK3XWrXtaBLq4T+EwPNhNTrhzfTbzLjqEq O5sFxyutT4UenGUHUZafi6M/1M1OCFrmnwPFrorftC0uLgb04yhjCywzNNgmAeqv XtTdF7QguHDsD9Z5zIgqLqmaUl+pybiB2AOmUA9vnZM+XYJXxy5kXAH4fSaFof3Y UO32wTWEWvpNy6vIaQ6HsXYeLP6pzRQ8Lj05MchkCB/1ahhT2i8eEzSU3QiZcbJE 8kNzaQk0PzGLNmkHWRI4Sr/6mJiIWTmTco5v7ao7W/pwoYE4ILdrMzwDLZiZpx7G 9IAm0JKhufbxxiPLHNJWb0kNlWcHY6E7eltDneGPGM8h8yxyoHRkuTd35O0RCWBN Qgu+Rh1r4GJH1QoMJFFXkpr0uTnytT8h7oHF8b20evMD/8rn9VQL0oaQkN+G8t1+ S8PqskbWdH7capbdVzRALTuzA7LBcTyMx4jk/btdv8uCZFPFoD/apsmulgLlBSDL OdOkFkPTS8ahTVS3zggyrVKmFmBG2dR8e3cwF9vrJ+oE95x6mBCq5tEHkQSSsZqS nmtQX41S+Wk++ueJQavaglBPi4h2ubTOdkhSw4+a3nkvsuwp/tE= =esio -----END PGP SIGNATURE----- --Qxx1br4bt0+wmkIi-- From owner-freebsd-stable@freebsd.org Fri Jun 26 10:55:07 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 85F123546E0 for ; Fri, 26 Jun 2020 10:55:07 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: from mail-lj1-x22f.google.com (mail-lj1-x22f.google.com [IPv6:2a00:1450:4864:20::22f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49tYgZ3TZxz4S0b for ; Fri, 26 Jun 2020 10:55:06 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: by mail-lj1-x22f.google.com with SMTP id h22so2691427lji.9 for ; Fri, 26 Jun 2020 03:55:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to:cc:content-transfer-encoding; bh=8mZ8HI2blpR4gQDNjD9Q8Cr4BcL6/WwSYs6pb6i+7iQ=; b=nO4JiLNA1V+YE80zymzP4zDnYBdMebndLi/JVJyRM/pgPVxK2Q0iZrQEsmQQXL5WsR eVXN7sBRF/DK/x97u1rNlkMacWzB7oEzBkBWtuz35zUnPIInKQIpRLarByoRhTcKJ0aE n69zLQMmUvSSg1L4tol7aFsV56ILYwI7ayipLFEie2iPAw0lH1VYC4QtmsXnU8tkC4xz pvgdYCaMqcM1QLburIN8rvDneysZ5eH2X7jRvx9pWYL01lIY/fS7V2MFefwS9zdWfVaj QglbQhPKC+/63kATmLKpYbj6FtiKOUJd/Do5k0RBhWcRrU53gNUylzrPwjVAkyIOeWj3 j2xQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc:content-transfer-encoding; bh=8mZ8HI2blpR4gQDNjD9Q8Cr4BcL6/WwSYs6pb6i+7iQ=; b=QXDgQ4FNcOcPkcNtY/DKTqtGcJA1VMoH14Z69y/cXc0/WsO2EB56sGAImIZMtn3AUZ k1MAyvh/AxCE+8jGT+j05aMRrK+O/cyAmsIr7VAAE3evSH8QoaVvXuJZ3gJJIHF+6mhi 0Nd0/kcl0V5onxCxuo8TEWiUGxALSOdeI0+ZdklSxaHSgZMDhFCkIBxRhG7cnQiDEECk H7kCZteDdKe50N4E8MqsBKQRLB6wHzsf0lPP0zs9gNAMI3cJ8N9yWZpYmJjscdSO7/l7 lI8Hh7RHjYc7xC7rOgGOKXr7Fq6o8A1htGBty25NruQOT7EkwIMJJDmmJWRA+Ox5DPJ8 K1hA== X-Gm-Message-State: AOAM533k4N0wGzPgjBocgXEICmF0D0gbYk+h0+YZUVqLcks6pjoLNHBy N2zX3OIHHUR+YrZ/NA6Gen7EEuxgCk1cR6ReN0osA+gB X-Google-Smtp-Source: ABdhPJxXZrJNn8bnPvHBV+cXuXcQjS55XjKHul+DOvNo2ksPNZHqqpKZS4h0WxzXxSKSbKmxZi2JeMZ/KwlE395K+Xs= X-Received: by 2002:a2e:959a:: with SMTP id w26mr1091677ljh.74.1593168904588; Fri, 26 Jun 2020 03:55:04 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:4703:0:0:0:0:0 with HTTP; Fri, 26 Jun 2020 03:55:04 -0700 (PDT) Reply-To: dwilde1@gmail.com In-Reply-To: <20200626102331.GA6406@server.rulingia.com> References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <20200626102331.GA6406@server.rulingia.com> From: Donald Wilde Date: Fri, 26 Jun 2020 03:55:04 -0700 Message-ID: Subject: Re: swap space issues To: Peter Jeremy Cc: freebsd-stable Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 49tYgZ3TZxz4S0b X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=nO4JiLNA; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of dwilde1@gmail.com designates 2a00:1450:4864:20::22f as permitted sender) smtp.mailfrom=dwilde1@gmail.com X-Spamd-Result: default: False [-3.47 / 15.00]; HAS_REPLYTO(0.00)[dwilde1@gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; REPLYTO_ADDR_EQ_FROM(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.38)[-0.377]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.04)[-1.043]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.05)[-1.045]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_REPLYTO(0.00)[gmail.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::22f:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Jun 2020 10:55:07 -0000 On 6/26/20, Peter Jeremy wrote: > On 2020-Jun-25 11:30:31 -0700, Donald Wilde wrote: >>Here's 'pstat -s' on the i3 (which registers as cpu HAMMER): >> >>Device 1K-blocks Used Avail Capacity >>/dev/ada0s1b 33554432 0 33554432 0% >>/dev/ada0s1d 33554432 0 33554432 0% >>Total 67108864 0 67108864 0% > > I strongly suggest you don't have more than one swap device on spinning > rust - the VM system will stripe I/O across the available devices and > that will give particularly poor results when it has to seek between the > partitions. My intent is to make this machine function -- getting the bear dancing. How deftly she dances is less important than that she dances at all. My for-real boxen will have real HP and real cores and RAM. > > Also, you can't actually use 64GB swap with 4GB RAM. If you look back > through your boot messages, I expect you'll find messages like: > warning: total configured swap (524288 pages) exceeds maximum recommended > amount (498848 pages). > warning: increase kern.maxswzone or reduce amount of swap. Yes, as I posted, those were part of the failure stream from the synth program. When I had kern.maxswzone increased, it got through boot without complaining. > or maybe: > WARNING: reducing swap size to maximum of xxxxMB per unit The warnings were there, in the as-it-failed complaints. > The absolute limit on swap space is vm.swap_maxpages pages but the > realistic > limit is about half that. By default the realistic limit is about 4=C3= =97RAM > (on > 64-bit architectures), but this can be adjusted via kern.maxswzone (which > defines the #bytes of RAM to allocate to swzone structures - the actual > space allocated is vm.swzone). > > As a further piece of arcana, vm.pageout_oom_seq is a count that controls > the number of passes before the pageout daemon gives up and starts killin= g > processes when it can't free up enough RAM. "out of swap space" messages > generally mean that this number is too low, rather than there being a > shortage of swap - particularly if your swap device is rather slow. > Thanks, Peter! --=20 Don Wilde **************************************************** * What is the Internet of Things but a system * * of systems including humans? * **************************************************** From owner-freebsd-stable@freebsd.org Fri Jun 26 10:58:03 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CD12C354C88 for ; Fri, 26 Jun 2020 10:58:03 +0000 (UTC) (envelope-from se@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49tYkz523Tz4Ryh; Fri, 26 Jun 2020 10:58:03 +0000 (UTC) (envelope-from se@freebsd.org) Received: from Stefans-MacBook-Pro-449.fritz.box (p200300cd5f203300bcc962682cf2cf29.dip0.t-ipconnect.de [IPv6:2003:cd:5f20:3300:bcc9:6268:2cf2:cf29]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: se/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 212F415292; Fri, 26 Jun 2020 10:58:03 +0000 (UTC) (envelope-from se@freebsd.org) Subject: Re: swap space issues To: freebsd-stable@freebsd.org References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <20200626102331.GA6406@server.rulingia.com> From: =?UTF-8?Q?Stefan_E=c3=9fer?= Autocrypt: addr=se@freebsd.org; keydata= mQENBFVxiRIBCADOLNOZBsqlplHUQ3tG782FNtVT33rQli9EjNt2fhFERHIo4NxHlWBpHLnU b0s4L/eItx7au0i7Gegv01A9LUMwOnAc9EFAm4EW3Wmoa6MYrcP7xDClohg/Y69f7SNpEs3x YATBy+L6NzWZbJjZXD4vqPgZSDuMcLU7BEdJf0f+6h1BJPnGuwHpsSdnnMrZeIM8xQ8PPUVQ L0GZkVojHgNUngJH6e21qDrud0BkdiBcij0M3TCP4GQrJ/YMdurfc8mhueLpwGR2U1W8TYB7 4UY+NLw0McThOCLCxXflIeF/Y7jSB0zxzvb/H3LWkodUTkV57yX9IbUAGA5RKRg9zsUtABEB AAG0J1N0ZWZhbiBFw59lciAoRnJlZUJTRCkgPHNlQGZyZWVic2Qub3JnPokBVAQTAQoAPgIb AwULCQgHAwUVCgkICwUWAwIBAAIeAQIXgBYhBKNx6mWcC+zIK3FTE0frte9a/fVEBQJa8u+q BQkLJQETAAoJEEfrte9a/fVEOeMH/icmdK1eZQvB3U8quJo9VMaZsaTuCMbUE4NThyfsIvIm MCd+rb/yULmMYwqNfjyKB1x4ikR4x+94l+yJoz7K0Usks+eNKDmMGJM6pWWssTigaJubFdVd hVVC+C1QJi7JshYSib08uONoPmO4lv5Az0TDYGtsMzsES2sIlc62c9go5WPGYhQFRbX3Lk6y V6m8OHh+G9XGSj3oPO4UteRwu+SzTdOLunZBWG1wu34+IeZm663D+2gOppQLWpLa2qaTerqw THu377ayZ2B2LPJ5JkvkZeHYPkwDQ+b5PGn0UhfkxPnDVYki5F7qKxvQ5uq1/q9YaCX7mmOl H2yO7tgVsrW5AQ0EVXGJEgEIALEj9qCXMZVucjpcd3QxM/TlUr98m5viEd1z4tCnPUyRWcIC EVtj2h5xMH+2iB0q1+KWhq+NsWtvScmEmfHnsr7dJ1K677OdpDhKVaJk61eeRulFY1R4yb6C 1MMxK+WgYB+vvpG0UeyR0M4uBewcPvRsq4yGUHFQKtLAbMdoPTSryJA+ElnmK1vdY+rPcHgi OIMBZM7ahsPXC0C9K4e5SP9clGyIoMpbfHXdx9q+Rp3zVtlbhyk3BS/xccu/+9pk9ICXL6GR js2sNnJ0wxdU1DsAlC59a5MnSruwiZFwRnkQhr3x6wk97Lg7sLS9jjTnCN7LGlVmSmpOEMy6 uq1AWfUAEQEAAYkBPAQYAQoAJgIbDBYhBKNx6mWcC+zIK3FTE0frte9a/fVEBQJa8u+rBQkL JQEZAAoJEEfrte9a/fVEuesH/2DNxGWnHvWwMyiyhlQtafvDKwEn/wAgR8gHJFodB7emf8rA TnukH7MVttCoHtjN5lvv9RSBHjNTZls5wR/ANlwdRuPQHd8ZGxLe3S6IuUB3zDSwFltLGurO N2kOMhs5mTGyypSa+uw3rtQbUAVYf1oPbiR4FLtiM8FLyEvE95hX5fPq9Qvx9FmN79kmCIEw jDKPqDaUf/OR2fEF0LSIbXHEk4tNqCEwx5DIJ0fp5/z5UzICUAmwxyRs5O/Hre1jzPsMVyud Ml9t7UTOJGKVWwRory1PMnOFxN+iz5/d4FhYSKXF7kfMiFgol4LuWaxJRwbBrr71VGBrRy2a L1nw6Bc= Cc: Peter Jeremy Message-ID: <52753cf4-57db-93d9-d217-c8f812d6bc7c@freebsd.org> Date: Fri, 26 Jun 2020 12:58:02 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 In-Reply-To: <20200626102331.GA6406@server.rulingia.com> Content-Type: text/plain; charset=windows-1252 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Jun 2020 10:58:03 -0000 Am 26.06.20 um 12:23 schrieb Peter Jeremy: > On 2020-Jun-25 11:30:31 -0700, Donald Wilde wrote: >> Here's 'pstat -s' on the i3 (which registers as cpu HAMMER): >> >> Device 1K-blocks Used Avail Capacity >> /dev/ada0s1b 33554432 0 33554432 0% >> /dev/ada0s1d 33554432 0 33554432 0% >> Total 67108864 0 67108864 0% > > I strongly suggest you don't have more than one swap device on spinning > rust - the VM system will stripe I/O across the available devices and > that will give particularly poor results when it has to seek between the > partitions. This used to be beneficial, when disk read and write bandwidth was limited and whole processes had to be swapped in or out due to RAM pressure. (This changed due to more RAM and a different ratio of seek to transfer times for a given amount of data.) An idea for a better strategy: It might be better to use an allocation algorithm that assigns a swap device to each running process that needs pages written to the swap device and only assign another swap device (and use if from then on for that process) if there is no free space left on the one used until then. Such a strategy would at least reduce the number of processes that need all configured swap devices at the same time in a striped configuration. If all processes start with the first configured swap device assigned to them, this will lead to only one of them being used until it fills up, then progressing to the next one. The strategy of whether the initial swap device assigned to a process is always the first one configured in the system, or whether after that could not be used by some process is moved on to the next one (typically the one assigned to that process for further page-outs) is not obvious to me. The behavior could be controlled by a sysctl to allow to adapt the strategy to the hardware (e.g. rotating vs. flash disks for swap). > As a further piece of arcana, vm.pageout_oom_seq is a count that controls > the number of passes before the pageout daemon gives up and starts killing > processes when it can't free up enough RAM. "out of swap space" messages > generally mean that this number is too low, rather than there being a > shortage of swap - particularly if your swap device is rather slow. I'm not sure that this specific sysctl is documented in such a way that it is easy to find by people suffering from out-of-memory kills. Perhaps it could be mentioned as a parameter that may need tuning in the OOM message? And while it does not come up that often in the mail list, it might be better for many kinds of application if the default was increased (a longer wait for resources might be more acceptable than the loss of all results of a long running computation). Regards, STefan From owner-freebsd-stable@freebsd.org Fri Jun 26 11:15:56 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4F778354ECF for ; Fri, 26 Jun 2020 11:15:56 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: from mail-lf1-x12a.google.com (mail-lf1-x12a.google.com [IPv6:2a00:1450:4864:20::12a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49tZ7c02Rpz4TC8; Fri, 26 Jun 2020 11:15:55 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: by mail-lf1-x12a.google.com with SMTP id m26so4926032lfo.13; Fri, 26 Jun 2020 04:15:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to:cc; bh=BO7+Zx4VBEafkCbELUkiIQJZWPv6Ry11NHYHl2HXMkM=; b=VdidUoNksxPHZwQBfMqRKTZTX+793ptiu4+gcFGkhbcDOw0xerWCkJ0TXlnhWutHT4 0bVfIcBYcuExz0Qy81Gfy3xVUJKVJaciSr2lKyOaChpGRGKZyTmUKnjrO25L3j6V94FU 5R/8hSJw6FYmM6zDF5HGoQflnERyP9HlBVwUMTpxgsitFQtVe/mO6hksq/SS+WDJNfTB ek5CMuxczfk+Ch4vQMwttzSbBcCss4KjO5v85nc8yN+1eEvnpynEZNBicM6PG231OPks by5oSSnfYwkNQWvKhf0oca76pYxQ50wm9nBEhJvjZpuBgA1wYLWwpbgY0wAiifNbGnRs 4gNw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc; bh=BO7+Zx4VBEafkCbELUkiIQJZWPv6Ry11NHYHl2HXMkM=; b=Tz4tEAn973HUITJ7WAWMZ1dYavJKPUSLR3mX9KkmAGVXfGZ8vK/U4t8lPijrVbbnWV lSWtnbrRZ8zaortWFYg4XcnIrlr6v4Y2j5XsxbdKIcAzWIB/oS/9dmiahtaN+XkB+I7k hnJ0f6g7R1tK+4LkO6fqbWaVVQyoBAoeCqJyAyUBgzVktA1acIF3ZtscFqm1seHlptHr adxN4++rQMRihUmNnjzLZ4jiRVX5jJUN0k1yYyxDI+kAfjCOBp7vnQa3Z1st4DNIPfx9 BAGCWuvjEmVNKZQEF7/TyXd814CaVZam4rPLXRxbMArHsYrwS2Er2EkAGlsIEcJATgY0 457w== X-Gm-Message-State: AOAM530BzVHuiTaBKCq6Bo+ioieUO8mSMbZIeJUTS3Ny/1Lm64TzMLiN u2E0ZaU7ge8sybGLn5eVdhBYaBthGJncH1rpyGz/q0b7 X-Google-Smtp-Source: ABdhPJwMvQ6sEfAON+LWCp9vrxV6zVS3JyJk6HEqnWsaIGO6TCvELGl7yHVkPfkrW76USS7HZO5/s9R3DhAa27WQb2g= X-Received: by 2002:a19:6b15:: with SMTP id d21mr1590938lfa.42.1593170153778; Fri, 26 Jun 2020 04:15:53 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:4703:0:0:0:0:0 with HTTP; Fri, 26 Jun 2020 04:15:53 -0700 (PDT) Reply-To: dwilde1@gmail.com In-Reply-To: <20200626044804.GC79048@eureka.lemis.com> References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <20200625052949.GC10210@eureka.lemis.com> <20200626013905.GB79048@eureka.lemis.com> <20200626044804.GC79048@eureka.lemis.com> From: Donald Wilde Date: Fri, 26 Jun 2020 04:15:53 -0700 Message-ID: Subject: Re: swap space issues To: "Greg 'groggy' Lehey" Cc: freebsd-stable Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 49tZ7c02Rpz4TC8 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Jun 2020 11:15:56 -0000 On 6/25/20, Greg 'groggy' Lehey wrote: > On Thursday, 25 June 2020 at 19:31:34 -0700, Donald Wilde wrote: >> On 6/25/20, Greg 'groggy' Lehey wrote: >>> On Wednesday, 24 June 2020 at 23:27:27 -0700, Kevin Oberman wrote, >>> without trimming: >>> >>>> On Wed, Jun 24, 2020 at 10:30 PM Greg 'groggy' Lehey >>>> wrote: >>> >>>> gpart(8) works just fine on MBR drives and partitions/slices and >>>> has a much friendlier user interface. "gpart resize" is the >>>> command you want. >>> >>> Thanks. I try to offer suggestions that I've tried, and offer an >>> example. I haven't tried 'gpart resize', but it looks much easier. >> >> 'gpart resize' did work well, > > Yes, I saw that from the gpart output you posted. > >> although the man page for gpart assumes way too much. I was able to >> successfully work my way through and create ('gpart add') and mount >> not just one but two 32G swap partitions. > > Yes, I saw that too. Not quite what I was suggesting: I suspected > some overflow issue, so the partitions should really have been a > little shy of 32 GB. And at least for the start you should only mount > one of them. In the unlikely event that it should threaten to fill > up, you can still mount the other one without rebooting (swapon(1)). I got greedy! :) i also wanted to embed my newfound understanding of gpart, geom, and swapping into the noggin so I could move on. > > How are things looking now? So far, it works, but there haven't been enough changes in the ports tree that synth even needs a cuppa. I think what I am going to do is to wipe the machine one more time from 12.1R (with 16G swap, as both you and Peter suggest), STABLE-ize it, and see if synth can handle the entire installed ports tree (around 300 primary+dependency ports) without crashing and with conservative builder-subtask limits. It will take it three days to do that, but I think I know enough of the gotchas to get it to succeed. It's a good idea to have a second one in reserve, but when it broke through the roof it happened way too fast for me to actually enable anything. I'll see if I can make a one-character script invocation and try it, though! > > Greg Again, my thanks. You guys are the best! :D -- Don Wilde **************************************************** * What is the Internet of Things but a system * * of systems including humans? * **************************************************** From owner-freebsd-stable@freebsd.org Fri Jun 26 11:57:12 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3A1DB356086 for ; Fri, 26 Jun 2020 11:57:12 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: from mail-lj1-x22e.google.com (mail-lj1-x22e.google.com [IPv6:2a00:1450:4864:20::22e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49tb3C2Tydz4X2Z; Fri, 26 Jun 2020 11:57:09 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: by mail-lj1-x22e.google.com with SMTP id s9so9992544ljm.11; Fri, 26 Jun 2020 04:57:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to:cc:content-transfer-encoding; bh=s8oHqTzXR6Rr/FQ6aR0oUrIYTFxBV9bdkA2JB/HnkIg=; b=JbhOJOIowP6+HToyv//RZ1fgO0RstDdXXXt6XcaQoRoo0fKXk04Rb77LUS0CsweE30 cJaVjFCeRJQ4njCWN/HPPxeEiDcnEECncDETlVTKzNlMr5OFAvkJyrgy4I4WAoT90iW9 cgKhlLLVOWSy4ox1yYjZDco4+BgycCpuYxIDKgOwCsrb4E5DZSnvDYcTgld7/oHSgK8l OA6bJdxVaoDigCvk0ulTssS0wiW1MVNEkIoacPXBmK7J+3cVzucl8Inwh7Lzuyloi3E4 8+io67Lj2dcXpFEB3Ug8CyArT8zXon0dmcSgt0MkB53FVsBeaYjvfbGQR6boEveBMLf9 6I+Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc:content-transfer-encoding; bh=s8oHqTzXR6Rr/FQ6aR0oUrIYTFxBV9bdkA2JB/HnkIg=; b=ThPjt1Vulh1B++WB0/FJHQTGxM3n66Km19V5XVSKPjHsdhuRtPGYj1oFIdyvP2Taex yLIxP3t4vKmfmx8fgEPKCpIQCoqr8sGJZ5VLFe3VQ1Qt0FCiHXCpQ/rtRG1Yjqx4NjwD nicSTH+jBqBydKL7snR4FfEM7zdRFyG+VsNwTz3DHhhjITJ4fSWo//Nt32CVY1cCmaKE nr4adzR80L0I+NAzeZWMUhz9F6dFRw2XBQoWPbYA+qFQhE8dtTD60FEVtoYyfEY+2zYK cVHxBnBDHSoo9fkWxn52WgmD5AETe1ZldnlW3PXcRZN4JZa5ug+Cz+7qfncVhL4qfx7c g9+Q== X-Gm-Message-State: AOAM533WCvFphFJzbLE8Qw+bMm5eSSKC3quBORWdDQoBthy/wBgObBH7 ZinFpCCkARE+JbNSZadwRAiwJPlytEaYGHmoDxo0FUZA X-Google-Smtp-Source: ABdhPJwB88QhfIHw+MZWvJmv8of83YTvwdFBNPYa0q0hhwHzfQ8fQSwemzRFOSbhFekOpUKpBZioSOGIpmkmyAp0xZI= X-Received: by 2002:a2e:580f:: with SMTP id m15mr546638ljb.357.1593172626640; Fri, 26 Jun 2020 04:57:06 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:4703:0:0:0:0:0 with HTTP; Fri, 26 Jun 2020 04:57:05 -0700 (PDT) Reply-To: dwilde1@gmail.com In-Reply-To: <52753cf4-57db-93d9-d217-c8f812d6bc7c@freebsd.org> References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <20200626102331.GA6406@server.rulingia.com> <52753cf4-57db-93d9-d217-c8f812d6bc7c@freebsd.org> From: Donald Wilde Date: Fri, 26 Jun 2020 04:57:05 -0700 Message-ID: Subject: Re: swap space issues To: =?UTF-8?B?U3RlZmFuIEXDn2Vy?= Cc: freebsd-stable@freebsd.org, Peter Jeremy Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 49tb3C2Tydz4X2Z X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; REPLY(-4.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Jun 2020 11:57:12 -0000 On 6/26/20, Stefan E=C3=9Fer wrote: > Am 26.06.20 um 12:23 schrieb Peter Jeremy: >> On 2020-Jun-25 11:30:31 -0700, Donald Wilde wrote: >>> Here's 'pstat -s' on the i3 (which registers as cpu HAMMER): [snip] > An idea for a better strategy: > > It might be better to use an allocation algorithm that assigns a > swap device to each running process that needs pages written to the > swap device and only assign another swap device (and use if from > then on for that process) if there is no free space left on the one > used until then. > > Such a strategy would at least reduce the number of processes that > need all configured swap devices at the same time in a striped > configuration. > > If all processes start with the first configured swap device assigned > to them, this will lead to only one of them being used until it fills > up, then progressing to the next one. > > The strategy of whether the initial swap device assigned to a process > is always the first one configured in the system, or whether after > that could not be used by some process is moved on to the next one > (typically the one assigned to that process for further page-outs) is > not obvious to me. You're getting over my head, STefan, but that's okay. I suspect that having somebody be loony -- and desperate enough -- to configure two swap partitions is a rare occurance. > > The behavior could be controlled by a sysctl to allow to adapt the > strategy to the hardware (e.g. rotating vs. flash disks for swap). Not to mention Intel and Micron and their fancy fast non-volatile chips ('Optane'). I do agree that SOMEBODY is going to need this kind of sysctl guidance for the kernel. > [snip] > And while it does not come up that often in the mail list, it might > be better for many kinds of application if the default was increased > (a longer wait for resources might be more acceptable than the loss > of all results of a long running computation). Yes. Synth seems to be able to keep going / recover from last-known success points, but your point is very valid. As we go further into OOP, the _controllable_ use of heap space, stack space, and recursion is going to become more crucial. We humans are used to operating without a "full stack," (sleep DOES help :) ) but I think the whole point of modern AI is to create systems that actually can master the logical inference chains proposed by the early LISP guys at MIT, C-M, and Stanford. The gains from ML have been enough to keep 'the Street' happy for now but they'll want more soon enough. > Regards, STefan Thought-provoking indeed. :D --=20 Don Wilde **************************************************** * What is the Internet of Things but a system * * of systems including humans? * **************************************************** From owner-freebsd-stable@freebsd.org Fri Jun 26 15:13:47 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0E07F35A303 for ; Fri, 26 Jun 2020 15:13:47 +0000 (UTC) (envelope-from paul@gromit.dlib.vt.edu) Received: from gromit.dlib.vt.edu (gromit.dlib.vt.edu [128.173.49.70]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "gromit.dlib.vt.edu", Issuer "Chumby Certificate Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 49tgQ227y5z4kQv; Fri, 26 Jun 2020 15:13:46 +0000 (UTC) (envelope-from paul@gromit.dlib.vt.edu) Received: from mather.gromit23.net (c-98-244-101-97.hsd1.va.comcast.net [98.244.101.97]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by gromit.dlib.vt.edu (Postfix) with ESMTPSA id 3461B173; Fri, 26 Jun 2020 11:13:45 -0400 (EDT) From: Paul Mather Message-Id: Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.14\)) Subject: Re: swap space issues Date: Fri, 26 Jun 2020 11:13:44 -0400 In-Reply-To: <52753cf4-57db-93d9-d217-c8f812d6bc7c@freebsd.org> Cc: freebsd-stable , Peter Jeremy To: =?utf-8?Q?Stefan_E=C3=9Fer?= References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <20200626102331.GA6406@server.rulingia.com> <52753cf4-57db-93d9-d217-c8f812d6bc7c@freebsd.org> X-Mailer: Apple Mail (2.3445.104.14) X-Rspamd-Queue-Id: 49tgQ227y5z4kQv X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=vt.edu (policy=none); spf=none (mx1.freebsd.org: domain of paul@gromit.dlib.vt.edu has no SPF policy when checking 128.173.49.70) smtp.mailfrom=paul@gromit.dlib.vt.edu X-Spamd-Result: default: False [-0.09 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MV_CASE(0.50)[]; NEURAL_HAM_LONG(-0.78)[-0.783]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_SPAM_SHORT(0.40)[0.402]; NEURAL_HAM_MEDIUM(-0.21)[-0.206]; RECEIVED_SPAMHAUS_PBL(0.00)[98.244.101.97:received]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:1312, ipnet:128.173.0.0/16, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DMARC_POLICY_SOFTFAIL(0.10)[vt.edu : No valid SPF, No valid DKIM,none] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Jun 2020 15:13:47 -0000 On Jun 26, 2020, at 6:58 AM, Stefan E=C3=9Fer wrote: > Am 26.06.20 um 12:23 schrieb Peter Jeremy: >> On 2020-Jun-25 11:30:31 -0700, Donald Wilde = wrote: >>> Here's 'pstat -s' on the i3 (which registers as cpu HAMMER): >>>=20 >>> Device 1K-blocks Used Avail Capacity >>> /dev/ada0s1b 33554432 0 33554432 0% >>> /dev/ada0s1d 33554432 0 33554432 0% >>> Total 67108864 0 67108864 0% >>=20 >> I strongly suggest you don't have more than one swap device on = spinning >> rust - the VM system will stripe I/O across the available devices and >> that will give particularly poor results when it has to seek between = the >> partitions. >=20 [[...]] >> As a further piece of arcana, vm.pageout_oom_seq is a count that = controls >> the number of passes before the pageout daemon gives up and starts = killing >> processes when it can't free up enough RAM. "out of swap space" = messages >> generally mean that this number is too low, rather than there being a >> shortage of swap - particularly if your swap device is rather slow. >=20 > I'm not sure that this specific sysctl is documented in such a way > that it is easy to find by people suffering from out-of-memory kills. >=20 > Perhaps it could be mentioned as a parameter that may need tuning in > the OOM message? >=20 > And while it does not come up that often in the mail list, it might > be better for many kinds of application if the default was increased > (a longer wait for resources might be more acceptable than the loss > of all results of a long running computation). The OOM issue is more pressing on platforms like FreeBSD/arm that tend = to have low RAM and slow writable storage such as SD card. There have = been several threads on the issues this creates (e.g., = https://docs.freebsd.org/cgi/getmsg.cgi?fetch=3D228789+0+archive/2018/free= bsd-arm/20180819.freebsd-arm = ) that have led to some insight into how = to tune the OOM killer. One thing that becomes clear is that the "Out = of swap space" error message is misleading as often it really means = "Couldn't obtain RAM in a timely fashion." On hardware such as the = Raspberry Pi, it's often the case that the system has enough swap space: = it's just that it can't write to swap on SD card before the default = vm.pageout_oom_seq passes are exhausted and so the OOM killer starts = reaping active processes (like the clang trying to build clang:), and = all sorts of things start to break. :-) Cheers, Paul.= From owner-freebsd-stable@freebsd.org Fri Jun 26 15:18:14 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2228235A432 for ; Fri, 26 Jun 2020 15:18:14 +0000 (UTC) (envelope-from rb@gid.co.uk) Received: from mx0.gid.co.uk (mx0.gid.co.uk [194.32.164.250]) by mx1.freebsd.org (Postfix) with ESMTP id 49tgW909Jhz4l38 for ; Fri, 26 Jun 2020 15:18:12 +0000 (UTC) (envelope-from rb@gid.co.uk) Received: from [194.32.164.27] ([194.32.164.27]) by mx0.gid.co.uk (8.14.2/8.14.2) with ESMTP id 05QFI6RC052031; Fri, 26 Jun 2020 16:18:06 +0100 (BST) (envelope-from rb@gid.co.uk) From: Bob Bishop Message-Id: Content-Type: multipart/signed; boundary="Apple-Mail=_1C93BF86-06EA-4E13-A01C-45FF967818F4"; protocol="application/pgp-signature"; micalg=pgp-sha1 Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.14\)) Subject: Re: swap space issues Date: Fri, 26 Jun 2020 16:18:05 +0100 In-Reply-To: <20200626102331.GA6406@server.rulingia.com> Cc: Donald Wilde , freebsd-stable To: Peter Jeremy References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <20200626102331.GA6406@server.rulingia.com> X-Mailer: Apple Mail (2.3445.104.14) X-Rspamd-Queue-Id: 49tgW909Jhz4l38 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of rb@gid.co.uk designates 194.32.164.250 as permitted sender) smtp.mailfrom=rb@gid.co.uk X-Spamd-Result: default: False [-3.64 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.03)[-1.032]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; HAS_ATTACHMENT(0.00)[]; DMARC_NA(0.00)[gid.co.uk]; NEURAL_SPAM_SHORT(0.21)[0.211]; NEURAL_HAM_LONG(-1.02)[-1.021]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; SIGNED_PGP(-2.00)[]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:42831, ipnet:194.32.164.0/24, country:GB]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Jun 2020 15:18:14 -0000 --Apple-Mail=_1C93BF86-06EA-4E13-A01C-45FF967818F4 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On 26 Jun 2020, at 11:23, Peter Jeremy wrote: >=20 > On 2020-Jun-25 11:30:31 -0700, Donald Wilde wrote: >> Here's 'pstat -s' on the i3 (which registers as cpu HAMMER): >>=20 >> Device 1K-blocks Used Avail Capacity >> /dev/ada0s1b 33554432 0 33554432 0% >> /dev/ada0s1d 33554432 0 33554432 0% >> Total 67108864 0 67108864 0% >=20 > I strongly suggest you don't have more than one swap device on = spinning > rust - the VM system will stripe I/O across the available devices and > that will give particularly poor results when it has to seek between = the > partitions. If you configure a ZFS mirror in bsdinstall you get a swap partition per = drive by default. > Also, you can't actually use 64GB swap with 4GB RAM. If you look back > through your boot messages, I expect you'll find messages like: > warning: total configured swap (524288 pages) exceeds maximum = recommended amount (498848 pages). > warning: increase kern.maxswzone or reduce amount of swap. > or maybe: > WARNING: reducing swap size to maximum of xxxxMB per unit >=20 > The absolute limit on swap space is vm.swap_maxpages pages but the = realistic > limit is about half that. By default the realistic limit is about = 4=C3=97RAM (on > 64-bit architectures), but this can be adjusted via kern.maxswzone = (which > defines the #bytes of RAM to allocate to swzone structures - the = actual > space allocated is vm.swzone). >=20 > As a further piece of arcana, vm.pageout_oom_seq is a count that = controls > the number of passes before the pageout daemon gives up and starts = killing > processes when it can't free up enough RAM. "out of swap space" = messages > generally mean that this number is too low, rather than there being a > shortage of swap - particularly if your swap device is rather slow. >=20 > -- > Peter Jeremy -- Bob Bishop t: +44 (0)118 940 1243 rb@gid.co.uk m: +44 (0)783 626 4518 --Apple-Mail=_1C93BF86-06EA-4E13-A01C-45FF967818F4 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- iF0EARECAB0WIQR+a6Wh87I/iYwcbE+8xpPppLfFvwUCXvYRrQAKCRC8xpPppLfF v/+wAJ98LGxalqGfcgebkSivRY0gwlaSqQCg1NlPCKTAvIcxA93kEGCwOBOF0uI= =Htua -----END PGP SIGNATURE----- --Apple-Mail=_1C93BF86-06EA-4E13-A01C-45FF967818F4-- From owner-freebsd-stable@freebsd.org Fri Jun 26 16:11:42 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D584735B390 for ; Fri, 26 Jun 2020 16:11:42 +0000 (UTC) (envelope-from ronald-lists@klop.ws) Received: from smtp-relay-int.realworks.nl (smtp-relay-int.realworks.nl [194.109.157.24]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49thhs3zr7z4ncj for ; Fri, 26 Jun 2020 16:11:41 +0000 (UTC) (envelope-from ronald-lists@klop.ws) Date: Fri, 26 Jun 2020 18:11:36 +0200 (CEST) From: Ronald Klop To: Bob Bishop Cc: Donald Wilde , Peter Jeremy , freebsd-stable Message-ID: <1140215402.1.1593187896838@localhost> In-Reply-To: References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <20200626102331.GA6406@server.rulingia.com> Subject: Re: swap space issues MIME-Version: 1.0 X-Mailer: Realworks (514.203.b005ea048dd) Importance: Normal X-Priority: 3 (Normal) X-Rspamd-Queue-Id: 49thhs3zr7z4ncj X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of ronald-lists@klop.ws designates 194.109.157.24 as permitted sender) smtp.mailfrom=ronald-lists@klop.ws X-Spamd-Result: default: False [-1.69 / 15.00]; MID_RHS_NOT_FQDN(0.50)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.88)[-0.879]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:194.109.157.0/24]; NEURAL_HAM_LONG(-1.01)[-1.011]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[klop.ws]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.00)[-0.001]; HAS_X_PRIO_THREE(0.00)[3]; RCVD_IN_DNSWL_NONE(0.00)[194.109.157.24:from]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3265, ipnet:194.109.0.0/16, country:NL]; FREEMAIL_CC(0.00)[gmail.com,rulingia.com,freebsd.org]; RWL_MAILSPIKE_VERYGOOD(0.00)[194.109.157.24:from] Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Jun 2020 16:11:42 -0000 =20 Van: Bob Bishop Datum: vrijdag, 26 juni 2020 17:18 Aan: Peter Jeremy CC: Donald Wilde , freebsd-stable Onderwerp: Re: swap space issues >=20 >=20 >=20 > > On 26 Jun 2020, at 11:23, Peter Jeremy wrote: > > > > On 2020-Jun-25 11:30:31 -0700, Donald Wilde wrote: > >> Here's 'pstat -s' on the i3 (which registers as cpu HAMMER): > >> > >> Device 1K-blocks Used Avail Capacity > >> /dev/ada0s1b 33554432 0 33554432 0% > >> /dev/ada0s1d 33554432 0 33554432 0% > >> Total 67108864 0 67108864 0% > > > > I strongly suggest you don't have more than one swap device on spinning > > rust - the VM system will stripe I/O across the available devices and > > that will give particularly poor results when it has to seek between th= e > > partitions. > =20 > If you configure a ZFS mirror in bsdinstall you get a swap partition per = drive by default. If you are running on multiple disks (a mirror) it can provide extra speed.= The example above is on the same disk. On one disk multiple swap partition= s will only spread the data non-optimal for the heads of the disk. >=20 > > Also, you can't actually use 64GB swap with 4GB RAM. If you look back > > through your boot messages, I expect you'll find messages like: > > warning: total configured swap (524288 pages) exceeds maximum recommend= ed amount (498848 pages). > > warning: increase kern.maxswzone or reduce amount of swap. > > or maybe: > > WARNING: reducing swap size to maximum of xxxxMB per unit > > > > The absolute limit on swap space is vm.swap_maxpages pages but the real= istic > > limit is about half that. By default the realistic limit is about 4=C3= =97RAM (on > > 64-bit architectures), but this can be adjusted via kern.maxswzone (whi= ch > > defines the #bytes of RAM to allocate to swzone structures - the actual > > space allocated is vm.swzone). > > > > As a further piece of arcana, vm.pageout_oom_seq is a count that contro= ls > > the number of passes before the pageout daemon gives up and starts kill= ing > > processes when it can't free up enough RAM. "out of swap space" messag= es > > generally mean that this number is too low, rather than there being a > > shortage of swap - particularly if your swap device is rather slow. > > > > -- > > Peter Jeremy >=20 >=20 > -- > Bob Bishop t: +44 (0)118 940 1243 > rb@gid.co.uk m: +44 (0)783 626 4518 >=20 >=20 >=20 >=20 > =20 >=20 >=20 > =20 From owner-freebsd-stable@freebsd.org Sat Jun 27 01:55:44 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5C6A9365CBC for ; Sat, 27 Jun 2020 01:55:44 +0000 (UTC) (envelope-from greg.bal4@gmail.com) Received: from mail-io1-xd36.google.com (mail-io1-xd36.google.com [IPv6:2607:f8b0:4864:20::d36]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49txfl3g4vz486R for ; Sat, 27 Jun 2020 01:55:43 +0000 (UTC) (envelope-from greg.bal4@gmail.com) Received: by mail-io1-xd36.google.com with SMTP id f23so11795495iof.6 for ; Fri, 26 Jun 2020 18:55:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=+LAenplLb+2zrulj31X2SELGHjqes9lxHKkyIiP3puM=; b=PGq7qnhKlnvcyUrNUx24XCnqStQ8LBhzAdHJREkQrwzsT1SpnGdzkEPCM4WM0tECKb 363ME0rnmgK71+nsTc3vSYgFO7Iv332aUuYSRlFA9JOmir9sgqw7ddlUxbriu4bwTKcF XQFekAUVB6hrEnkZ65zfZVbd/BjYtb0ohnM1Tz0off9pLxqcTzfgmxn1nx9z6gkBgIrP CWYZqKKza2EvPs4uwRDKmQPyhjErPsUVSr4hgvTUs/Oz/trhEbSrrnrY0cgHt390ONzV bmTq+LZjjquB7XT6nZCfMioXekaz4D44Qot8aaQ8busVcwk610J4AlCAIVK1w6fySauK LAsg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=+LAenplLb+2zrulj31X2SELGHjqes9lxHKkyIiP3puM=; b=RY4AiVFbb3YAzfYZ5+B36WftUbk6PfyJgME+/9qmR48jF8CWbqpcw3gHAtmUSHAfN/ HimgUW155AChs16ln0w/U5ncf0mpEnIech/u9gPcSOGe6hftiIytzteei7X+UYD6QSZs GywMSUiwOOxaxPJ/dNI1tbl7LXtG890Ija8/XeSwTYHFlxqAllznTcfAUvAbjsgVZK8+ MexzcmXA0qRWUctjJGXD0jBS+c3KwfLisuOzfJ0znf+pZ9xnOLZouT3QCsfS1/DkK94j 22Q3pkHPBw1TstHDBkdrFikmkFeoiTb1igrSjeGBfo2+dJhA3+XbTGcUi6qj+POYc/KG OIDw== X-Gm-Message-State: AOAM530n+q2473wmbAmvXbbsl+8NP5vCMgU5C1X13W9HRu5CD+IdGLec N5JBRzQO7RjCgVt6+AzMpC6OTW9SDYmRSRl7+4RF19M3 X-Google-Smtp-Source: ABdhPJxlRUPio5ZAD/0RLp47EY7XI/EFlus/iN1t70oUhCoji5K2O5olXOBPWpvWhHilrs8LUvWY46r2FlZ7M20FQC8= X-Received: by 2002:a05:6602:2d41:: with SMTP id d1mr4838932iow.54.1593222941755; Fri, 26 Jun 2020 18:55:41 -0700 (PDT) MIME-Version: 1.0 From: Greg Balfour Date: Fri, 26 Jun 2020 20:55:31 -0500 Message-ID: Subject: 11.4-RELEASE make delete-old To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 49txfl3g4vz486R X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=PGq7qnhK; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of gregbal4@gmail.com designates 2607:f8b0:4864:20::d36 as permitted sender) smtp.mailfrom=gregbal4@gmail.com X-Spamd-Result: default: False [-3.19 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-0.99)[-0.993]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.02)[-1.022]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::d36:from]; NEURAL_HAM_SHORT(-0.18)[-0.177]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Jun 2020 01:55:44 -0000 On a fresh install of 11.4-RELEASE, rebuilding the operating system results in several files being deleted during the "make delete-old" step. This surprised me. I wouldn't have expected this on a rebuild of a new install without any updates applied. See below, but for example /usr/bin/llvm-ar is present after the initial install but is then removed by the "make delete-old" step. Is this to be expected? Is the correct action to respond y when prompted about the files? root@test:/usr/src # make -j 4 buildworld buildkernel ... root@test:/usr/src # make installkernel ... root@test:/usr/src # make installworld ... root@test:/usr/src # make delete-old >>> Removing old files (only deletes safe to delete libs) remove /usr/bin/llvm-ar? y remove /usr/lib/debug/usr/bin/llvm-ar.debug? y remove /usr/bin/llvm-nm? y remove /usr/lib/debug/usr/bin/llvm-nm.debug? y remove /usr/bin/llvm-ranlib? y remove /usr/share/man/man1/llvm-ar.1.gz? y remove /usr/share/man/man1/llvm-nm.1.gz? y remove /usr/share/man/man1/llvm-symbolizer.1.gz? y >>> Old files removed >>> Removing old directories >>> Old directories removed To remove old libraries run 'make delete-old-libs'. From owner-freebsd-stable@freebsd.org Sat Jun 27 11:02:41 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8457A34C3B6 for ; Sat, 27 Jun 2020 11:02:41 +0000 (UTC) (envelope-from dimitry@andric.com) Received: from tensor.andric.com (tensor.andric.com [87.251.56.140]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "tensor.andric.com", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49v9nr3Tgzz3SCZ for ; Sat, 27 Jun 2020 11:02:40 +0000 (UTC) (envelope-from dimitry@andric.com) Received: from [10.10.156.45] (unknown [45.85.81.142]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by tensor.andric.com (Postfix) with ESMTPSA id 5DBC86E253; Sat, 27 Jun 2020 13:02:33 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=andric.com; s=201904; t=1593255753; bh=2ZEvwZrb/6wEVyEVh2FIA2nWGFAJfDS3tqZy/LwdVf4=; h=From:Subject:Date:In-Reply-To:Cc:To:References:From; b=gf6DMGyOAgFBRsn+rhAQZqOAubcWvXD6LQ5MkNVJSn2k07PlUsX9XYsoffuYGJvWn 8psO8mEgdhk5Lf7VUopxGdpK13Y3W6TzT24ewlU77s2RtI9PCgRo1+m0SOdvZz8QJZ Ea/FYZhDfRK4crdzPxKsgiPDLfBXJBFUS3WxCoMqNqEW7rKsIMeMJ96tL77ikY4c5N jUzRiOFD/ONH9eUS/L3+qRF8Ki0xQw51VTqO686pjpGpPuJwxsxDj08KJkwNyF24wd X8GXA2+JDkn6Kbv1vZ6Xpzw+LSvzpjmxZwfihjI3JHea9EExrYM6GrfAuYqiIO5nEH h1ArNJLTLc+Fw== From: Dimitry Andric Message-Id: <60E0BADC-8740-4206-A15D-F7F701E59E70@andric.com> Content-Type: multipart/signed; boundary="Apple-Mail=_B2733154-0C8B-453B-AF3C-E1789A23CEC2"; protocol="application/pgp-signature"; micalg=pgp-sha1 Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.14\)) Subject: Re: 11.4-RELEASE make delete-old Date: Sat, 27 Jun 2020 13:02:25 +0200 In-Reply-To: Cc: freebsd-stable@freebsd.org To: Greg Balfour References: X-Mailer: Apple Mail (2.3445.104.14) X-Rspamd-Queue-Id: 49v9nr3Tgzz3SCZ X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=andric.com header.s=201904 header.b=gf6DMGyO; dmarc=pass (policy=none) header.from=andric.com; spf=pass (mx1.freebsd.org: domain of dimitry@andric.com designates 87.251.56.140 as permitted sender) smtp.mailfrom=dimitry@andric.com X-Spamd-Result: default: False [-5.30 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[andric.com:s=201904]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:87.251.56.140]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; NEURAL_HAM_LONG(-0.96)[-0.959]; HAS_ATTACHMENT(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[andric.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[andric.com,none]; NEURAL_HAM_SHORT(-0.79)[-0.788]; NEURAL_HAM_MEDIUM(-0.96)[-0.955]; SIGNED_PGP(-2.00)[]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:12859, ipnet:87.251.32.0/19, country:NL]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Jun 2020 11:02:41 -0000 --Apple-Mail=_B2733154-0C8B-453B-AF3C-E1789A23CEC2 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=us-ascii On 27 Jun 2020, at 03:55, Greg Balfour wrote: > > On a fresh install of 11.4-RELEASE, rebuilding the operating system > results in several files being deleted during the "make delete-old" > step. This surprised me. I wouldn't have expected this on a rebuild > of a new install without any updates applied. See below, but for > example /usr/bin/llvm-ar is present after the initial install but is then > removed by the "make delete-old" step. Is this to be expected? > Is the correct action to respond y when prompted about the files? > > root@test:/usr/src # make -j 4 buildworld buildkernel > ... > root@test:/usr/src # make installkernel > ... > root@test:/usr/src # make installworld > ... > root@test:/usr/src # make delete-old >>>> Removing old files (only deletes safe to delete libs) > remove /usr/bin/llvm-ar? y > remove /usr/lib/debug/usr/bin/llvm-ar.debug? y > remove /usr/bin/llvm-nm? y > remove /usr/lib/debug/usr/bin/llvm-nm.debug? y > remove /usr/bin/llvm-ranlib? y > remove /usr/share/man/man1/llvm-ar.1.gz? y > remove /usr/share/man/man1/llvm-nm.1.gz? y > remove /usr/share/man/man1/llvm-symbolizer.1.gz? y >>>> Old files removed >>>> Removing old directories >>>> Old directories removed > To remove old libraries run 'make delete-old-libs'. Hmm, you found an issue in tools/build/mk/OptionalObsoleteFiles.inc. At some point llvm-ar, llvm-nm, llvm-objdump and llvm-symbolizer got promoted out of MK_CLANG_EXTRAS, so they always get installed. But in OptionalObsoleteFiles they are still under MK_CLANG_EXTRAS, so if you don't have that enabled, they are proposed for deletion. I have MFCd a few additional changes to fix this, in: https://svnweb.freebsd.org/changeset/base/362674 but this will have to be manually applied to your source tree, if you don't want to get prompted anymore. Otherwise, simply ignore the removal requests. -Dimitry --Apple-Mail=_B2733154-0C8B-453B-AF3C-E1789A23CEC2 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.2 iF0EARECAB0WIQR6tGLSzjX8bUI5T82wXqMKLiCWowUCXvcnQQAKCRCwXqMKLiCW o6BuAJ9UL/6d6DWT1i8Cyl/tQ7EJjJSvkQCg92vkunHGTmnJtxkUn2hi7y6L/Pw= =9d9q -----END PGP SIGNATURE----- --Apple-Mail=_B2733154-0C8B-453B-AF3C-E1789A23CEC2-- From owner-freebsd-stable@freebsd.org Sat Jun 27 16:28:49 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B7F47356489 for ; Sat, 27 Jun 2020 16:28:49 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: from mail-lf1-x12a.google.com (mail-lf1-x12a.google.com [IPv6:2a00:1450:4864:20::12a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49vK283Drmz49Qd; Sat, 27 Jun 2020 16:28:48 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: by mail-lf1-x12a.google.com with SMTP id g2so6761611lfb.0; Sat, 27 Jun 2020 09:28:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to:cc; bh=zJC2eAJeWPpEInADaXZffLQZiBhynXqBdDRrL6hTJNc=; b=t3muortUtX3+il6UfsYhvud20uXaU+zjkgpDZP7jP2DWBBADN7mCBVx31bzRM/eND1 m43o5Crig/MK2k5VTM7IO/OlRDvOEWDPt0LGOiVnWg8YTdDHXG54Iyek6uIFdyv8oErf Za8VCzFAxp5ogapo3HHaV9B88iQ+Jcxhlioj97hVs9hiDSY7uDJ8ASNloT1KXWPK7rX6 RhD0nRQ51avI1x4dLe3P+q7MxNL/GFTD770zHTehQkN7O0454xMvqaBtQcAd9DP1yH2g 9+4112qAwH2diXoEfWGcWrLEQOHgJqLOkj4prBa42zFikcgr3AaVHjJQpbjUfYEi8Vfw yjxw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc; bh=zJC2eAJeWPpEInADaXZffLQZiBhynXqBdDRrL6hTJNc=; b=Y1j5+P51tyjfQfn/HE1bukISKCMRiJrQfgRy0xhqnROfKBAGgQ4PKcsiPhyGs2Huuy 0GDQJH4US+ojNjeRPtp0YGAu5gbCjuM9XkgBZYzsYRIjmztiW0ngpN2bNgbyYqEuQvr2 aILi8bUHzO04O0J4LOnkO0//weFbQalbwTIGwjA2AVTuF6QoiBzeuwJ/hC2ci/EEskwl snHSlLUaEauf/lqE2q51OMpsnZ9t3pz5YbazFJqYSaq29GWEo8DlD3Yor+f8mXT+ILZ5 Qb6pYMdjlgp57xGOinUqBwNvtsGNXHMWHKj+d3aPDA428TKHW00fdgZ0ykzT2jT4ZpWg gVeg== X-Gm-Message-State: AOAM532Fn8EjobsFA8hls0OdApiDjn6CpaTnmQHmLm/VfZZP/IwRRDLW gcaMTMmAgZWE6meB10YrSmWOUmEC1oRZx/Qk62GCWH/m X-Google-Smtp-Source: ABdhPJy4wvg9Az9ynRVDtYh25llsKid73Bf4W07GQjHu9awKelFeX3+F1mkwp7j4t7njQvXKsGtwbVdQDN1sBr/FS18= X-Received: by 2002:a19:4301:: with SMTP id q1mr4879539lfa.96.1593275326292; Sat, 27 Jun 2020 09:28:46 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:4703:0:0:0:0:0 with HTTP; Sat, 27 Jun 2020 09:28:45 -0700 (PDT) Reply-To: dwilde1@gmail.com In-Reply-To: <1140215402.1.1593187896838@localhost> References: <20200625000410.GA10210@eureka.lemis.com> <20200625025248.GB10210@eureka.lemis.com> <20200626102331.GA6406@server.rulingia.com> <1140215402.1.1593187896838@localhost> From: Donald Wilde Date: Sat, 27 Jun 2020 09:28:45 -0700 Message-ID: Subject: Re: swap space issues To: Ronald Klop Cc: Bob Bishop , Peter Jeremy , "Greg 'groggy' Lehey" , freebsd-stable Content-Type: multipart/mixed; boundary="000000000000da831805a9135173" X-Rspamd-Queue-Id: 49vK283Drmz49Qd X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=t3muortU; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of dwilde1@gmail.com designates 2a00:1450:4864:20::12a as permitted sender) smtp.mailfrom=dwilde1@gmail.com X-Spamd-Result: default: False [-1.43 / 15.00]; HAS_REPLYTO(0.00)[dwilde1@gmail.com]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; HAS_ATTACHMENT(0.00)[]; REPLYTO_ADDR_EQ_FROM(0.00)[]; MIME_BASE64_TEXT_BOGUS(1.00)[]; RCPT_COUNT_FIVE(0.00)[5]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MIME_BASE64_TEXT(0.10)[]; CTYPE_MIXED_BOGUS(1.00)[]; NEURAL_HAM_SHORT(-0.57)[-0.571]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-0.97)[-0.966]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; FREEMAIL_REPLYTO(0.00)[gmail.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::12a:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Jun 2020 16:28:49 -0000 --000000000000da831805a9135173 Content-Type: text/plain; charset="UTF-8" On 6/26/20, Ronald Klop wrote: > > Van: Bob Bishop > Datum: vrijdag, 26 juni 2020 17:18 > Aan: Peter Jeremy > CC: Donald Wilde , freebsd-stable > > Onderwerp: Re: swap space issues >> >> >> >> > On 26 Jun 2020, at 11:23, Peter Jeremy wrote: >> > >> > On 2020-Jun-25 11:30:31 -0700, Donald Wilde wrote: >> >> Here's 'pstat -s' on the i3 (which registers as cpu HAMMER): >> >> >> >> Device 1K-blocks Used Avail Capacity >> >> /dev/ada0s1b 33554432 0 33554432 0% >> >> /dev/ada0s1d 33554432 0 33554432 0% >> >> Total 67108864 0 67108864 0% >> > >> > I strongly suggest you don't have more than one swap device on spinning >> > rust - the VM system will stripe I/O across the available devices and >> > that will give particularly poor results when it has to seek between >> > the >> > partitions. >> Based on all recommendations on this thread (thanks, guys!), I've rebuilt my i3 mule with exactly one 16G partition, as it has only 'spinning rust' for a disk. My loader.conf has kern.maxswzone=4200000 and ccache is fully active and working for both root on tcsh and users on sh. I have yet to try synth again. I'm doing buildworld/buildkernel for 12-STABLE, but evidence so far is good. 'top -t' is actually happy, showing 16G (grog?), so I'll try firing up synth after another hour or so on the latest fetch of the ports tree. Happy coder, me! :D -- Don Wilde **************************************************** * What is the Internet of Things but a system * * of systems including humans? * **************************************************** --000000000000da831805a9135173 Content-Type: text/plain; charset="US-ASCII"; name="fstab.txt" Content-Disposition: attachment; filename="fstab.txt" Content-Transfer-Encoding: base64 X-Attachment-Id: file0 IyBEZXZpY2UJTW91bnRwb2ludAlGU3R5cGUJT3B0aW9ucwlEdW1wCVBhc3MjCi9kZXYvYWRhMHMx YQkvCQl1ZnMJcncJMQkxCi9kZXYvYWRhMHMxYglub25lCQlzd2FwCXN3CTAJMAovZGV2L2FkYTBz MWQJL2V4cAkJdWZzCXJ3CTIJMgpmZGVzYwkJL2Rldi9mZAkJZmRlc2NmcwlydwkwCTAKcHJvYwkJ L3Byb2MJCXByb2NmcwlydwkwCTAKCg== --000000000000da831805a9135173--