From owner-freebsd-pkgbase@freebsd.org Sun May 24 16:09:52 2020 Return-Path: Delivered-To: freebsd-pkgbase@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E375D2CA005 for ; Sun, 24 May 2020 16:09:52 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from mail.nomadlogic.org (mail.nomadlogic.org [174.136.98.114]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.nomadlogic.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49VQCz4dyvz4G1f for ; Sun, 24 May 2020 16:09:51 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from [192.168.1.159] (cpe-23-243-161-111.socal.res.rr.com [23.243.161.111]) by mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id d602a3e9 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO) for ; Sun, 24 May 2020 16:09:44 +0000 (UTC) To: freebsd-pkgbase@freebsd.org From: Pete Wright Subject: Parse Error running make packages Message-ID: <5634b606-fece-58bd-f044-930248bb7a4a@nomadlogic.org> Date: Sun, 24 May 2020 09:09:43 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.8.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 49VQCz4dyvz4G1f X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of pete@nomadlogic.org designates 174.136.98.114 as permitted sender) smtp.mailfrom=pete@nomadlogic.org X-Spamd-Result: default: False [-1.45 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-pkgbase@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.27)[-0.268]; DMARC_NA(0.00)[nomadlogic.org]; NEURAL_HAM_SHORT(-0.21)[-0.209]; NEURAL_HAM_MEDIUM(-0.67)[-0.673]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:25795, ipnet:174.136.96.0/20, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[23.243.161.111:received] X-BeenThere: freebsd-pkgbase@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Packaging the FreeBSD base system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 May 2020 16:09:52 -0000 Hello, Is the preferred method for building a package base repository still to run "make packages" after running buildworld and buildkernel?  I am testing this locally and am running into this error: ===> Creating FreeBSD-acct-dbg-13.0.s20200524150532 pkg -o ABI_FILE=/usr/obj/usr/home/pete/git/freebsd/amd64.amd64/worldstage/usr/bin/uname -o ALLOW_BASE_SHLIBS=yes  create -f txz -M /usr/obj/usr/home/pete/git/freebsd/amd64.am d64/worldstage/acct-dbg.ucl  -p /usr/obj/usr/home/pete/git/freebsd/amd64.amd64/worldstage/acct-dbg.plist -r /usr/obj/usr/home/pete/git/freebsd/amd64.amd64/worldstage  -o /us r/obj/usr/home/pete/git/freebsd/repo/FreeBSD:13:amd64/13.0.s20200524150532 pkg: Error parsing manifest: error while parsing : line: 19, column: 12 - 'invalid character in a key', character: '%' *** Error code 1 It looks like it's tripping up on this line in acct-dbg.ucl: deps: {     FreeBSD-%PKGDEPS%: {         origin: "base",         version: "13.0.s20200524150532"     } } specifically the %PKGDEPS%.  I wonder if I'm missing a step in this process. -pete -- Pete Wright pete@nomadlogic.org @nomadlogicLA From owner-freebsd-pkgbase@freebsd.org Mon May 25 15:23:23 2020 Return-Path: Delivered-To: freebsd-pkgbase@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5F135329B35 for ; Mon, 25 May 2020 15:23:23 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from mail.nomadlogic.org (mail.nomadlogic.org [174.136.98.114]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.nomadlogic.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49W17t1lTDz406d for ; Mon, 25 May 2020 15:23:21 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from [192.168.1.159] (cpe-23-243-161-111.socal.res.rr.com [23.243.161.111]) by mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id f580ab6a (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO) for ; Mon, 25 May 2020 15:23:20 +0000 (UTC) Subject: Re: Parse Error running make packages To: freebsd-pkgbase@freebsd.org References: <5634b606-fece-58bd-f044-930248bb7a4a@nomadlogic.org> From: Pete Wright Message-ID: Date: Mon, 25 May 2020 08:23:19 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.8.0 MIME-Version: 1.0 In-Reply-To: <5634b606-fece-58bd-f044-930248bb7a4a@nomadlogic.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 49W17t1lTDz406d X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of pete@nomadlogic.org designates 174.136.98.114 as permitted sender) smtp.mailfrom=pete@nomadlogic.org X-Spamd-Result: default: False [-1.22 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-pkgbase@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.62)[-0.619]; DMARC_NA(0.00)[nomadlogic.org]; NEURAL_SPAM_SHORT(0.04)[0.039]; NEURAL_HAM_MEDIUM(-0.34)[-0.342]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:25795, ipnet:174.136.96.0/20, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[23.243.161.111:received] X-BeenThere: freebsd-pkgbase@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Packaging the FreeBSD base system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 May 2020 15:23:23 -0000 On 5/24/20 9:09 AM, Pete Wright wrote: > Hello, > Is the preferred method for building a package base repository still > to run "make packages" after running buildworld and buildkernel?  I am > testing this locally and am running into this error: > > ===> Creating FreeBSD-acct-dbg-13.0.s20200524150532 > pkg -o > ABI_FILE=/usr/obj/usr/home/pete/git/freebsd/amd64.amd64/worldstage/usr/bin/uname > -o ALLOW_BASE_SHLIBS=yes  create -f txz -M > /usr/obj/usr/home/pete/git/freebsd/amd64.am > d64/worldstage/acct-dbg.ucl  -p > /usr/obj/usr/home/pete/git/freebsd/amd64.amd64/worldstage/acct-dbg.plist > -r /usr/obj/usr/home/pete/git/freebsd/amd64.amd64/worldstage  -o /us > r/obj/usr/home/pete/git/freebsd/repo/FreeBSD:13:amd64/13.0.s20200524150532 > > pkg: Error parsing manifest: error while parsing : line: 19, > column: 12 - 'invalid character in a key', character: '%' > *** Error code 1 > > > It looks like it's tripping up on this line in acct-dbg.ucl: > deps: { >     FreeBSD-%PKGDEPS%: { >         origin: "base", >         version: "13.0.s20200524150532" >     } > } > > > specifically the %PKGDEPS%.  I wonder if I'm missing a step in this > process. > > To close the loop on this for the mail archives. I had a some old .ucl files under /release/packages/ that were not being processed correctly by /release/packages/generate-ucl.sh. removing these files allowed me to successfully build package.  I suspect I previously built with packagebase in this tree before generate-ucl.sh was refactored which led to this issue. -pete -- Pete Wright pete@nomadlogic.org @nomadlogicLA From owner-freebsd-pkgbase@freebsd.org Mon May 25 20:41:07 2020 Return-Path: Delivered-To: freebsd-pkgbase@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 324522CAD10 for ; Mon, 25 May 2020 20:41:07 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-io1-f45.google.com (mail-io1-f45.google.com [209.85.166.45]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49W8BV33Zcz4YR6 for ; Mon, 25 May 2020 20:41:06 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: by mail-io1-f45.google.com with SMTP id q8so18393238iow.7 for ; Mon, 25 May 2020 13:41:06 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ezwV18+PnZYZdsRroPf8b/dlhh+23XHQ+qHell1oh4o=; b=aUqvnFRomWwOoPiWfyez0DQSqSZRv2+BWoXiE/7+LIesHIHf1tpoYZOT5eBv9ZlV6t e6Oj8nqrQFp9eFXznsTTvclgFx+8z7W62CNiuILSUpZo5mxD02WvfGAYEJEpjAaYTGXO JiccCFw7qGpjt2RGgSFRKHMB2yBGPssPrUk0Tg6jiwILCr79vgdJfV70wBl5E7J2v2ku awGTkdCo3N3ljQiGtyqNqEc8otGBp3xwEI/ROAszMvK+5m6SKyw1tPXk/91sOXk4tFPN dzA3R1MDsaRc17f3MXANFG49mAONewFqk54be9mthm6cSEf6AFdcMn5Uba1Qkuljz8Wq NlLA== X-Gm-Message-State: AOAM531VzuvPG5A9sK1+fUMUZTT4NuFOAaz/MwlOCYfI7De2GMOp8IwB hcGHdboLamSBRZqq6rBDR8s5BJQUq5+DaWVLBqOpRCIpeHk= X-Google-Smtp-Source: ABdhPJyFETn8CPhGvcvCTTj4QNXrXX0EMYbdD3Rd0+boXMH1L/MB7+jg+z9vKZfbuk7o0VSjzsAGDCRH/GI0Cq6U2KY= X-Received: by 2002:a6b:680c:: with SMTP id d12mr8877786ioc.102.1590439265469; Mon, 25 May 2020 13:41:05 -0700 (PDT) MIME-Version: 1.0 References: <5634b606-fece-58bd-f044-930248bb7a4a@nomadlogic.org> In-Reply-To: From: Ed Maste Date: Mon, 25 May 2020 16:40:53 -0400 Message-ID: Subject: Re: Parse Error running make packages To: Pete Wright Cc: freebsd-pkgbase@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 49W8BV33Zcz4YR6 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of carpeddiem@gmail.com designates 209.85.166.45 as permitted sender) smtp.mailfrom=carpeddiem@gmail.com X-Spamd-Result: default: False [-1.82 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.96)[-0.962]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; URI_HIDDEN_PATH(1.00)[https://github.com/freebsd/freebsd/blob/master/.cirrus.yml]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-pkgbase@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; NEURAL_HAM_LONG(-0.96)[-0.961]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.89)[-0.892]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[209.85.166.45:from]; FORGED_SENDER(0.30)[emaste@freebsd.org,carpeddiem@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.166.45:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[emaste@freebsd.org,carpeddiem@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-pkgbase@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Packaging the FreeBSD base system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 May 2020 20:41:07 -0000 On Mon, 25 May 2020 at 11:23, Pete Wright wrote: > > I had a some old .ucl files under /release/packages/ that were not being > processed correctly by /release/packages/generate-ucl.sh. removing these > files allowed me to successfully build package. I suspect I previously > built with packagebase in this tree before generate-ucl.sh was > refactored which led to this issue. Glad you were able to fix your issue - this sort of thing is something we'd want to address automatically, but not really unexpected while pkgbase is still in development. FWIW the Cirrus-CI config builds a set of packages as one of the steps: https://github.com/freebsd/freebsd/blob/master/.cirrus.yml package_script: - make WITHOUT_TOOLCHAIN=yes PKG_FORMAT=tar packages I have WIP stashed somewhere to use those pkgs for the boot smoke test and will get that into the tree sometime. We'll also do similar things with the official CI on ci.freebsd.org.