From owner-freebsd-arm@freebsd.org Thu Mar 18 11:24:58 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0504A57064E for ; Thu, 18 Mar 2021 11:24:58 +0000 (UTC) (envelope-from mw@semihalf.com) Received: from mail-qt1-x831.google.com (mail-qt1-x831.google.com [IPv6:2607:f8b0:4864:20::831]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1Pnj2WTrz3KDm for ; Thu, 18 Mar 2021 11:24:57 +0000 (UTC) (envelope-from mw@semihalf.com) Received: by mail-qt1-x831.google.com with SMTP id u7so3714982qtq.12 for ; Thu, 18 Mar 2021 04:24:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=semihalf-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=t100G5F/fhjR2QIm8zPjo6A+tF1vWhWNSB6rxv2iw1s=; b=sp/9E5s9i/B7ScyeplWtE7AjKKAw6HMzRgYGTMSD0v8D1H1Q51n06RcRpdSZL5Iu+U a7dmxmI3znuMHYp9PyLg6wRWUYSk8zDGe7sr2YQhoGyW2hMqof9TAVO6pDCIAW/hlRw0 wGYnF36/og7hOmTn8H+cJdk4UT+zjBlgY+oZij3uzMhfRC7ZrTCxolrLVNO0x5hXa7n9 JD58cr8856wh4azV4rsbdPYc0QgvgHzpUAN0o1MZTUXR49wL8fWhbteOwPJHscYSjNEw xeqD2KQhAxieZEk3x6xjVFnQzEKkdjfIkjlay5xSRpcBVQNHOxIhDcbQKkfcBywS5ZKU 8+bw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=t100G5F/fhjR2QIm8zPjo6A+tF1vWhWNSB6rxv2iw1s=; b=OvTh76YeaApXwIcVU00YPmbzySubKcA2mVuNvlpkqxxXKLi82kot1pg44RCrOj4bzo fdUynf6u0XPj3rt0u0tzQR6FSc0BNyaXw5618olYhJN8m5KL0g3q4RM/nwKAXvNJ22hh mBTdMn3veue+NUjlXRbtZCA+TghKLjfVVVPnDq8WPhK7iakfFFdaYil+0hUkJa7OlJ0+ WS5TiQZpLES+Q7lW6Bin9B6GcsIXX0O7HRtZk2Fweityvi3mqd/k2Jj3DAXm2BwAXIRN lDvJrxS4lHfApV+TP7qQVCwyzpIFp855D91dfNYtRIsgW2m/3URdiFGQMPnqQY6W506+ 2/CQ== X-Gm-Message-State: AOAM53061A/rjt38cuPo1Yz3X1JqsKU4IDKDn9/jZee09XuTQwnvAtTa GTF7UlQHl3CNqpeVufvdm166Z4/WbxmIGnnJqHpA+A== X-Google-Smtp-Source: ABdhPJwJB5cFskCbYCkswto2+U30tJSHjYRkM8JPufyOTTk1HwiM22AR3U24fREnPpSP/Vf1T/+qMsPCJ7lfuU2TE+0= X-Received: by 2002:ac8:70d1:: with SMTP id g17mr3248474qtp.306.1616066696354; Thu, 18 Mar 2021 04:24:56 -0700 (PDT) MIME-Version: 1.0 References: <3420FB5B-6499-42E5-8FFE-F9BF57CCECE7@icloud.com> <5D99B7D1-CDF6-4C96-AF62-ADF9626639CF@yahoo.com> <13F0E8C6-639D-4529-8348-79DDCCC3B4F4@yahoo.com> <80D7FDC3-1143-479C-85B2-DFF8EFB3CF64@yahoo.com> <7744246D-0F1A-4035-BCAA-0903A3AB030D@yahoo.com> In-Reply-To: <7744246D-0F1A-4035-BCAA-0903A3AB030D@yahoo.com> From: Marcin Wojtas Date: Thu, 18 Mar 2021 12:24:45 +0100 Message-ID: Subject: Re: MACHIATOBin Double Shot booted into FreeBSD from Optane in PCIe slot To: Mark Millard Cc: Greg V , freebsd-arm , Mark Murray Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4F1Pnj2WTrz3KDm X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=semihalf-com.20150623.gappssmtp.com header.s=20150623 header.b=sp/9E5s9; dmarc=none; spf=none (mx1.freebsd.org: domain of mw@semihalf.com has no SPF policy when checking 2607:f8b0:4864:20::831) smtp.mailfrom=mw@semihalf.com X-Spamd-Result: default: False [-1.92 / 15.00]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[semihalf-com.20150623.gappssmtp.com:+]; FREEMAIL_TO(0.00)[yahoo.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::831:from]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[semihalf-com.20150623.gappssmtp.com:s=20150623]; FREEFALL_USER(0.00)[mw]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_SPAM_SHORT(0.38)[0.384]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; DMARC_NA(0.00)[semihalf.com]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::831:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::831:from]; R_SPF_NA(0.00)[no SPF record]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm]; FREEMAIL_CC(0.00)[unrelenting.technology,freebsd.org,icloud.com] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 11:24:58 -0000 Hi Mark, =C5=9Br., 17 mar 2021 o 06:01 Mark Millard via freebsd-arm napisa=C5=82(a): > > I've no plans on generally using the PCIe slot but > I decided to test using it with an Optane as the > only storage media (besides the microsd card that > has the UEFI/ACPI material on it). > > It worked fine based on UEFI/ACPI being (indirectly) > from: > > https://unrelentingtech.s3.dualstack.eu-west-1.amazonaws.com/flash-image-= 2020-07-01-mainline-tfa.bin > > So I did the following (starting with being > powered off already), at least in summary: > > A) Disconnected the usual power source > B) Disconnected the SATA disk setup > C) Plugged in the Optane into the PCIe slot > D) Plugged in power that could handle far more > E) Booted from the Optane > (I used the UEFI UI to select the "UEFI Misc Device" > in Boot Manager.) > F) Transfered materials to update the FreeBSD (prebuilt) > that was on the Optane. > (Using ethernet dongle in the USB3 port, like normal > for my context.) > G) Ran the procedure for updating FreeBSD on the Macch. > (A bunch of chroot directory trees are updated > as well, not just the boot context.) > H) Rebooted, again selecting "UEFI Misc Device". > > It is now running based on main 7381bbee29df > (form 2021-Mar-12) from the Optane media: > > # ~/fbsd-based-on-what-freebsd-main.sh > merge-base: 7381bbee29df959e88ec59866cf2878263e7f3b2 > merge-base: CommitDate: 2021-03-12 20:29:42 +0000 > def0058cc690 (HEAD -> mm-src) mm-src snapshot for mm's patched build in g= it context. > 7381bbee29df (freebsd/main, freebsd/HEAD, pure-src, main) cam: Run all XP= T_ASYNC ccbs in a dedicated thread > FreeBSD CA72n16 14.0-CURRENT FreeBSD 14.0-CURRENT mm-src-n245445-def0058c= c690 GENERIC-NODBG arm64 aarch64 1400005 1400005 > > >> . . . A > >> verbose boot reported: > >> pcib0: on acpi0 > >> pcib0: Bus is cache-coherent > >> pcib0: ECAM for bus 0-0 at mem e0000000-e00fffff > >> pci0: on pcib0 > >> pci0: domain=3D0, physical bus=3D0 > >> but that was all for pci*. pciconf -l reported > >> an empty output. > > > > That's all you'll see without a card inserted. > > On this device, we can only expose this much with ECAM. > > Now it shows as follows (verbose boot used): > > pcib0: on acpi0 > pcib0: Bus is cache-coherent > pcib0: ECAM for bus 0-0 at mem e0000000-e00fffff > pci0: on pcib0 > pci0: domain=3D0, physical bus=3D0 > found-> vendor=3D0x8086, dev=3D0x2700, revid=3D0x00 > domain=3D0, bus=3D0, slot=3D0, func=3D0 > class=3D01-08-02, hdrtype=3D0x00, mfdev=3D0 > cmdreg=3D0x0006, statreg=3D0x0010, cachelnsz=3D0 (dwords) > lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns= ) > intpin=3Da, irq=3D255 > powerspec 3 supports D0 D3 current D0 > MSI-X supports 32 messages in map 0x10 > map[10]: type Memory, range 64, base 0x800000000, size 14, enable= d > pcib0: rman_reserve_resource: start=3D0x800000000, end=3D0x800003fff, cou= nt=3D0x4000 > nvme0: mem 0x800000000-0x800003fff at device 0.0 on= pci0 > nvme0: attempting to allocate 5 MSI-X vectors (32 supported) > nvme0: using IRQs 11-15 for MSI-X > nvme0: CapLo: 0x04010fff: MQES 4095, CQR, TO 4 > nvme0: CapHi: 0x00000020: DSTRD 0, CSS 1, MPSMIN 0, MPSMAX 0 > nvme0: Version: 0x00010000: 1.0 > . . . > pass0 at nvme0 bus 0 scbus4 target 0 lun 1 > pass0: > pass0: Serial Number *REPLACED* > pass0: nvme version 1.0 x4 (max x4) lanes PCIe Gen3 (max Gen3) link > nda0 at nvme0 bus 0 scbus4 target 0 lun 1 > GEOM: new disk nda0 > nda0: > nda0: Serial Number *REPLACED* > nda0: nvme version 1.0 x4 (max x4) lanes PCIe Gen3 (max Gen3) link > nda0: 457862MB (937703088 512 byte sectors) > > # pciconf -lv > nvme0@pci0:0:0:0: class=3D0x010802 rev=3D0x00 hdr=3D0x00 vendor=3D0= x8086 device=3D0x2700 subvendor=3D0x8086 subdevice=3D0x3900 > vendor =3D 'Intel Corporation' > device =3D 'Optane SSD 900P Series' > class =3D mass storage > subclass =3D NVM > > > Thanks again. > > > Note on the "image checksum verification failed" > notices and such . . . > > I have seen the rejection of the microsd card > UEFI/ACPI material's checksum sometimes (same > media both ways, no content update). With your > report as well, it seems that reading microsd > card media is unreliable at the start. Its > simple retries worked in my case, for example: > > BootROM - 2.03 > Starting CP-0 IOROM 1.07 > Booting from SD 0 (0x29) > Found valid image at boot postion 0x000 > lNOTICE: Starting binary extension > NOTICE: SVC: SW Revision 0x0. SVC is not supported > mv_ddr: mv_ddr-devel-18.08.0-ga881467 (Jul 01 2020 - 21:18:08) > mv_ddr: completed successfully > NOTICE: Cold boot Up to this part everything looks fine - BootROM loaded first part of the image (DDR training) and executed it in SRAM. > Error: image checksum verification failed > Error: no valid header till end of media > Error: Failed boot attempt 01. error =3D 0x041 Above message is from the BootROM - it tries to fetch remaining part of the image (later to be executed from DRAM). This step fails. If it's not consistent, I'd check the uSD card is placed firmly in the slot and/or try also some different cards. Best regards, Marcin > > BootROM - 2.03 > Starting CP-0 IOROM 1.07 > Booting from SD 0 (0x29) > Found valid image at boot postion 0x000 > lNOTICE: Starting binary extension > NOTICE: SVC: SW Revision 0x0. SVC is not supported > mv_ddr: mv_ddr-devel-18.08.0-ga881467 (Jul 01 2020 - 21:18:08) > mv_ddr: completed successfully > NOTICE: Cold boot > NOTICE: Booting Trusted Firmware > NOTICE: BL1: v2.3(release):v2.3-269-g568a88172-dirty (Marvell-devel-18.1= 2.0) > NOTICE: BL1: Built : 21:19:59, Jul 1 2020 > NOTICE: BL1: Booting BL2 > NOTICE: BL2: v2.3(release):v2.3-269-g568a88172-dirty (Marvell-devel-18.1= 2.0) > NOTICE: BL2: Built : 21:20:00, Jul 1 2020 > NOTICE: SCP_BL2 contains 5 concatenated images > NOTICE: Skipping MSS CP3 related image > NOTICE: Skipping MSS CP2 related image > NOTICE: Load image to CP1 MSS AP0 > NOTICE: Loading MSS image from addr. 0x40269f4 Size 0x1cd8 to MSS at 0xf= 4280000 > NOTICE: Done > NOTICE: Load image to CP0 MSS AP0 > NOTICE: Loading MSS image from addr. 0x40286cc Size 0x1cd8 to MSS at 0xf= 2280000 > NOTICE: Done > NOTICE: Load image to AP0 MSS > NOTICE: Loading MSS image from addr. 0x402a3a4 Size 0x5420 to MSS at 0xf= 0580000 > NOTICE: Done > NOTICE: SCP Image doesn't contain PM firmware > NOTICE: BL1: Booting BL31 > lNOTICE: MSS PM is not supported in this build > NOTICE: BL31: v2.3(release):v2.3-269-g568a88172-dirty (Marvell-devel-18.= 12.0) > NOTICE: BL31: Built : 21:19:59, Jul 1 2020 > > For the sequence: > > NOTICE: Cold boot > Error: image checksum verification failed > Error: no valid header till end of media > Error: Failed boot attempt 01. error =3D 0x041 > > Is all that before it is even executing > material that is from the microsd card? If > it is, then the problem would not seem to > be tied to the specific image used but be > a more general problem reading microsd > media by code that is in use before the > microsd card's code is in use. > > > > I've not tried other media or any such yet. > It is not the media that I'd used for so > long before switching images: At the time > I kept the original media as it was so that > I could revert to it if needed. The two > media (older and newer) are not of the same > type. I'd never noticed such retries with > the older media --but I was not looking for > such either. > > > =3D=3D=3D > Mark Millard > marklmi at yahoo.com > ( dsl-only.net went > away in early 2018-Mar) > > _______________________________________________ > freebsd-arm@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-arm > To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org"