Date: Wed, 22 May 2024 16:48:34 +0100 From: Doug Rabson <dfr@rabson.org> To: Ronald Klop <ronald-lists@klop.ws> Cc: Mark Millard <marklmi@yahoo.com>, Mario Marietto <marietto2008@gmail.com>, arm@freebsd.org, Lexi Winter <lexi@le-fay.org> Subject: Re: vmm (bhyve) on GICv2 Message-ID: <CACA0VUgi-1oWUyTuXp22-MxbELK7dsn7A0DmYC5_UxWY11sz1g@mail.gmail.com> In-Reply-To: <1923834610.13708.1716392599662@localhost> References: <Zk2YnPCESoEHC-8D@ilythia.eden.le-fay.org> <CA%2B1FSihooPem=qRFFU7RG21UKUf-uCrW_CPMvH1NxROArXivPA@mail.gmail.com> <Zk2d8lACXhhD9V9p@ilythia.eden.le-fay.org> <18B789E4-5891-4F3E-BAB6-05FD45949438@yahoo.com> <1923834610.13708.1716392599662@localhost>
next in thread | previous in thread | raw e-mail | index | archive | help
--00000000000097d47f06190cdeeb Content-Type: text/plain; charset="UTF-8" I have some unfinished patches, currently stuck trying to figure out how MSI works on the platform. Sadly, this part is not documented publicly and I have no access to NDA documentation. The Linux driver is my only reference which is far from optimal. Mike Karels is also interested in getting this working. Doug. On Wed, 22 May 2024 at 16:43, Ronald Klop <ronald-lists@klop.ws> wrote: > > *Van:* Mark Millard <marklmi@yahoo.com> > *Datum:* woensdag, 22 mei 2024 17:34 > *Aan:* Lexi Winter <lexi@le-fay.org> > *CC:* Mario Marietto <marietto2008@gmail.com>, arm@freebsd.org > *Onderwerp:* Re: vmm (bhyve) on GICv2 > > On May 22, 2024, at 00:25, Lexi Winter <lexi@le-fay.org> wrote: > > > Mario Marietto: > >> On Wed, May 22, 2024 at 9:03AM Lexi Winter <lexi@le-fay.org> wrote: > >>> i was pleased to see ARM64 vmm has been merged to main recently. > >>> > >>> i have several use-cases to run bhyve on RPi4, but unfortunately this > >>> hardware only supports GICv2 while vmm requires GICv3. > >>> > >>> does anyone have an idea if GICv2 is likely to be supported in the > >>> future? > >> > >> Does RPi5 support GICv3 ? I would like to know which kind of relatively > >> cheap arm hardware can run bhyve. > > > > i don't know off hand, but i do know FreeBSD doesn't support RPi5 at > > all right now, so this is not an immediate solution :-) > > I boot and run a RPi5 via EDK2 in the microsd card slot and a USB3 > UFS system media (that has lots of different swap partition sizes > for use on various machines with widely varying amounts of RAM): > > # gpart show -pl > => 40 249737136 mmcsd0 GPT (119G) > 40 2008 - free - (1.0M) > 2048 249733120 mmcsd0p1 RPi5-edk2 (119G) > 249735168 2008 - free - (1.0M) > > => 34 1875384941 da0 GPT (894G) > 34 32734 - free - (16M) > 32768 501760 da0p1 PkgBaseEFI (245M) > 534528 20971520 da0p2 PkgBaseSwp10 (10G) > 21506048 29360128 da0p3 PkgBaseSwp14 (14G) > 50866176 33554432 da0p4 PkgBaseSwp16 (16G) > 84420608 67108864 da0p5 PkgBaseSwp32 (32G) > 151529472 96468992 da0p6 PkgBaseSwp46 (46G) > 247998464 268435456 da0p7 PkgBaseSwp128 (128G) > 516433920 7340032 da0p8 PkgBaseSwp3p5 (3.5G) > 523773952 13631488 da0p10 PkgBaseSwp6p5 (6.5G) > 537405440 1337979528 da0p9 PkgBaseUFS (638G) > 1875384968 7 - free - (3.5K) > > See: https://github.com/worproject/rpi5-uefi > > # uname -apKU > FreeBSD aarch64-main-pkgs 15.0-CURRENT FreeBSD 15.0-CURRENT #5 > main-n269589-9dcf39575efb-dirty: Sun Apr 21 01:42:00 PDT 2024 > root@aarch64-main-pbase:/usr/obj/BUILDs/main-CA76-nodbg-clang/usr/main-src/arm64.aarch64/sys/GENERIC-NODBG-CA76 > arm64 aarch64 1500018 1500018 > > That kernel is at: /boot/kernel.CA76-NODBG/kernel in my context. > > But I also have kernels that I got from: > > https://pkg.freebsd.org/FreeBSD:15:aarch64/base_latest/ > > that boot it as well: > > # strings /boot/kernel.GENERIC-NODEBUG/kernel | grep 15.0- > @(#)FreeBSD 15.0-CURRENT main-n269581-dfa39133b333 GENERIC-NODEBUG > FreeBSD 15.0-CURRENT main-n269581-dfa39133b333 GENERIC-NODEBUG > 15.0-CURRENT > > And the debug version (witness and such): > > # strings /boot/kernel/kernel | grep 15.0- > @(#)FreeBSD 15.0-CURRENT main-n269581-dfa39133b333 GENERIC > FreeBSD 15.0-CURRENT main-n269581-dfa39133b333 GENERIC > 15.0-CURRENT > > (It has beem a while since I updated.) > > All these kernels boot a world that I got from the same: > > https://pkg.freebsd.org/FreeBSD:15:aarch64/base_latest/ > > I do have another world in a directory tree that I built that I > can chroot to. > > === > Mark Millard > marklmi at yahoo.com > > > ------------------------------ > > > > Hi, > > This looks nice. Are there any FreeBSD patches needed to boot a RPI5? Or > only an up-to-date EDK2? > > And if it works well can we collaborate in documenting the RPI5 on > https://wiki.freebsd.org/arm/Raspberry%20Pi? > > Regards, > Ronald. > > --00000000000097d47f06190cdeeb Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr">I have some unfinished patches, currently stuck trying=C2= =A0to figure out how MSI works on the platform. Sadly, this part is not doc= umented publicly and I have no access to NDA documentation. The Linux drive= r is my only reference which is far from optimal. Mike Karels is also inter= ested in getting this working.<div><br></div><div>Doug.</div><div><br></div= ></div><br><div class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr"= >On Wed, 22 May 2024 at 16:43, Ronald Klop <<a href=3D"mailto:ronald-lis= ts@klop.ws">ronald-lists@klop.ws</a>> wrote:<br></div><blockquote class= =3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;bo= rder-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">= <div><br> <p><strong>Van:</strong> Mark Millard <<a href=3D"mailto:marklmi@yahoo.c= om" target=3D"_blank">marklmi@yahoo.com</a>><br> <strong>Datum:</strong> woensdag, 22 mei 2024 17:34<br> <strong>Aan:</strong> Lexi Winter <<a href=3D"mailto:lexi@le-fay.org" ta= rget=3D"_blank">lexi@le-fay.org</a>><br> <strong>CC:</strong> Mario Marietto <<a href=3D"mailto:marietto2008@gmai= l.com" target=3D"_blank">marietto2008@gmail.com</a>>, <a href=3D"mailto:= arm@freebsd.org" target=3D"_blank">arm@freebsd.org</a><br> <strong>Onderwerp:</strong> Re: vmm (bhyve) on GICv2</p> <blockquote style=3D"padding-right:0px;padding-left:5px;margin-left:5px;bor= der-left-width:2px;border-left-style:solid;border-left-color:rgb(0,0,0);mar= gin-right:0px"> <div id=3D"m_826457840600317568P"> <div id=3D"m_826457840600317568P.P">On May 22, 2024, at 00:25, Lexi Winter = <<a href=3D"mailto:lexi@le-fay.org" target=3D"_blank">lexi@le-fay.org</a= >> wrote:<br> <br> > Mario Marietto:<br> >> On Wed, May 22, 2024 at 9:03AM Lexi Winter <<a href=3D"mailto:l= exi@le-fay.org" target=3D"_blank">lexi@le-fay.org</a>> wrote:<br> >>> i was pleased to see ARM64 vmm has been merged to main recentl= y.<br> >>><br> >>> i have several use-cases to run bhyve on RPi4, but unfortunate= ly this<br> >>> hardware only supports GICv2 while vmm requires GICv3.<br> >>><br> >>> does anyone have an idea if GICv2 is likely to be supported in= the<br> >>> future?<br> >><br> >> Does RPi5 support GICv3 ? I would like to know which kind of relat= ively<br> >> cheap arm hardware can run bhyve.<br> ><br> > i don't know off hand, but i do know FreeBSD doesn't support R= Pi5 at<br> > all right now, so this is not an immediate solution :-)<br> <br> I boot and run a RPi5 via EDK2 in the microsd card slot and a USB3<br> UFS system media (that has lots of different swap partition sizes<br> for use on various machines with widely varying amounts of RAM):<br> <br> # gpart show -pl<br> =3D> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A040 =C2=A0249737136 =C2=A0=C2=A0= =C2=A0mmcsd0 =C2=A0GPT =C2=A0(119G)<br> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A040 =C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A02008 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0- free - =C2=A0(1.0M)<br> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A02048 =C2=A0249733120 =C2=A0mmcsd0= p1 =C2=A0RPi5-edk2 =C2=A0(119G)<br> =C2=A0=C2=A0249735168 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A02008 =C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0- free - =C2=A0(1.0M)= <br> <br> =3D> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A034 =C2=A01875384941 =C2= =A0=C2=A0=C2=A0=C2=A0da0 =C2=A0GPT =C2=A0(894G)<br> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A034 =C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A032734 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0- free - =C2=A0(16M)<br> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A032768 =C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0501760 =C2=A0=C2=A0da0p1 =C2=A0PkgBaseEFI =C2=A0(245M)<br> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0534528 =C2=A0=C2=A0=C2=A020971520 =C2= =A0=C2=A0da0p2 =C2=A0PkgBaseSwp10 =C2=A0(10G)<br> =C2=A0=C2=A0=C2=A0=C2=A021506048 =C2=A0=C2=A0=C2=A029360128 =C2=A0=C2=A0da0= p3 =C2=A0PkgBaseSwp14 =C2=A0(14G)<br> =C2=A0=C2=A0=C2=A0=C2=A050866176 =C2=A0=C2=A0=C2=A033554432 =C2=A0=C2=A0da0= p4 =C2=A0PkgBaseSwp16 =C2=A0(16G)<br> =C2=A0=C2=A0=C2=A0=C2=A084420608 =C2=A0=C2=A0=C2=A067108864 =C2=A0=C2=A0da0= p5 =C2=A0PkgBaseSwp32 =C2=A0(32G)<br> =C2=A0=C2=A0=C2=A0151529472 =C2=A0=C2=A0=C2=A096468992 =C2=A0=C2=A0da0p6 = =C2=A0PkgBaseSwp46 =C2=A0(46G)<br> =C2=A0=C2=A0=C2=A0247998464 =C2=A0=C2=A0268435456 =C2=A0=C2=A0da0p7 =C2=A0P= kgBaseSwp128 =C2=A0(128G)<br> =C2=A0=C2=A0=C2=A0516433920 =C2=A0=C2=A0=C2=A0=C2=A07340032 =C2=A0=C2=A0da0= p8 =C2=A0PkgBaseSwp3p5 =C2=A0(3.5G)<br> =C2=A0=C2=A0=C2=A0523773952 =C2=A0=C2=A0=C2=A013631488 =C2=A0da0p10 =C2=A0P= kgBaseSwp6p5 =C2=A0(6.5G)<br> =C2=A0=C2=A0=C2=A0537405440 =C2=A01337979528 =C2=A0=C2=A0da0p9 =C2=A0PkgBas= eUFS =C2=A0(638G)<br> =C2=A0=C2=A01875384968 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A07 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0- free - = =C2=A0(3.5K)<br> <br> See: <a href=3D"https://github.com/worproject/rpi5-uefi" target=3D"_blank">= https://github.com/worproject/rpi5-uefi</a><br>; <br> # uname -apKU<br> FreeBSD aarch64-main-pkgs 15.0-CURRENT FreeBSD 15.0-CURRENT #5 main-n269589= -9dcf39575efb-dirty: Sun Apr 21 01:42:00 PDT 2024 =C2=A0=C2=A0=C2=A0=C2=A0r= oot@aarch64-main-pbase:/usr/obj/BUILDs/main-CA76-nodbg-clang/usr/main-src/a= rm64.aarch64/sys/GENERIC-NODBG-CA76 arm64 aarch64 1500018 1500018<br> <br> That kernel is at: /boot/kernel.CA76-NODBG/kernel in my context.<br> <br> But I also have kernels that I got from:<br> <br> <a href=3D"https://pkg.freebsd.org/FreeBSD:15:aarch64/base_latest/" target= =3D"_blank">https://pkg.freebsd.org/FreeBSD:15:aarch64/base_latest/</a><br>; <br> that boot it as well:<br> <br> # strings /boot/kernel.GENERIC-NODEBUG/kernel | grep 15.0-<br> @(#)FreeBSD 15.0-CURRENT main-n269581-dfa39133b333 GENERIC-NODEBUG<br> FreeBSD 15.0-CURRENT main-n269581-dfa39133b333 GENERIC-NODEBUG<br> 15.0-CURRENT<br> <br> And the debug version (witness and such):<br> <br> # strings /boot/kernel/kernel | grep 15.0-<br> @(#)FreeBSD 15.0-CURRENT main-n269581-dfa39133b333 GENERIC<br> FreeBSD 15.0-CURRENT main-n269581-dfa39133b333 GENERIC<br> 15.0-CURRENT<br> <br> (It has beem a while since I updated.)<br> <br> All these kernels boot a world that I got from the same:<br> <br> <a href=3D"https://pkg.freebsd.org/FreeBSD:15:aarch64/base_latest/" target= =3D"_blank">https://pkg.freebsd.org/FreeBSD:15:aarch64/base_latest/</a><br>; <br> I do have another world in a directory tree that I built that I<br> can chroot to.<br> <br> =3D=3D=3D<br> Mark Millard<br> marklmi at <a href=3D"http://yahoo.com" target=3D"_blank">yahoo.com</a><br> <br> =C2=A0</div> <hr></div> </blockquote> <br> <br> Hi,<br> <br> This looks nice. Are there any FreeBSD patches needed to boot a RPI5? Or on= ly an up-to-date EDK2?<br> <br> And if it works well can we collaborate in documenting the RPI5 on <a href= =3D"https://wiki.freebsd.org/arm/Raspberry%20Pi" target=3D"_blank">https://= wiki.freebsd.org/arm/Raspberry%20Pi</a>?<br> <br> Regards,<br> Ronald.<br> =C2=A0</div></blockquote></div> --00000000000097d47f06190cdeeb--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CACA0VUgi-1oWUyTuXp22-MxbELK7dsn7A0DmYC5_UxWY11sz1g>