From owner-freebsd-arm@freebsd.org Wed Jun 17 20:32:43 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9E497334FE6 for ; Wed, 17 Jun 2020 20:32:43 +0000 (UTC) (envelope-from dan.kotowski@a9development.com) Received: from mail-40133.protonmail.ch (mail-40133.protonmail.ch [185.70.40.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "protonmail.com", Issuer "SwissSign Server Gold CA 2014 - G22" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49nGwB5N7rz4Sld for ; Wed, 17 Jun 2020 20:32:42 +0000 (UTC) (envelope-from dan.kotowski@a9development.com) Date: Wed, 17 Jun 2020 20:32:36 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=a9development.com; s=protonmail; t=1592425959; bh=u3tN50Myf1fRz5G3u2ybDOHqYaoARoewurpNWFXjgeE=; h=Date:To:From:Cc:Reply-To:Subject:In-Reply-To:References:From; b=Em71Awr/2HAFWKzenurl4bIT5sR54g4UM5s6s2C9nlt7qF3WQ51g4uqm66v6kJPg0 wekTiCvTTUBGVYT45ogbDTq8uqgcXrsFOSVGnDdc9/8UM5mBcLqZnVJsvWxWjWIctN 8ryqxLQtZ57QUDSLnvhWPHr2hKgbLwfWJY7vFKBE= To: myfreeweb From: Dan Kotowski Cc: freebsd-arm Reply-To: Dan Kotowski Subject: Re: FreeBSD on Layerscape/QorIQ LX2160X Message-ID: In-Reply-To: References: <940a6099e971e01bd6d04564d0982b9d@unrelenting.technology> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-1.2 required=7.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF shortcircuit=no autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on mail.protonmail.ch X-Rspamd-Queue-Id: 49nGwB5N7rz4Sld X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=a9development.com header.s=protonmail header.b=Em71Awr/; dmarc=pass (policy=none) header.from=a9development.com; spf=pass (mx1.freebsd.org: domain of dan.kotowski@a9development.com designates 185.70.40.133 as permitted sender) smtp.mailfrom=dan.kotowski@a9development.com X-Spamd-Result: default: False [-3.80 / 15.00]; HAS_REPLYTO(0.00)[dan.kotowski@a9development.com]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[a9development.com:s=protonmail]; REPLYTO_EQ_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:185.70.40.0/24]; NEURAL_HAM_LONG(-0.97)[-0.967]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_MEDIUM(-1.00)[-0.997]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[a9development.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[a9development.com,none]; NEURAL_HAM_SHORT(-0.73)[-0.735]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RWL_MAILSPIKE_VERYGOOD(0.00)[185.70.40.133:from]; ASN(0.00)[asn:62371, ipnet:185.70.40.0/24, country:CH]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[185.70.40.133:from] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 20:32:43 -0000 > > > By the way, did you get any different firmware builds in the meantime= ? That don't have everything suspiciously routed to the SMMU in IORT.. > > > > s/suspiciously/by design/ > > BEGIN QUOTE > > the PCIe root nodes are hidden from the rich OS with this configuration= . To access the root nodes you need a quirk implemented. > > eventually it will be an option for those that want to run custom kerne= ls, but for now this is the solution for the most SBSA like configuration > > END QUOTE > > And how are we supposed to get any MSI-X interrupts in this configuration= ? > > Our fallback code for when nothing was matched in IORT (i.e. directly usi= ng PCIe RID with no offset) did not result in working interrupts. > > IIRC legacy interrupts didn't work either, but maybe you should retest th= em (disabling MSI, MSI-X). NSTR, but here you go anyways: https://gist.github.com/agrajag9/d4d75d7dca4= 1b3cb64c0a4243eed4eb7 Forgive my n00bishness and feel free to correct me below, I'm still learnin= g my way around down here... What are we doing with all the GSIVs in the IO= RT SMMU node? Based on reading the table and dmesg.boot, I'm seeing the following: * ITS node for gics * 2 root complex nodes for pci0 and 1, * Named component nodes for MCE, ugens, mmcs (if we still had that in), and= ahcis But then the SMMU node has: * 64 context interrupts, * 10 PMU interrupts, and * 5 ID mappings Where do these go? Are we perhaps not walking this section properly and tha= t's the quirk to which Jon is referring?