Date: Thu, 15 Dec 2016 16:25:01 +0000 From: Matthew Seaman <matthew@FreeBSD.org> To: freebsd-ports@freebsd.org Subject: Re: (In)Stability of the Quarterly Branch Message-ID: <d806b1f6-9f9a-6546-d44f-5b04f3c422a9@FreeBSD.org> In-Reply-To: <20161215170154.0ca2017914c0bb032516b413@gmail.com> References: <3e7f94efc6428181a289742d7dd627df@acheronmedia.com> <CAO%2BPfDcYDy=w9Xaf02zWiYNO38Yex0ioX6z4a-5KL8k7e9qgQA@mail.gmail.com> <20161215170154.0ca2017914c0bb032516b413@gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --tsE7TwppDsFN8JDVQsA84BdlnDwuG0ri2 Content-Type: multipart/mixed; boundary="a7XLXsctw67nvt4vibkcdqIl844nMd5RR"; protected-headers="v1" From: Matthew Seaman <matthew@FreeBSD.org> To: freebsd-ports@freebsd.org Message-ID: <d806b1f6-9f9a-6546-d44f-5b04f3c422a9@FreeBSD.org> Subject: Re: (In)Stability of the Quarterly Branch References: <3e7f94efc6428181a289742d7dd627df@acheronmedia.com> <CAO+PfDcYDy=w9Xaf02zWiYNO38Yex0ioX6z4a-5KL8k7e9qgQA@mail.gmail.com> <20161215170154.0ca2017914c0bb032516b413@gmail.com> In-Reply-To: <20161215170154.0ca2017914c0bb032516b413@gmail.com> --a7XLXsctw67nvt4vibkcdqIl844nMd5RR Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 2016/12/15 16:01, Olivier Duchateau wrote: >> The problem is that there are no tests in FreeBSD ports. All source >> based systems I've tested: pkgsrc, FreeBSD ports, OpenBSD, Gentoo; >> FreeBSD is the one that have the most instability. Not to mention >> committers that commit without testing the port, just look at >> www/redmine to get your point of view on that issue. > Are your serious when you said, there're no tests on FreeBSD ports. I > can tell you Xfce ports are tested with FreeBSD i386 9.3 and amd64 > 11.0 machines (on real hardware, no virtualization), and on poudriere > with Gtk+ 3.20 (port version is not not in ports tree, it's defaut > toolkits for the next stable release 4.14). >=20 > For the LXQt desktop is the same thing (tested with official ports > tree Qt5 and which one in plasma5 branch (on KDE repository). >=20 > I'm also working on the Pantheon desktop (desktop environment of > Elementary OS, I use Vala 0.30.2 and Vala 0.34.4, in order to test > stability of applications. >=20 > I use also OpenBSD macppc, it's piece of shit. WebKit browers are > broken, Xfce components crash often, stable branch is outdated, fix > are not propagated in stable branch. Personally I prefer the FreeBSD > scheme, because I'm sure it's quite stable. Most port committers will run compile tests any time they update a port: the better ones will test compilation on all supported FreeBSD versions and all hardware architectures they have access to (ie. generally i386 and amd64). Additionally the package build cluster will rebuild any modified ports within a few days for all of the OS versions and architectures the project tries to provide ports for: that's yet another level of validating the coding of the port itself. However, I believe the OP's point is that *we do not routinely run the software's own built-in regression tests for the packages we succeed in building*. This is something that is slowly coming. For instance, you can run 'make test' for many python, ruby or perl packages and see those tests being run. TEST_DEPENDS is pretty much standardized as the way to install dependencies required for testing nowadays. Yet another layer of package validation would be very good to have, but it isn't routine yet. Cheers, Matthew --a7XLXsctw67nvt4vibkcdqIl844nMd5RR-- --tsE7TwppDsFN8JDVQsA84BdlnDwuG0ri2 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQJ8BAEBCgBmBQJYUsPkXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXQxOUYxNTRFQ0JGMTEyRTUwNTQ0RTNGMzAw MDUxM0YxMEUwQTlFNEU3AAoJEABRPxDgqeTnQx4QAIHcIZZxd/hQgMxKcgAwzgRn j2/UNYb1VU0eaEkLwFB+d5Qt354bLzydAjxJaUfLuqw4zvobNSj0GGjNStris5F1 ibqoNKHUpq0iFZdcs20niMNzENFE56T9TSMc4iOapLM67VXA48MhB5NUB9jp2sNE aPvirgXXrQ3I7Tfm6ZVrL+F8HtjeKjzomdjQbcvUVCf3gXxd47qa7+gW6Ug5pUWt /zzATHq+HosEblczj9dfdPpwaxjlAUhGy1VvAVfueCb6bxpx0tEN8li3i0kkbFYx aqB9Depk+Qr8Gm1pZvO2OYIRuoXIWDamD1a7XikYGXvIsEJru+zLzrxPe1D/0y+z 89verHRCtfp7F3a7DHuG4k5iav/lEtbQxa6BAJhBOonPdHfdM5LCdZue+j3hIZa5 9nhpsTCJGnnKDBiCFh1Gn68A01hHcmzy5/ze42NMonMwtgOhWg5C4Kfldghp6pay AHNWd2Wncga8E1mBARVui4tCbTzpUpeZsiPj4sZBBHBL9suWEed/8Q4HbMCOtDhs 4vPzipeEC8lcj7Wwa2lu5pKlwHfkZmodZ9vhG+o9KAIBytP9AasPpqOj9GuU5GT7 DOINThVOYAlN1x0PkPFr8POVBljNabPKqjxSipRE4hxbTZuQuZV5xBkRNIzjHWyP Fa5ivBo6CTi6KdmttmE7 =IXYu -----END PGP SIGNATURE----- --tsE7TwppDsFN8JDVQsA84BdlnDwuG0ri2--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?d806b1f6-9f9a-6546-d44f-5b04f3c422a9>