Cirrus-CI: add a manual amd64-gcc9 build and smoketest job

Allow users to test changes and find GCC-specific issues using Cirrus-CI
against their own GitHub forks.

Reviewed by: lwhsu, jhb
MFC after

Cirrus-CI: add a manual amd64-gcc9 build and smoketest job

Allow users to test changes and find GCC-specific issues using Cirrus-CI
against their own GitHub forks.

Reviewed by: lwhsu, jhb
MFC after: 1 week
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D34289

(cherry picked from commit 75e44873df2c86b9e15544b496af7040f9f6e0d2)

show more ...

Cirrus-CI: use qemu-nox11

We use -nographic for the smoke test and there is no need to pull in all
of the x11 deps. This saves some time and bandwidth during package
installation.

When I originall

Cirrus-CI: use qemu-nox11

We use -nographic for the smoke test and there is no need to pull in all
of the x11 deps. This saves some time and bandwidth during package
installation.

When I originally added Cirrus-CI support the -nox11 package was not
available.

Sponsored by: The FreeBSD Foundation

(cherry picked from commit e510f97b4814f5ddb8169bf378030a31a99545d9)

show more ...

Cirrus-CI: build with LLVM 13 package

As of 28a41182c08e the base system uses Clang/LLVM 13. Follow along in
Cirrus-CI (which uses a packaged toolchain for speed).

Sponsored by: The FreeBSD Founda

Cirrus-CI: build with LLVM 13 package

As of 28a41182c08e the base system uses Clang/LLVM 13. Follow along in
Cirrus-CI (which uses a packaged toolchain for speed).

Sponsored by: The FreeBSD Foundation

(cherry picked from commit 63f44132810d2b15178503cb738866f6e8533aee)

show more ...

Cirrus-CI: switch to Clang/LLVM 12

dim@ is preparing to import Clang/LLVM 12 into the base system as the
system compiler / toolchain. Apply the same change to the Cirrus-CI
config.

Reviewed by: im

Cirrus-CI: switch to Clang/LLVM 12

dim@ is preparing to import Clang/LLVM 12 into the base system as the
system compiler / toolchain. Apply the same change to the Cirrus-CI
config.

Reviewed by: imp, markj
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D30109

(cherry picked from commit 15c0aaf51703cc102940aa647d623ec8ffbe9259)

show more ...

Cirrus-CI: report pkg version

PR: 257422
(cherry picked from commit a077a4e3b41bb676be1237fb0af78d6814393fe7)

Cirrus-CI: add a manually triggered arm64 task

Reviewed by: imp
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D31953

(cherry picked from commit 8cba2003e85

Cirrus-CI: add a manually triggered arm64 task

Reviewed by: imp
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D31953

(cherry picked from commit 8cba2003e85b49a482ca623945209ca537374229)

show more ...

CI: use amd64 EDK II firmware included with QEMU

QEMU (now) includes a prebuilt EDK II firmare in edk2-x86_64-code.fd.
Use that instead of requring a standalone uefi-edk2-qemu-x86_64 package.

Revie

CI: use amd64 EDK II firmware included with QEMU

QEMU (now) includes a prebuilt EDK II firmare in edk2-x86_64-code.fd.
Use that instead of requring a standalone uefi-edk2-qemu-x86_64 package.

Reviewed by: imp
MFC after: 3 weeks
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D30915

(cherry picked from commit 7d9794b34bcd465a380f05b02ccfea469dd0a48e)

show more ...

Cirrus-CI: reduce VM memory to 8G

Cirrus-CI now provides a task memory use graph, and it is clear we do
not need to provision the VM with 24GB.

Sponsored by: The FreeBSD Foundation

(cherry picked

Cirrus-CI: reduce VM memory to 8G

Cirrus-CI now provides a task memory use graph, and it is clear we do
not need to provision the VM with 24GB.

Sponsored by: The FreeBSD Foundation

(cherry picked from commit bbf70270551d8defb427316e5d0e0f368b9aac96)

show more ...

Cirrus-CI: retry pkg installation on failure

Pkg installation failed somewhat frequently, always at:

[62/104] Fetching jpeg-turbo-2.0.6.txz: .......... done
pkg: http://pkgmir.geo.freebsd.org/FreeB

Cirrus-CI: retry pkg installation on failure

Pkg installation failed somewhat frequently, always at:

[62/104] Fetching jpeg-turbo-2.0.6.txz: .......... done
pkg: http://pkgmir.geo.freebsd.org/FreeBSD:13:amd64/quarterly/All/jbigkit-2.1_1.txz: No route to host

Move pkg installation to a script and retry once upon failure as a
(hopefully temporary) workaround.

Reviewed by: imp
MFC after: 1 week
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D30613

(cherry picked from commit dd41de95a84d979615a2ef11df6850622bf6184e)

show more ...

Cirrus-CI: Add descriptive task name

Previously it appeared only as "main" in places like GitHub's list
of checks run as part of a pull request.

MFC after: 1 week
Sponsored by: The FreeBSD Foundati

Cirrus-CI: Add descriptive task name

Previously it appeared only as "main" in places like GitHub's list
of checks run as part of a pull request.

MFC after: 1 week
Sponsored by: The FreeBSD Foundation

(cherry picked from commit 903526542ac2309c08c769e517ea173a9f67cdb2)

show more ...

Restore Cirrus-CI boot smoke test

This reverts commit a7d593dd1da27833b5384349700bc3c7bcae6aad.
We now use compute_engine_instance which allows us to specify a custom
disk size. Also go back to usi

Restore Cirrus-CI boot smoke test

This reverts commit a7d593dd1da27833b5384349700bc3c7bcae6aad.
We now use compute_engine_instance which allows us to specify a custom
disk size. Also go back to using the default qemu version (rather than
qemu42 or qemu-devel) as any issues were fixed some time ago.

Reviewed by: lwhsu, markj
MFC after: 1 month
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D30082

(cherry picked from commit cec2682cd2910080951782391d7d7cd30c95c4ea)

show more ...

Cirrus-CI: use FreeBSD 13.0 image for base system CI build

We generally want to build and test on the highest release version, and
FreeBSD 13.0 also brings some performance benefits.

Reviewed by: l

Cirrus-CI: use FreeBSD 13.0 image for base system CI build

We generally want to build and test on the highest release version, and
FreeBSD 13.0 also brings some performance benefits.

Reviewed by: lwhsu
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D29842

(cherry picked from commit 407abff2b91847e23711625ad7c69c17e99b3d1d)

show more ...

Cirrus-CI: temporarily avoid qemu smoke test boot

Cirrus-CI has been red for some time because we're running out of disk
space on the ephemeral GCP VMs. For now remove the package + qemu boot,
and

Cirrus-CI: temporarily avoid qemu smoke test boot

Cirrus-CI has been red for some time because we're running out of disk
space on the ephemeral GCP VMs. For now remove the package + qemu boot,
and just check for build regressions.

This change to be reverted once we have identified and addressed the
underlying issue.

Sponsored by: The FreeBSD Foundation

(cherry picked from commit a7d593dd1da27833b5384349700bc3c7bcae6aad)

show more ...

Cirrus-CI: add df/du to track down disk full issues

Cirrus-CI: show mounted filesystems and free space at start

CI runs have been encountering disk full errors. Add a `df` invocation
so that we ca

Cirrus-CI: add df/du to track down disk full issues

Cirrus-CI: show mounted filesystems and free space at start

CI runs have been encountering disk full errors. Add a `df` invocation
so that we can see what we're working with.

(cherry picked from commit af11c2029006b64da41a78f2e2dcc910e13ce07a)

Cirrus-CI: Add more information to help track down disk full issues

Execute df(1) before and after the build (reporting in MiB for
consistency), and du(1) of /usr/obj. Also include the uname.

(cherry picked from commit f2f24008a2b1b3c7a1c4b75e9b9c2d0f08abc27b)

show more ...

Cirrus-CI: remove svn2git remnant

Previously Cirrus was skipped on svn_head to avoid running CI on two
different branches with identical content. With the transition to git
this serves no purpose.

Cirrus-CI: remove svn2git remnant

Previously Cirrus was skipped on svn_head to avoid running CI on two
different branches with identical content. With the transition to git
this serves no purpose.

Reported by: kevans
Sponsored by: The FreeBSD Foundation

(cherry picked from commit f17fc5439f517d06ac8976f53354789cde5a7427)

show more ...

Update vendor/libarchive/dist to 227a4b9719a7fbeba6ba46e377ff7d953f405cd5

Libarchive 3.5.1

Update vendor/libarchive/dist to git 833821f55b1807cac22a63a58b759a7802df2fb7

Libarchive 3.5.0

Relevant vendor changes:
Issue #1258: add archive_read_support_filter_by_code()
PR #1347: mtree di

Update vendor/libarchive/dist to git 833821f55b1807cac22a63a58b759a7802df2fb7

Libarchive 3.5.0

Relevant vendor changes:
Issue #1258: add archive_read_support_filter_by_code()
PR #1347: mtree digest reader support
Issue #1381: skip hardlinks pointing to itself on extraction
PR #1387: fix writing of cpio archives with hardlinks without file type
PR #1388: fix rdev field in cpio format for device nodes
PR #1389: completed support for UTF-8 encoding conversion
PR #1405: more formats in archive_read_support_format_by_code()
PR #1408: fix uninitialized size in rar5_read_data
PR #1409: system extended attribute support
PR #1435: support for decompression of symbolic links in zipx archives
Issue #1456: memory leak after unsuccessful archive_write_open_filename

show more ...

CI: switch to qemu42 package

It appears that booting FreeBSD from qemu's synthesized FAT filesystem
broke somehow in a recent qemu-devel update. qemu42 works so switch to
it for now.

Speed up Cirrus CI by using CROSS_TOOLCHAIN

Installing the llvm11 package instead of bootstrapping it from the source
tree reduces the build time by about 20 minutes.

The last freebsd/freebsd build

Speed up Cirrus CI by using CROSS_TOOLCHAIN

Installing the llvm11 package instead of bootstrapping it from the source
tree reduces the build time by about 20 minutes.

The last freebsd/freebsd build that was tested (r366629) took 1h 21m 22s,
whereas my GitHub fork with this .cirrus.yml took 58m 6s.
We could probably further reduce time by using images that have LLVM
pre-installed: the pkg install step took 4 minutes 30s.

Since the bootstrap toolchain is still tested by Jenkins, this should not
reduce test coverage of the CI testing.

Reviewed By: emaste
Differential Revision: https://reviews.freebsd.org/D26747

show more ...

Cirrus-CI: skip svn_head branch

svn_head has the same content as the master or main branch (it's just
the result of a `git svn` conversion instead of svn2git).

Sponsored by: The FreeBSD Foundation

Cirrus-CI: build as an unprivileged user

The Cirrus-CI-provided working tree is owned by root. Leave that as is
for simplicity but build as an unprivileged user; this tests building
with an unmodif

Cirrus-CI: build as an unprivileged user

The Cirrus-CI-provided working tree is owned by root. Leave that as is
for simplicity but build as an unprivileged user; this tests building
with an unmodifiable source tree as a side effect.

Continue running the smoke test as root for now, as it failed when run
as an unprivileged user - pkg reported "Fail to chmod
/usr/bin/.pkgtemp.lpq.dUHpEqPGJ9pq:Operation not permitted"

Sponsored by: The FreeBSD Foundation

show more ...

Update vendor/libarchive/dist to git 85b9f665b6a2d4397fdd38992152d011265e374b

Relevant vendor changes:
Issue #1257: Add testcase for ZIPX files with LZMA_STREAM_END marker
PR #1331: cpio.5: fix

Update vendor/libarchive/dist to git 85b9f665b6a2d4397fdd38992152d011265e374b

Relevant vendor changes:
Issue #1257: Add testcase for ZIPX files with LZMA_STREAM_END marker
PR #1331: cpio.5: fix hard link description
Issue #1335: archive_read.c: fix UBSan warning about undefined behavior
Issue #1338: XAR reader: fix UBSan warning about undefined behavior
Issue #1339: bsdcpio_test: fix datatype in from_hex()
Issue #1341: Safe writes: delete temporary file if rename fails

show more ...

Cirrus-CI: increase timeout to 120m

For some reason build+package+test time went from about 1h10 to over
1h30 (killed due to timeout prior to completion).

The reason for the increase still needs in

Cirrus-CI: increase timeout to 120m

For some reason build+package+test time went from about 1h10 to over
1h30 (killed due to timeout prior to completion).

The reason for the increase still needs investigation.

show more ...

Cirrus-CI: add `make packages` to CI test

Now that we can override the format to avoid the time spent compressing
pkgbase packages we can test `make packages` with only 5 minutes or so
added to the

Cirrus-CI: add `make packages` to CI test

Now that we can override the format to avoid the time spent compressing
pkgbase packages we can test `make packages` with only 5 minutes or so
added to the CI cycle time.

A future change should switch the CI smoke test to using these packages.

Sponsored by: The FreeBSD Foundation

show more ...

Cirrus-CI: bump VM image to FreeBSD 12.1

12.0 will be EOL.

Sponsored by: The FreeBSD Foundation