Portage

--------------

TODO

--------------

Features:
* Scheduler: Support parallel-install with merge-wait (bug 256616, bug 925213).

This makes the (future) improvement mentioned in portage-3.0.62's NEWS.

* phase-functions: prematurely delete WORKDIR if FEATURES=merge-wait

The 'merge-wait' feature could lead to running out of disk space on
PORTAGE_TMPDIR's filesystem because many more workdirs were kept around
until merging was queued up. We now purge the workdirs but keep the image
around until merging.

* Start to record REPO_REVISIONS in build-info in VDB (bug 924772).

Ultimately the intention is to expose this information in binhost
metadata so that clients can select consistent revisions of source
repositories.

* util: file_copy: Support btrfs's FICLONE ioctl for fast file clones.

Added when implementing the below 'src: Drop linux_reflink C module.'
cleanup.

* sync: Add new 'zipfile' sync-type.

This allows fetching ebuild repositories via snapshots from e.g. GitHub,
gitweb, cgit.

Bug fixes:
* ctypes: Add workaround for loading libc on musl.

* util: set a timeout for urlopen calls (bug 926221).

* SpawnProcess: Fix noise / warnings caused by set_term_size (bug 923750, bug 925456).

* binpkg, gpkg: Add missing newlines to error messages.

* writable_check: Improve whitespace handling when parsing /proc/self/mountinfo (bug 925888).

* doebuild: Call _setup_locale (bug 925863).

This is needed to more robustly handle invalid or inappropriate locale settings.

* binarytree._populate_remote: Fix UnboundLocalError for binpkg-request-signature (bug 926048).

* elog/mod_custom: Spawn processes in background (bug 925907).

Fixes a noisy crash on exit.

* Fix REQUIRED_USE error with --fetchonly --pretend but not --fetchonly (bug 675748).

* socks5: Fix exit with FEATURES="network-sandbox-proxy" or FEATURES="distcc" (bug 925240).

* meson.build: Install dist-info METADATA (bug 920330).

This is needed for 'pip' to not be confused when Portage is installed system-wide.

* EbuildPhase/EbuildBinpkg: Ensure PKGDIR subdirectory permissions (bug 712222).

A warning (failure) was observed with FEATURES="installsources" otherwise.

* config: Sort FEATURES to avoid non-determinism (bug 914441).

* man: Document autoenabled options by --getbinpkgonly.

* BinpkgPrefetcher: Use eerror for binarytree inject failures (bug 927632).

This improves the readability of the error substantially.

* install-qa-check.d: Remove QA warning when no bash completions are found (bug 928599, bug 928869).

This check had too many false positives.

* lib: use more pure git-describe output for --version (bug 912209).

This makes 'emerge --version' info far nicer when using portage-9999.

* lib: adhere to python package version conventions (bug 926966).

(Note that this needed fixing even before the change for bug 912209).

Cleanups:
* cnf: sets: Migrate golang-rebuild to dev-lang/go (removed from Portage) (bug 919751).

* src: Drop libc C module.

This was only used for `find_library` on musl. We've now implemented
an alternative workaround for this.

* src: Drop linux_reflink C module.

This is now implemented in pure Python, which also means PyPy can
benefit.

Testsuite coverage was also improved for this area.

* Delete compat_coroutine module.

--------------

Bug fixes:
* emerge: Skip installed packages with emptytree in depgraph selection (bug 651018).

* bin/install-qa-check.d: 90gcc-warnings: drop warnings with too many FPs (bug 925460).

* AsyncioEventLoop: Call process.run_exitfuncs() before close (bug 925240).

Fixes hang with FEATURES="network-sandbox-proxy" or FEATURES="distcc".

* SchedulerInterface/PollScheduler: Add _loop property (bug 925333).

Fixes erroneous assert.

* _dynamic_deps_preload: Fix settings reference (bug 925350).

Fix KeyError with --dynamic-deps.

* process.spawn: Fix logic for missing libc.unshare on musl (bug 925311).

Fix handling when we can't unshare where we might e.g. modify the hostname
of the real system on musl.

* dbapi: Fix TypeError when passing Exception to warnings.warn (bug 922935).

Fix testUpdateDbentryDbapiTestCase.

* _start_proc: Prevent premature ForkProcess garbage collection (bug 925456).

Fix warnings/errors like "[ERROR] Task was destroyed but it is pending!".

Cleanups:
* More asyncio porting.

--------------

This release has a lot of misc. bug fixes as well as many asyncio fixes from Zac to
kill off unsafe fork use.

Features:
* cnf: make.conf.example.arc: Add for the arc arch.

* ELF: Add entries for ARC machines

* bintree: Use urllib to parse PORTAGE_BINHOST / sync-uri so IPv6 works (bug 921400).

* FEATURES: Add FEATURES="merge-wait", enabled by default, to control whether
we do parallel merges of images to the live filesystem (bug 663324).

If enabled, we serialize these merges.

For now, this makes FEATURES="parallel-install" a no-op, but in future, it
will be improved to allow parallel merges, just not while any packages are
compiling.

* estrip: Add FEATURES="dedupdebug" (bug 906368).

This uses sys-devel/dwz to deduplicate installed DWARF debug information.

Future improvements may be made for multifile support.

* Support PROPERTIES="test_privileged" to not drop privileges for tests (bug 924585).

Bug fixes:
* vartree: Make _needs_move() resilient to corrupt files on the live filesystem
(do a full copy/replace).

* binpkgs: Handle SignatureException during package moves (bug 922142).

* gpkg, bintree, binpkg: Add missing newlines to signed binpkg update notice.

* emerge: Backtrack consistently regardless of --fetchonly (bug 922038).

* emaint: Cleanup duplicate 'usage:' output.

* installed_dynlibs: Resolve *.so symlinks (bug 921170).

* bin: Consistently prefix eqawarn with 'QA Notice' (bug 728046).

* _overlap_dnf: Deduplicate any-of blocks which improves performance (bug 891137).

* tests: Handle larger PAGE_SIZE in environment size check (bug 923368).

Cleanups:
* tests: Add a job with multiprocessing set to the 'spawn' method.

* tests: Fix missing playground cleanups.

* process.spawn: Add abstraction for os.fork() to allow migrating callers to it.

--------------

A small set of binpkg robustness fixes.

Bug fixes:
* BinpkgFetcher: Preserve mtime (bug 921208).

* bintree: Don't call trust helper unless bindb is writable (bug 915842, bug 920180).

* bintree: Avoid unnecessary build id incrementation (bug 921208).

* bintree: Handle inject failures (bug 921327).

* emaint: merges: Fix TrackingFile for utf8_mode (bug 921181).

--------------

A small set of binpkg robustness fixes.

Bug fixes:
* EbuildBinpkg: Avoid crash with verification failure in some cases (bug 921089).

* dbapi: Raise CorruptionKeyError - which is treated as a warning - during pkgmoves
to avoid falling over in the event of a corrupt Packages index (bug 920828).

* EbuildFetchTestCase: Fix key order assumption (bug 921107).

* gpkg: Fix basename handling via aux_update (in particular with FEATURES="binpkg-multi-instance")
(bug 920828).