Ros-buildfarm

------------------

* Improvements

* Add support for EmPy v4 (`1086 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1086>`_) (`#1087 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1087>`_) (`#1089 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1089>`_) (`#1088 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1088>`_) (`#1090 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1090>`_)
* Add pytest 'linter' mark to other linter tests (`1083 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1083>`_)
* Initial customization for reprepro-updater (`1080 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1080>`_)

* Changes

* Deprecate 'options' argument to 'expand_template' (`1085 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1085>`_)
* 24.04 compatibility (`1084 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1084>`_)

------------------

* New features

* Add !relative_url YAML constructor (`1057 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1057>`_)
* Add per-package configuration for release binary job weight (`1063 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1063>`_)
* Add support for custom_rosdep_urls in build files (`1055 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1055>`_)
* Add support for distro-independent CI jobs on Jenkins (`1056 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1056>`_)
* Set up Bazel single-threaded compilation limit. (`1016 <https://github.com/ros-infrastructure/pull/1016>`_)
* Use createrepo-agent for RPMs. (`976 <https://github.com/ros-infrastructure/ros_buildfarm/pull/976>`_)
* Add 'list_priorities.py' helper script (`975 <https://github.com/ros-infrastructure/ros_buildfarm/pull/975>`_)
* Add support for publishing CI archives to the repo host (`932 <https://github.com/ros-infrastructure/ros_buildfarm/pull/932>`_)
* Add a validation script for buildfarm configuration (`913 <https://github.com/ros-infrastructure/ros_buildfarm/pull/913>`_)
* Add in the capability for a sync package percent. (`896 <https://github.com/ros-infrastructure/ros_buildfarm/pull/896>`_)
* Add rosdoc2 support to generate_doc_maintenance_jobs.py (`916 <https://github.com/ros-infrastructure/ros_buildfarm/pull/916>`_)
* Add configurations for omitting package testing (`903 <https://github.com/ros-infrastructure/ros_buildfarm/pull/903>`_)
* Implement rosdoc2 documentation job type. (`880 <https://github.com/ros-infrastructure/ros_buildfarm/pull/880>`_)
* Add a tool to audit a rosdistro and all it's buildfiles for missing dependencies. (`815 <https://github.com/ros-infrastructure/ros_buildfarm/pull/815>`_)
* Add RPM import_upstream job (`779 <https://github.com/ros-infrastructure/ros_buildfarm/pull/779>`_)
* Support for building RPM packages (`713 <https://github.com/ros-infrastructure/ros_buildfarm/pull/713>`_) (`#726 <https://github.com/ros-infrastructure/ros_buildfarm/pull/726>`_) (`#727 <https://github.com/ros-infrastructure/ros_buildfarm/pull/727>`_) (`#729 <https://github.com/ros-infrastructure/ros_buildfarm/pull/729>`_) (`#731 <https://github.com/ros-infrastructure/ros_buildfarm/pull/731>`_) (`#721 <https://github.com/ros-infrastructure/ros_buildfarm/pull/721>`_) (`#730 <https://github.com/ros-infrastructure/ros_buildfarm/pull/730>`_) (`#732 <https://github.com/ros-infrastructure/ros_buildfarm/pull/732>`_) (`#733 <https://github.com/ros-infrastructure/ros_buildfarm/pull/733>`_) (`#735 <https://github.com/ros-infrastructure/ros_buildfarm/pull/735>`_) (`#745 <https://github.com/ros-infrastructure/ros_buildfarm/pull/745>`_) (`#756 <https://github.com/ros-infrastructure/ros_buildfarm/pull/756>`_) (`#757 <https://github.com/ros-infrastructure/ros_buildfarm/pull/757>`_)
* GPU support for build files (`624 <https://github.com/ros-infrastructure/ros_buildfarm/pull/624>`_)
* Implement the abichecker run on devel builds (`681 <https://github.com/ros-infrastructure/ros_buildfarm/pull/681>`_)
* Add scripts to build blocked source entries page (`674 <https://github.com/ros-infrastructure/ros_buildfarm/pull/674>`_)

* Improvements

* Convert to subprocess model for flake8 test (`1075 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1075>`_)
* Make apt work with unsigned repositories (`1070 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1070>`_)
* Add flags to separate generate_release_script parts (`1066 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1066>`_)
* Delete any existing UID user in Dockerfile (`1061 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1061>`_)
* Support unsigned apt repositories (`947 <https://github.com/ros-infrastructure/ros_buildfarm/pull/947>`_)
* Switch to rosdistro.get_package_condition_context API (`1065 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1065>`_)
* Add logic for excluding group workaround dependencies (`1040 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1040>`_)
* Add new seccomp warning text to ignore pattern. (`1050 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1050>`_)
* Use tar and ssh to publish package metadata files. (`1049 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1049>`_)
* Clean up any dangling cidfiles (Container ID files) in workspace. (`1047 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1047>`_)
* Avoid jenkinsapi trying to fetch all jobs. (`1045 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1045>`_)
* Make sure to call generate_doc_maintenance_jobs.py for rosdoc2. (`1043 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1043>`_)
* Set PODMAN_USERNS=keep-id when invoking 'docker run' (`1032 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1032>`_) (`#1069 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1069>`_)
* Use environment to configure breaking system packages. (`1036 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1036>`_)
* Handle RPM \*-SPECPARTS build subdirectory (`1033 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1033>`_)
* Read virtual packages from deb/RPM repositories (`1022 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1022>`_)
* Display CPU information in build log. (`1010 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1010>`_)
* Handle virtual deb packages when querying apt cache (`1023 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1023>`_)
* Call dpkg-buildpackage directly instead of apt-src (`986 <https://github.com/ros-infrastructure/ros_buildfarm/pull/986>`_)
* Enable CRB in RHEL containers (`991 <https://github.com/ros-infrastructure/ros_buildfarm/pull/991>`_)
* Stop considering disabled packages to be regressions (`984 <https://github.com/ros-infrastructure/ros_buildfarm/pull/984>`_)
* Add support for group dependencies in release jobs (`980 <https://github.com/ros-infrastructure/ros_buildfarm/pull/980>`_)
* Add support for bare file paths in index URL (`974 <https://github.com/ros-infrastructure/ros_buildfarm/pull/974>`_)
* Opt-out of Phased Updates in apt in CI jobs (`969 <https://github.com/ros-infrastructure/ros_buildfarm/pull/969>`_)
* Create checksum files with CI archives (`956 <https://github.com/ros-infrastructure/ros_buildfarm/pull/956>`_)
* Only install workspace package in ROS 2 devel jobs not CI jobs. (`955 <https://github.com/ros-infrastructure/ros_buildfarm/pull/955>`_)
* Mark CI jobs unstable based on static analysis (`953 <https://github.com/ros-infrastructure/ros_buildfarm/pull/953>`_)
* Disable jobs downstream of packages with nulled release versions (`951 <https://github.com/ros-infrastructure/ros_buildfarm/pull/951>`_)
* Add rosdoc2 job to CI workflow. (`949 <https://github.com/ros-infrastructure/ros_buildfarm/pull/949>`_)
* Teach CI jobs to pull released packages from rosdistro (`944 <https://github.com/ros-infrastructure/ros_buildfarm/pull/944>`_)
* Switch from hacky dist_suffix to release_suffix in RPMs (`939 <https://github.com/ros-infrastructure/ros_buildfarm/pull/939>`_)
* Parse deb dependency exclusions and support nocheck (`919 <https://github.com/ros-infrastructure/ros_buildfarm/pull/919>`_)
* Also set DEB_BUILD_PROFILES when skipping tests (`918 <https://github.com/ros-infrastructure/ros_buildfarm/pull/918>`_)
* Test ROS 2 release jobs in CI (`866 <https://github.com/ros-infrastructure/ros_buildfarm/pull/866>`_)
* Clean up old directory structure that was a reference to an unused repo. (`881 <https://github.com/ros-infrastructure/ros_buildfarm/pull/881>`_)
* Add a clang-tidy warning publisher. (`897 <https://github.com/ros-infrastructure/ros_buildfarm/pull/897>`_)
* Add non-Debian/Ubuntu repos to upload jobs (`869 <https://github.com/ros-infrastructure/ros_buildfarm/pull/869>`_)
* Abort release builds if already re-queued (`864 <https://github.com/ros-infrastructure/ros_buildfarm/pull/864>`_)
* Fix a flake8 suppression. (`865 <https://github.com/ros-infrastructure/ros_buildfarm/pull/865>`_)
* Add mechanism to 'ignore' packages (`858 <https://github.com/ros-infrastructure/ros_buildfarm/pull/858>`_)
* Clean up repositories directory after successful doc job (`849 <https://github.com/ros-infrastructure/ros_buildfarm/pull/849>`_)
* Make the doc_independent_docker_build a little more generic. (`846 <https://github.com/ros-infrastructure/ros_buildfarm/pull/846>`_)
* Make the shared ccache optional (`844 <https://github.com/ros-infrastructure/ros_buildfarm/pull/844>`_)
* Add support for the Jenkins Heavy Job plugin (`839 <https://github.com/ros-infrastructure/ros_buildfarm/pull/839>`_)
* Add support for the Jenkins Benchmark plugin (`835 <https://github.com/ros-infrastructure/ros_buildfarm/pull/835>`_)
* Support custom !include directive in config files (`834 <https://github.com/ros-infrastructure/ros_buildfarm/pull/834>`_)
* Only use xUnit type JUnit for \*.xunit.xml results if pytest compliant (`831 <https://github.com/ros-infrastructure/ros_buildfarm/pull/831>`_)
* Add --dry-run argument to generate_devel_job.py (`833 <https://github.com/ros-infrastructure/ros_buildfarm/pull/833>`_)
* Disable automatic out-of-source CMake builds in RPMs (`830 <https://github.com/ros-infrastructure/ros_buildfarm/pull/830>`_)
* Enable RPM debug packages (`829 <https://github.com/ros-infrastructure/ros_buildfarm/pull/829>`_)
* Use distinct xunit pattern for ROS 2 (`828 <https://github.com/ros-infrastructure/ros_buildfarm/pull/828>`_)
* Show additional context on Jenkins job diffs. (`827 <https://github.com/ros-infrastructure/ros_buildfarm/pull/827>`_)
* Add Fedora to repos status page platform list (`825 <https://github.com/ros-infrastructure/ros_buildfarm/pull/825>`_)
* install pytest-rerunfailures for colcon --retest-until-pass (`824 <https://github.com/ros-infrastructure/ros_buildfarm/pull/824>`_)
* Add build_tool_args and build_tool_test_args to devel jobs (`796 <https://github.com/ros-infrastructure/ros_buildfarm/pull/796>`_)
* Use package manager configuration in mock config (`810 <https://github.com/ros-infrastructure/ros_buildfarm/pull/810>`_)
* clarify docs for custom distribution files and tags (`803 <https://github.com/ros-infrastructure/ros_buildfarm/pull/803>`_)
* Make docker container names unique for status pages. (`800 <https://github.com/ros-infrastructure/ros_buildfarm/pull/800>`_)
* Allow status page jobs to run on any agent. (`799 <https://github.com/ros-infrastructure/ros_buildfarm/pull/799>`_)
* Avoid peak loads for status page jobs. (`801 <https://github.com/ros-infrastructure/ros_buildfarm/pull/801>`_)
* only show failed test numbers in chart (`798 <https://github.com/ros-infrastructure/ros_buildfarm/pull/798>`_)
* Add build_tool_test_args parameter to CI jobs (`793 <https://github.com/ros-infrastructure/ros_buildfarm/pull/793>`_)
* Enable package selection at build time in CI (`791 <https://github.com/ros-infrastructure/ros_buildfarm/pull/791>`_)
* Support --build-tool-args in generate_ci_script.py (`792 <https://github.com/ros-infrastructure/ros_buildfarm/pull/792>`_)
* Allow file:// URLs to repos files in CI jobs (`794 <https://github.com/ros-infrastructure/ros_buildfarm/pull/794>`_)
* Add support to archive arbitrary artifacts in CI jobs. (`784 <https://github.com/ros-infrastructure/ros_buildfarm/pull/784>`_)
* Introduce a PlatformPackageDescriptor object (`785 <https://github.com/ros-infrastructure/ros_buildfarm/pull/785>`_)
* Refactor get_package_repo_data out of common (`783 <https://github.com/ros-infrastructure/ros_buildfarm/pull/783>`_)
* Add '$distname' resolution to RPM URLs (`782 <https://github.com/ros-infrastructure/ros_buildfarm/pull/782>`_)
* Update repository status page to support RPM (`781 <https://github.com/ros-infrastructure/ros_buildfarm/pull/781>`_)
* Never skip ros_buildfarm RPM repositories (`780 <https://github.com/ros-infrastructure/ros_buildfarm/pull/780>`_)
* Sort CI job plot groups in Jenkins job XML (`773 <https://github.com/ros-infrastructure/ros_buildfarm/pull/773>`_)
* Add sync-to-main job for RPM repos (`771 <https://github.com/ros-infrastructure/ros_buildfarm/pull/771>`_)
* Use directory arguments on deb job scripts for decoupling (`769 <https://github.com/ros-infrastructure/ros_buildfarm/pull/769>`_)
* Process conditional dependencies in release jobs (`758 <https://github.com/ros-infrastructure/ros_buildfarm/pull/758>`_)
* Unify approach to computing package conditional context (`761 <https://github.com/ros-infrastructure/ros_buildfarm/pull/761>`_)
* Change --env-vars to parse as a dict (`760 <https://github.com/ros-infrastructure/ros_buildfarm/pull/760>`_)
* Mark implicitly excluded packages in status pages. (`752 <https://github.com/ros-infrastructure/ros_buildfarm/pull/752>`_)
* Include filtered packages in status pages (`750 <https://github.com/ros-infrastructure/ros_buildfarm/pull/750>`_)
* Call out the buildname for easier debugging (`749 <https://github.com/ros-infrastructure/ros_buildfarm/pull/749>`_)
* Reduce uniqueness of docker images to prevent continuous aggregation (`748 <https://github.com/ros-infrastructure/ros_buildfarm/pull/748>`_)
* Add per-project authorization for CI builds (`737 <https://github.com/ros-infrastructure/ros_buildfarm/pull/737>`_)
* Add --dry-run option to generate_release_job (`720 <https://github.com/ros-infrastructure/ros_buildfarm/pull/720>`_)
* Add support for Jenkins credential binding plugin (`716 <https://github.com/ros-infrastructure/ros_buildfarm/pull/716>`_)
* Add support for param files in Jenkins trigger plugin (`714 <https://github.com/ros-infrastructure/ros_buildfarm/pull/714>`_)
* Update subprocess_reaper.py to work with psutil 3.x to 5.x. (`718 <https://github.com/ros-infrastructure/ros_buildfarm/pull/718>`_)
* Refactor and abstract debian repo data caching (`707 <https://github.com/ros-infrastructure/ros_buildfarm/pull/707>`_)
* Use yaml.safe_load (`708 <https://github.com/ros-infrastructure/ros_buildfarm/pull/708>`_)
* Replace debian-specific concepts with something more platform-neutral (`705 <https://github.com/ros-infrastructure/ros_buildfarm/pull/705>`_) (`#711 <https://github.com/ros-infrastructure/ros_buildfarm/pull/711>`_) (`#712 <https://github.com/ros-infrastructure/ros_buildfarm/pull/712>`_) (`#717 <https://github.com/ros-infrastructure/ros_buildfarm/pull/717>`_)
* Update OS code name mapping (`699 <https://github.com/ros-infrastructure/ros_buildfarm/pull/699>`_) (`#700 <https://github.com/ros-infrastructure/ros_buildfarm/pull/700>`_) (`#704 <https://github.com/ros-infrastructure/ros_buildfarm/pull/704>`_)
* Add post test plots for performance test (`689 <https://github.com/ros-infrastructure/ros_buildfarm/pull/689>`_) (`#740 <https://github.com/ros-infrastructure/ros_buildfarm/pull/740>`_)
* add rosdep_update_options (`684 <https://github.com/ros-infrastructure/ros_buildfarm/pull/684>`_)
* Add CI option to display generated images on build summary (`680 <https://github.com/ros-infrastructure/ros_buildfarm/pull/680>`_)
* vertical align cells in blocked status pages (`679 <https://github.com/ros-infrastructure/ros_buildfarm/pull/679>`_)
* Support any number of layered workspaces (`670 <https://github.com/ros-infrastructure/ros_buildfarm/pull/670>`_)
* add option to configure CI jobs using repository names from rosdistro (`661 <https://github.com/ros-infrastructure/ros_buildfarm/pull/661>`_)
* Add CI config 'jenkins_job_upstream_trigger' (`664 <https://github.com/ros-infrastructure/ros_buildfarm/pull/664>`_)
* Add --dry-run option to generate_ci_job (`663 <https://github.com/ros-infrastructure/ros_buildfarm/pull/663>`_

* Changes

* Align stdeb dependencies with setup.py (`1073 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1073>`_)
* Update version string as it's not compatible after setuptools 66+ (`1018 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1018>`_)
* Update target platform list for making debs (`1068 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1068>`_)
* Use 'host' network in deb container builds (`1071 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1071>`_)
* Drop support for Python 2 (`1067 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1067>`_)
* Stop testing Python 3.5 support. (`1048 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1048>`_)
* Drop support for CentOS/RHEL 7 (`1034 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1034>`_)
* Add os code name mapping for Ubuntu Noble (`1017 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1017>`_)
* Convert Bionic CI jobs to run on Focal (`996 <https://github.com/ros-infrastructure/ros_buildfarm/pull/996>`_)
* Target RHEL 9 in CI (`995 <https://github.com/ros-infrastructure/ros_buildfarm/pull/995>`_)
* Increase the default timeout for Jenkins connections (`981 <https://github.com/ros-infrastructure/ros_buildfarm/pull/981>`_)
* Move all scripts into the Python package
* Explicitly state no compatibility with flake8 >= 5.0.0 (`970 <https://github.com/ros-infrastructure/ros_buildfarm/pull/970>`_)
* Declare test dependencies in [test] extra (`967 <https://github.com/ros-infrastructure/ros_buildfarm/pull/967>`_)
* List 'ROS Infrastructure Team' as the package maintainer (`952 <https://github.com/ros-infrastructure/ros_buildfarm/pull/952>`_)
* Unify approach to using 'logging' module (`945 <https://github.com/ros-infrastructure/ros_buildfarm/pull/945>`_)
* Add os code name mapping for Ubuntu Jammy and Debian Bullseye. (`942 <https://github.com/ros-infrastructure/ros_buildfarm/pull/942>`_)
* Update label expression for jobs running on Jenkins built-in agent. (`934 <https://github.com/ros-infrastructure/ros_buildfarm/pull/934>`_)
* Run status jobs in Focal containers rather than Xenial. (`885 <https://github.com/ros-infrastructure/ros_buildfarm/pull/885>`_)
* Un-normalize some test dependency package names (`924 <https://github.com/ros-infrastructure/ros_buildfarm/pull/924>`_)
* Switch from CentOS 8 to AlmaLinux for RHEL jobs (`929 <https://github.com/ros-infrastructure/ros_buildfarm/pull/929>`_)
* Add CI action for reconfiguring release jobs (`912 <https://github.com/ros-infrastructure/ros_buildfarm/pull/912>`_)
* add graphviz as a dependency necessary for sphinx in rosdoc_lite
* Update base container images for release-related jobs. (`886 <https://github.com/ros-infrastructure/ros_buildfarm/pull/886>`_)
* Run devel and ci task jobs in Focal containers. (`906 <https://github.com/ros-infrastructure/ros_buildfarm/pull/906>`_)
* Update container image base for doc-related container templates. (`884 <https://github.com/ros-infrastructure/ros_buildfarm/pull/884>`_)
* Drop portlet IDs from dashboard views (`873 <https://github.com/ros-infrastructure/ros_buildfarm/pull/873>`_)
* Update xunit plugin version in template. (`872 <https://github.com/ros-infrastructure/ros_buildfarm/pull/872>`_)
* Update plugin versions in all templates. (`874 <https://github.com/ros-infrastructure/ros_buildfarm/pull/874>`_)
* Update version of dashboard-view plugin. (`883 <https://github.com/ros-infrastructure/ros_buildfarm/pull/883>`_)
* Update the groovy-extract-warnings script. (`887 <https://github.com/ros-infrastructure/ros_buildfarm/pull/887>`_)
* Switch from Travis CI to GitHub Actions (`857 <https://github.com/ros-infrastructure/ros_buildfarm/pull/857>`_)
* Update credentials_binding plugin version (`861 <https://github.com/ros-infrastructure/ros_buildfarm/pull/861>`_)
* Drop superfluous mentions of 'CentOS' (`850 <https://github.com/ros-infrastructure/ros_buildfarm/pull/850>`_)
* Remove references to EOL distro Eloquent. (`852 <https://github.com/ros-infrastructure/ros_buildfarm/pull/852>`_)
* Update mailer to 1.32.1. (`851 <https://github.com/ros-infrastructure/ros_buildfarm/pull/851>`_)
* Set junit_family=xunit2 for pytest results in Foxy and older distros (`836 <https://github.com/ros-infrastructure/ros_buildfarm/pull/836>`_)
* Update Jenkins plugin versions used by ros_buildfarm. (`826 <https://github.com/ros-infrastructure/ros_buildfarm/pull/826>`_)
* Add Suite3 and Python2-Depends-Name configuration for stdeb releases. (`816 <https://github.com/ros-infrastructure/ros_buildfarm/pull/816>`_)
* Re-add flake8_docstrings, add flake8_class_newline (`795 <https://github.com/ros-infrastructure/ros_buildfarm/pull/795>`_)
* Update Jenkins script-security plugin. (`742 <https://github.com/ros-infrastructure/ros_buildfarm/pull/742>`_)
* Update Jenkins xunit plugin. (`744 <https://github.com/ros-infrastructure/ros_buildfarm/pull/744>`_)
* Update Jenkins subversion plugin. (`741 <https://github.com/ros-infrastructure/ros_buildfarm/pull/741>`_)
* Replace Warnings plugin with Warnings-ng (`743 <https://github.com/ros-infrastructure/ros_buildfarm/pull/743>`_)
* use Python 3 / pip3 to install Python dependencies in doc jobs (`772 <https://github.com/ros-infrastructure/ros_buildfarm/pull/772>`_)
* Update plugin versions (`660 <https://github.com/ros-infrastructure/ros_buildfarm/pull/660>`_) (`#683 <https://github.com/ros-infrastructure/ros_buildfarm/pull/683>`_) (`#698 <https://github.com/ros-infrastructure/ros_buildfarm/pull/698>`_)
* Don't override MAKEFLAGS blindly (`645 <https://github.com/ros-infrastructure/ros_buildfarm/pull/645>`_)
* Update GPG key and move to supported platform for CI builds (`641 <https://github.com/ros-infrastructure/ros_buildfarm/pull/641>`_)

* Fixes

* Plumb 'build_environment_variables' into doc jobs (`1079 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1079>`_)
* Fix permissions on mock config copied into container (`1072 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1072>`_)
* Restore PM-specific option specification in mock config (`1074 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1074>`_)
* Install ca-certificates before processing repository keys (`1062 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1062>`_)
* Switch from 'include_package_data' to 'package_data' (`1039 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1039>`_)
* Use raw strings when specifying regular expressions (`1038 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1038>`_)
* Fix binarydeb permission cleanup script. (`1025 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1025>`_)
* Set a sane HOME for binarypkg jobs. (`1013 <https://github.com/ros-infrastructure/ros_buildfarm/pull/1013>`_)
* Fix handling of 'None' group members (`990 <https://github.com/ros-infrastructure/ros_buildfarm/pull/990>`_)
* Fix page percent division by zero (`960 <https://github.com/ros-infrastructure/ros_buildfarm/pull/960>`_)
* Fix double minus sign on timezone (`935 <https://github.com/ros-infrastructure/ros_buildfarm/pull/935>`_)
* Set trigger_timer from build file if unset. (`922 <https://github.com/ros-infrastructure/ros_buildfarm/pull/922>`_)
* Don't configure CI maintenance job more than once (`941 <https://github.com/ros-infrastructure/ros_buildfarm/pull/941>`_)
* Make python3 interpreter replacement in scripts stricter (`925 <https://github.com/ros-infrastructure/ros_buildfarm/pull/925>`_)
* Use prerequisite repos in sync job container (`888 <https://github.com/ros-infrastructure/ros_buildfarm/pull/888>`_)
* Fix a few minor issues in the doc_independent_docker_job. (`854 <https://github.com/ros-infrastructure/ros_buildfarm/pull/854>`_)
* Run c_rehash to work around openssl rehash issue on focal/armhf. (`848 <https://github.com/ros-infrastructure/ros_buildfarm/pull/848>`_)
* Run upload jobs after import_upstream. (`843 <https://github.com/ros-infrastructure/ros_buildfarm/pull/843>`_)
* Use python3 when invoking reprepro-updater (`842 <https://github.com/ros-infrastructure/ros_buildfarm/pull/842>`_)
* Handle 'None' job weight configuration (`840 <https://github.com/ros-infrastructure/ros_buildfarm/pull/840>`_)
* Fix the Jenkins job authorization snippet order (`837 <https://github.com/ros-infrastructure/ros_buildfarm/pull/837>`_)
* Fix the indentation for the warnings job snippet (`838 <https://github.com/ros-infrastructure/ros_buildfarm/pull/838>`_)
* Ensure RPM mock macros start with % character (`823 <https://github.com/ros-infrastructure/ros_buildfarm/pull/823>`_)
* Update importlib-metadata for Python 3.6 prerelease jobs (`822 <https://github.com/ros-infrastructure/ros_buildfarm/pull/822>`_)
* Don't consider source package name if not provided (`788 <https://github.com/ros-infrastructure/ros_buildfarm/pull/788>`_)
* Don't show subpackage source packages as missing (`787 <https://github.com/ros-infrastructure/ros_buildfarm/pull/787>`_)
* Don't tell apt which versions of debian packages to install (`775 <https://github.com/ros-infrastructure/ros_buildfarm/pull/775>`_)
* Resolve group membership and use in topological ordering (`767 <https://github.com/ros-infrastructure/ros_buildfarm/pull/767>`_)
* add missing jenkinsapi dependency (`754 <https://github.com/ros-infrastructure/ros_buildfarm/pull/754>`_)
* Install rosdoc_lite deps based on python version (`751 <https://github.com/ros-infrastructure/ros_buildfarm/pull/751>`_)
* Do not reuse cid files (`753 <https://github.com/ros-infrastructure/ros_buildfarm/pull/753>`_)
* Don't inject ros_workspace dep when there is no ros_workspace (`722 <https://github.com/ros-infrastructure/ros_buildfarm/pull/722>`_)
* Front-load manifest parsing and ros_workspace dep injection (`719 <https://github.com/ros-infrastructure/ros_buildfarm/pull/719>`_)
* Escape $ in repo URLs and strip() the GPG keys (`715 <https://github.com/ros-infrastructure/ros_buildfarm/pull/715>`_)
* create '/$HOME/.ccache' as a user before mounting it (`696 <https://github.com/ros-infrastructure/ros_buildfarm/pull/696>`_)
* Always update apt cache for CI dependency enumeration (`691 <https://github.com/ros-infrastructure/ros_buildfarm/pull/691>`_)
* inject downstream job dependencies for ros_workspace (`690 <https://github.com/ros-infrastructure/ros_buildfarm/pull/690>`_)
* Ensure repos file names don't collide (`688 <https://github.com/ros-infrastructure/ros_buildfarm/pull/688>`_)
* work around ros_version not being available in the scope of list comprehension (`675 <https://github.com/ros-infrastructure/ros_buildfarm/pull/675>`_)
* Always update ccache symlinks in devel jobs. (`671 <https://github.com/ros-infrastructure/ros_buildfarm/pull/671>`_)
* evaluate dependency conditions in doc jobs (`668 <https://github.com/ros-infrastructure/ros_buildfarm/pull/668>`_)
* make order of build env vars deterministic (`667 <https://github.com/ros-infrastructure/ros_buildfarm/pull/667>`_)
* workarounds to get the Noetic CI jobs using Python 3 to turn over (`666 <https://github.com/ros-infrastructure/ros_buildfarm/pull/666>`_)
* fix checking evaluate conditions in CI jobs (`662 <https://github.com/ros-infrastructure/ros_buildfarm/pull/662>`_)
* install colcon-metadata to get metadata from colcon.pkg files (`659 <https://github.com/ros-infrastructure/ros_buildfarm/pull/659>`_)
* add -l to workaround hanging docker build when uid is large (`656 <https://github.com/ros-infrastructure/ros_buildfarm/pull/656>`_)
* Prevent colcon from crawling the catkin results (`655 <https://github.com/ros-infrastructure/ros_buildfarm/pull/655>`_)
* Fix CI job generation when called from generate_all_jobs (`653 <https://github.com/ros-infrastructure/ros_buildfarm/pull/653>`_)
* Fix extra build tool arguments when testing with colcon (`650 <https://github.com/ros-infrastructure/ros_buildfarm/pull/650>`_)
* Manually inspect colcon index to find CI underlay packages (`648 <https://github.com/ros-infrastructure/ros_buildfarm/pull/648>`_)
* allow 'vcs export --exact' to fail when merging a branch (`647 <https://github.com/ros-infrastructure/ros_buildfarm/pull/647>`_)
* set git user email and name for 'git merge' to work (`646 <https://github.com/ros-infrastructure/ros_buildfarm/pull/646>`_)
* Fix CI build detection of non-ROS packages (`642 <https://github.com/ros-infrastructure/ros_buildfarm/pull/642>`_)

------------------
This new major version requires a post-JEP-200 Jenkins version (see `587 <https://github.com/ros-infrastructure/ros_buildfarm/pull/587>`_) and therefore the provisioned machine to be updated (`buildfarm_deployment#207 <https://github.com/ros-infrastructure/buildfarm_deployment/pull/207>`_).

* New features

* support colcon build tool using a configuration option (`585 <https://github.com/ros-infrastructure/ros_buildfarm/pull/585>`_, `#589 <https://github.com/ros-infrastructure/ros_buildfarm/pull/589>`_, `#591 <https://github.com/ros-infrastructure/ros_buildfarm/pull/591>`_)
* add CI jobs for building and testing workspaces defined in a .repos file (`590 <https://github.com/ros-infrastructure/ros_buildfarm/pull/590>`_, `#607 <https://github.com/ros-infrastructure/ros_buildfarm/pull/607>`_, `#610 <https://github.com/ros-infrastructure/ros_buildfarm/pull/610>`_, `#623 <https://github.com/ros-infrastructure/ros_buildfarm/pull/623>`_, `#628 <https://github.com/ros-infrastructure/ros_buildfarm/pull/628>`_, `#629 <https://github.com/ros-infrastructure/ros_buildfarm/pull/629>`_, `#630 <https://github.com/ros-infrastructure/ros_buildfarm/pull/630>`_, `#632 <https://github.com/ros-infrastructure/ros_buildfarm/pull/632>`_, `#633 <https://github.com/ros-infrastructure/ros_buildfarm/pull/633>`_, `#636 <https://github.com/ros-infrastructure/ros_buildfarm/pull/636>`_)

* Improvements

* evaluate conditions in manifests (`621 <https://github.com/ros-infrastructure/ros_buildfarm/pull/621>`_, `#634 <https://github.com/ros-infrastructure/ros_buildfarm/pull/634>`_)
* support for a docker_build type of doc_independent build (`576 <https://github.com/ros-infrastructure/ros_buildfarm/pull/576>`_, `#619 <https://github.com/ros-infrastructure/ros_buildfarm/pull/619>`_)
* add options to configure apt/pip package dependencies for the independent doc job in the build file (`618 <https://github.com/ros-infrastructure/ros_buildfarm/pull/618>`_)
* [prerelease] add ability to generate repos files for faster cloning (rebased) (`600 <https://github.com/ros-infrastructure/ros_buildfarm/pull/600>`_)
* only consider same type distros when looking for previous distro (`593 <https://github.com/ros-infrastructure/ros_buildfarm/pull/593>`_)
* share ccache between docker builds (`580 <https://github.com/ros-infrastructure/ros_buildfarm/pull/580>`_)
* allow searching by email on status pages (`561 <https://github.com/ros-infrastructure/ros_buildfarm/pull/561>`_)
* set build environment variables from build files (`554 <https://github.com/ros-infrastructure/ros_buildfarm/pull/554>`_, `#558 <https://github.com/ros-infrastructure/ros_buildfarm/pull/558>`_)
* add devel job test statistics collation (`541 <https://github.com/ros-infrastructure/ros_buildfarm/pull/541>`_)

* Changes

* add all Ubuntu EOL distros back to boxturtle to old release template (`637 <https://github.com/ros-infrastructure/ros_buildfarm/pull/637>`_)
* fetch artful from old-releases (`569 <https://github.com/ros-infrastructure/ros_buildfarm/pull/569>`_)
* bump tests to use latest ROS releases (`613 <https://github.com/ros-infrastructure/ros_buildfarm/pull/613>`_)
* support expression of dependencies via install list file (`612 <https://github.com/ros-infrastructure/ros_buildfarm/pull/612>`_)
* also test with Python 3.5 and 3.6 (`570 <https://github.com/ros-infrastructure/ros_buildfarm/pull/570>`_)

* Fixes

* pin sphinx version due to issue with latest release 2.0.0 (`615 <https://github.com/ros-infrastructure/ros_buildfarm/pull/615>`_)
* fix remaining flake8 violations (`611 <https://github.com/ros-infrastructure/ros_buildfarm/pull/611>`_)
* handle scenario where no views or jobs are reconfigured (`606 <https://github.com/ros-infrastructure/ros_buildfarm/pull/606>`_)
* support flake8 3.5.0 and fix various linter violations (`608 <https://github.com/ros-infrastructure/ros_buildfarm/pull/608>`_)
* use version number on -modules dependency (`562 <https://github.com/ros-infrastructure/ros_buildfarm/pull/562>`_, `#599 <https://github.com/ros-infrastructure/ros_buildfarm/pull/599>`_)
* use Bourne shell / dash compatible shell condition (`592 <https://github.com/ros-infrastructure/ros_buildfarm/pull/592>`_)
* fix return codes from some job generation scripts (`595 <https://github.com/ros-infrastructure/ros_buildfarm/pull/595>`_)
* install updated version of dpkg on Trusty (`564 <https://github.com/ros-infrastructure/ros_buildfarm/pull/564>`_, `#566 <https://github.com/ros-infrastructure/ros_buildfarm/pull/566>`_)
* fix regex to not match jobs from other build files (`563 <https://github.com/ros-infrastructure/ros_buildfarm/pull/563>`_)
* install dh-python explicitly on Bionic and Buster as it's not included with Python 3 (`553 <https://github.com/ros-infrastructure/ros_buildfarm/pull/553>`_, `#556 <https://github.com/ros-infrastructure/ros_buildfarm/pull/556>`_)
* use single pipe to avoid problems with Jenkins reading them concurrently (`552 <https://github.com/ros-infrastructure/ros_buildfarm/pull/552>`_)
* install apt transport https (`551 <https://github.com/ros-infrastructure/ros_buildfarm/pull/551>`_)
* add ddebs to published binarydeb files (`545 <https://github.com/ros-infrastructure/ros_buildfarm/pull/545>`_)

------------------

* Improvements

* use egrep to find repository components in arbitrary positions (`532 <https://github.com/ros-infrastructure/ros_buildfarm/pull/532>`_)

* Fixes

* revert "remove using the test_depend from binary jobs" introduced in 2.0.0 (`540 <https://github.com/ros-infrastructure/ros_buildfarm/pull/540>`_)
* add missing import from future for Python 2 compatibility (`537 <https://github.com/ros-infrastructure/ros_buildfarm/pull/537>`_)

------------------
This new major version requires the provisioned machines to be based on the updated `buildfarm_deployment` which is based on Ubuntu Xenial hosts with Java 8 and Jenkins up to version 2.89.x.
Jenkins 2.107.x comes with additional changes which this version is not yet suitable for.

* New features

* generate YAML files with build information (`521 <https://github.com/ros-infrastructure/ros_buildfarm/pull/521>`_, `#522 <https://github.com/ros-infrastructure/ros_buildfarm/pull/522>`_)
* git clone with --recurse-submodules (`515 <https://github.com/ros-infrastructure/ros_buildfarm/pull/515>`_)

* Changes

* remove using the test_depend for binary jobs (`534 <https://github.com/ros-infrastructure/ros_buildfarm/pull/534>`_)
* move all jobs that are at priority 40 down to 35 (`500 <https://github.com/ros-infrastructure/ros_buildfarm/pull/500>`_)
* fix Debian revision (replace - with .) as of ROS Melodic and ROS 2 Bouncy (`460 <https://github.com/ros-infrastructure/ros_buildfarm/pull/460>`_, `#512 <https://github.com/ros-infrastructure/ros_buildfarm/pull/512>`_)
* update plugin versions and configurations (`477 <https://github.com/ros-infrastructure/ros_buildfarm/pull/477>`_, `#482 <https://github.com/ros-infrastructure/ros_buildfarm/pull/482>`_, `#486 <https://github.com/ros-infrastructure/ros_buildfarm/pull/486>`_)
* merge the changes for Xenial into master (`480 <https://github.com/ros-infrastructure/ros_buildfarm/pull/480>`_)
* increase days_to_keep for some job types (`481 <https://github.com/ros-infrastructure/ros_buildfarm/pull/481>`_)

* Improvements

* add the mail publisher to the trigger_upload_repo_job (`520 <https://github.com/ros-infrastructure/ros_buildfarm/pull/520>`_)
* document and use option canonical_base_url (`517 <https://github.com/ros-infrastructure/ros_buildfarm/pull/517>`_)
* add artful and bionic to the short os names (`493 <https://github.com/ros-infrastructure/ros_buildfarm/pull/493>`_)
* do not make job unstable if there are skipped tests (`492 <https://github.com/ros-infrastructure/ros_buildfarm/pull/492>`_)
* add initial version of upload trigger job generators (`474 <https://github.com/ros-infrastructure/ros_buildfarm/pull/474>`_)

* Fixes

* do not generate a blocked-releases job for the first distro (`533 <https://github.com/ros-infrastructure/ros_buildfarm/pull/533>`_)
* fix warning about duplicate apt repos (`530 <https://github.com/ros-infrastructure/ros_buildfarm/pull/530>`_)
* don't set an empty ssh-agent wrapper on devel jobs (`528 <https://github.com/ros-infrastructure/ros_buildfarm/pull/528>`_, `#531 <https://github.com/ros-infrastructure/ros_buildfarm/pull/531>`_)
* mount the shared jenkins hgcache to allow hg operations (`526 <https://github.com/ros-infrastructure/ros_buildfarm/pull/526>`_)
* ignore the seccomp profile warning in docker info (`527 <https://github.com/ros-infrastructure/ros_buildfarm/pull/527>`_)
* call super in JobValidationError to correcly print the error (`524 <https://github.com/ros-infrastructure/ros_buildfarm/pull/524>`_)
* fix check for existing description tag (`518 <https://github.com/ros-infrastructure/ros_buildfarm/pull/518>`_)
* install gnupg on newer Ubuntu (`506 <https://github.com/ros-infrastructure/ros_buildfarm/pull/506>`_)
* use -d option to skip checking for build deps in source jobs on newer Ubuntu (`505 <https://github.com/ros-infrastructure/ros_buildfarm/pull/505>`_)
* move old_releases sources before installing locales (`504 <https://github.com/ros-infrastructure/ros_buildfarm/pull/504>`_)
* update list of EOL ubuntu distributions up to Zesty (`503 <https://github.com/ros-infrastructure/ros_buildfarm/pull/503>`_)
* resolve catkin instead of assuming current rosdistro (`501 <https://github.com/ros-infrastructure/ros_buildfarm/pull/501>`_)
* fix mercurial config (`490 <https://github.com/ros-infrastructure/ros_buildfarm/pull/490>`_)
* fix config of created views if they have no jobs associated (`483 <https://github.com/ros-infrastructure/ros_buildfarm/pull/483>`_)

* Documentation

* point to the Buildfarm Discourse instead of the old SIG (`499 <https://github.com/ros-infrastructure/ros_buildfarm/pull/499>`_)
* add delete views instructions (`485 <https://github.com/ros-infrastructure/ros_buildfarm/pull/485>`_)

------------------
* Improvements

* increase limit of age and/or count for kept build logs for some jobs (`471 <https://github.com/ros-infrastructure/ros_buildfarm/pull/471>`_)
* retry apt on corrupted package archive error (`468 <https://github.com/ros-infrastructure/ros_buildfarm/pull/468>`_)
* improve docs to remove obsolete jobs (`464 <https://github.com/ros-infrastructure/ros_buildfarm/issues/464>`_, `#473 <https://github.com/ros-infrastructure/ros_buildfarm/pull/473>`_)
* make Dockerfile template more flexible (`463 <https://github.com/ros-infrastructure/ros_buildfarm/pull/463>`_)

* Fixes

* use cloudfront mirror for all debian sources (`467 <https://github.com/ros-infrastructure/ros_buildfarm/pull/467>`_)