Ros-buildfarm

------------------
This new major version requires a post-JEP-200 Jenkins version (see `587 <https://github.com/ros-infrastructure/ros_buildfarm/pull/587>`_) and therefore the provisioned machine to be updated (`buildfarm_deployment207 <https://github.com/ros-infrastructure/buildfarm_deployment/pull/207>`_).

* New features

* support colcon build tool using a configuration option (`585 <https://github.com/ros-infrastructure/ros_buildfarm/pull/585>`_, `589 <https://github.com/ros-infrastructure/ros_buildfarm/pull/589>`_, `591 <https://github.com/ros-infrastructure/ros_buildfarm/pull/591>`_)
* add CI jobs for building and testing workspaces defined in a .repos file (`590 <https://github.com/ros-infrastructure/ros_buildfarm/pull/590>`_, `607 <https://github.com/ros-infrastructure/ros_buildfarm/pull/607>`_, `610 <https://github.com/ros-infrastructure/ros_buildfarm/pull/610>`_, `623 <https://github.com/ros-infrastructure/ros_buildfarm/pull/623>`_, `628 <https://github.com/ros-infrastructure/ros_buildfarm/pull/628>`_, `629 <https://github.com/ros-infrastructure/ros_buildfarm/pull/629>`_, `630 <https://github.com/ros-infrastructure/ros_buildfarm/pull/630>`_, `632 <https://github.com/ros-infrastructure/ros_buildfarm/pull/632>`_, `633 <https://github.com/ros-infrastructure/ros_buildfarm/pull/633>`_, `636 <https://github.com/ros-infrastructure/ros_buildfarm/pull/636>`_)

* Improvements

* evaluate conditions in manifests (`621 <https://github.com/ros-infrastructure/ros_buildfarm/pull/621>`_, `634 <https://github.com/ros-infrastructure/ros_buildfarm/pull/634>`_)
* support for a docker_build type of doc_independent build (`576 <https://github.com/ros-infrastructure/ros_buildfarm/pull/576>`_, `619 <https://github.com/ros-infrastructure/ros_buildfarm/pull/619>`_)
* add options to configure apt/pip package dependencies for the independent doc job in the build file (`618 <https://github.com/ros-infrastructure/ros_buildfarm/pull/618>`_)
* [prerelease] add ability to generate repos files for faster cloning (rebased) (`600 <https://github.com/ros-infrastructure/ros_buildfarm/pull/600>`_)
* only consider same type distros when looking for previous distro (`593 <https://github.com/ros-infrastructure/ros_buildfarm/pull/593>`_)
* share ccache between docker builds (`580 <https://github.com/ros-infrastructure/ros_buildfarm/pull/580>`_)
* allow searching by email on status pages (`561 <https://github.com/ros-infrastructure/ros_buildfarm/pull/561>`_)
* set build environment variables from build files (`554 <https://github.com/ros-infrastructure/ros_buildfarm/pull/554>`_, `558 <https://github.com/ros-infrastructure/ros_buildfarm/pull/558>`_)
* add devel job test statistics collation (`541 <https://github.com/ros-infrastructure/ros_buildfarm/pull/541>`_)

* Changes

* add all Ubuntu EOL distros back to boxturtle to old release template (`637 <https://github.com/ros-infrastructure/ros_buildfarm/pull/637>`_)
* fetch artful from old-releases (`569 <https://github.com/ros-infrastructure/ros_buildfarm/pull/569>`_)
* bump tests to use latest ROS releases (`613 <https://github.com/ros-infrastructure/ros_buildfarm/pull/613>`_)
* support expression of dependencies via install list file (`612 <https://github.com/ros-infrastructure/ros_buildfarm/pull/612>`_)
* also test with Python 3.5 and 3.6 (`570 <https://github.com/ros-infrastructure/ros_buildfarm/pull/570>`_)

* Fixes

* pin sphinx version due to issue with latest release 2.0.0 (`615 <https://github.com/ros-infrastructure/ros_buildfarm/pull/615>`_)
* fix remaining flake8 violations (`611 <https://github.com/ros-infrastructure/ros_buildfarm/pull/611>`_)
* handle scenario where no views or jobs are reconfigured (`606 <https://github.com/ros-infrastructure/ros_buildfarm/pull/606>`_)
* support flake8 3.5.0 and fix various linter violations (`608 <https://github.com/ros-infrastructure/ros_buildfarm/pull/608>`_)
* use version number on -modules dependency (`562 <https://github.com/ros-infrastructure/ros_buildfarm/pull/562>`_, `599 <https://github.com/ros-infrastructure/ros_buildfarm/pull/599>`_)
* use Bourne shell / dash compatible shell condition (`592 <https://github.com/ros-infrastructure/ros_buildfarm/pull/592>`_)
* fix return codes from some job generation scripts (`595 <https://github.com/ros-infrastructure/ros_buildfarm/pull/595>`_)
* install updated version of dpkg on Trusty (`564 <https://github.com/ros-infrastructure/ros_buildfarm/pull/564>`_, `566 <https://github.com/ros-infrastructure/ros_buildfarm/pull/566>`_)
* fix regex to not match jobs from other build files (`563 <https://github.com/ros-infrastructure/ros_buildfarm/pull/563>`_)
* install dh-python explicitly on Bionic and Buster as it's not included with Python 3 (`553 <https://github.com/ros-infrastructure/ros_buildfarm/pull/553>`_, `556 <https://github.com/ros-infrastructure/ros_buildfarm/pull/556>`_)
* use single pipe to avoid problems with Jenkins reading them concurrently (`552 <https://github.com/ros-infrastructure/ros_buildfarm/pull/552>`_)
* install apt transport https (`551 <https://github.com/ros-infrastructure/ros_buildfarm/pull/551>`_)
* add ddebs to published binarydeb files (`545 <https://github.com/ros-infrastructure/ros_buildfarm/pull/545>`_)

------------------

* Improvements

* use egrep to find repository components in arbitrary positions (`532 <https://github.com/ros-infrastructure/ros_buildfarm/pull/532>`_)

* Fixes

* revert "remove using the test_depend from binary jobs" introduced in 2.0.0 (`540 <https://github.com/ros-infrastructure/ros_buildfarm/pull/540>`_)
* add missing import from future for Python 2 compatibility (`537 <https://github.com/ros-infrastructure/ros_buildfarm/pull/537>`_)

------------------
This new major version requires the provisioned machines to be based on the updated `buildfarm_deployment` which is based on Ubuntu Xenial hosts with Java 8 and Jenkins up to version 2.89.x.
Jenkins 2.107.x comes with additional changes which this version is not yet suitable for.

* New features

* generate YAML files with build information (`521 <https://github.com/ros-infrastructure/ros_buildfarm/pull/521>`_, `522 <https://github.com/ros-infrastructure/ros_buildfarm/pull/522>`_)
* git clone with --recurse-submodules (`515 <https://github.com/ros-infrastructure/ros_buildfarm/pull/515>`_)

* Changes

* remove using the test_depend for binary jobs (`534 <https://github.com/ros-infrastructure/ros_buildfarm/pull/534>`_)
* move all jobs that are at priority 40 down to 35 (`500 <https://github.com/ros-infrastructure/ros_buildfarm/pull/500>`_)
* fix Debian revision (replace - with .) as of ROS Melodic and ROS 2 Bouncy (`460 <https://github.com/ros-infrastructure/ros_buildfarm/pull/460>`_, `512 <https://github.com/ros-infrastructure/ros_buildfarm/pull/512>`_)
* update plugin versions and configurations (`477 <https://github.com/ros-infrastructure/ros_buildfarm/pull/477>`_, `482 <https://github.com/ros-infrastructure/ros_buildfarm/pull/482>`_, `486 <https://github.com/ros-infrastructure/ros_buildfarm/pull/486>`_)
* merge the changes for Xenial into master (`480 <https://github.com/ros-infrastructure/ros_buildfarm/pull/480>`_)
* increase days_to_keep for some job types (`481 <https://github.com/ros-infrastructure/ros_buildfarm/pull/481>`_)

* Improvements

* add the mail publisher to the trigger_upload_repo_job (`520 <https://github.com/ros-infrastructure/ros_buildfarm/pull/520>`_)
* document and use option canonical_base_url (`517 <https://github.com/ros-infrastructure/ros_buildfarm/pull/517>`_)
* add artful and bionic to the short os names (`493 <https://github.com/ros-infrastructure/ros_buildfarm/pull/493>`_)
* do not make job unstable if there are skipped tests (`492 <https://github.com/ros-infrastructure/ros_buildfarm/pull/492>`_)
* add initial version of upload trigger job generators (`474 <https://github.com/ros-infrastructure/ros_buildfarm/pull/474>`_)

* Fixes

* do not generate a blocked-releases job for the first distro (`533 <https://github.com/ros-infrastructure/ros_buildfarm/pull/533>`_)
* fix warning about duplicate apt repos (`530 <https://github.com/ros-infrastructure/ros_buildfarm/pull/530>`_)
* don't set an empty ssh-agent wrapper on devel jobs (`528 <https://github.com/ros-infrastructure/ros_buildfarm/pull/528>`_, `531 <https://github.com/ros-infrastructure/ros_buildfarm/pull/531>`_)
* mount the shared jenkins hgcache to allow hg operations (`526 <https://github.com/ros-infrastructure/ros_buildfarm/pull/526>`_)
* ignore the seccomp profile warning in docker info (`527 <https://github.com/ros-infrastructure/ros_buildfarm/pull/527>`_)
* call super in JobValidationError to correcly print the error (`524 <https://github.com/ros-infrastructure/ros_buildfarm/pull/524>`_)
* fix check for existing description tag (`518 <https://github.com/ros-infrastructure/ros_buildfarm/pull/518>`_)
* install gnupg on newer Ubuntu (`506 <https://github.com/ros-infrastructure/ros_buildfarm/pull/506>`_)
* use -d option to skip checking for build deps in source jobs on newer Ubuntu (`505 <https://github.com/ros-infrastructure/ros_buildfarm/pull/505>`_)
* move old_releases sources before installing locales (`504 <https://github.com/ros-infrastructure/ros_buildfarm/pull/504>`_)
* update list of EOL ubuntu distributions up to Zesty (`503 <https://github.com/ros-infrastructure/ros_buildfarm/pull/503>`_)
* resolve catkin instead of assuming current rosdistro (`501 <https://github.com/ros-infrastructure/ros_buildfarm/pull/501>`_)
* fix mercurial config (`490 <https://github.com/ros-infrastructure/ros_buildfarm/pull/490>`_)
* fix config of created views if they have no jobs associated (`483 <https://github.com/ros-infrastructure/ros_buildfarm/pull/483>`_)

* Documentation

* point to the Buildfarm Discourse instead of the old SIG (`499 <https://github.com/ros-infrastructure/ros_buildfarm/pull/499>`_)
* add delete views instructions (`485 <https://github.com/ros-infrastructure/ros_buildfarm/pull/485>`_)

------------------
* Improvements

* increase limit of age and/or count for kept build logs for some jobs (`471 <https://github.com/ros-infrastructure/ros_buildfarm/pull/471>`_)
* retry apt on corrupted package archive error (`468 <https://github.com/ros-infrastructure/ros_buildfarm/pull/468>`_)
* improve docs to remove obsolete jobs (`464 <https://github.com/ros-infrastructure/ros_buildfarm/issues/464>`_, `473 <https://github.com/ros-infrastructure/ros_buildfarm/pull/473>`_)
* make Dockerfile template more flexible (`463 <https://github.com/ros-infrastructure/ros_buildfarm/pull/463>`_)

* Fixes

* use cloudfront mirror for all debian sources (`467 <https://github.com/ros-infrastructure/ros_buildfarm/pull/467>`_)

------------------
* New features

* add new jobs to display the failing jobs by ROS distro (`454 <https://github.com/ros-infrastructure/ros_buildfarm/issues/454>`_)
* add nightly job to trigger missed jobs (`451 <https://github.com/ros-infrastructure/ros_buildfarm/issues/451>`_)
* add option to trigger only not-failed jobs (`446 <https://github.com/ros-infrastructure/ros_buildfarm/issues/446>`_)
* use Xenial Docker images instead of Trusty (`444 <https://github.com/ros-infrastructure/ros_buildfarm/issues/444>`_, `445 <https://github.com/ros-infrastructure/ros_buildfarm/issues/445>`_)
* add ORPHANED that shows both end-of-life and unmaintaned (`439 <https://github.com/ros-infrastructure/ros_buildfarm/issues/439>`_)
* support OR syntax as well as regex (`435 <https://github.com/ros-infrastructure/ros_buildfarm/issues/435>`_, `436 <https://github.com/ros-infrastructure/ros_buildfarm/issues/436>`_)
* add config option to enable / disable sending notification emails for pull request jobs (`432 <https://github.com/ros-infrastructure/ros_buildfarm/issues/432>`_)

* Improvements

* print blank lines around error message (`459 <https://github.com/ros-infrastructure/ros_buildfarm/issues/459>`_)
* add 'Failed to stat' to the list of apt known errors (`458 <https://github.com/ros-infrastructure/ros_buildfarm/issues/458>`_)
* catch another apt hiccup (`452 <https://github.com/ros-infrastructure/ros_buildfarm/issues/452>`_)
* improve performance to generate maintenance jobs (`450 <https://github.com/ros-infrastructure/ros_buildfarm/issues/450>`_)
* show parameter of reconfigure jobs in build description (`449 <https://github.com/ros-infrastructure/ros_buildfarm/issues/449>`_)
* invert logic for future proofing (`443 <https://github.com/ros-infrastructure/ros_buildfarm/issues/443>`_)
* update description of import_upstream job (`442 <https://github.com/ros-infrastructure/ros_buildfarm/issues/442>`_)
* use higher prio for import_upstream job (`441 <https://github.com/ros-infrastructure/ros_buildfarm/issues/441>`_)
* change color of "unmaintained" from yellow to orange (`440 <https://github.com/ros-infrastructure/ros_buildfarm/issues/440>`_)
* add title to input fields (`436 <https://github.com/ros-infrastructure/ros_buildfarm/issues/436>`_)
* improve performance to collect recursive dependencies (`430 <https://github.com/ros-infrastructure/ros_buildfarm/issues/430>`_)

* Fixes

* use cloudfront.debian.net rather than deb.debian.org (`461 <https://github.com/ros-infrastructure/ros_buildfarm/issues/461>`_)
* avoid installing wrapper scripts (`457 <https://github.com/ros-infrastructure/ros_buildfarm/issues/457>`_)
* check version in a way that supports Python 2.6 (`438 <https://github.com/ros-infrastructure/ros_buildfarm/issues/438>`_)
* explicitly reschedule aborted builds (`437 <https://github.com/ros-infrastructure/ros_buildfarm/issues/437>`_)

------------------
* modify compare page to list packages rather than repositories (`425 <https://github.com/ros-infrastructure/ros_buildfarm/pull/425>`_)
* fix regression in trigger logic introduced in 1.3.1 (`427 <https://github.com/ros-infrastructure/ros_buildfarm/issues/427>`_)