Cobbler

This release syncs release30 with master. No patches for release30 were needed specifically.

We have +13,585 additions and −6,365 removals. We have merged 45 pull requests.

**New**:

- For the distro there is now a parameter `remote_boot_initrd` and `remote_boot_kernel` ()
- For the profile there is now a parameter `filename` for DHCP. (https://github.com/cobbler/cobbler/pull/2280)
- Signatures for ESXi 6 and 7 (https://github.com/cobbler/cobbler/pull/2308)
- The `hardlink` command is now detected more dynamically and thus more error resistant (https://github.com/cobbler/cobbler/pull/2297)
- HTTPBoot will now work in some cases out of the bug. (https://github.com/cobbler/cobbler/pull/2295)
- Additional DNS query for a case where the wrong record was queried in the `nsupdate system` case (https://github.com/cobbler/cobbler/pull/2285)

**Changes**:

- Enabled a lot of tests, removed some and implemented new. (https://github.com/cobbler/cobbler/pull/2202)
- Removed not used files from the codebase. (https://github.com/cobbler/cobbler/pull/2302)
- Exchanged `mkisofs` to `xorrisofs`. (https://github.com/cobbler/cobbler/pull/2296)
- Removed duplicate code. (https://github.com/cobbler/cobbler/pull/2224)
- Removed unreachable code. (https://github.com/cobbler/cobbler/pull/2223)
- Snippet creation and deletion now works again via xmlrpc. (https://github.com/cobbler/cobbler/pull/2244)
- Replace `createrepo` with `createrepo_c`. (https://github.com/cobbler/cobbler/pull/2266)
- Enable Kerberos through having a case sensitive `users.conf`. (https://github.com/cobbler/cobbler/pull/2272)

**Bugfixes**:

- General various Bugfixes (https://github.com/cobbler/cobbler/pull/2331, )
- `Makefile` usage and commands. (https://github.com/cobbler/cobbler/pull/2344, https://github.com/cobbler/cobbler/pull/2304)
- Fix the dhcp template. (https://github.com/cobbler/cobbler/pull/2314)
- Creation of the management classes and gPXE. (https://github.com/cobbler/cobbler/pull/2310)
- Fix the `scm_track` module. (https://github.com/cobbler/cobbler/pull/2275, https://github.com/cobbler/cobbler/pull/2279)
- Fix passing the `netdevice` parameter correctly to the `linuxrc`. (https://github.com/cobbler/cobbler/pull/2263)
- `powerstatus` from cobbler now works thanks to a wrapper for `ipmitool`. (https://github.com/cobbler/cobbler/pull/2267)
- In case the LDAP is used for auth, it now works with ADs. (https://github.com/cobbler/cobbler/pull/2274)
- Fix passthru authentication. (https://github.com/cobbler/cobbler/pull/2271)

**Other**:

- Add Codecov. (https://github.com/cobbler/cobbler/pull/2229)
- Documentation updates. (https://github.com/cobbler/cobbler/pull/2333, https://github.com/cobbler/cobbler/pull/2326, https://github.com/cobbler/cobbler/pull/2305, https://github.com/cobbler/cobbler/pull/2249, https://github.com/cobbler/cobbler/pull/2268)
- Buildprocess:
- Recreation and cleanup of Grub2. (https://github.com/cobbler/cobbler/pull/2278)
- Fix small errors for openSUSE Leap. (https://github.com/cobbler/cobbler/pull/2233)
- Fix `rpmlint` errors. (https://github.com/cobbler/cobbler/pull/2237)
- Maximum compatibility for debbuild package creation. (https://github.com/cobbler/cobbler/pull/2255, https://github.com/cobbler/cobbler/pull/2292, https://github.com/cobbler/cobbler/pull/2242, https://github.com/cobbler/cobbler/pull/2300)
- Fixes related to our CI Pipeline (https://github.com/cobbler/cobbler/pull/2254, https://github.com/cobbler/cobbler/pull/2269)
- Internal Code cleanup (https://github.com/cobbler/cobbler/pull/2273, https://github.com/cobbler/cobbler/pull/2270)

**Breaking Changes**:

- Hash handling in users.digest file. (https://github.com/cobbler/cobbler/pull/2299)
- When using a DEB or RPM we now replace the configs. So preserving the config needs to be ensured by you.

**Bugfixes**:

- Incremented Version to 3.1.1 from 3.0.1

This release syncs release30 with master. No patches for release30 were needed specifically.

I would like to especially thank Conan-Kudo for his work on the cross-distro specfile for cobbler and koan as well as rbberger who was so kind to contribute a lot regarding building the rpms in docker for CentOS with the specfile this helped a lot!

We have a 8497 line diff for this release.

**New**:

- We are now having a cross-distro specfile which can be build in the OBS (2220) - before rewritten it was improved by 2144 & 2174
- Grub Submenu for net-booting machines (2217)
- Building the Cent-OS RPMs in Docker (2190 2189)
- Reintroduced manpage build in `setup.py` (2185)
- `mgmt_parameters` are now passed to the dhcp template (2182)
- Using the standard Pyhton3 logger instead of a custom one (2160 2139 2151)
- Script for converting the settings file from 3.0.0 to 3.0.1 (2154)
- Docs now inside the repo instead of cobbler.github.io and improved with sphinx (2117)

**Changes**:

- The default tftpboot directory is now `/var/lib/tftpboot` instead of previously `/srv/tftpboot` (2220)
- Distro signatures were adjusted where necessary (2219 2134)
- Removed `requirements.txt` and placed the requirements in `setup.py` (2204)
- Display only entries in grub which are from the same arch (2191 2216)
- Change the name of the cobbler manpage form `cobbler-cli` to `cobbler` back and move it to section 8 (2188 2186)

**Bugfixes**:

- S390 Support was cleaned up (2207 2178)
- PowerPC Support was cleaned up (2178)
- Added a missing import while importing a distro with `cobbler import` (2201)
- Fixed a case where a stacktrace would be produced so pass none instead (2203)
- Rename of `suse_kopts_textmode_overwrite` to `kops_overwrite` to `utils` (2143 2200)
- Fix rsync subprocess call (2199 2179)
- Fixed an error where the template rendering did not work (2176)
- Fixed some `cobbler import` errors (2172)
- Wrong shebang in various scripts (2148)
- Fix some imports which fixes errors introduced by the remodularization (2150 2153)

**Other**:

- Issue Templates for Github (2187)

**Breaking Changes**: None

**Announcements**: The V3.x.x branch is now maintained in his own branch to allow development changes to go on top of master.

**Changes**:
- We made cobbler now more modularized. So plugins can be grouped by directories and can be imported from sub-directories.
- We dropped support for older Ubuntu versions.
- We updated the `dhcpd.template` to bring an improved experience with dhcp templating.
- We removed the custom logger and are now using the standard python3 logger with a config in `/etc/cobbler/logging_config.conf`
- We fixed some shebangs to `/usr/bin/python3` to ease the pain for package maintainers
- And more smaller fixes which should not affect your day to day usage but should improve your experience with cobbler.

**WARNING**: This release contains breaking changes for your settings file! A guide on how to convert your settings file can be found here [cobbler.github.io](https://cobbler.github.io/blog/2019/10/24/cobbler_3.0.1_migration.html)

After quite some time we proudly announce cobbler version 3.0.0.
This version is mostly adjusting code to python3.
Thanks to SchoolGuy it got elementary test enhancements and re-writes.
This is the reason why we have Travis and a nicely working continuous integration process running on github for a while.

SuMa (SuSE Manager) 4.0 makes use of this cobbler release. So be sure that this one gets important bug fixes and backports from time to time.

While there have been adoptions for other distributions as well, some might have waited for a python3 compatible release. So here it is.
As soon as we got some bigger major fixes there might soon be another release. Work in progress is for example:
- Documentation (consolidating and updating github and source documention, fix dead links/text)
- Python Module/Import structure (shuffle code around to have a proper python module structure)
- Spread latest python3 cobbler version and help distros building with latest python3 package dependencies if not yet done.


Enhancements

- Use new dracut ip option for configuring static interfaces (koan).
- Add a whitelist of directories in order to persist a cobbler sync.
- Add proxy support for get-loaders, signature update and reposync.
- Add initial support for DJBDNS.
- Enable external YUM repo mirroring through a proxy server.
- DHCP configuration now also supports the per interface gateway setting.
- A new interface_type BMC was added which also can be managed with DHCP.
- Yaboot was updated to 1.3.17.
- Add ability to have per-profile/per-system next_server values (1196).
- Add --graphics option to Koan.
- Improved input validation and error handling.
- Support virtio26 for generic QEMU fallback in Koan.
- Debian network config: add support for tagged vlan only bonding interfaces.
- Documentation has been converted into rST and is now included with the source tree.
- Integrated pyflakes into the build system and resolved hundreds of issues.
- Integrated pep8 (coding style) into the build system and resolved thousands of issues.
- Add a new field to the system type ipv6_prefix (203).
- Minor update to CSS; make better use of screen (tables) (cobbler-web).
- Add support for an empty system status.
- If dns-name is specified, set it as DHCP hostname in preference to the hostname field.
- Allow user to choose whether or not to delete item(s) recursively (cobbler-web).
- Set ksdevice kernel option to MAC address for ppc systems as bootif is not used by yaboot.
- Return to list of snippets/kickstarts when snippet/kickstart is saved (cobbler-web).
- Layout in snippet/kickstart edit form has been improved (cobbler-web).
- Better handling of copy/remove actions for subprofiles (API and cobbler-web).
- Make kickstart selectable from a pulldown list in cobbler-web (991).

Bugfixes

- Changed Apache configuration directory in Ubuntu 14.04 (1208).
- build_reporting no longer fails with an empty string in ignorelist (1248).
- Kickstart repo statement, filter invalid values: gpgcheck, gpgkey and enabled (323).
- Several improvements to Debian/Ubuntu packaging.
- Some class/method names have been changed to make the code more intuitive for developers.
- Remove root= argument in Koan when using grubby and replace-self to avoid booting the current OS.
- Exit with an error if the cobblerd executable can’t be found (1108, 1135).
- Fix cobbler sync bug by xmlrpclib returning NoneType object.
- Dont send the Puppet environment when system status is empty (560).
- Cobbler-web kept only the most recent interface change (687).
- Fix broken gitdate, gitstamp values in /etc/cobbler/version.
- Prevent disappearing profiles after cobblerd restart (1030).
- Add missing icons to cobbler_web/content (679).
- cobbler-ext-nodes was broken with mgmt_classes defined at the profile level (790).
- Properly name the VLAN interface in the manual page.
- Fix wrong address of the Free Software Foundation.
- Remove legacy (EL5/6) cruft from the RPM specfile.
- Koan: use the print function instead of the print statement.
- Minor improvement to LDAP configuration (217).
- Improvements to the unittest framework.
- Removed several unused functions from utils.
- List of authors is now automagically generated.

Upgrade notes

- Support for LDAP configuration through Koan has been removed.
- Support for redhat_management (Spacewalk/Satelite) has been moved to contrib. Users of this functionality should checkout contrib/redhat-management/README.
- Monit support has been removed; you really need to use a CMS to manage your services.
- Support for remote kickstart templates and files been removed (eg. kickstart=http://).
- All object names are now validated like that of the system object.
- The use of parent and distro on subprofiles are now mutually exclusive.
- Support for s390/s390x has been removed.
- Support for ia64 (Itanium) has been removed.
- Support for the MySQL backend has been removed.
- Support for deprecated fieldnames (subnet, bonding_master, bonding) has been removed.
- Cobbler now requires python 2.7 and Koan now requires python 2.6.
- Red Hat specific default kernel options have been removed from the settings file.
- Support for Func integration has been moved to contrib. Users of this functionality should checkout contrib/func/README.
- Deprecated Koan LiveCD: moved to contrib.

This version comes with the following changes and new features:

**Fixes**:
- Fixes the use of disk drivers with koan (1936)
- Fix rsync distro import (1613)
- Fix built-in tftp server (2018)
- Fix URL generation when https is enabled (2063)
- Update the signatures (2141 2105)
- Update the sample.seed file with master (2092)
- Only use the set-module only as a fallback (2090)
- Fix IPMI usage (2110)
- Some small Web-UI fixes (2111 - contains also the version bump in the files where needed)
- Fix for the dhcp_tag being undefined (2095)

**New**:
- Use django 1.8+ (2104)
- Add mgmt_parameters to the dhcp template (2180)
- Docs are now maintained inside this repo for readthedocs.io (2197)