Scancodeio

--------------------

- Add authentication for the Web UI views and REST API endpoint.
The autentication is disabled by default and can be enabled using the
SCANCODEIO_REQUIRE_AUTHENTICATION settings.
When enabled, users have to authenticate through a login form in the Web UI, or using
their API Key in the REST API.
The API Key can be viewed in the Web UI "Profile settings" view ince logged-in.
Users can be created using the Django "createsuperuser" management command.
https://github.com/nexB/scancode.io/issues/359

- Include project errors in XLSX results output.
https://github.com/nexB/scancode.io/issues/364

- Add input_sources used to fetch inputs to JSON results output.
https://github.com/nexB/scancode.io/issues/351

- Refactor the update_or_create_package pipe to support the ProjectError system
and fix a database transaction error.
https://github.com/nexB/scancode.io/issues/381

- Add webhook subscription available when creating project from REST API.
https://github.com/nexB/scancode.io/issues/98

- Add the project "reset" feature in the UI, CLI, and REST API.
https://github.com/nexB/scancode.io/issues/375

- Add a new GitHub action that build the docker-compose images and run the test suite.
This ensure that the app is properly working and tested when running with Docker.
https://github.com/nexB/scancode.io/issues/367

- Add --no-install-recommends in the Dockerfile apt-get install and add the
`linux-image-amd64` package. This packages makes available the kernels
required by extractcode and libguestfs for proper VM images extraction.
https://github.com/nexB/scancode.io/issues/367

- Add a new `list-project` CLI command to list projects.
https://github.com/nexB/scancode.io/issues/365

--------------------

- Remove the --no-install-recommends in the Dockerfile apt-get install to include
required dependencies for proper VM extraction.
https://github.com/nexB/scancode.io/issues/367

--------------------

- Synchronize QUEUED and RUNNING pipeline runs with their related worker jobs during
worker maintenance tasks scheduled every 10 minutes.
If a container was taken down while a pipeline was running, or if pipeline process
was killed unexpectedly, that pipeline run status will be updated to a FAILED state
during the next maintenance tasks.
QUEUED pipeline will be restored in the queue as the worker redis cache backend data
is now persistent and reloaded on starting the image.
Note that internaly, a running job emits a "heartbeat" every 60 seconds to let all the
workers know that it is properly running.
After 90 seconds without any heartbeats, a worker will determine that the job is not
active anymore and that job will be moved to the failed registry during the worker
maintenance tasks. The pipeline run will be updated as well to reflect this failure
in the Web UI, the REST API, and the command line interface.
https://github.com/nexB/scancode.io/issues/130

- Enable redis data persistence using the "Append Only File" with the default policy of
fsync every second in the docker-compose.
https://github.com/nexB/scancode.io/issues/130

- Add a new tutorial chapter about license policies and compliance alerts.
https://github.com/nexB/scancode.io/issues/337

- Include layers in docker image data.
https://github.com/nexB/scancode.io/issues/175

- Fix a server error on resource details view when the compliance alert is "missing".
https://github.com/nexB/scancode.io/issues/344

- Migrate the ScanCodebase pipeline from `scancode.run_scancode` subprocess to
`scancode.scan_for_application_packages` and `scancode.scan_for_files`.
https://github.com/nexB/scancode.io/issues/340

--------------------

- Fix a build failure related to dependency conflict.
https://github.com/nexB/scancode.io/issues/342

-------------------

- Upgrade ScanCode-toolkit to version 30.1.0

- Replace the task queue system, from Celery to RQ.
https://github.com/nexB/scancode.io/issues/176

- Add ability to delete "not started" and "queued" pipeline tasks.
https://github.com/nexB/scancode.io/issues/176

- Add ability to stop "running" pipeline tasks.
https://github.com/nexB/scancode.io/issues/176

- Refactor the "execute" management command and add support for --async mode.
https://github.com/nexB/scancode.io/issues/130

- Include codebase resource data in the details of package creation project errors.
https://github.com/nexB/scancode.io/issues/208

- Add a SCANCODEIO_REST_API_PAGE_SIZE setting to control the number of objects
returned per page in the REST API.
https://github.com/nexB/scancode.io/issues/328

- Provide an "add input" action on the Project endpoint of the REST API.
https://github.com/nexB/scancode.io/issues/318

-------

- Add ability to "archive" projects, from the Web UI, API and command line interface.
Data cleanup of the project's input, codebase, and output directories is available
during the archive operation.
Archived projects cannot be modified anymore and are hidden by default from the
project list.
A project cannot be archived if one of its related run is queued or already running.
https://github.com/nexB/scancode.io/issues/312

- Remove the run_extractcode pipe in favor of extractcode API.
https://github.com/nexB/scancode.io/issues/312

- The `scancode.run_scancode` pipe now uses an optimal number of available CPUs for
multiprocessing by default.
The exact number of parallel processes available to ScanCode.io can be defined
using the SCANCODEIO_PROCESSES setting.
https://github.com/nexB/scancode.io/issues/302

- Renamed the SCANCODE_DEFAULT_OPTIONS setting to SCANCODE_TOOLKIT_CLI_OPTIONS.
https://github.com/nexB/scancode.io/issues/302

- Log the outputs of run_scancode as progress indication.
https://github.com/nexB/scancode.io/issues/300