Scancodeio

--------

- Adds a new way to fetch docker images using skopeo provided as a
plugin using docker:// reference URL-like pointers to a docker image.
The syntax is docker://<docker image> where <docker image> is the string
that would be used in a "docker pull <docker image>" command.
Also rename scanpipe.pipes.fetch.download() to fetch_http()
https://github.com/nexB/scancode.io/issues/174

- Pipeline status modals are now loaded asynchronously and available from the
project list view.

- Fix an issue accessing codebase resource content using the scan_codebase and
load_inventory pipelines.
https://github.com/nexB/scancode.io/issues/147

--------

- The installation local timezone can be configured using the TIME_ZONE setting.
The current timezone in now included in the dates representation in the web UI.
https://github.com/nexB/scancode.io/issues/142

- Fix pipeline failure issue related to the assignment of un-saved (not valid) packages.
https://github.com/nexB/scancode.io/issues/162

- Add a new QUEUED status to differentiate a pipeline that is in the queue for execution
from a pipeline execution not requested yet.
https://github.com/nexB/scancode.io/issues/130

- Refactor the multiprocessing code for file and package scanning.
All database related operation are now executed in the main process as forking the
existing database connection in sub-processes is a source of issues.
Add progress logging for scan_for_files and scan_for_application_packages pipes.
https://github.com/nexB/scancode.io/issues/145

- Links from the charts to the resources list are now also filtered by
in_package/not_in_package if enabled on the project details view.
https://github.com/nexB/scancode.io/issues/124

- Add ability to filter on codebase resource detected values such as licenses,
copyrights, holders, authors, emails, and urls.
https://github.com/nexB/scancode.io/issues/153

- Filtered list views from a click on chart sections can now be opened in a new tab
using ctrl/meta + click.
https://github.com/nexB/scancode.io/issues/125

- Add links to codebase resource and to discovered packages in list views.

--------

- Implement timeout on the scan functions, default to 120 seconds per resources.
https://github.com/nexB/scancode.io/issues/135

- Fix issue with closing modal buttons in the web UI.
https://github.com/nexB/scancode.io/issues/116
https://github.com/nexB/scancode.io/issues/141

-------

- Add support for Docker and VM images using RPMs such as Fedora, CentOS, RHEL,
and openSUSE linux distributions.
https://github.com/nexB/scancode.io/issues/6

- Add a compliance alert system based on license policies provided through a
policies.yml file. The compliance alerts are computed from the license_expression and
stored on the codebase resource. When the policy feature is enabled, the compliance
alert values are displayed in the UI and returned in all the downloadable results.
The enable and setup the policy feature, refer to
https://scancodeio.readthedocs.io/en/latest/scancodeio-settings.html#scancode-io-settings
https://github.com/nexB/scancode.io/issues/90

- Add a new codebase resource detail view including the file content.
Detected value can be displayed as annotation in the file source.
https://github.com/nexB/scancode.io/issues/102

- Download URLs can be provided as inputs on the project form.
Each URL is fetched and added to the project input directory.
https://github.com/nexB/scancode.io/issues/100

- Run celery worker with the "threads" pool implementation.
Implement parallelization with ProcessPoolExecutor for file and package scans.
Add a SCANCODEIO_PROCESSES settings to control the multiprocessing CPUs count.
https://github.com/nexB/scancode.io/issues/70

- Optimize "tag" type pipes using the update() API in place of save() on the QuerySet
iteration.
https://github.com/nexB/scancode.io/issues/70

- Use the extractcode API for the Docker pipeline.
This change helps with performance and results consistency between pipelines.
https://github.com/nexB/scancode.io/issues/70

- Implement cache to prevent scanning multiple times a duplicated codebase resource.
https://github.com/nexB/scancode.io/issues/70

- Create the virtualenv using the virtualenv.pyz app in place of the bundled "venv".
https://github.com/nexB/scancode.io/issues/104

- Consistent ordering for the pipelines, now sorted alphabetically.

-------------------

- Display project extra data in the project details view.
https://github.com/nexB/scancode.io/issues/88

- Add a profile decorator for profiling pipeline step execution.
https://github.com/nexB/scancode.io/issues/73

- Support inputs as tarballs in root_filesystem pipelines.
The input archives are now extracted with extractcode to the codebase/ directory.
https://github.com/nexB/scancode.io/issues/96

- Improve support for unknown distros in docker and root_filesystem pipelines.
The pipeline logs the distro errors on the project instead of failing.
https://github.com/nexB/scancode.io/issues/97

- Implement Pipeline registration through distribution entry points.
Pipeline can now be installed as part of external libraries.
With this change pipelines are no longer referenced by the
Python script path, but by their registered name.
This is a breaking command line API change.
https://github.com/nexB/scancode.io/issues/91

- Add a "Run Pipeline" button in the Pipeline modal of the Project details view.
Pipelines can now be added from the Project details view.
https://github.com/nexB/scancode.io/issues/84

- Upgrade scancode-toolkit to version 21.2.9

- Allow to start the pipeline run immediately on addition in the `add_pipeline` action
of the Project API endpoint.
https://github.com/nexB/scancode.io/issues/92

- Rename the pipes.outputs module to pipes.output for consistency.

- Remove the dependency on Metaflow.
WARNING: The new Pipelines syntax is not backward compatible with v1.0.x
https://github.com/nexB/scancode.io/issues/82

-------------------

- Add user interface to manage Projects from a web browser
All the command-line features are available
https://github.com/nexB/scancode.io/issues/24

- Log messages from Pipeline execution on a new Run instance `log` field
https://github.com/nexB/scancode.io/issues/66

- Add support for scancode pipes and Project name with whitespaces

- Add a profile() method on the Run model for profiling pipeline execution
https://github.com/nexB/scancode.io/issues/73