Resolwe

===================

Added
-----
- Add processes ``gatk-variant-filtration-single`` and
``gatk-select-variants-single``
- Add ExtendedCollectionFilter filter to allow filtering collections by samples
containing given species, tissue type, outcome or treatment type
- Add process ``reference-space`` and ``upload-ml-expression``
- Rewrite ``macs2-callpeak`` process to Python
- Add process ``mutations-table``

Changed
-------
- Specify tmp dir for GATK processes
- Attach workflow data objects to Samples
- Remove ``workflow-accel`` pipeline and related process:
``align-bwa-trim``, ``coveragebed``, ``picard-pcrmetrics``,
``upload-picard-pcrmetrics``, ``upload-picard-pcrmetrics``,
``vc-realign-recalibrate``, ``vc-gatk-hc``, ``lofreq``,
``snpeff-legacy``, ``amplicon-report``, ``amplicon-table``,
``upload-master-file``, ``amplicon-archive-multi-report``,
``upload-snpeff``
- Rewrite processes to Python and add ``geneset`` DescriptorSchema to
Data made by processes:

- ``upload-geneset``
- ``create-geneset``
- ``create-geneset-venn``

Fixed
-----
- Attach GATK VariantFiltration and SelectVariants output to the
Sample object in ``workflow-rnaseq-variantcalling`` pipeline
- Set ``Persistence`` property to ``TEMP`` for processes
``find-similar`` and ``clustering-hierarchical-etc``
- Fix input schema in pipeline ``workflow-rnaseq-variantcalling``
- Fail gracefully when no relation labels are found in
``merge-fastq-single`` and ``merge-fastq-paired`` processes


===================

===================

Added
-----
- Add process ``gatk-split-ncigar``
- Add process ``gatk-variant-filtration``
- Add process ``snpeff``
- Add workflow ``workflow-rnaseq-variantcalling``
- Add support for ``Python`` 3.10

Changed
-------
- **BACKWARD INCOMPATIBLE:** Require Resolwe 30.x
- **BACKWARD INCOMPATIBLE:** Change the slug of the process
``snpeff`` to ``snpeff-legacy``
- **BACKWARD INCOMPATIBLE:** Deprecate process ``upload-orange-metadata``
in favour of processes ``upload-metadata`` and
``upload-metadata-unique``
- Add parameter ``--use-original-qualities`` to ``bqsr`` process
- Add ``fn_ignore_dirs`` options to MultiQC configuration file in
``resolwebio/common:3.0.1`` Docker image
- Add parameter ``--exclude-filtered`` to ``gatk-select-variants``
process
- Normalize processes that use ``resolwebio/dnaseq`` Docker image to
use the latest version 6.3.1 and modify tests as necessary
- Rewrite process ``vc-gatk4-hc`` to Python
- Prepare ``resolwebio/rnaseq:6.0.0`` Docker image:

- Update Python package versions for Python 3.8
- Pin R package versions
- Bump genome-tools to 1.6.2
- Add Java memory settings to processes ``bqsr`` and ``markduplicates``
- Update SnpEff version to 5.1 in ``resolwebio/snpeff:2.1.0`` Docker
image
- Add additional file output with source ids and target ids to process
``goenrichment``
- Normalize all processes that rely on ``rnaseq`` Docker image to use
the latest ``resolwebio/rnaseq:6.0.0`` Docker image version

Fixed
-----
- Fix ``--cl-config`` input option in MultiQC process. Use
``resolwebio/common:3.0.1`` Docker image with updated MultiQC
configuration file to omit parsing the unwanted ``tmp`` folder
- Fix LISTENER_CONNECTION settings to work on Mac
- Add tool Tabix to ``resolwebio/snpeff:2.1.1`` Docker image


===================

===================

Added
-----
- Add bcftools version 1.14 to ``resolwebio/common`` Docker image

Changed
-------
- **BACKWARD INCOMPATIBLE:** Rewrite processes
``workflow-bbduk-star-featurecounts-qc-single`` and
``workflow-bbduk-star-featurecounts-qc-paired`` to Python
- **BACKWARD INCOMPATIBLE:** Rewrite workflows
``workflow-bbduk-star-fc-quant-single``,
``workflow-bbduk-star-fc-quant-paired``,
``workflow-cutadapt-star-fc-quant-single`` and
``workflow-cutadapt-star-fc-quant-wo-depletion-single`` to Python
- **BACKWARD INCOMPATIBLE:** Rewrite workflows
``workflow-bbduk-salmon-qc-single`` and
``workflow-bbduk-salmon-qc-paired`` to Python
- Changes to ``resolwebio/common:3.0.0`` Docker image include pinning
of R version and corresponding packages, fixed Python to 3.8,
updated picard-tools to version 2.26.10, updated samtools to
version 1.14 and updated MultiQC to version 1.11
- Normalize processes that use ``resolwebio/common`` Docker image to
use the latest version 3.0.0 and modify tests as necessary
- Bump GATK version to 4.2.4.1 and pin R package versions in
``resolwebio/dnaseq:6.3.0`` Docker image
- **BACKWARD INCOMPATIBLE:** Bump Django requirement to version 3.2

Fixed
-----
- Fix file import and process progress updates in ``upload-fasta-nucl``
- Fix Ensembl-VEP installation in ``resolwebio/dnaseq:6.3.1`` Docker
image


===================

===================

Added
-----
- Add an action for resolving pasted genes on Feature endpoint
- Make Knowledge base squashed migration reversable

Changed
-------
- **BACKWARD INCOMPATIBLE:** Run ``ensembl-vep`` process offline and add
mandatory reference sequence input
- **BACKWARD INCOMPATIBLE:** Remove Diagenode CATS RNA-seq pipeline and
related tools (``rsem``, ``index-fasta-nucl``,
``workflow-custom-cutadapt-star-htseq-single``,
``workflow-custom-cutadapt-star-htseq-paired``,
``workflow-custom-cutadapt-star-rsem-single``,
``workflow-custom-cutadapt-star-rsem-paired``,
``cutadapt-custom-single``, ``cutadapt-custom-paired``).
- **BACKWARD INCOMPATIBLE:** Remove HTSeq-count tool and related
workflows (``htseq-count``, ``htseq-count-raw``,
``workflow-rnaseq-single``, ``workflow-rnaseq-paired``,
``workflow-bbduk-star-htseq``).
- **BACKWARD INCOMPATIBLE:** Remove redundant ``wgs-preprocess`` process
- **BACKWARD INCOMPATIBLE:** Unify Feature autocomplete and search
endpoints into a single endpoint
- Rewrite ``goenrichment`` process to Python
- Rewrite process ``basespace-file-import`` to Python
- Change Ensembl-VEP version check in ``ensembl-vep`` process
- Rename ``featureCounts`` class to ``FeatureCounts``
- Add scatter-gather approach for ``BaseRecalibrator`` and ``ApplyBQSR``
in ``wgs-preprocess-bwa2`` process

Fixed
-----
- Fix build mismatch error message in ``differentialexpression-deseq2``
- Fix how ``self.progress`` is called in ``FeatureCounts``


===================

===================

Added
-----
- Add ``gatk-select-variants`` process

Changed
-------
- **BACKWARD INCOMPATIBLE:** Rewrite ``alignment-star`` and
``alignment-star-index`` processes to Python
- **BACKWARD INCOMPATIBLE:** Rewrite processes ``upload-expression``
and ``upload-expression-cuffnorm`` to Python
- Rewrite processes ``seqtk-sample-single`` and ``seqtk-sample-paired``
to Python
- Rewrite ``bbduk-single`` and ``bbduk-paired`` processes to Python
- Rewrite processes ``upload-fastq-single``, ``upload-fastq-paired``,
``files-to-fastq-single`` and ``files-to-fastq-paired`` to Python
- Rewrite processes ``clustering-hierarchical-samples`` and
``clustering-hierarchical-genes`` to Python
- Add java memory setting and remove unused inputs in
``gatk-genotype-gvcfs``
- Change the ``independent`` field to True by default in process
``differentialexpression-deseq2`` to match the behaviour of the R
script
- Add ``--fork`` parameter in ``ensembl-vep`` process


===================

===================

Added
-----
- Add ``gatk-merge-vcfs`` process

Changed
-------
- **BACKWARD INCOMPATIBLE:** Require Resolwe 29.x
- **BACKWARD INCOMPATIBLE:** Update ``workflow-wgs-gvcf`` to include
BWA-MEM2-based preprocessing step. Support triggering the pipeline
using a pre-aligned BAM input file
- Add ``qin`` and ``ignorebadquality`` BBDuk options to workflows
``workflow-bbduk-salmon-qc-single``,
``workflow-bbduk-salmon-qc-paired``,
``workflow-bbduk-star-featurecounts-qc-single``,
``workflow-bbduk-star-featurecounts-qc-paired``,
``workflow-bbduk-star-fc-quant-single``,
``workflow-bbduk-star-fc-quant-paired``,
``workflow-bbduk-star-htseq``,
``workflow-bbduk-star-htseq-paired``
- Replace ReSDK interface with Python API calls when accesing the
gene KB in processes ``salmon-quant``, ``alleyoop-collapse``,
``slam-count`` and ``mapped-microarray-expression``
- Use downsampled alignment for running QoRTs in 3' mRNA-Seq workflows
``workflow-bbduk-star-fc-quant-single``,
``workflow-bbduk-star-fc-quant-paired``,
``workflow-cutadapt-star-fc-quant-single``,
``workflow-cutadapt-star-fc-quant-wo-depletion-single``
- Replace ``ANONYMOUS_USER_ID`` with ``ANONYMOUS_USER_NAME`` in
settings.py
- Add java memory settings in ``gatk-genomicsdb-import``

Fixed
-----
- Fix data name and advanced options in ``variants-to-table`` process


===================