Resolwe

=================

Changed
-------
- **BACKWARD INCOMPATIBLE:** Require Resolwe 16.x
- **BACKWARD INCOMPATIBLE:** Rename and improve descriptions of
processes specific to CATS RNA-seq kits. Remove related
``cutadapt-star-htseq`` descriptor schema.
- **BACKWARD INCOMPATIBLE:** Remove ``workflow-accel-gatk4`` pipeline.
Remove ``amplicon-panel``, ``amplicon-panel-advanced`` and
``amplicon-master-file`` descriptor schemas.
- **BACKWARD INCOMPATIBLE:** Remove obsolete processes and descriptor
schemas: ``rna-seq-quantseq``, ``bcm-workflow-rnaseq``,
``bcm-workflow-chipseq``, ``bcm-workflow-wgbs``, ``dicty-align-reads``,
``dicty-etc``, ``affy`` and ``workflow-chip-seq``
- Expose additional parameters of ``bowtie2`` process
- Support strandedness auto detection in ``qorts-qc`` process

Added
-----
- Add shRNAde (v1.0) R package to the ``resolwebio/rnaseq:4.4.0`` Docker image
- Add ``resolwebio/scseq`` Docker image
- Add shRNA differential expression process. This is a two-step process which
trims, aligns and quantifies short hairpin RNA species. These are then used
in a differential expression.
- Add ``sc-seq`` processes:

- ``cellranger-mkref``
- ``cellranger-count``
- ``upload-sc-10x``
- ``upload-bam-scseq-indexed``

Fixed
-----
- Bump memory requirements in ``seqtk-sample-single`` and
``seqtk-sample-paired`` processes
- Fix ``cellranger-count`` html report
- Mark spliced-alignments with XS flags in ``workflow-rnaseq-cuffquant``
- Fix whitespace handling in ``cuffnorm`` process


=================

=================

Added
-----
- Add ``qorts-qc`` (Quality of RNA-seq Tool-Set QC) process
- Add ``workflow-bbduk-star-fc-quant-single`` and
``workflow-bbduk-star-fc-quant-paired`` processes
- Add independent gene filtering and gene filtering based on Cook's distance
in ``DESeq2`` differential expression process

Changed
-------
- **BACKWARD INCOMPATIBLE**: Move gene filtering by expression count
input to ``filter.min_count_sum`` in ``DESeq2`` differential expression
process
- **BACKWARD INCOMPATIBLE:** Require Resolwe 15.x
- Update ``resolwebio/common:1.1.0`` Docker image:

- add QoRTs (1.3.0) package
- bump MultiQC to 1.7.0
- bump Subread package to 1.6.3
- Expose ``maxns`` input parameter in ``bbduk-single`` and
``bbduk-paired`` processes. Make this parameter available in workflows
``workflow-bbduk-star-featurecounts-qc-single``,
``workflow-bbduk-star-featurecounts-qc-paired``,
``workflow-bbduk-star-featurecounts-single`` and
``workflow-bbduk-star-featurecounts-paired``.
- Save CPM-normalized expressions in ``feature_counts`` process. Control
the default expression normalization type (``exp_type``) using the
``normalization_type`` input.
- Bump MultiQC to version 1.7.0 in ``multiqc`` process
- Use ``resolwebio/rnaseq:4.3.0`` with Subread/featureCounts version
1.6.3 in ``feature_counts`` process


=================

=================

Changed
-------
- Bump STAR aligner version to 2.7.0c in ``resolwebio/rnaseq:4.2.2``
- Processes ``alignment-star`` and ``alignment-star-index`` now use Docker
image ``resolwebio/rnaseq:4.2.2`` which contains STAR version ``2.7.0c``
- Persistence of ``basespace-file-import`` process changed from ``RAW`` to
``TEMP``

Added
-----
- Make ``prepare-geo-chipseq`` work with both
``data:chipseq:callpeak:macs2`` and
``data:chipseq:callpeak:macs14`` as inputs

Fixed
-----
- Report correct total mapped reads and mapped reads percentage in
prepeak QC report for ``data:alignment:bam:bowtie2`` inputs in
``macs2-callpeak`` process


=================

=================

Changed
-------
- Enable multithreading mode in ``alignment-bwa-aln`` and
``alignment-bwa-sw``
- Lineary lower the timeout for BigWig calculation when running on
multiple cores

Fixed
-----
- Remove ``pip`` ``--process-dependency-links`` argument in testenv
settings
- Fix walt getting killed when ``sort`` runs out of memory. The ``sort``
command buffer size was limited to the process memory limit.


=================

=================

Changed
-------

Added
-----
- Add the ``FASTQ`` file validator script to the ``upload-fastq-single``,
``upload-fastq-paired``, ``files-to-fastq-single`` and
``files-to-fastq-paired`` processes
- Add ``spikein-qc`` process
- Add to ``resolwebio/rnaseq:4.1.0`` Docker image:

- ``dnaio`` Python library
- Add to ``resolwebio/rnaseq:4.2.0`` Docker image:

- ERCC table
- common Genialis fonts and css file
- spike-in QC report template
- Set ``MPLBACKEND`` environment variable to ``Agg`` in
``resolwebio/common:1.0.1`` Docker image

Fixed
-----
- Fix the format of the output ``FASTQ`` file in the ``demultiplex.py``
script
- Fix NSC and RSC QC metric calculation for ATAC-seq and paired-end
ChIP-seq samples in ``macs2-callpeak`` and ``qc-prepeak`` processes


=================

=================

Changed
-------
- **BACKWARD INCOMPATIBLE:** Require Resolwe 14.x
- **BACKWARD INCOMPATIBLE:** Remove obsolete processes ``findsimilar``
- **BACKWARD INCOMPATIBLE:** Include ENCODE-proposed QC analysis metrics
methodology in the ``macs2-callpeak`` process. Simplified MACS2
analysis inputs now allow the use of sample relations
(treatment/background) concept to trigger multiple MACS2 jobs
automatically using the ``macs2-batch`` or ``macs2-rose2-batch``
processes.
- **BACKWARD INCOMPATIBLE:** Update ``workflow-atac-seq`` inputs to
match the updated ``macs2-callpeak`` process
- Use ``resolwebio/rnaseq:4.0.0`` Docker image in
``alignment-star-index``, ``bbduk-single``, ``bbduk-paired``,
``cuffdiff``, ``cufflinks``, ``cuffmerge``, ``cuffnorm``,
``cuffquant``, ``cutadapt-custom-single``, ``cutadapt-custom-paired``,
``cutadapt-single``, ``cutadapt-paired``,
``differentialexpression-deseq2``, ``differentialexpression-edger``,
``expression-aggregator``, ``feature_counts``, ``goenrichment``,
``htseq-count``, ``htseq-count-raw``, ``index-fasta-nucl``,
``library-strandedness``, ``pca``, ``regtools-junctions-annotate``,
``rsem``, ``salmon-index``, ``trimmomatic-single``,
``trimmomatic-paired``, ``upload-expression``,
``upload-expression-cuffnorm``, ``upload-expression-star``,
``upload-fasta-nucl``, ``upload-fastq-single``,
``upload-fastq-paired``, ``files-to-fastq-single``,
``files-to-fastq-paired``, ``upload-gaf``, ``upload-genome``,
``upload-gff3``, ``upload-gtf`` and ``upload-obo``
- Order statistical groups in expression aggregator output by sample
descriptor field value
- Use ``resolwebio/biox:1.0.0`` Docker image in ``etc-bcm``,
``expression-dicty`` and ``mappability-bcm`` processes
- Use ``resolwebio/common:1.0.0`` Docker image in ``amplicon-table``,
``mergeexpressions``, ``upload-diffexp``, ``upload-etc``,
``upload-multiplexed-single`` and ``upload-multiplexed-paired``
processes
- Use ``resolwebio/base:ubuntu-18.04`` Docker image in
``create-geneset``, ``create-geneset-venn``, ``mergeetc``,
``prepare-geo-chipseq``, ``prepare-geo-rnaseq``, ``upload-cxb``,
``upload-geneset``, ``upload-header-sam``, ``upload-mappability``,
``upload-snpeff`` and ``upload-picard-pcrmetrics`` processes
- Update GATK4 to version 4.0.11.0 in ``resolwebio/dnaseq:4.1.0`` Docker
image. Install and use JDK v8 by default to ensure compatibility with
GATK4 package.
- Use ``resolwebio/dnaseq:4.1.0`` Docker image in ``align-bwa-trim``,
``coveragebed``, ``filtering-chemut``, ``lofreq``,
``picard-pcrmetrics``, ``upload-master-file``, ``upload-variants-vcf``
and ``vc-gatk4-hc`` processes
- Expose reads quality filtering (q) parameter, reorganize inputs and
rename the stats output file in ``alignment-bwa-aln`` process
- Use ``resolwebio/chipseq:4.0.0`` Docker image in ``chipseq-genescore``,
``chipseq-peakscore``, ``macs14``, ``upload-bed`` and ``qc-prepeak``
processes
- Use ``resolwebio/bamliquidator:1.0.0`` Docker image in
``bamliquidator`` and ``bamplot`` processes

Added
-----
- Add biosample source field to ``sample`` descriptor schema
- Add ``background_pairs`` Jinja expressions filter that accepts a list of
data objects and orders them in a list of pairs (case, background) based on
the background relation between corresponding samples
- Add ``chipseq-bwa`` descriptor schema. This schema specifies the
default inputs for BWA ALN aligner process as defined in ENCODE
ChIP-Seq experiments.
- Add support for MACS2 result files to MultiQC process
- Add ``macs2-batch``, ``macs2-rose2-batch`` and ``workflow-macs-rose``
processes
- Add feature symbols to expressions in ``archive-samples`` process

Fixed
-----
- Make ChIP-seq fields in ``sample`` descriptor schema visible when
ChIPmentation assay type is selected
- Fix handling of whitespace in input BAM file name in script
``detect_strandedness.sh``
- Set available memory for STAR aligner to 36GB. Limit the available
memory for STAR aligner ``--limitBAMsortRAM`` parameter to 90% of the
Docker requirements setting
- Set ``bbduk-single`` and ``bbduk-paired`` memory requirements to 8GB
- Fix wrong file path in ``archive-samples`` process


=================