Padocc

Bug Fixes
- Fixed error handling with validator (Issue 73)
- Fixed worst_error bugs (Issue 72)
- Fixed identical variables bug (Issue 71)
- Fixed Preslice time issues (Issue 70)
- Fixed Data Formatting in validator (Issue 69)
- Fixed Dimension specs for zarr (Issue 67)
- Fixed Remote s3 config file option (Issue 66)

General Changes
- Added `report` special function.

What's Changed
* Fixed small critical bugs from previous stage: 1.3.4a by dwest77a in https://github.com/cedadev/padocc/pull/76


**Full Changelog**: https://github.com/cedadev/padocc/compare/v1.3.4...v1.3.4a

Bug Fixes
- Fixed a bug with the CFA dataset extension not being applied to the path.
- Fixed the github repo link on the index page.
- Fixed filesystem logging issues for compute phase - now runs well in parallel operation too!

General Changes
- Added `remote_attribute` function applied to datasets in a project.
- Added documentation for all core modules.

Feature Addition: Parallelisation
- Moved `create_sbatch` to `deploy_parallel` for SLURM operation
- Fixed several bugs with existing parallel deployment code, not been updated in a while.
- Added hook for LOTUS2 when ready.
- Added `parallel` flag for parallel deployments for groups.

Feature Addition: S3 write
- Added `write_to_s3` function for zarr filehandler.
- Added `store` properties to zarr filehandlers to easily connect to s3.
- Added `remote_s3` option to Projects so zarr stores can be configured to write to s3.
- Added input capacity for s3 when creating projects in the following functions. *
- Add project (group)
- Init project (group)
- Add/Remove s3 (group/project)

Feature Addition: Special Features
- Consolidated special features in CLI, added `list` option.
- Added `add` feature for CLI.
- Added `list` to enable discovery of groups.
- Added `status` to check status of projects in a group from CLI.
- Added `check` to check an attribute of projects in a group.
- Added `complete` to complete projects in a group.

Coming Soon:
- `write_to_s3` workflow for kerchunk. Needs:
- File Transfer mechanism to s3 for kerchunk file.
- File Transfer mechanism to s3 for NetCDF files (with options)
- Auto rewrite for Kerchunk to fix paths to s3 netcdf files.

Feature Addition: Validation Report
- Added getter function for validation report for each project.

Feature Addition: CCI Integrations
- Added `moles_tags` option to `add_project` for a new way to add projects to groups (+ documentation)
- Added `apply_defaults` option for projects to apply default attributes to dataset filehandlers (+CFA, + documentation)

Bug Fixes
- Fixed bug with logging to filesystem filehandler.
- Fixed bug with failed CFA checks, and ensured results are saved when successful.
- Fixed issue with validation where no size errors are present.

Documentation
- Revised docstrings for all core modules.

New Features
- Added completion workflow for projects and groups.
- Added `spawn_copy` method for filehandlers, fits into completion workflow.
- Added logging for ALL project datasets instances.
- Revised CFA dataset filepath, added forward-compatible checker.
- Added CFA metadata write ability.
- Added Automatic CFA dataset updates when ANY other dataset metadata is updated.
- Added Automatic history addition if minor version is incremented.

Bug Fixes
- Fixed bug with using index to ID project from cli
- Fixed bug when updating cloud format to CFA (55)
- Fixed CFA scan order issue - CFA scan performed as base (56)
- Fixed bug with validator check - dimension differences prevented data difference detection which interfered with `identical_dims` (57)

All feature adjustments
- Privatised some directory creations (SLURM) in projects and group.
- Removed file/dir exists check from projects.
- Removed obsolete custom errors.
- Fixed various bugs in all project/group methods. Any further bugs should be reported as github issues.
- Added CLI and Interactive sections in the Documentation (MAJOR UPGRADE)
- Rearranged all dataset properties.
- Rearranged CFA-only operation to a sensible configuration (base ComputeOperation now performs CFA conversion)
- Tested Add/Remove project
- Noted Transfer-Project as an issue
- Noted Merge/Unmerge as an issue due to transfer project.
- Noted project manipulation issue (solved by Dave Poulter)
- Fixed Zarr compute and Zstore filehandler issues.
- Added Shepard documentation.