Dtool

---------------------

Added
^^^^^

- Add ``dtool readme validate`` command
- Ability to update descriptive metadata in README of frozen datasets
when using ``dtool redme write``

Fixed
^^^^^

- Fixed several defects in how URIs were parsed and generated on Windows.

---------------------

Improved Python API for creating datasets.

Added
^^^^^

- dtoolcore.create_proto_dataset() helper function
- dtoolcore.create_derived_proto_dataset() helper function
- dtoolcore.DataSetCreator helper context manager class
- dtoolcore.DerivedDataSetCreator helper context manager class

Fixed
^^^^^

- Fixed defect where using ``DTOOL_NUM_PROCESSES`` > 1 resulted in
a cPickle.PicklingError on some storage brokers. Multiprocessing
is now only used if the storage broker supports it.

---------------------

- Fixed defect where 'dtool verify' calculated hashes even when the '-f/--full'
option was not specified. The 'dtool verify' command now runs more quickly.

---------------------

Added
^^^^^

- Ability to use multiple processes (cores) to generate item properties for
manifest files in parallel. Set the environment variable
``DTOOL_NUM_PROCESSES`` to specify the number of processes to use.

Fixed
^^^^^

- Included .dtool/annotations directory in DiskStorageBroker self description file

---------------------

*New feature: Dataset annotation*

Dataset annotations are intended to make it easy to add and access specific
metadata at a per dataset level.

The difference between annotations and the descriptive metadata is that the
former is easier to work with in a programmatic fashion. The descriptive
metadata, stored in the dataset's README content, is more free form. It is
non-trivial to access specific pieces of information from the descriptive
metadata in the dataset's README content, whereas a dtool annotation can be
easily accessed by its name.

Added
^^^^^

- Added ``dtool annotation set`` command
- Added ``dtool annotation get`` command
- Added ``dtool annotation ls`` command

---------------------

Added
^^^^^

- Added sorting of items by relpath to 'dtool ls <DS_URI>'

Fixed
^^^^^

- Fixed formatting of 'dtool ls <DS_URI>' from using two whitespaces to using
one tab to make it easier to work with command line tools such as ``cut``
- Fixed ordering of lines in overlay CSV template from being sorted by the
identifier to being ordered by the relpath