Ispyb

-------------------

New or modified tables and columns:

- Add ``purgedProcessedData`` boolean column to the ``BLSession`` table. This is
a flag to indicate whether the ``processed`` folder in the associated visit
directory has been purged.

-------------------

New or modified tables and columns:

- Add ``binnedPixelSize`` column to the ``ParticleClassificationGroup`` table
- Add ``gridSquareId`` column to the ``Tomogram`` table

-------------------

Note: The schema files now include a command in the first line to set the sanbox
mode which is incompatible with older clients. For more info and to disable, see:
https://mariadb.org/mariadb-dump-file-compatibility-change/

Admin: Changes to GitHub workflows as 'main' is now the default branch (previously 'master')

New or modified tables and columns:

- Add ``processingPipelineId`` column to the ``AutoProcProgram`` table
- Add new boolean column ``deleted`` to the ``AutoProcProgramAttachment`` table
- Add unique index on ``BLSample(containerId, location, subLocation)``
- Update the ``ProcessedTomogram`` table comment

Roles and permissions:

- Add new grants for Expeye and combine grants into two roles instead of three
- Add roles and grants for MaxScale
- Add role with grants for fragment screening

Scripts and data changes:

- Trim trailing '1' in the ``SpaceGroup`` table's ``spaceGroupShortName`` column
- Add scripts that can delete ``DataCollection`` and ``DataCollectionGroup`` rows and referenced rows in other tables

-------------------

Roles and permissions: Granted ``SELECT``, ``INSERT``, ``UPDATE`` on ``ProcessedTomogram``
for ``ispyb_processing``

-------------------

Roles and permissions: grants files for new ispyb expeye roles

New or modified tables, columns, lookup values:

- New table ``ProcessedTomogram``
- New rows for 'VMXm-Cartridge' and 'VMXm-Cartridge' in the ``ContainerType`` table
- New FK column ``ownerId`` (references ``Person.personId``) in the ``BLSampleGroup`` table
- New 'Metal ID' enum item in ``DiffractionPlan.experimentKind``
- New 'Metal ID' enum item in ``DataCollectionGroup.experimentType``
- New row for 'Metal ID' (for MX) in ``ExperimentType`` table

Stored procedures: ``upsert_dc_group_v3`` now populates ``DataCollectionGroup.experimentTypeId`` based on ``p_experimenttype``

New script to perform LVM snapshot-based backup

-------------------

New or modified tables and columns:

- New table ``Atlas``
- New table ``GridSquare``
- New Table ``FoilHole``
- In table ``Movie``: New columns ``foilHoleId`` and ``templateLabel``
- In table ``Shipping``: New column ``source`` and ``externalShippingIdToSynchrotron``
- In table ``Dewar``: New column ``source`` and ``externalShippingIdFromSynchrotron``
- In table ``Container``: New column ``source``
- In table ``BLSample``: New column ``source``
- In table ``AutoProcProgramMessage``: Make column ``severity`` not nullable
- In table ``ContainerQueue``: Make column ``containerId`` not nullable

Indexes:

- In table ``BLSubSample``: Replace ``blSampleId`` FK index with compound index ``(blSampleId, source)``
- In table ``ProcessingJobParameter``: Add compund index (parameterKey, processingJobId)
- In table ``AutoProc``: Remove ``spaceGroup`` from compound index ``(refinedCell_a, refinedCell_b, refinedCell_c, refinedCell_alpha, refinedCell_beta, refinedCell_gamma)``

Roles and permissions:

- Granted SELECT, INSERT, UPDATE on ``BFactorFit``, ``Atlas``, ``GridSquare``, ``FoilHole`` for ``ispyb_processing``
- Added new role ``ispyb_propagation`` and granted SELECT, UPDATE, INSERT, DELETE on relevant tables