Dcicsnovault

=====

* Redis support, adding /callback info to /auth0_config if a Redis server is configured

=====

* Change ``pytest.yield_fixture`` to ``pytest.yield``. This is techinically incompatible since it would break downstream portals if they were below ``pytest`` 6, but they are both at ``pytest 7`` now, so they should be unaffected.
* Address some places involving ``.execute(raw_string)`` that should be ``.execute(text(raw_string))``.

=====

* In ``Makefile``:

* Make sure ``make test`` and ``make test-full`` also run ``make test-static``.

* In ``snovault/storage.py``:

* Add ``POSTGRES_COMPATIBLE_MAJOR_VERSIONS`` (moved from ``snovault/tests/test_storage.py``)

* In ``snovault/elasticsearch/create_mapping.py``:

* Per Will's direction, replace a call to ``run_index_data`` with a ``vapp`` creation and
a call to an index post with given uuids.

* In ``snovault/elasticsearch/mpindexer.py``:

* Very minor syntactic refactor to make a use of ``global`` more clear.

* In ``snovault/tools.py``:

* Reimplement ``index_n_items_for_testing`` for better clarity and to fix a potential bug.

* In ``snovault/tests/test_indexing.py``

* Various test optimizations using better synchronization for robustness.

=====

* In ``Makefile``:

* New ``make`` target ``test-one``.


* Separate testing of indexing tests from other unit tests,
renaming the "npm" tests to "indexing" tests.

* Make github workflow ``main.yml`` consistent with ``Makefile`` changes.

* In ``pyproject.toml``:

* Use ``pytest 7.2.2``.

=====

* In ``Makefile``:

* Add ``make test-full`` to test like ``make test`` but without the ``instafail`` option.

* Add ``make test-static`` to run static checks.

* Add ``make test-one TEST_NAME=<test_name_or_filename_base>`` so you can test a single file or test from ``make``.
This is not so important in ``snovault`` as in ``cgap-portal`` but I want the interface to be uniform.

* In all testing, added ``SQLALCHEMY_WARN_20=1`` at start of command line to enable SQLAlchemy 2.0
compatibility warnings, since we're using ``SQLAlchemy 1.4``, which has those warnings.

* In ``pyproject.toml``:
* Require ``dcicutils 6,7`` for fixes to ``Eventually``.

* Include ``pipdeptree`` as a dev dependency for debugging.

* Remove "backports.statistics", needed for Python 3.3 support and earlier.

* Bump python_magic foothold (no effective change, just faster locking)

* Update some comments.

* In ``snovault/updater.py``:

* Better error message for UUID integrity errors, noting they might not be conflits but just maybe also UUID missing.

* Rearrange imports for clarity.

* In new file ``snovault/tools.py``:

* New functions ``make_testapp``, ``make_htmltestapp``, ``make_authenticated_testapp``,
``make_submitter_testapp``, ``make_indexer_testapp``, and ``make_embed_testapp``.

* New context managers ``being_nested`` and ``local_collections``.

* New function ``index_n_items_for_testing``.

These functions are potentially useful in the portal repos, so are not part of the test files.

* In file ``snovault/tests/serverfixtures.py``:

* New fixture ``engine``

* In file ``snovault/tests/test_indexing.py``:

* Material changes to testing to use better storage synchronization (semaphor-style rather than sleep-style),
hopefully achieving fewer intermittent errors in testing both locally and in GA.

* Bug fixes in a few tests that were assigning settings or other dictionary structures but not assuring an
undo was done if the test failed.

* In files ``snovault/util.py``, ``snovault/tests/test_embedding.py``, ``snovault/tests/test_storage.py``:

* Various changes for PEP8 or other readability reasons, including to satisfy ``PyCharm`` linters.

* Allow Postgres 14 to be used.

=====

* In ``upgrader.py``, default ``parse_version`` argument to ``'0'``, rather than ``'1'``
when ``None`` or the empty string is given.

* Remove the Python 3.7 classifier in ``pyproject.toml``.

* Add ``make clear-poetry-cache`` in ``Makefile``.

* Misc PEP8.