Synapse

====================

Features and Enhancements
-------------------------
- Add ``.cacheget()`` and ``cacheset()`` APIs to the Storm ``node:data``
object for easy caching of structured data on nodes based on time.
(`2290 <https://github.com/vertexproject/synapse/pull/2290>`_)
- Make the Stormtypes unique properly with a Set type. This does disallow the
use of mutable types such as dictionaries inside of a Set.
(`2225 <https://github.com/vertexproject/synapse/pull/2225>`_)
- Skip executing non-runtsafe commands when there are no inbound nodes.
(`2291 <https://github.com/vertexproject/synapse/pull/2291>`_)
- Add ``asroot:perms`` key to Storm Package modules. This allows package
authors to easily declare permissions their packages. Add Storm commands
``auth.user.add``, ``auth.role.add``, ``auth.user.addrule``,
``auth.role.addrule``, and ``pkg.perms.list`` to help with some of the
permission management.
(`2294 <https://github.com/vertexproject/synapse/pull/2294>`_)

====================

Features and Enhancements
-------------------------
- Add a ``iden`` parameter when creating Cron jobs to allow the creation of
jobs with stable identifiers.
(`2264 <https://github.com/vertexproject/synapse/pull/2264>`_)
- Add ``$lib.cell`` Stormtypes library to allow for introspection of the
Cortex from Storm for Admin users.
(`2285 <https://github.com/vertexproject/synapse/pull/2285>`_)
- Change the Telepath Client connection loop error logging to log at the
Error level instead of the Info level.
(`2283 <https://github.com/vertexproject/synapse/pull/2283>`_)
- Make the tag part normalization more resilient to data containing non-word
characters.
(`2289 <https://github.com/vertexproject/synapse/pull/2289>`_)
- Add ``$lib.tags.prefix()`` Stormtypes to assist with normalizing a list of
tags with a common prefix.
(`2289 <https://github.com/vertexproject/synapse/pull/2289>`_)
- Do not allow the Storm ``divert`` command to work with non-generator
functions.
(`2282 <https://github.com/vertexproject/synapse/pull/2282>`_)

Bugfixes
--------
- Fix an issue with Storm command execution with non-runtsafe options.
(`2284 <https://github.com/vertexproject/synapse/pull/2284>`_)
- Log when the process pool fails to initialize. This may occur in certain
where CPython multiprocessing primitives are not completely supported.
(`2288 <https://github.com/vertexproject/synapse/pull/2288>`_)
- In the Telepath Client, fix a race condition which could have raised an
AttributeError in Aha resolutions.
(`2286 <https://github.com/vertexproject/synapse/pull/2286>`_)
- Prevent the reuse of a Telepath Client object when it has been fini'd.
(`2286 <https://github.com/vertexproject/synapse/pull/2286>`_)
- Fix a race condition in the Aha server when handling distributed changes
which could have left the service in a desynchronized state.
(`2287 <https://github.com/vertexproject/synapse/pull/2287>`_)

Improved Documentation
----------------------
- Update the documentation for the ``synapse.tools.feed`` tool.
(`2279 <https://github.com/vertexproject/synapse/pull/2279>`_)

====================

Features and Enhancements
-------------------------
- Add a Storm ``divert`` command to ease the implementation of ``--yield``
constructs in Storm commands. This optionally yields nodes from a generator,
or yields inbound nodes, while still ensuring the generator is conusmed.
(`2277 <https://github.com/vertexproject/synapse/pull/2277>`_)
- Add Storm runtime debug tracking. This is a boolean flag that can be set or
unset via ``$lib.debug``. It can be used by Storm packages to determine if
they should take extra actions, such as additional print statements, without
needing to track additional function arguments in their implementations.
(`2278 <https://github.com/vertexproject/synapse/pull/2278>`_)

Bugfixes
--------
- Fix an ambiguity in the Storm grammar.
(`2280 <https://github.com/vertexproject/synapse/pull/2280>`_)
- Fix an issue where form autoadds could fail to be created in specific cases of
the model.
(`2273 <https://github.com/vertexproject/synapse/pull/2273>`_)

====================

Features and Enhancements
-------------------------
- Add ``$lib.regex.replace()`` Stormtypes API to perform regex based
replacement of string parts.
(`2274 <https://github.com/vertexproject/synapse/pull/2274>`_)
- Add universal properties to the dictionary returned by
``Cortex.getModelDict()`` as a ``univs`` key.
(`2276 <https://github.com/vertexproject/synapse/pull/2276>`_)
- Add additional ``asyncio.sleep(0)`` statements to ``Layer._storNodeEdits``
to improve Cortex responsiveness when storing large numbers of edits at
once.
(`2275 <https://github.com/vertexproject/synapse/pull/2275>`_)

====================

Features and Enhancements
-------------------------
- Update the Cortex ``storm:log:level`` configuration value to accept string
values such as ``DEBUG``, ``INFO``, etc. The default log level for Storm
query logs is now ``INFO`` level.
(`2262 <https://github.com/vertexproject/synapse/pull/2262>`_)
- Add ``$lib.regex.findall()`` Stormtypes API to find all matching parts of a
regular expression in a given string.
(`2265 <https://github.com/vertexproject/synapse/pull/2265>`_)
- Add ``$lib.inet.http.head()`` Stormtypes API to perform easy HEAD requests,
and ``allow_redirects`` arguments to existing ``lib.inet.http`` APIs to
allow controlling the redirect behavior.
(`2268 <https://github.com/vertexproject/synapse/pull/2268>`_)
- Add ``$lib.storm.eval()`` API to evaluate Storm values from strings.
(`2269 <https://github.com/vertexproject/synapse/pull/2269>`_)
- Add ``getSystemInfo()`` and ``getBackupInfo()`` APIS to the Cell for getting
useful system information.
(`2267 <https://github.com/vertexproject/synapse/pull/2267>`_)
- Allow lists in rstorm bodies.
(`2261 <https://github.com/vertexproject/synapse/pull/2261>`_)
- Add a ``:desc`` secondary property to the ``proj:sprint`` form.
(`2261 <https://github.com/vertexproject/synapse/pull/2261>`_)
- Call _normStormPkg in all loadStormPkg paths, move validation to post
normalization and remove mutation in validator
(`2260 <https://github.com/vertexproject/synapse/pull/2260>`_)
- Add ``SYN_SLAB_COMMIT_PERIOD`` environment variable to control the Synapse
slab commit period. Add ``layer:lmdb:max_replay_log`` Cortex option to
control the slab replay log size.
(`2266 <https://github.com/vertexproject/synapse/pull/2266>`_)
- Update Ahacell log messages.
(`2270 <https://github.com/vertexproject/synapse/pull/2270>`_)

Bugfixes
--------
- Fix an issue where the ``Trigger.pack()`` method failed when the user that
created the trigger had been deleted.
(`2263 <https://github.com/vertexproject/synapse/pull/2263>`_)

Improved Documentation
----------------------
- Update the Cortex devops documentation for the Cortex to document the Storm
query logging. Update the Cell devops documentation to explain the Cell
logging and how to enable structured (JSON) logging output.
(`2262 <https://github.com/vertexproject/synapse/pull/2262>`_)
- Update Stormtypes API documentation for ``bool``, ``proj:epic``,
``proj:epics``, ``proj:ticket``, ``proj:tickets``, ``proj:sprint``,
``proj:sprints``, ``proj:project``, ``stix:bundle`` types.
(`2261 <https://github.com/vertexproject/synapse/pull/2261>`_)

====================

Features and Enhancements
-------------------------
- Add a application level process pool the base Cell implemenation. Move the
processing of Storm query text into the process pool.
(`2250 <https://github.com/vertexproject/synapse/pull/2250>`_)
(`2259 <https://github.com/vertexproject/synapse/pull/2259>`_)
- Minimize the re-validation of Storm code on Cortex boot.
(`2257 <https://github.com/vertexproject/synapse/pull/2257>`_)
- Add the ``ou:preso`` form to record conferences and presentations. Add a
``status`` secondary property to the ``it:mitre:attack:technique`` form to
track if techniques are current, deprecated or withdrawn.
(`2254 <https://github.com/vertexproject/synapse/pull/2254>`_)

Bugfixes
--------
- Remove incorrect use of ``cmdopts`` in Storm command definitions unit tests.
(`2258 <https://github.com/vertexproject/synapse/pull/2258>`_