Pipelime-python

What's Changed
* :computer: Several fixes for the TUI, to adapt it to the latest updates of `textual`.
* :zap: Multiprocessing is now done with `multiprocessing` from standard library, insted of `billiard` which caused random deadlocks. This change prevents spawning nested processes by default, but it is possible to enable it with a flag in the grabber ( :warning: this may lead to zombie processes and unreleased resources in case of unhandled crashes).
* :bomb: :sparkles: :fire: `pipelime` finally supports `pydantic v2`! Internally, we still use `pydantic v1` by doing `import pydantic.v1 as pyd`. This can be done starting from `pydantic==1.10.17`, so that final users can still use `pydantic v1`, if needed.
* 💥 The data cache is disabled by default for all items! A new option can be passed to the CLI to enable it for all the items or for a specific subset.
* ✨ It is now possible to create a `SamplesSequence` from a single video (each sample will contain one frame of the video).
* :up: Python supported versions have been updated to `3.10`, `3.11` and `3.12`.
* :building_construction: Tox can now be used to run tests against all supported python versions.

**Full Changelog**: https://github.com/eyecan-ai/pipelime-python/compare/v1.9.1...v2.0.0

What's Changed
* 91% test coverage
* 🩹 fixed ShellCommand
* 🚸 if `LOGURU_LEVEL` is not set as env var, then `-v` sets the logger level from `WARNING` (no `-v`) to `TRACE` (`-vvv` or more)
* 🗑️ `WatcherNodesGraphExecutor` has been deprecated (use `DirectTrackCallback` instead)


**Full Changelog**: https://github.com/eyecan-ai/pipelime-python/compare/v1.9.0...v1.9.1

What's Changed

🎉 New Features!
* 🚸 last `pipelime` call (with no `--ckpt` option) is saved and can be **replayed** with `pipelime resume` (❗TUI partial inputs included❗)
* 👉 actually, last 3 calls are cached: try this `pipelime resume +ckpt 2` to replay the second-last
* ✨ `cat` (both _pipe_ and _command_) accepts multiple sequences with optional `interleave` flag
* ✨ `batched`/`unbatched` pipes to group/ungroup multiple samples
* ✨ InputDatasetInterface and OutputDatasetInterface accept a custom pipe; now you can:
* ⚙️ add a custom processing on input/output dataset
* 🔀 completely replace the data source with your own
* ✏️ skip the default output underfolder

🪛 Many Fixes And UX Improvements!
*🪄 interactive context filling when, eg, some `$var`s are missing
*🧵 multiprocessing should now eat almost everything, lambda functions included
* 🧑‍💻 better error reporting in case of malformed `command` or failing imports
* 📝 `pipelime lc` lists DAG commands in a separate section
* 🚸 when `pipelime help` finds a pydantic `Field` with `expand_help=True`, such field will be expanded if the type is a `BaseModel`
* 🐛 fixed `split` command with size `1`

**Full Changelog**: https://github.com/eyecan-ai/pipelime-python/compare/v1.8.1...v1.9.0

What's Changed
* stub for `SamplesSequence.from_images` had an incorrect default
* fixed error when loading extra `.py` files multiple times
* fixed some use-cases in dag creation and drawing
* fixed missing variable in `FileListenerCallback`
* fixed `pipelime list` that was not showing anything


**Full Changelog**: https://github.com/eyecan-ai/pipelime-python/compare/v1.8.0...v1.8.1

What's Changed
* 🎉 Big news:
* 🛸 Resume from checkpoint! -> [especially when you run a DAG](https://pipelime-python.readthedocs.io/en/latest/cli/piper.html#resuming-a-dag-from-a-checkpoint)
* 🧑‍💻 When you import a python symbol, eg, `$symbol`, `CallableDef` etc, now you can even use **plain python code** or **lambda** -> and it is **fully compatible** with a multi-process grabber!
* 🧑‍💻 CLI: no need to repeat a `+/` option when you want to append a value -> [see the docs](https://pipelime-python.readthedocs.io/en/latest/cli/overview.html#merge-options-from-file-and-command-line)
* 🕸️ DAG news:
* 🛸 [Resume/Replay a DAG](https://pipelime-python.readthedocs.io/en/latest/cli/piper.html#resuming-a-dag-from-a-checkpoint)
* ✏️ Advanced node selection -> [see the docs](https://pipelime-python.readthedocs.io/en/latest/cli/piper.html#running-a-subset-of-nodes)
* 🐍 Python DAGs:
* 📝 [Checkout the docs](https://pipelime-python.readthedocs.io/en/latest/cli/piper.html#python-dag)
* 🧑‍💻 `create_graph` can return a list of (lazy) `PipelimeCommand`s: node names will be auto-generated
* 🗑️ Temp folder is not automatically delete if you use `--keep-tmp`
* ✨ Commands, stages and pipes:
* `stage-time` command to measure the average time spent by each stage of a pipeline
* `resume` command to load and run a Pipelime checkpoint
* `map-if` command to apply a stage only on a subset of samples
* `repeat` now accepts floating point values to repeat a sequence a fractional number of times
* 🚶 General improvements:
* 🧑‍💻 `PipelimeTmp.make_session_dir()` now always returns a subfolder of the Pipelime session temp folder
* 🐛 command now correctly manages submodel parameters
* ✨ Input/Output interface now have a default piper port
* ✨ The pydantic type `NewPath` can check or set the extension for you


**Full Changelog**: https://github.com/eyecan-ai/pipelime-python/compare/v1.7.0...v1.8.0

What's Changed
* fix: 🐛 Choixe now supports non-string dictionary keys
* fix: 🐛 Input/Output command ports can now be mappings
* feat: 🧑‍💻 Decoupled DAG command and DAG creation
* feat: ✨ Remove cached data after serialization


**Full Changelog**: https://github.com/eyecan-ai/pipelime-python/compare/v1.6.2...v1.7.0