Pipelime-python

Latest version: v1.9.1

Safety actively analyzes 688792 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 4

1.9.1

What's Changed
* 91% test coverage
* 🩹 fixed ShellCommand
* 🚸 if `LOGURU_LEVEL` is not set as env var, then `-v` sets the logger level from `WARNING` (no `-v`) to `TRACE` (`-vvv` or more)
* πŸ—‘οΈ `WatcherNodesGraphExecutor` has been deprecated (use `DirectTrackCallback` instead)


**Full Changelog**: https://github.com/eyecan-ai/pipelime-python/compare/v1.9.0...v1.9.1

1.9.0

What's Changed

πŸŽ‰ New Features!
* 🚸 last `pipelime` call (with no `--ckpt` option) is saved and can be **replayed** with `pipelime resume` (❗TUI partial inputs included❗)
* πŸ‘‰ actually, last 3 calls are cached: try this `pipelime resume +ckpt 2` to replay the second-last
* ✨ `cat` (both _pipe_ and _command_) accepts multiple sequences with optional `interleave` flag
* ✨ `batched`/`unbatched` pipes to group/ungroup multiple samples
* ✨ InputDatasetInterface and OutputDatasetInterface accept a custom pipe; now you can:
* βš™οΈ add a custom processing on input/output dataset
* πŸ”€ completely replace the data source with your own
* ✏️ skip the default output underfolder

πŸͺ› Many Fixes And UX Improvements!
*πŸͺ„ interactive context filling when, eg, some `$var`s are missing
*🧡 multiprocessing should now eat almost everything, lambda functions included
* πŸ§‘β€πŸ’» better error reporting in case of malformed `command` or failing imports
* πŸ“ `pipelime lc` lists DAG commands in a separate section
* 🚸 when `pipelime help` finds a pydantic `Field` with `expand_help=True`, such field will be expanded if the type is a `BaseModel`
* πŸ› fixed `split` command with size `1`

**Full Changelog**: https://github.com/eyecan-ai/pipelime-python/compare/v1.8.1...v1.9.0

1.8.1

What's Changed
* stub for `SamplesSequence.from_images` had an incorrect default
* fixed error when loading extra `.py` files multiple times
* fixed some use-cases in dag creation and drawing
* fixed missing variable in `FileListenerCallback`
* fixed `pipelime list` that was not showing anything


**Full Changelog**: https://github.com/eyecan-ai/pipelime-python/compare/v1.8.0...v1.8.1

1.8.0

What's Changed
* πŸŽ‰ Big news:
* πŸ›Έ Resume from checkpoint! -> [especially when you run a DAG](https://pipelime-python.readthedocs.io/en/latest/cli/piper.html#resuming-a-dag-from-a-checkpoint)
* πŸ§‘β€πŸ’» When you import a python symbol, eg, `$symbol`, `CallableDef` etc, now you can even use **plain python code** or **lambda** -> and it is **fully compatible** with a multi-process grabber!
* πŸ§‘β€πŸ’» CLI: no need to repeat a `+/` option when you want to append a value -> [see the docs](https://pipelime-python.readthedocs.io/en/latest/cli/overview.html#merge-options-from-file-and-command-line)
* πŸ•ΈοΈ DAG news:
* πŸ›Έ [Resume/Replay a DAG](https://pipelime-python.readthedocs.io/en/latest/cli/piper.html#resuming-a-dag-from-a-checkpoint)
* ✏️ Advanced node selection -> [see the docs](https://pipelime-python.readthedocs.io/en/latest/cli/piper.html#running-a-subset-of-nodes)
* 🐍 Python DAGs:
* πŸ“ [Checkout the docs](https://pipelime-python.readthedocs.io/en/latest/cli/piper.html#python-dag)
* πŸ§‘β€πŸ’» `create_graph` can return a list of (lazy) `PipelimeCommand`s: node names will be auto-generated
* πŸ—‘οΈ Temp folder is not automatically delete if you use `--keep-tmp`
* ✨ Commands, stages and pipes:
* `stage-time` command to measure the average time spent by each stage of a pipeline
* `resume` command to load and run a Pipelime checkpoint
* `map-if` command to apply a stage only on a subset of samples
* `repeat` now accepts floating point values to repeat a sequence a fractional number of times
* 🚢 General improvements:
* πŸ§‘β€πŸ’» `PipelimeTmp.make_session_dir()` now always returns a subfolder of the Pipelime session temp folder
* πŸ› command now correctly manages submodel parameters
* ✨ Input/Output interface now have a default piper port
* ✨ The pydantic type `NewPath` can check or set the extension for you


**Full Changelog**: https://github.com/eyecan-ai/pipelime-python/compare/v1.7.0...v1.8.0

1.7.0

What's Changed
* fix: πŸ› Choixe now supports non-string dictionary keys
* fix: πŸ› Input/Output command ports can now be mappings
* feat: πŸ§‘β€πŸ’» Decoupled DAG command and DAG creation
* feat: ✨ Remove cached data after serialization


**Full Changelog**: https://github.com/eyecan-ai/pipelime-python/compare/v1.6.2...v1.7.0

1.6.2

What's Changed
* hotfix: πŸš‘οΈ Missing imports


**Full Changelog**: https://github.com/eyecan-ai/pipelime-python/compare/v1.6.1...v1.6.2

Page 1 of 4

Β© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.