Periflow-sdk

Latest version: v0.1.2

Safety actively analyzes 681812 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

0.1.2

What's Changed
- Allow checkpoint uploading only once for an iteration.

**Full Changelog**: https://github.com/friendliai/periflow-python-sdk/compare/0.1.1...0.1.2

0.1.1

What's Changed
* Handle `torch.multiprocessing.spawn` use-case (without `torchrun`)
* Set default value of `total_train_steps` as `None`
* now just calling `pf.init()` is okay

0.1.0

What's Changed
* Use `NPROC_PER_NODE` auto-set env var in examples by kooyunmo in https://github.com/friendliai/periflow-python-sdk/pull/36
* Add copyright and change emergency save condition by kooyunmo in https://github.com/friendliai/periflow-python-sdk/pull/37
* add trigger_time of checkpoint_upload by ktaebum in https://github.com/friendliai/periflow-python-sdk/pull/39
* Last step fix by ktaebum in https://github.com/friendliai/periflow-python-sdk/pull/38


**Full Changelog**: https://github.com/friendliai/periflow-python-sdk/compare/0.1.0rc1...0.1.0

0.1.0rc1

What's Changed
* Initial Interface & Implementation for Periflow Python SDK by DifferentSC in https://github.com/friendliai/periflow-python-sdk/pull/1
* Add docker script by sj6077 in https://github.com/friendliai/periflow-python-sdk/pull/8
* Automatic recovery and resumable iterator by DifferentSC in https://github.com/friendliai/periflow-python-sdk/pull/6
* Huggingface Transformers example by Hyeonmin-Ha in https://github.com/friendliai/periflow-python-sdk/pull/9
* [PFT-222, PFT-224] Newly designed Periflow Python SDK by DifferentSC in https://github.com/friendliai/periflow-python-sdk/pull/13
* [PFT-254] Fix save error in SDK by DifferentSC in https://github.com/friendliai/periflow-python-sdk/pull/14
* [PFT-265] Add rank information in SDK metrics by DifferentSC in https://github.com/friendliai/periflow-python-sdk/pull/16
* [PFT-256] Make tests for failure paths of SDK by DifferentSC in https://github.com/friendliai/periflow-python-sdk/pull/15
* [PFT-272] Calculate parallelism rank in sdk by ktaebum in https://github.com/friendliai/periflow-python-sdk/pull/17
* [PFT-271] Fix pf.load() so that it supports all the arguments of torch.load() by DifferentSC in https://github.com/friendliai/periflow-python-sdk/pull/18
* make run when CKPT_DIR is not set by ktaebum in https://github.com/friendliai/periflow-python-sdk/pull/19
* Send last_step to WorkerFTModule by ktaebum in https://github.com/friendliai/periflow-python-sdk/pull/20
* [PFT-304] update ipc by ktaebum in https://github.com/friendliai/periflow-python-sdk/pull/21
* do not send save_type when not saved by ktaebum in https://github.com/friendliai/periflow-python-sdk/pull/22
* not always create cloud_path by ktaebum in https://github.com/friendliai/periflow-python-sdk/pull/23
* refactoring sdk by ktaebum in https://github.com/friendliai/periflow-python-sdk/pull/24
* Add configuration dotfiles by kooyunmo in https://github.com/friendliai/periflow-python-sdk/pull/25
* reorder file directory by ktaebum in https://github.com/friendliai/periflow-python-sdk/pull/26
* cleanup sdk by ktaebum in https://github.com/friendliai/periflow-python-sdk/pull/27
* fix getting RANK by ktaebum in https://github.com/friendliai/periflow-python-sdk/pull/28
* remove job_finished by ktaebum in https://github.com/friendliai/periflow-python-sdk/pull/29
* Examples by ktaebum in https://github.com/friendliai/periflow-python-sdk/pull/30
* Freeze repository for package version 0.1.0-rc1 by Algy in https://github.com/friendliai/periflow-python-sdk/pull/31
* Hotfix 0.1.0-rc1 by Algy in https://github.com/friendliai/periflow-python-sdk/pull/33
* add readme by ktaebum in https://github.com/friendliai/periflow-python-sdk/pull/32
* Update VERSION by Algy in https://github.com/friendliai/periflow-python-sdk/pull/34

New Contributors
* DifferentSC made their first contribution in https://github.com/friendliai/periflow-python-sdk/pull/1
* sj6077 made their first contribution in https://github.com/friendliai/periflow-python-sdk/pull/8
* Hyeonmin-Ha made their first contribution in https://github.com/friendliai/periflow-python-sdk/pull/9
* ktaebum made their first contribution in https://github.com/friendliai/periflow-python-sdk/pull/17
* kooyunmo made their first contribution in https://github.com/friendliai/periflow-python-sdk/pull/25
* Algy made their first contribution in https://github.com/friendliai/periflow-python-sdk/pull/31

**Full Changelog**: https://github.com/friendliai/periflow-python-sdk/commits/0.1.0rc1

Links

Releases

Has known vulnerabilities

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.