Tosfs

What's Changed

* Bump up tosfs version to 2024.11.2.dev0 by yanghua in https://github.com/fsspec/tosfs/pull/281
* Bug: Fix the wrong flatten issue when path special char dir name by yanghua in https://github.com/fsspec/tosfs/pull/283
* Use get_file_status API to reduce rpc requests by yanghua in https://github.com/fsspec/tosfs/pull/286
* [feature] Support hns by yanghua in https://github.com/fsspec/tosfs/pull/156


**Full Changelog**: https://github.com/fsspec/tosfs/commits/2024.11.2

What's Changed
* Bump up tosfs version to 2024.11.1.dev0 by yanghua in https://github.com/fsspec/tosfs/pull/271
* Add a switch to control if use glob search by yanghua in https://github.com/fsspec/tosfs/pull/273
* Update repo url by yanghua in https://github.com/fsspec/tosfs/pull/276
* Add new feature to feature list by yanghua in https://github.com/fsspec/tosfs/pull/277
* Bug: Too many requests error missed retry by yanghua in https://github.com/fsspec/tosfs/pull/279


**Full Changelog**: https://github.com/fsspec/tosfs/commits/2024.11.1

What's Changed
* Bump up tos version to 2024.10.2.dev0 by yanghua in https://github.com/fsspec/tosfs/pull/239
* Fix license classifier for pypi by yanghua in https://github.com/fsspec/tosfs/pull/240
* Introduce DeletingObject model by yanghua in https://github.com/fsspec/tosfs/pull/243
* Make TOS_SDK_LOGGING_LEVEL work for github action by yanghua in https://github.com/fsspec/tosfs/pull/245
* Remove useless rstrip slash after _strip_protocol by yanghua in https://github.com/fsspec/tosfs/pull/248
* Add new fsspec version into version matrix by yanghua in https://github.com/fsspec/tosfs/pull/252
* Add test to verify put dir tree by yanghua in https://github.com/fsspec/tosfs/pull/254
* Support recursive and batch yield for ls_iterate API by yanghua in https://github.com/fsspec/tosfs/pull/256
* Bug: isdir API when not found should list it to check by yanghua in https://github.com/fsspec/tosfs/pull/261
* Handle exception when get a empty file by yanghua in https://github.com/fsspec/tosfs/pull/265
* Bump up tos python sdk version to 2.8.0 by yanghua in https://github.com/fsspec/tosfs/pull/266
* Add user-agent to mark access source by yanghua in https://github.com/fsspec/tosfs/pull/268
* Add ray example by yanghua in https://github.com/fsspec/tosfs/pull/262


**Full Changelog**: https://github.com/fsspec/tosfs/commits/2024.11.0

What's Changed

* Bump up tosfs version to 2024.10.1.dev0 by yanghua (200)
* Optimize log level print by yanghua (205)
* Remove TODO from installation by yanghua (202)
* Set tosfs default log level to warning by yanghua (207)
* Add warning log for all rm apis by yanghua (209)
* Test fsspec register and class import by yanghua (211)
* Add pytorch example by yanghua (213)
* Refactor README about Privacy Statement and integration usages by yanghua (215)
* Bump up tos version by yanghua in https://github.com/fsspec/tosfs/pull/219
* Add more detail to pyproject toml by yanghua in https://github.com/fsspec/tosfs/pull/217
* Remove open dir defensive inspection by yanghua in https://github.com/fsspec/tosfs/pull/221
* Refactor dependency package versions by yanghua in https://github.com/fsspec/tosfs/pull/223
* Add append to feature list by yanghua in https://github.com/fsspec/tosfs/pull/225
* Refactor MPU logic by yanghua in https://github.com/fsspec/tosfs/pull/227
* Remove unnecessary tag log by yanghua in https://github.com/fsspec/tosfs/pull/229
* Introduce a compatible class to handle walk and find method by yanghua in https://github.com/fsspec/tosfs/pull/231
* Remove unnecessary close when download file by yanghua in https://github.com/fsspec/tosfs/pull/233
* Enhance the robustness about parse bucket by yanghua in https://github.com/fsspec/tosfs/pull/236


**Full Changelog**: https://github.com/fsspec/tosfs/commits/2024.10.1

What's Changed
* Implement ls API by yanghua in https://github.com/volcengine/tosfs/pull/7
* [TOSFS 16] Generate a simple test issue template by yanghua in https://github.com/volcengine/tosfs/pull/17
* Introduce ruff to check code style by yanghua in https://github.com/volcengine/tosfs/pull/13
* Implement _rm inner API by yanghua in https://github.com/volcengine/tosfs/pull/15
* Override fssepcinfo default implementation to optimize performance by yanghua in https://github.com/volcengine/tosfs/pull/21
* [TOSFS 10] Implement rmdir API by yanghua in https://github.com/volcengine/tosfs/pull/23
* Core: Clean unnecessary logs by yanghua in https://github.com/volcengine/tosfs/pull/27
* Core: Remove cache in all tosfs APIs by yanghua in https://github.com/volcengine/tosfs/pull/29
* Core: Add touch API by yanghua in https://github.com/volcengine/tosfs/pull/30
* Core: Implement isdir api by yanghua in https://github.com/volcengine/tosfs/pull/34
* Core: Implement isfile API by yanghua in https://github.com/volcengine/tosfs/pull/33
* Core: Implement exists api by yanghua in https://github.com/volcengine/tosfs/pull/19
* Core: Implement mkdir API by yanghua in https://github.com/volcengine/tosfs/pull/39
* Core: Implement put_file API by yanghua in https://github.com/volcengine/tosfs/pull/40
* Core: Implement get_file API by yanghua in https://github.com/volcengine/tosfs/pull/41
* Core: Implement write API by yanghua in https://github.com/volcengine/tosfs/pull/42
* Core: Implement walk api by yanghua in https://github.com/volcengine/tosfs/pull/47
* Core: Implement find api by yanghua in https://github.com/volcengine/tosfs/pull/48
* Core: Implement read API by yanghua in https://github.com/volcengine/tosfs/pull/51
* Core: Fix _rm API missed slash issue by yanghua in https://github.com/volcengine/tosfs/pull/50
* Core: Implement cp_file API by yanghua in https://github.com/volcengine/tosfs/pull/55
* Core: Implement expand_path API by yanghua in https://github.com/volcengine/tosfs/pull/56
* Infra: Verify fsspec version compatibility by yanghua in https://github.com/volcengine/tosfs/pull/59
* Core: Implement glob api by yanghua in https://github.com/volcengine/tosfs/pull/62
* Core: Support append mode for write API by yanghua in https://github.com/volcengine/tosfs/pull/63
* Core: Extract hard code numbers by yanghua in https://github.com/volcengine/tosfs/pull/65
* Fsspec: Add fsspec compatibility test cases by yanghua in https://github.com/volcengine/tosfs/pull/54
* Config tos client log to align tosfs by yanghua in https://github.com/volcengine/tosfs/pull/67
* Infra: Fix make wheel command issue by yanghua in https://github.com/volcengine/tosfs/pull/69
* Core: Add params supported by tos client by yanghua in https://github.com/volcengine/tosfs/pull/71
* Core: Optimize rm API via batch delete by yanghua in https://github.com/volcengine/tosfs/pull/72
* Core: Refactor exception writing method by yanghua in https://github.com/volcengine/tosfs/pull/74
* Infra: introduce retry func warpper by yanghua in https://github.com/volcengine/tosfs/pull/76
* Add line number and file name to log format by yanghua in https://github.com/volcengine/tosfs/pull/78
* Core: Enhance retryability for TosFile by yanghua in https://github.com/volcengine/tosfs/pull/81
* Core: Check MPU threshold by yanghua in https://github.com/volcengine/tosfs/pull/84
* Performance: Read optimize by yanghua in https://github.com/volcengine/tosfs/pull/88
* Performance: Reduce call exists in makedirs by yanghua in https://github.com/volcengine/tosfs/pull/86
* Performance: Use iterator to optimize large dir list by yanghua in https://github.com/volcengine/tosfs/pull/90
* Test: Use tosfs to replace tos client by yanghua in https://github.com/volcengine/tosfs/pull/92
* Optimize: Introduce multiple disk write for MPU by yanghua in https://github.com/volcengine/tosfs/pull/94
* MPU: Init staging dirs if not exist by yanghua in https://github.com/volcengine/tosfs/pull/97
* Enhance retry sleep logic by yanghua in https://github.com/volcengine/tosfs/pull/99
* Verify file content write via MPU by yanghua in https://github.com/volcengine/tosfs/pull/100
* Extract mpu and staging part logic into mpu.py by yanghua in https://github.com/volcengine/tosfs/pull/102
* Add ChunkedEncodingError to retryable error set by yanghua in https://github.com/volcengine/tosfs/pull/114
* Simplfy random file name in test_fsspec.py by yanghua in https://github.com/volcengine/tosfs/pull/104
* Refactor workflow: rename file and jump CI for some special files suffix by yanghua in https://github.com/volcengine/tosfs/pull/111
* Add more api test to align with pyproton by yanghua in https://github.com/volcengine/tosfs/pull/109
* Refactor get_file API to reuse retry logic by yanghua in https://github.com/volcengine/tosfs/pull/116
* Performance: fetch range optimize by yanghua in https://github.com/volcengine/tosfs/pull/119
* Add TosFileSystem class into __init__.py by yanghua in https://github.com/volcengine/tosfs/pull/121
* Add more details for README by yanghua in https://github.com/volcengine/tosfs/pull/107
* Disable version_aware feature by yanghua in https://github.com/volcengine/tosfs/pull/117
* Workflow: Add scheduler workflow for stability by yanghua in https://github.com/volcengine/tosfs/pull/125
* Catch exceptions in fetch method to enhance stability by yanghua in https://github.com/volcengine/tosfs/pull/123
* Bug: Fix wrong judgement about retryable server error by yanghua in https://github.com/volcengine/tosfs/pull/132
* Bug: Part is not full when multiple write by yanghua in https://github.com/volcengine/tosfs/pull/130
* Add test cases for stability by yanghua in https://github.com/volcengine/tosfs/pull/129
* Refactor scheduled workflow for stability by yanghua in https://github.com/volcengine/tosfs/pull/134
* Bug: Fix rm api and walk api bug by yanghua in https://github.com/volcengine/tosfs/pull/137
* Support tag the access source by yanghua in https://github.com/volcengine/tosfs/pull/135
* Setting tos configs to tolerance network issue by yanghua in https://github.com/volcengine/tosfs/pull/142
* Add fsspec and python version compatibility matrix to README by yanghua in https://github.com/volcengine/tosfs/pull/145
* Set tos python sdk default log level to warning by yanghua in https://github.com/volcengine/tosfs/pull/144
* API: ls support last_modified property by yanghua in https://github.com/volcengine/tosfs/pull/149
* Bug: put api do not support local dir by yanghua in https://github.com/volcengine/tosfs/pull/147
* Classification different methods by yanghua in https://github.com/volcengine/tosfs/pull/150
* Fix quickstart wrong description about credentials_provider by yanghua in https://github.com/volcengine/tosfs/pull/153
* Add test for mv source dir recursively by yanghua in https://github.com/volcengine/tosfs/pull/155
* Bug: Fix isfile and isdir do not return bool value by yanghua in https://github.com/volcengine/tosfs/pull/161
* Bug: Fix TOS_TAG_ENABLED does not take effort by yanghua in https://github.com/volcengine/tosfs/pull/158
* Add more badge in README.md by yanghua in https://github.com/volcengine/tosfs/pull/169
* Expose more tos python client config items from tosfs by yanghua in https://github.com/volcengine/tosfs/pull/166
* Refactor code for readable by yanghua in https://github.com/volcengine/tosfs/pull/165
* Fix exists return non-bool value by yanghua in https://github.com/volcengine/tosfs/pull/163
* Build doc infra by yanghua in https://github.com/volcengine/tosfs/pull/167
* Missed check logic in some APIs by yanghua in https://github.com/volcengine/tosfs/pull/171
* Support tag via session token by yanghua in https://github.com/volcengine/tosfs/pull/173
* Refactor code for readable by yanghua in https://github.com/volcengine/tosfs/pull/175
* Enhance doc infra by yanghua in https://github.com/volcengine/tosfs/pull/177
* Add features to README file by yanghua in https://github.com/volcengine/tosfs/pull/181
* Fix autodoc does not work by yanghua in https://github.com/volcengine/tosfs/pull/183
* Add native example for tosfs by yanghua in https://github.com/volcengine/tosfs/pull/178
* Evaluate package version and tosfs version by yanghua in https://github.com/volcengine/tosfs/pull/187
* Fix release script by yanghua in https://github.com/volcengine/tosfs/pull/189
* Introduce VOLC_REGION env for tag testing by yanghua in https://github.com/volcengine/tosfs/pull/191
* Add more debug info for tagging by yanghua in https://github.com/volcengine/tosfs/pull/198
* Add Privacy Statement to README file by yanghua in https://github.com/volcengine/tosfs/pull/194
* Add test for size API by yanghua in https://github.com/volcengine/tosfs/pull/196


**Full Changelog**: https://github.com/volcengine/tosfs/commits/2024.10.0