Data subsystem now uses fsspec, partial support for maps, python 3.11, flyte file/directory streaming, device auth flow.
Please see the [Flyte release notes](https://github.com/flyteorg/flyte/releases/tag/v1.5.0) for usage snippets.
Full changelog below.
What's Changed
* prefer FLYTE_ prefixed AWS creds env vars by flixr in https://github.com/flyteorg/flytekit/pull/1523
* Filter out remote entity when generating pb by honnix in https://github.com/flyteorg/flytekit/pull/1545
* Pyflyte docs formatting by bryanwweber in https://github.com/flyteorg/flytekit/pull/1538
* Data subsystem by wild-endeavor in https://github.com/flyteorg/flytekit/pull/1526
* Less strict docker dependency versions by jcugat in https://github.com/flyteorg/flytekit/pull/1536
* Pluck retry from flytekit and into sagemaker by eapolinario in https://github.com/flyteorg/flytekit/pull/1411
* Update the pypi wait by wild-endeavor in https://github.com/flyteorg/flytekit/pull/1554
* Stream Directories and Files using Flyte by kumare3 in https://github.com/flyteorg/flytekit/pull/1512
* Make `FlyteFile` compatible with `Annotated[..., HashMethod]` by AdrianoKF in https://github.com/flyteorg/flytekit/pull/1544
* move FlyteSchema deprecation warning to initialization method by cosmicBboy in https://github.com/flyteorg/flytekit/pull/1558
* add pod_template and pod_template_name arguments for ContainerTask by flixr in https://github.com/flyteorg/flytekit/pull/1515
* Pass locally defined scopes to RemoteClientConfigStore by franco-bocci in https://github.com/flyteorg/flytekit/pull/1553
* TypeTransformer for TensorFlow model by samhita-alla in https://github.com/flyteorg/flytekit/pull/1562
* Remove flytekit-fsspec plugin from default dockerfile by wild-endeavor in https://github.com/flyteorg/flytekit/pull/1561
* Device auth flow / Headless auth by kumare3 in https://github.com/flyteorg/flytekit/pull/1552
* support python 3.11 by cosmicBboy in https://github.com/flyteorg/flytekit/pull/1557
* url encode secret in client credentials flow by wild-endeavor in https://github.com/flyteorg/flytekit/pull/1566
* Python run multiple files by pingsutw in https://github.com/flyteorg/flytekit/pull/1559
* General Partial support in flytekit and multi-list support in flytekit by kumare3 in https://github.com/flyteorg/flytekit/pull/1556
* fix: Silence keyring warnings by changing to debug by ggydush in https://github.com/flyteorg/flytekit/pull/1568
* Support GCP secrets by wild-endeavor in https://github.com/flyteorg/flytekit/pull/1571
* Automatically remove unused import by pingsutw in https://github.com/flyteorg/flytekit/pull/1574
* Disallow partial lists in map tasks by eapolinario in https://github.com/flyteorg/flytekit/pull/1577
* Remove duplicate reporting logic by wild-endeavor in https://github.com/flyteorg/flytekit/pull/1578
* [Core feature] Convert List[Any] to a single pickle file by Yicheng-Lu-llll in https://github.com/flyteorg/flytekit/pull/1535
* Improve authoring structure documentation by samhita-alla in https://github.com/flyteorg/flytekit/pull/1572
New Contributors
* bryanwweber made their first contribution in https://github.com/flyteorg/flytekit/pull/1538
* franco-bocci made their first contribution in https://github.com/flyteorg/flytekit/pull/1553
* ggydush made their first contribution in https://github.com/flyteorg/flytekit/pull/1568
* Yicheng-Lu-llll made their first contribution in https://github.com/flyteorg/flytekit/pull/1535
**Full Changelog**: https://github.com/flyteorg/flytekit/compare/v1.4.2...v1.5.0