Envpool

- Fix JAX newest version compatibility (282, ethanluoyc)
- Fix cuda stream sync issue (284, mavenlin)
- Fix ci and upgrade dependency (285, 286, Trinkle23897)

[Disclaimer: generated by ChatGPT API]

🚨 Hey contributors! 🚨

It's a great day to celebrate our open-source contributions to sail-sg/envpool! Over the past 78 days, we have merged some notable changes we'd like to share. Here's a summary of those changes:

🔧 PR 237 [MiniGrid Empty Env] wangsiping97:
Port MiniGrid EmptyEnv to envpool.

🔧 PR 238 [lazy import] Trinkle23897:
`import envpool` will no longer raise an error due to procgen qt5 dependency, making fresh devboxes more accessible.

🔧 PR 242 [chore: update dev-cn dockerfile] Benjamin-eecs:
The fast installation of dependencies makes development faster and more efficient.

🔧 PR 243 [Use new gym API in examples] leninilyich:
The environment used to return five values which could not be unpacked into "done". It has been fixed and is working as intended.

🐛 PR 245 [typo fix in `CarpoletSwingup`] vwxyzjn:
A small typo in the CarpoletSwingup environment has been corrected.

🔧 PR 248 [chore: add timeout flag for pip requirements installation] Benjamin-eecs:
An extended timeout for pip requirements installation has been added. It is especially helpful for users in CN.

🚀 PR 249 [fix(hansbug): use treevalue 1.4.7] HansBug:
There was a bug in PR 246, which has now been fixed by upgrading the version of treevalue to 1.4.7.

🚀 PR 247 [deps: replace `treevalue` with `optree`] Benjamin-eecs XuehaiPan:
We have replaced `treevalue` with `optree` to speed up and support custom node type registration. It has introduced a new feature and a non-breaking change that adds core functionality.

🔧 PR 252 [Fix publish ci `packaging not found` issue and change minigrid deterministic test] Trinkle23897:
This PR fixed the packaging issue and changed the minigrid deterministic test. It will lead to more stable performance.

🐛 PR 254 [fix old gym version return type error] Trinkle23897:
This PR fixes a bug introduced by PR 247.

🐛 PR 255 [fix atari incorrect trunc flag when episodic_life=True] Trinkle23897:
A bug which caused incorrect trunc flag in atari with episodic_life=True has been fixed.

Each of these PRs has made significant contributions to our codebase. We encourage you to take a look and check out our latest improvements with new and fixed features. As always, we appreciate your support and hope to continue our partnership with you for a long time to come.

Thanks to everybody who contributed!

Enhancement

- Add `channel_first` option in procgen env, change default observation shape from `(64, 64, 3)` to `(3, 64, 64)` (232, Trinkle23897)

New Environment

Add 42 procgen environments (197, YukunJ, LeoGuo98, Trinkle23897)

Procgen library change in https://github.com/Trinkle23897/procgen
- Fix Qt library include error
- Fix globalGameRegistry == nullptr issue by adding another explicit make_* function (thanks to Yukun!)
- Disable auto-reset because envpool has already handled this feature

Changes:
- Add new dependency `qtdeclarative5-dev`, rebuild docker image
- Update pypi wheel from manylinux_2_17_x86_64 to manylinux_2_24_x86_64 because of libstdc++.so.6 symbol
- Add 42 procgen envs
- Refactor `base_path`
- Docs: https://envpool.readthedocs.io/en/latest/env/procgen.html

Enhancement

- Support atari full action space (230, Trinkle23897)

Finally, all environments in gym are in EnvPool! You can fully deprecate Box2D / box2d-py / mujoco_py pypi package.

New Environment

1. CarRacing-v2 (199, Alicia1529)

Enhancement

1. Add use_fire_reset option in atari env (223, Trinkle23897)
2. Add back contact force in humanoid-v3 (224, Trinkle23897)
3. Integrating Gymnasium (222, Markus28)
4. Infra improvement, using ubuntu 22.04 + python 3.10 for unit test, adding python 3.11 wheel release (228, Trinkle23897)
5. Upgrade dependency and fix clang-tidy error (229, Trinkle23897)