Mmhuman3d

Highlights
- Support new data structure SMC for new dataset HuMMan that will soon be released
- Support for multi-GPU training/testing without slurm
- Support training-time validation and additional metrics such as PVE
- Bug fixes in data augmentation for more stable training
- Stronger HybrIK baseline (PA-MPJPE 49.02 on 3DPW)

New Datasets
- Add data converter for HuMMan dataset
- Add support for training with HuMMan dataset

New Features
- Add a new data structure SMC with SMCReader
- Add support for multi-GPU training/testing without slurm
- Add eval hook that supports validation during training and additional metrics such as PVE
- Support rigid transformation of SMPL parameters
- Add video-based inference pipeline to support VIBE demo
- CameraParameter accepts numpy and torch tensor and K, R, T can be obtained by a single method

Better Methods
- Reproduce a stronger HybrIK baseline (PA-MPJPE 49.02 on 3DPW)

Bug Fixes
- Fix a bug in data augmentation that causes keypoint2d loss not converging
- Fix a bug in SMPL rotation augmentation
- Fix bugs in data converters
- Fix GPU memory wastage due to unnecessary initialization

Documentation
- Use shared menu from OpenMMLab theme
- Add metafile

Refactoring
- Registration-based methods are moved to models/, under the new module abstraction named “registrants”
- Body model wrappers have their own module abstraction named “body_models”

Datasets
- Add support for GTA-Human dataset
- Add support for datasets needed by VIBE

New features
- Upgrade SMPLify: batch size adaptation and use standard camera module
- Upgrade camera: helper functions such as concat, parameter conversion and value type check
- Upgrade renderer: refactored to use registry, refactored smpl visualization
Documents
- Update README, tutorials, and readthedocs

Bug fixes:
- Unit tests: test_cache that raises time comparison error
- Visualization: holes in rendered mesh
- Data converters: image paths, and H36M and LSP

CICD
- Deploy workflow on GitHub
- Add codedev reports in workflow

Main Features

* Supports registration-based methods: SMPLify and SMPLify-X
* Supports regression-based methods: HMR, SPIN, VIBE, and HybrIK
* Supports 16 datasets with the unified data format HumanData
* Supports differentiable visualization of parametric models

The actual commit id for this tag is https://github.com/open-mmlab/mmhuman3d/commit/8255b065db4f46d0ab436d35be4bff27b71009a7