Bug fixes
- Fix preprocessing for high-resolution images/videos in imaging_quality (46275d9, b484867)
- Fix VBench_full_info.json not found in PyPI package (90f0973)
Features
- Add `filter_scope` argument for selecting the videos to be considered for filtering out static videos (fb75b02)
- Add `mode` argument to select between three different evaluation modes (02e2ee1):
> custom_input: Receive input prompt from --prompt/--prompt_file flags or read directly from the filename
> vbench_standard: Evaluate using the standard prompt suite of VBench (default)
> vbench_category: Evaluate using a specific category of VBench
- Allow evaluating with prompts specified by a file containing a dictionary using `--prompt_file`. (efaa6d3)
Others Changes
- Receive list of dimension instead of single dimension in `--dimension` flag (91bece8)