Autogluon.bench

What's Changed
* Add the support of testing on multiple datasets after training on one dataset. by Harry-zzh in https://github.com/autogluon/autogluon-bench/pull/69
* Bench update by suzhoum in https://github.com/autogluon/autogluon-bench/pull/70
* Updates for evaluation and aggregation based on AG 1.0 by Innixma in https://github.com/autogluon/autogluon-bench/pull/71
* Add `metric` to fill missing logic by Innixma in https://github.com/autogluon/autogluon-bench/pull/72
* Update for eval refactor by Innixma in https://github.com/autogluon/autogluon-bench/pull/73
* Update multimodal dep by suzhoum in https://github.com/autogluon/autogluon-bench/pull/75

New Contributors
* Harry-zzh made their first contribution in https://github.com/autogluon/autogluon-bench/pull/69

**Full Changelog**: https://github.com/autogluon/autogluon-bench/compare/v0.4.2...v0.4.3

This is a minor update from the previous release v0.4.1.

Main Features

1. Support few shot learning and custom metrics in config generation script.
2. Bug fix to use the correct file paths when installing autogluon.bench automatically from source or PyPI.
3. Some minor bug fixes.

This release contains 6 [commits](https://github.com/autogluon/autogluon-bench/compare/v0.4.1...v0.4.2) from 2 contributor.

Full Contributor List (ordered by of commits):
prateekdesai04 suzhoum

This release supports Python versions 3.9. and 3.10.

We're excited to announce the release of AutoGluon-Bench 0.4.1!

For more details, please check out the [README](https://github.com/autogluon/autogluon-bench/blob/master/README.md).

Main Features

1. Support custom metrics for multimodal module
2. Improvements on evaluation module
3. Improvements on infrastructure

This release contains 32 [commits](https://github.com/autogluon/autogluon-bench/compare/v0.4.0...v0.4.1) from 3 contributor.

Full Contributor List (ordered by of commits):
Innixma prateekdesai04 suzhoum

This release supports Python versions 3.9. and 3.10.

We hope you enjoy the new features in this release! Please don't hesitate to reach out to us with any questions or feedback.

We're excited to announce the release of AutoGluon-Bench 0.4.0!

For more details, please check out the [README](https://github.com/autogluon/autogluon-bench/blob/master/README.md).

Main Features

1. `timeseries` module is now supported! Similar as `tabular` module, `timeseries` benchmarks are running on the [AMLB](https://github.com/openml/automlbenchmark) framework but with better support in cloud infrastructure. Custom datasets and frameworks are supported as well.
2. Hardware metrics including `CPUUtilizaiton` and `GPUUtilization` can now be queried from `CloudWatch` with the added option `--save-hardeware-metrics` in `agbench run`. They are pulled and saved to S3 bucket immediately after all jobs have run into completion.
3. Updates in evaluation logic

This release contains 4 [commits](https://github.com/autogluon/autogluon-bench/compare/v0.3.0...v0.4.0) from 3 contributor.

Full Contributor List (ordered by of commits):
suzhoum Innixma shreyash2106

This release supports Python versions 3.9. and 3.10.

We hope you enjoy the new features in this release! Please don't hesitate to reach out to us with any questions or feedback.

We're excited to announce the release of AutoGluon-Bench 0.3.0!

For more details, please check out the [README](https://github.com/autogluon/autogluon-bench/blob/master/README.md).

Main Features

1. Introduced `framework` and `constraint` concepts in `multimodal` module so that metadata is better logged in the results.
2. Added evaluation support for `multimodal` module.

This release contains 2 [commits](https://github.com/autogluon/autogluon-bench/compare/v0.2.2...v0.3.0) from 1 contributor.

Full Contributor List (ordered by of commits):
suzhoum

This release supports Python versions 3.9. and 3.10.

We hope you enjoy the new features in this release! Please don't hesitate to reach out to us with any questions or feedback.

We're excited to announce the release of AutoGluon-Bench 0.2.2!

For more details, please check out the [README](https://github.com/autogluon/autogluon-bench/blob/master/README.md).

Main Features

1. Support custom dataset with custom data loader for `multimodal` module
3. Added model failure support to evaluation `output_context.py`
4. Added median relative error diff to evaluation `evaluate_results.py`
5. Added detailed hardware monitoring support with 5s intervals
6. Support CPU base image when using non-GPU machines
7. Updated base images to reduce image size
8. Bug fix for running benchmark on CPU machine.

This release contains 11 [commits](https://github.com/autogluon/autogluon-bench/compare/v0.2.1...v0.2.2) from 3 contributor.

Full Contributor List (ordered by of commits):
Innixma suzhoum yinweisu

This release supports Python versions 3.9. and 3.10.

We hope you enjoy the new features in this release! Please don't hesitate to reach out to us with any questions or feedback.