Mmdet

We have released the official version of MMDetection v3.0.0

Highlights

- Support Semi-automatic annotation Base [Label-Studio](https://github.com/open-mmlab/mmdetection/blob/main/projects/LabelStudio) (#10039)
- Support [EfficientDet](https://github.com/open-mmlab/mmdetection/blob/main/projects/EfficientDet) in projects (#9810)

New Features

- File I/O migration and reconstruction (9709)
- Release DINO Swin-L 36e model (9927)

Bug Fixes

- Fix benchmark script (9865)
- Fix the crop method of PolygonMasks (9858)
- Fix Albu augmentation with the mask shape (9918)
- Fix `RTMDetIns` prior generator device error (9964)
- Fix `img_shape` in data pipeline (9966)
- Fix cityscapes import error (9984)
- Fix `solov2_r50_fpn_ms-3x_coco.py` config error (10030)
- Fix Conditional DETR AP and Log (9889)
- Fix accepting an unexpected argument local-rank in PyTorch 2.0 (10050)
- Fix `common/ms_3x_coco-instance.py` config error (10056)
- Fix compute flops error (10051)
- Delete `data_root` in `CocoOccludedSeparatedMetric` to fix bug (9969)
- Unifying metafile.yml (9849)

Improvements

- Added BoxInst r101 config (9967)
- Added config migration guide (9960)
- Added more social networking links (10021)
- Added RTMDet config introduce (10042)
- Added visualization docs (9938, 10058)
- Refined data_prepare docs (9935)
- Added support for setting the cache_size_limit parameter of dynamo in PyTorch 2.0 (10054)
- Updated coco_metric.py (10033)
- Update type hint (10040)

Contributors

A total of 19 developers contributed to this release.

Thanks IRONICBo, vansin, RangeKing, Ghlerrix, okotaku, JosonChan1998, zgzhengSEU, bobo0810, yechenzhi, Zheng-LinXiao, LYMDLUT, yarkable, xiejiajiannb, chhluo, BIGWangYuDong, RangiLyu, zwhus, hhaAndroid, ZwwWayne

Highlights

- Support [Boxinst](../../../configs/boxinst), [Objects365 Dataset](../../../configs/objects365), and [Separated and Occluded COCO metric](../user_guides/useful_tools.mdCOCO-Separated-&-Occluded-Mask-Metric)
- Support [ConvNeXt-V2](../../../projects/ConvNeXt-V2), [DiffusionDet](../../../projects/DiffusionDet), and inference of [EfficientDet](../../../projects/EfficientDet) and [Detic](../../../projects/Detic) in `Projects`
- Refactor [DETR](../../../configs/detr) series and support [Conditional-DETR](../../../configs/conditional_detr), [DAB-DETR](../../../configs/dab_detr), and [DINO](../../../configs/detr)
- Support `DetInferencer` for inference, Test Time Augmentation, and automatically importing modules from registry
- Support RTMDet-Ins ONNXRuntime and TensorRT [deployment](../../../configs/rtmdet/README.mddeployment-tutorial)
- Support [calculating FLOPs of detectors](../user_guides/useful_tools.mdModel-Complexity)

New Features

- Support [Boxinst](https://arxiv.org/abs/2012.02310) (#9525)
- Support [Objects365 Dataset](https://openaccess.thecvf.com/content_ICCV_2019/papers/Shao_Objects365_A_Large-Scale_High-Quality_Dataset_for_Object_Detection_ICCV_2019_paper.pdf) (#9600)
- Support [ConvNeXt-V2](http://arxiv.org/abs/2301.00808) in `Projects` (#9619)
- Support [DiffusionDet](https://arxiv.org/abs/2211.09788) in `Projects` (#9639, 9768)
- Support [Detic](http://arxiv.org/abs/2201.02605) inference in `Projects` (#9645)
- Support [EfficientDet](https://arxiv.org/abs/1911.09070) inference in `Projects` (#9645)
- Support [Separated and Occluded COCO metric](https://arxiv.org/abs/2210.10046) (#9710)
- Support auto import modules from registry (9143)
- Refactor DETR series and support Conditional-DETR, DAB-DETR and DINO (9646)
- Support `DetInferencer` for inference (9561)
- Support Test Time Augmentation (9452)
- Support calculating FLOPs of detectors (9777)

Bug Fixes

- Fix deprecating old type alias due to new version of numpy (9625, 9537)
- Fix VOC metrics (9784)
- Fix the wrong link of RTMDet-x log (9549)
- Fix RTMDet link in README (9575)
- Fix MMDet get flops error (9589)
- Fix `use_depthwise` in RTMDet (9624)
- Fix `albumentations` augmentation post process with masks (9551)
- Fix DETR series Unit Test (9647)
- Fix `LoadPanopticAnnotations` bug (9703)
- Fix `isort` CI (9680)
- Fix amp pooling overflow (9670)
- Fix docstring about noise in DINO (9747)
- Fix potential bug in `MultiImageMixDataset` (9764)

Improvements

- Replace NumPy transpose with PyTorch permute to speed-up (9762)
- Deprecate `sklearn` (9725)
- Add RTMDet-Ins deployment guide (9823)
- Update RTMDet config and README (9603)
- Replace the models used in the tutorial document with RTMDet (9843)
- Adjust the minimum supported python version to 3.7 (9602)
- Support modifying palette through configuration (9445)
- Update README document in `Project` (9599)
- Replace `github` with `gitee` in `.pre-commit-config-zh-cn.yaml` file (9586)
- Use official `isort` in `.pre-commit-config.yaml` file (9701)
- Change MMCV minimum version to `2.0.0rc4` for `dev-3.x` (9695)
- Add Chinese version of single_stage_as_rpn.md and test_results_submission.md (9434)
- Add OpenDataLab download link (9605, 9738)
- Add type hints of several layers (9346)
- Add typehint for `DarknetBottleneck` (9591)
- Add dockerfile that is easier to use in China (9659)
- Add twitter, discord, medium, and youtube link (9775)
- Prepare for merging refactor-detr (9656)
- Add metafile to ConditionalDETR, DABDETR and DINO (9715)
- Support to modify `non_blocking` parameters (9723)
- Comment repeater visualizer register (9740)
- Update user guide: `finetune.md` and `inference.md` (9578)

New Contributors

- NoFish-528 made their first contribution in <https://github.com/open-mmlab/mmdetection/pull/9346>
- 137208 made their first contribution in <https://github.com/open-mmlab/mmdetection/pull/9434>
- lyviva made their first contribution in <https://github.com/open-mmlab/mmdetection/pull/9625>
- zwhus made their first contribution in <https://github.com/open-mmlab/mmdetection/pull/9589>
- zylo117 made their first contribution in <https://github.com/open-mmlab/mmdetection/pull/9670>
- chg0901 made their first contribution in <https://github.com/open-mmlab/mmdetection/pull/9740>
- DanShouzhu made their first contribution in https://github.com/open-mmlab/mmdetection/pull/9578

Contributors

A total of 27 developers contributed to this release.

Thanks JosonChan1998, RangeKing, NoFish-528, likyoo, Xiangxu-0103, 137208, PeterH0323, tianleiSHI, wufan-tb, lyviva, zwhus, jshilong, Li-Qingyun, sanbuphy, zylo117, triple-Mu, KeiChiTse, LYMDLUT, nijkah, chg0901, DanShouzhu, zytx121, vansin, BIGWangYuDong, hhaAndroid, RangiLyu, ZwwWayne


**Full Changelog**: https://github.com/open-mmlab/mmdetection/compare/v3.0.0rc5...v3.0.0rc6

Highlights

- Support [RTMDet](https://arxiv.org/abs/2212.07784) instance segmentation models. The technical report of RTMDet is on [arxiv](https://arxiv.org/abs/2212.07784)
- Support SSHContextModule in paper [SSH: Single Stage Headless Face Detector](https://arxiv.org/abs/1708.03979).

New Features

- Support [RTMDet](https://arxiv.org/abs/2212.07784) instance segmentation models and improve RTMDet test config (#9494)
- Support SSHContextModule in paper [SSH: Single Stage Headless Face Detector](https://arxiv.org/abs/1708.03979) (#8953)
- Release [CondInst](https://arxiv.org/abs/2003.05664) pre-trained model (#9406)

Bug Fixes

- Fix CondInst predict error when `batch_size` is greater than 1 in inference (9400)
- Fix the bug of visualization when the dtype of the pipeline output image is not uint8 in browse dataset (9401)
- Fix `analyze_logs.py` to plot mAP and calculate train time correctly (9409)
- Fix backward inplace error with `PAFPN` (9450)
- Fix config import links in model converters (9441)
- Fix `DeformableDETRHead` object has no attribute `loss_single` (9477)
- Fix the logic of pseudo bboxes predicted by teacher model in SemiBaseDetector (9414)
- Fix demo API in instance segmentation tutorial (9226)
- Fix `analyze_results` (9380)
- Fix the error that Readthedocs API cannot be displayed (9510)

Improvements

- Remove legacy `builder.py` (9479)
- Make sure the pipeline argument shape is in `(width, height)` order (9324)
- Add `.pre-commit-config-zh-cn.yaml` file (9388)
- Refactor dataset metainfo to lowercase (9469)
- Add PyTorch 1.13 checking in CI (9478)
- Adjust `FocalLoss` and `QualityFocalLoss` to allow different kinds of targets (9481)
- Refactor `setup.cfg` (9370)
- Clip saturation value to valid range `[0, 1]` (9391)
- Only keep meta and state_dict when publishing model (9356)
- Add segm evaluator in ms-poly_3x_coco_instance config (9524)
- Update deployment guide (9527)
- Update zh_cn `faq.md` (9396)
- Update `get_started` (9480)
- Update the zh_cn user_guides of `useful_tools.md` and `useful_hooks.md` (9453)
- Add type hints for `bfp` and `channel_mapper` (9410)
- Add type hints of several losses (9397)
- Add type hints and update docstring for task modules (9468)

Contributors

A total of 20 developers contributed to this release.

Thanks liuyanyi, RangeKing, lihua199710, MambaWong, sanbuphy, Xiangxu-0103, twmht, JunyaoHu, Chan-Sun, tianleiSHI, zytx121, kitecats, QJC123654, JosonChan1998, lvhan028, Czm369, BIGWangYuDong, RangiLyu, hhaAndroid, ZwwWayne

New Contributors
* lihua199710 made their first contribution in https://github.com/open-mmlab/mmdetection/pull/9388
* twmht made their first contribution in https://github.com/open-mmlab/mmdetection/pull/9450
* tianleiSHI made their first contribution in https://github.com/open-mmlab/mmdetection/pull/9453
* kitecats made their first contribution in https://github.com/open-mmlab/mmdetection/pull/9481
* QJC123654 made their first contribution in https://github.com/open-mmlab/mmdetection/pull/9468

**Full Changelog**: https://github.com/open-mmlab/mmdetection/compare/v3.0.0rc4...v3.0.0rc5

Highlights

- Support [CondInst](https://arxiv.org/abs/2003.05664)
- Add `projects/` folder, which will be a place for some experimental models/features.
- Support [SparseInst](https://arxiv.org/abs/2203.12827) in [`projects`](./projects/SparseInst/README.md)

New Features

- Support [CondInst](https://arxiv.org/abs/2003.05664) (#9223)
- Add `projects/` folder, which will be a place for some experimental models/features (9341)
- Support [SparseInst](https://arxiv.org/abs/2203.12827) in [`projects`](./projects/SparseInst/README.md) (#9377)

Bug Fixes

- Fix `pixel_decoder_type` discrimination in MaskFormer Head. (9176)
- Fix wrong padding value in cached MixUp (9259)
- Rename `utils/typing.py` to `utils/typing_utils.py` to fix `collect_env` error (9265)
- Fix resume arg conflict (9287)
- Fix the configs of Faster R-CNN with caffe backbone (9319)
- Fix torchserve and update related documentation (9343)
- Fix bbox refine bug with sigmooid activation (9538)

Improvements

- Update the docs of GIoU Loss in README (8810)
- Handle dataset wrapper in `inference_detector` (9144)
- Update the type of `counts` in COCO’s compressed RLE (9274)
- Support saving config file in `print_config` (9276)
- Update docs about video inference (9305)
- Update guide about model deployment (9344)
- Fix doc typos of useful tools (9177)
- Allow to resume from specific checkpoint in CLI (9284)
- Update FAQ about windows installation issues of pycocotools (9292)


Contributors

A total of 13 developers contributed to this release.

Thanks JunyaoHu, sanbuphy, Czm369, Daa98, jbwang1997, BIGWangYuDong, JosonChan1998, lvhan028, RunningLeon, RangiLyu, Daa98, ZwwWayne, hhaAndroid

New Contributors
* Daa98 made their first contribution in https://github.com/open-mmlab/mmdetection/pull/9274
* lvhan028 made their first contribution in https://github.com/open-mmlab/mmdetection/pull/9344
* JunyaoHu made their first contribution in https://github.com/open-mmlab/mmdetection/pull/9383

**Full Changelog**: https://github.com/open-mmlab/mmdetection/compare/v3.0.0rc3...v3.0.0rc4

Highlights

- Support [CrowdDet](https://arxiv.org/abs/2003.09163) and [EIoU Loss](https://ieeexplore.ieee.org/document/9429909)
- Support training detection models in Detectron2
- Refactor Fast R-CNN
- **Note**: In this version, we upgrade the minimum version requirement of MMEngine to 0.3.0 to use `ignore_key` of `ConcatDataset` for training VOC datasets (9058)

New Features

- Support [CrowdDet](https://arxiv.org/abs/2003.09163) (#8744)
- Support training detection models in Detectron2 with examples of Mask R-CNN, Faster R-CNN, and RetinaNet (8672)
- Support [EIoU Loss](https://ieeexplore.ieee.org/document/9429909) (#9086)

Bug Fixes

- Fix `XMLDataset` image size error (9216)
- Fix bugs of empty_instances when predicting without nms in roi_head (9015)
- Fix the config file of DETR (9158)
- Fix SOLOv2 cannot dealing with empty gt image (9192)
- Fix inference demo (9153)
- Add `ignore_key` in VOC `ConcatDataset` (9058)
- Fix dumping results issue in test scripts. (9241)
- Fix configs of training coco subsets on MMDet 3.x (9225)
- Fix corner2hbox of HorizontalBoxes for supporting empty bboxes (9140)

Improvements

- Refactor Fast R-CNN (9132)
- Clean requirements of mmcv-full due to SyncBN (9207)
- Support training detection models in detectron2 (8672)
- Add `box_type` support for `DynamicSoftLabelAssigner` (9179)
- Make scipy as a default dependency in runtime (9187)
- Update eval_metric (9062)
- Add `seg_map_suffix` in `BaseDetDataset` (9088)

New Contributors

- Wwupup made their first contribution in <https://github.com/open-mmlab/mmdetection/pull/9086>
- sanbuphy made their first contribution in <https://github.com/open-mmlab/mmdetection/pull/9153>
- cxiang26 made their first contribution in <https://github.com/open-mmlab/mmdetection/pull/9158>
- JosonChan1998 made their first contribution in <https://github.com/open-mmlab/mmdetection/pull/9225>

Contributors

A total of 13 developers contributed to this release.

Thanks wanghonglie, Wwupup, sanbuphy, BIGWangYuDong, liuyanyi, cxiang26, jbwang1997, ZwwWayne, yuyoujiang, RangiLyu, hhaAndroid, JosonChan1998, Czm369


**Full Changelog**: https://github.com/open-mmlab/mmdetection/compare/v3.0.0rc2...v3.0.0rc3

Highlights

- Support [imagenet pre-training](configs/rtmdet/cspnext_imagenet_pretrain) for RTMDet's backbone

New Features

- Support [imagenet pre-training](configs/rtmdet/cspnext_imagenet_pretrain) for RTMDet's backbone (8887)
- Add `CrowdHumanDataset` and Metric (8430)
- Add `FixShapeResize` to support resize of fixed shape (8665)

Bug Fixes

- Fix `ConcatDataset` Import Error (8909)
- Fix `CircleCI` and `readthedoc` build failed (8980, 8963)
- Fix bitmap mask translate when `out_shape` is different (8993)
- Fix inconsistency in `Conv2d` weight channels (8948)
- Fix bugs when plotting loss curve by analyze_logs.py (8944)
- Fix type change of labels in `albumentations` (9074)
- Fix some docs and types error (8818)
- Update memory occupation of `RTMDet` in metafile (9098)
- Fix wrong arguments of `OpenImageMetrics` in the config (9061)

Improvements

- Refactor standard roi head with `box type` (8658)
- Support mask concatenation in `BitmapMasks` and `PolygonMasks` (9006)
- Update PyTorch and dependencies' version in dockerfile (8845)
- Update `robustness_eval.py` and `print_config` (8452)
- Make compatible with `ConfigDict` and `dict` in `dense_heads` (8942)
- Support logging coco metric copypaste (9012)
- Remove `Normalize` transform (8913)
- Support jittering the color of different instances of the same class (8988)
- Add assertion for missing key in `PackDetInputs` (8982)

Contributors

A total of 13 developers contributed to this release.

Thanks RangiLyu, jbwang1997, wanghonglie, Chan-Sun, RangeKing, chhluo, MambaWong, yuyoujiang, hhaAndroid, sltlls, Nioolek, ZwwWayne, wufan-tb

New Contributors
* Chan-Sun made their first contribution in https://github.com/open-mmlab/mmdetection/pull/8909
* MambaWong made their first contribution in https://github.com/open-mmlab/mmdetection/pull/8913
* yuyoujiang made their first contribution in https://github.com/open-mmlab/mmdetection/pull/8437
* sltlls made their first contribution in https://github.com/open-mmlab/mmdetection/pull/8944
* Nioolek made their first contribution in https://github.com/open-mmlab/mmdetection/pull/8845
* wufan-tb made their first contribution in https://github.com/open-mmlab/mmdetection/pull/9061

**Full Changelog**: https://github.com/open-mmlab/mmdetection/compare/v3.0.0rc1...v3.0.0rc2