Segmentation output

[nery-bemagro]

Would it be possible to add a segmentation output adding a mask head like in the original detr?

I would be willing to work on this PR just need some guidance and know if it is achievable with the current architecture.

https://github.com/facebookresearch/detr/blob/main/models/segmentation.py

[lyuwenyu]

Welcome to add segmentation task on rtdetr pytorch version codebase.

---

Paddle version code:

https://github.com/PaddlePaddle/PaddleDetection/tree/release/2.8/configs/mask_rtdetr

---

Pytorch rtdetr arch.

0. config file

• https://github.com/lyuwenyu/RT-DETR/blob/main/rtdetrv2_pytorch/configs/rtdetr/include/rtdetr_r50vd.yml

2. architecture

• https://github.com/lyuwenyu/RT-DETR/blob/main/rtdetrv2_pytorch/src/zoo/rtdetr/rtdetr.py

3. encoder features

• https://github.com/lyuwenyu/RT-DETR/blob/main/rtdetrv2_pytorch/src/zoo/rtdetr/hybrid_encoder.py#L183

4. decoder outputs

• https://github.com/lyuwenyu/RT-DETR/blob/main/rtdetrv2_pytorch/src/zoo/rtdetr/rtdetrv2_decoder.py#L554

5. compute losses

• https://github.com/lyuwenyu/RT-DETR/blob/main/rtdetrv2_pytorch/src/zoo/rtdetr/rtdetr_criterion.py#L22

[GeorgePearse]

Hey @nery-bemagro this is what's stopping me from migrating to rt-detr, please keep me posted on your progress!