Tricks

总结一下各类出现过的trick，针对end to end，主要分4部分，

1. 数据输入部分的处理
2. backbone的创新（模块的设计，激活函数的优化）
3. Neck
4. Prediction

1 Data Augmentation

1. Cutout
2. MixUp
3. CutMix
4. Mosaic

2 Regulization Method

1. dropBlock

3 Normalization of Network activation by their mean and variance

1. BN
2. Cross-GPU Batch Normalization (CGBN or SyncBN)
3. Filter Response Normalization (FRN)
4. Cross-Iteration Batch Normalization (CBN)

4 Skip-Connection

1. Residual connections
2. Weighted residual connections
3. Multi-input weighted residual connections
4. Cross stage partial connections

5 BBox Regression LOSS

1. MSE
2. IoU
3. GIoU
4. CIoU
5. DIoU

6 Activation

1. ReLU
2. leaky-ReLU
3. parametric-ReLU
4. ReLU6
5. SELU
6. Swish
7. Mish

7 Additional block

1. SPP
2. ASPP
3. RFB
4. SAM

8 Path aggregation Block

1. FPN
2. PAN
3. NAS-FPN
4. Fully-connected FPN
5. BiFPN
6. ASFF
7. SFAM