Configuracion for Assembled CNN Model

[josueortc]

Hello,

I was looking to make use of this repo to make an Assembled CNN (https://arxiv.org/abs/2001.06268) model on ImageNet. I know all the ingredients seem to be here but I can only find pretrained skresnet50d which probably only has some.

I was wondering if anyone has a config to train this model or if it's already available.

Thanks for the help

[rwightman]

@josueortc Almost all of the pieces for Assembled CNN are here, except the KD and BL parts... but there are KD codebases that work with the models here.

I'd point out that after the E5 config above, the model changes significalty. Anything with the SK involves a significant increase in parameters, they didn't use grouped convs like the original SK paper so their R50D + SK is getting close to 40M parameters, which is more like a ResNet101 in size/throughput than 50.

[josueortc]

Awesome. Thanks for the help. Is there any KD codebase that you would recommend?