Checkout submodules is slow

I've got a repo with 1 submodule and no nested submodules. Running actions/checkout with default depth 1 and submodules=true, it takes 19 seconds. Without submodules it takes 5 seconds. The submodule repo is smaller than the root one. Wondering if there's some problem - 19 seconds seems like a long time