You'll need to use an SSH key instead of a PAT if any URL in your .gitmodules file starts with ssh:// instead of https:// or git@github.com: otherwise GitHub will fail to clone the submodule in question with a Host key verification failed error.