So I went again through the setup and it finally works now!
Maybe this here also helped: [Support Guide] How do I access private repositories in the build environment?
The only „feature request“ that I would make, is add support for relative submodule-paths. What do you think @coelmay ? (Where I can replace in .gitmodules https://GitHub.com/user/repo with …/repo)