It's no longer necessary to remove sources for automatically downloaded dependencies in CI

We are currently removing the downloaded sources in the CI in order to keep artifacts small. This is no longer needed due to #256 (closed) and it actually complicates CI scripts by not being able to rely on CMake.