Simplify #4116

Job	Run time
build-gcc	18m 22s
build-macos (-DCMAKE_DISABLE_PRECOMPILE_HEADERS=On)	6m 25s
build-distros (alpine)	14m 50s
build-macos (-DMOLD_USE_ASAN=On)	14m 22s
build-clang (-DCMAKE_DISABLE_PRECOMPILE_HEADERS=On)	11m 18s
build-distros (archlinux)	16m 41s
build-clang (-DMOLD_USE_TSAN=On)	18m 44s
build-msys	10m 46s
build-distros (fedora)	11m 50s
build-distros (gentoo/stage3)	17m 38s
build-windows	27m 17s
build-distros (opensuse/tumbleweed)	11m 37s
	2h 59m 50s

Provide feedback