fix: remove unnecessary packages and try to increase linux space #17

Job	Run time
build-mac-x86 (x64, cpu)	1m 36s
build-mac-arm (arm64, cpu)	28s
build-windows (x64, cuda)	4m 27s
build-linux (x64, cuda)	5m 35s
build-windows (x64, directml, --pre)	1m 9s
build-linux (x64, cpu, --extra-index-url https://download.pytorch.org/whl/cpu)	1m 38s
build-windows (x64, cpu)	1m 13s
build-linux (x64, rocm)	7m 50s
release	4m 57s
	28m 53s

Provide feedback