Handle model state in benchmark CI jobs #380

Job	Run time
set-parameters	7s
prepare-test-specs (llama, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114...	41s
prepare-test-specs (llama, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:30853538511...	43s
prepare-test-specs (llama, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:device...	44s
build-benchmark-app / macos-job	18m 21s
export-models (llama, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicepool:... / macos-job	7m 58s
export-models (llama, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:dev... / macos-job	9m 3s
export-models (llama, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devi... / macos-job	8m 28s
upload-benchmark-app	0s
benchmark-on-device (llama, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:3085353851... / mobile-job (ios)	1m 1s
benchmark-on-device (llama, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devic... / mobile-job (ios)	55s
benchmark-on-device (llama, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:30853538511... / mobile-job (ios)	1m 1s
upload-benchmark-results	1m 10s
	50m 12s

Provide feedback