Add fast path for replaying already shrunk test cases #4650

Job	Run time
test-pyodide	8m 53s
test-win (3.11, nocover)	4m 6s
test-osx (check-py310-cover)	2m 52s
test-win (3.11, cover+rest)	8m 38s
test (check-whole-repo-tests)	6m 30s
test-osx (check-py310-nocover)	2m 17s
test-win (3.11, x86, nocover)	5m 13s
test (lint)	46s
test-osx (check-py310-niche)	1m 25s
test-win (3.11, x86, cover+rest)	9m 5s
test (check-format)	57s
test-osx (check-py311-cover)	2m 46s
test (check-coverage)	8m 56s
test (check-conjecture-coverage)	2m 8s
test (check-py39-cover)	6m 3s
test (check-pypy39-cover)	6m 10s
test (check-py310-cover)	5m 37s
test (check-py310-nocover)	4m 57s
test (check-py310-niche)	3m 37s
test (check-pypy310-cover)	5m 59s
test (check-py311-cover)	5m 4s
test (check-py311-nocover)	4m 56s
test (check-py311-niche)	3m 38s
test (check-py312-cover)	6m 48s
test (check-py312-nocover)	6m 18s
test (check-py312-niche)	3m 54s
test (check-py313-cover)	6m 31s
test (check-py313-nocover)	5m 38s
test (check-py313-niche)	3m 45s
test (check-quality)	3m 51s
test (check-py39-nose)	1m 17s
test (check-py39-pytest46)	1m 52s
test (check-py39-pytest54)	2m 1s
test (check-pytest62)	1m 46s
test (check-django50)	1m 51s
test (check-django42)	1m 41s
test (check-pandas22)	1m 21s
test (check-pandas21)	1m 12s
test (check-pandas20)	1m 11s
test (check-pandas15)	1m 18s
test (check-pandas14)	1m 21s
test (check-pandas13)	1m 10s
test (check-py39-pandas12)	1m 15s
test (check-py39-pandas11)	1m 23s
test (check-py39-oldestnumpy)	1m 49s
test (check-numpy-nightly)	8m 5s
deploy	0s
	2h 57m 51s

Provide feedback