Skip to content
build

Split prefilling batch with decoding batch for increamental decoding. #3525

Sign in to view logs

Split prefilling batch with decoding batch for increamental decoding.

Split prefilling batch with decoding batch for increamental decoding. #3525

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Build FlexFlow with the Makefile
21m 36s
Build FlexFlow with CMake (cuda)
23m 30s
Build FlexFlow with CMake (hip_rocm)
30m 28s
1h 15m 34s