Skip to content
gpu-ci

Split prefilling batch with decoding batch for increamental decoding. #3157

Sign in to view logs

Split prefilling batch with decoding batch for increamental decoding.

Split prefilling batch with decoding batch for increamental decoding. #3157

Run time

Learn about OS pricing on GitHub Actions
Job Run time
GPU CI Concierge
14s
Check Python Interface
1s
Inference Tests
1s
Training Tests
1s
17s