Skip to content
Optimum neuron LLM inference cache builder

Optimum neuron LLM inference cache builder #18

Sign in to view logs

Optimum neuron LLM inference cache builder

Optimum neuron LLM inference cache builder #18

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Create optimum-neuron inference cache (gpt2)
4m 57s
Create optimum-neuron inference cache (llama3-8b)
40m 46s
Create optimum-neuron inference cache (llama3-70b)
1h 45m 58s
Create optimum-neuron inference cache (llama2-7b-13b)
1h 37m 4s
Create optimum-neuron inference cache (llama2-70b)
1h 33m 54s
Create optimum-neuron inference cache (mistral)
59m 4s
Create optimum-neuron inference cache (llama-variants)
1h 44m 51s
Create optimum-neuron inference cache (mistral-variants)
19m 58s
Create optimum-neuron inference cache (mixtral)
55m 34s
9h 42m 6s