Replies: 2 comments
-
Hey @sdel555 for best inference performance, deepsparse does not use virtual threads provided through hyper threading. It only uses the physical cores. |
Beta Was this translation helpful? Give feedback.
0 replies
-
oh thanks, I didn't notice that lol
…On Tue, 23 Jan 2024, 06:09 Michael Goin, ***@***.***> wrote:
Hey @sdel555 <https://github.com/sdel555> for best inference performance,
deepsparse does not use virtual threads provided through hyper threading.
It only uses the physical cores.
—
Reply to this email directly, view it on GitHub
<#1550 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/A5EL5VTFPADD6MRAMHTO6P3YP3PQNAVCNFSM6AAAAABCEA6IZKVHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4DEMJTHA4DO>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi, does anyone know why my code is not fully using all CPU cores, but just those "even number"-indexed cores are around 100% usage?
The machine is with AMD Ryzen 7 5800H CPU, running with Linux 6.5.11-7-pve.
code:
Beta Was this translation helpful? Give feedback.
All reactions