update the HTP power setting #22227
update the HTP power setting #22227
Conversation
| rpc_control_latency_cfg.rpcControlLatencyConfig = rpc_control_latency; | ||
| rpc_polling_time.option = QNN_HTP_PERF_INFRASTRUCTURE_POWER_CONFIGOPTION_RPC_POLLING_TIME; | ||
| rpc_polling_time.rpcPollingTimeConfig = 9999; |
There was a problem hiding this comment.
it's my understanding the polling change can only be supported by Android platform.
There was a problem hiding this comment.
verified it's supported on Windows
| // only v69 or higher support rpc polling mode. | ||
| QnnHtpPerfInfrastructure_PowerConfig_t& rpc_polling_time_cfg = rpc_power_configs[1]; | ||
| rpc_polling_time_cfg.option = QNN_HTP_PERF_INFRASTRUCTURE_POWER_CONFIGOPTION_RPC_POLLING_TIME; | ||
| if (rpc_polling_time > 0) { |
There was a problem hiding this comment.
previous commit was setting to 9999 (max)
now we don't set anything (unless user provides)
Is that the desired default behavior? @chiwwang can you advise.
There was a problem hiding this comment.
Hi George,
I think it's ok -- up to what you want to provide to users.
In some other implementations like TFLite Delegate, we bundled the rpc polling time into the performance profile, e.g., burst, HighPerformance... etc, so users have no chance to adjust the polling time.
But it's totally ok to make users decide this value, which gives users a finer grant cotrol.
Description
update the HTP power setting