You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
With latest version of indexer, we can interact much more blocks as response, and this works well in curl.
However with exact query ( fetching like 2k ~16k ) indexer wrapper of hdp doesn't have same performance.
I left log, basically fetching time it self is super similar from curl however, parsing part takes alot of time ...
get_headers_proof took 3021 ms
start parsing response
json response took 21787 ms
2024-06-26T14:29:37.982150Z INFO hdp_provider::evm::provider: Time taken (Headers Proofs Fetch): 26.856025709s
so, this single line takes like 20s !!
let body: Value = response.json().await.map_err(IndexerError::ReqwestError)?;
The text was updated successfully, but these errors were encountered:
rkdud007
changed the title
Investigate parsing http response super slow with indexer
enable gzip feature to resolve slow http response parse time
Jun 26, 2024
rkdud007
changed the title
enable gzip feature to resolve slow http response parse time
resolve slow http response parse time ( potentially enable gzip feature)
Jun 26, 2024
Note: http response size is more than 10MB
Fortunately seems solution : https://users.rust-lang.org/t/using-json-with-response-data-in-reqwest-is-slow/95346/19 --- one questionable thing is, compare to this case we need to parse all of the response anyway. not sure how much improvement it will give
With latest version of indexer, we can interact much more blocks as response, and this works well in
curl
.However with exact query ( fetching like 2k ~16k ) indexer wrapper of hdp doesn't have same performance.
I left log, basically fetching time it self is super similar from
curl
however, parsing part takes alot of time ...so, this single line takes like 20s !!
The text was updated successfully, but these errors were encountered: