Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: CLI arguments for configuring GraphQL query costs. #2335

Conversation

netrome
Copy link
Contributor

@netrome netrome commented Oct 11, 2024

Linked Issues/PRs

Description

This PR adds CLI options to configure graphql query costs dynamically.

Checklist

  • Breaking changes are clearly marked as such in the PR description and changelog
  • New behavior is reflected in tests

Before requesting review

  • I have reviewed the code myself

@netrome netrome changed the base branch from release/v0.38.0 to master October 11, 2024 22:20
@netrome netrome force-pushed the 2318-make-all-limits-of-the-of-the-complexity-to-be-configurable-via-the-cli branch 2 times, most recently from 7bf18ce to ec34236 Compare October 11, 2024 22:25
@netrome netrome requested a review from a team October 11, 2024 22:26
@netrome netrome marked this pull request as ready for review October 11, 2024 22:26
tests/tests/dos.rs Outdated Show resolved Hide resolved
tests/tests/dos.rs Outdated Show resolved Hide resolved
Copy link
Member

@rymnc rymnc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

left some comments and queries

@netrome netrome requested review from rymnc and acerone85 October 14, 2024 07:23
@rymnc
Copy link
Member

rymnc commented Oct 14, 2024

wonder why the ci is failing for the test included in this pr. lgtm otherwise, the test passes locally.

@netrome
Copy link
Contributor Author

netrome commented Oct 14, 2024

wonder why the ci is failing for the test included in this pr. lgtm otherwise, the test passes locally.

Yeah, I'll investigate it. It was the same with the previous parameters so something else is going on here but I have no idea what.

@netrome
Copy link
Contributor Author

netrome commented Oct 14, 2024

Yeah, I'll investigate it. It was the same with the previous parameters so something else is going on here but I have no idea what.

Reproduced locally now. The test only fails for me with libtest and not nextest when running cargo test complex_queries - so it seems to be some sort of interference between the tests. Running it in isolation succeeds with both libtest and nextest. I suspect that we're querying a node initialized in another test.

@netrome
Copy link
Contributor Author

netrome commented Oct 14, 2024

Reproduced locally now. The test only fails for me with libtest and not nextest when running cargo test complex_queries - so it seems to be some sort of interference between the tests. Running it in isolation succeeds with both libtest and nextest. I suspect that we're querying a node initialized in another test.

Alright, so the problem is that libtest will initialize QUERY_COSTS once for the entire test suite.

acerone85 and others added 5 commits October 14, 2024 13:54
Co-authored-by: Mårten Blankfors <marten@blankfors.se>
* Move query costs initialization function
* Feature gate default implementation on "test-helpers" feature
* Only set block header query cost in test
@netrome netrome force-pushed the 2318-make-all-limits-of-the-of-the-complexity-to-be-configurable-via-the-cli branch from 8f93f4f to 645db49 Compare October 14, 2024 11:55
@netrome netrome requested a review from rymnc October 14, 2024 11:58
@xgreenx xgreenx enabled auto-merge (squash) October 14, 2024 18:01
@xgreenx xgreenx merged commit 7528047 into master Oct 14, 2024
32 checks passed
@xgreenx xgreenx deleted the 2318-make-all-limits-of-the-of-the-complexity-to-be-configurable-via-the-cli branch October 14, 2024 18:28
@xgreenx xgreenx mentioned this pull request Oct 14, 2024
xgreenx added a commit that referenced this pull request Oct 14, 2024
## Version v0.40.0

### Added
- [2347](#2347): Add GraphQL
complexity histogram to metrics.
- [2350](#2350): Added a new
CLI flag `graphql-number-of-threads` to limit the number of threads used
by the GraphQL service. The default value is `2`, `0` enables the old
behavior.
- [2335](#2335): Added CLI
arguments for configuring GraphQL query costs.

### Fixed
- [2345](#2345): In PoA
increase priority of block creation timer trigger compare to txpool
event management

### Changed
- [2334](#2334): Prepare the
GraphQL service for the switching to `async` methods.
- [2310](#2310): New metrics:
"The gas prices used in a block" (`importer_gas_price_for_block`), "The
total gas used in a block" (`importer_gas_per_block`), "The total fee
(gwei) paid by transactions in a block" (`importer_fee_per_block_gwei`),
"The total number of transactions in a block"
(`importer_transactions_per_block`), P2P metrics for swarm and protocol.
- [2340](#2340): Avoid long
heavy tasks in the GraphQL service by splitting work into batches.
- [2341](#2341): Updated all
pagination queries to work with the async stream instead of the sync
iterator.
- [2350](#2350): Limited the
number of threads used by the GraphQL service.

#### Breaking
- [2310](#2310): The `metrics`
command-line parameter has been replaced with `disable-metrics`. Metrics
are now enabled by default, with the option to disable them entirely or
on a per-module basis.
- [2341](#2341): The maximum
number of processed coins from the `coins_to_spend` query is limited to
`max_inputs`.

## What's Changed
* fix(gas_price_service): service name and unused trait impl by @rymnc
in #2317
* Do not require build of docker images to pass CI by @xgreenx in
#2342
* Prepare the GraphQL service for the switching to `async` methods by
@xgreenx in #2334
* Limited the number of threads used by the GraphQL service by @xgreenx
in #2350
* Increase priority of timer over txpool event by @xgreenx in
#2345
* Disable flaky `test_poa_multiple_producers` test by @rafal-ch in
#2353
* feat: CLI arguments for configuring GraphQL query costs. by @netrome
in #2335
* Add graphql query complexity histogram metric by @AurelienFT in
#2349
* Updated all pagination queries to work with the `Stream` instead of
`Iterator` by @xgreenx in
#2341
* Avoid long heavy tasks in the GraphQL service by @xgreenx in
#2340
* Add more metrics by @rafal-ch in
#2310


**Full Changelog**:
v0.39.0...v0.40.0

---------

Co-authored-by: Rafał Chabowski <rafal.chabowski@fuel.sh>
Co-authored-by: acerone85 <andrea.cerone@gmail.com>
Co-authored-by: rymnc <43716372+rymnc@users.noreply.github.com>
Co-authored-by: Rafał Chabowski <88321181+rafal-ch@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Make all limits of the of the complexity to be configurable via the CLI
5 participants