Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Stress Testing] - Data Catalog and Config Loader #4125

Closed
noklam opened this issue Aug 29, 2024 · 2 comments · Fixed by #4230 or #4246
Closed

[Stress Testing] - Data Catalog and Config Loader #4125

noklam opened this issue Aug 29, 2024 · 2 comments · Fixed by #4230 or #4246
Assignees
Labels
Issue: Feature Request New feature or improvement to existing feature

Comments

@noklam
Copy link
Contributor

noklam commented Aug 29, 2024

Description

To create stress test for individual components:

  • DataCatalog
  • ConfigLoader

As for DataCatalog, the most important thing is to test it within the pipeline, CLI and separately by simulating scenarios when calling some methods as (add_feed_dict). Where the tests themselves should include different sets and combinations of parameters, datasets and patterns. #3957 (comment)

The tickets combined the two components as I believe the setup will be similar, or at least there need to be some mechanism to setup different datasets first so I thought it makes sense to bundle these two components together.

Context

#3957 (comment)

Component stress test:

  • The main goal for this is to benchmark performance of individual component, this will inform if refactoring work has positive/negative impact. Currently we only check if test pass, so we have no idea if a change may slow down performance. We have done this in the past but usually ad-hoc basis, we should run this regularly (or at least per release).

The direction of this is simple, we want to make measure the change of time against # number of entries. We would start with Datasets and Catalog, as this fits in the DataCatalog2.0 work and will be immediately useful.

  • DataCatalog (test # of datasets with catalog.yml & dataset factory)
  • ConfigLoader(# of parameters)
  • Optional: pipelines generated in loops (Dynamic pipeline)

This can address:

@astrojuanlu
Copy link
Member

xref #4154

@ankatiyar
Copy link
Contributor

Keeping this open for performance tests for KedroDataCatalog

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Issue: Feature Request New feature or improvement to existing feature
Projects
Status: Done
5 participants