Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

adding CloudCatalog as a PyHC package #342

Merged
merged 2 commits into from
Sep 18, 2024
Merged

adding CloudCatalog as a PyHC package #342

merged 2 commits into from
Sep 18, 2024

Conversation

sandyfreelance
Copy link
Contributor

CloudCatalog (pip install cloudcatalog) is a specification plus Python client for labeling and retrieving cloud data sets. The shared Cloud Catalog specification can be used for sharing datasets across cloud frameworks as well as exposing cloud archives outside of the cloud. The Python tool is designed for retrieving file catalog (index) files from a specific ID entry in a catalog within a bucket. It also includes search functionality for searching through all data index catalogs found in the bucket list.

For HelioCloud, this specification creates a global data registry of publicly-accessible disks ('HelioDataRegistry'), maintained at the HDRL HelioCloud.org website. Individual dataset owners then define their dataset file catalogs ('CloudCatalog') for each dataset, that resides in the S3 (or equivalent) bucket alongside the dataset.

All grades are 'Good' except a rating of 'Partially met' for Community, as we are shifting from a private gitlab to public github and our CI/CD testing is only implemented in the gitlab portion. We anticipate changing our pipeline fully to github in the near future to better support PRs.

@sandyfreelance
Copy link
Contributor Author

Added to PR that I re-ordered it alphabetically in the second commit. So approving this PR will (a) add CloudCatalog to PyHC and (b) update the projects.yml to be alphabetic again.

Copy link
Contributor

@sapols sapols left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Sandy! I agree with your self-eval for CloudCatalog and I appreciate you alphabetizing this file for us. Welcome to PyHC, CloudCatalog.

@sapols sapols merged commit 9661f4e into main Sep 18, 2024
1 check passed
@sapols sapols deleted the cloudcatalog branch September 18, 2024 16:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants