Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM-39022: Add group name presence server. #54

Merged
merged 6 commits into from
May 28, 2024
Merged

DM-39022: Add group name presence server. #54

merged 6 commits into from
May 28, 2024

Conversation

ktlim
Copy link
Collaborator

@ktlim ktlim commented Mar 31, 2024

This change records the group names/ids of images as they're being ingested and adds a Web service that reports the presence or absence of a particular group name (with instrument, snap, and detector).

@ktlim ktlim force-pushed the tickets/DM-39022 branch from 1675491 to 6937af0 Compare March 31, 2024 02:29
@ktlim ktlim force-pushed the tickets/DM-43558 branch from eec6b44 to cf8669c Compare March 31, 2024 02:33
@ktlim ktlim force-pushed the tickets/DM-39022 branch 5 times, most recently from c4fe31c to 0e8ac06 Compare April 1, 2024 11:23
Base automatically changed from tickets/DM-43558 to main April 18, 2024 20:19
@ktlim ktlim requested a review from hsinfang May 24, 2024 23:15
Copy link
Contributor

@hsinfang hsinfang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

logger.info("Ingesting %s", resources)
refs = None
try:
refs = ingester.run(resources)
except Exception:
logger.exception("Error while ingesting %s", resources)
continue
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this needed with this commit?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is actually a separate fix that prevents visit definition (and Rucio registration) from trying to run if an exception occurred in ingest. I'll split it out into a separate commit.

@ktlim ktlim force-pushed the tickets/DM-39022 branch from b03af58 to 5a66a64 Compare May 28, 2024 20:01
@ktlim ktlim merged commit 41deacf into main May 28, 2024
4 checks passed
@ktlim ktlim deleted the tickets/DM-39022 branch May 28, 2024 20:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants