Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Include timing information in provenance #975

Open
benjeffery opened this issue Oct 3, 2024 · 0 comments
Open

Include timing information in provenance #975

benjeffery opened this issue Oct 3, 2024 · 0 comments

Comments

@benjeffery
Copy link
Member

Tracking wallclock and cpu time used in inference is challenging in the distributed inference pipelines we're running, as they are often interrupted with steps redone and the tooling around the pipeline unable to report time actually used by tsinfer accurately.
It would be possible to record this information in the provenance field of the tree sequence, steps that are distributed can store their timings and combine them on finalise.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant