Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Theory uncertainties implemented #35

Draft
wants to merge 5 commits into
base: main
Choose a base branch
from
Draft

Theory uncertainties implemented #35

wants to merge 5 commits into from

Conversation

J-M-Moore
Copy link
Collaborator

This PR implements the theory covariance matrix supplied in the simu_fac files. Currently only does things at the level of the fit, we also need to add this to the chi2 computation and the plots.

@comane
Copy link
Member

comane commented Nov 22, 2023

This PR implements the theory covariance matrix supplied in the simu_fac files. Currently only does things at the level of the fit, we also need to add this to the chi2 computation and the plots.

Hi @J-M-Moore , thanks for this. Could you please add some more description / update the description of the PR ?

Also are there some checks/benchmark we can perform before merging this?

@J-M-Moore J-M-Moore changed the title Theory uncertainties for fit Theory uncertainties implemented Nov 22, 2023
@LucaMantani
Copy link
Member

It seems fine to me, I don't see mistakes.

The easy benchmark is to compare the two alpha_EW datasets, the one that contains the th_covmat in the commondata and the other by adding it in the fit

@LucaMantani
Copy link
Member

@J-M-Moore or @comane Could you run a dumb fit of just cll in alphaEW, fixed PDF, in the two scenarios and verify that the results are the same? Than we can merge it.

Comment on lines +354 to +355
spec_dict["invcovmat"] = invcovmat

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @J-M-Moore, here you are changing the invcovmat entry of spec_dict.
What about the covmat one, is that not needed?

I am asking since out_exp at line 378 is given the covmat not augmented with the theory one.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm yeah you're probably right that this is a mistake

@@ -318,6 +330,29 @@ def observable_generator(
obsrot_tr = None
obsrot_vl = None

if use_th_covmat:
data_path = str(_get_nnpdf_profile()['data_path']) + 'theory_' + theoryid.id + '/simu_factors'
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We probably need to have a check here to ensure that only the SIMUnet theory is used.
No other theory has simu_factors

@comane
Copy link
Member

comane commented Jan 9, 2024

What is the status of this @J-M-Moore, are we planning on merging it or is this not needed anymore?

@comane comane marked this pull request as draft January 19, 2024 14:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants