Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Segmentation Fault with combineTools using HybridNew in Combine-v10/CMSSW_14_1_0_pre4 #330

Open
sergicastells9 opened this issue Aug 29, 2024 · 0 comments

Comments

@sergicastells9
Copy link

sergicastells9 commented Aug 29, 2024

I've recently upgraded from CMSSW_11_3_4 to CMSSW_14_1_0_pre4 with Combine v10 and am trying to run HybridNew. I am doing a parametric analysis that uses RooPdfs for the signal/background models. My setup used to work with CMSSW_11_3_4, but now, with CMSSW_14_1_0_pre4, I get a segmentation fault when running combine -M HybridNew -m 125 -d ../combine/15_GeV/h4g_15_GeV_datacard.txt -n 15GeV --LHCmode LHC-limits --saveHybridResult. I've gone through both the ROOT and Combine changelogs and haven't found anything that might explain this behavior. Note that I've posted the same issue to the HiggsAnalysis-CombinedLimit GitHub page as it is unclear to me now whether this is a CombineHarvester or a Combine problem.

Additional notes: I use the recommended tags for Combine and CombineHarvester so everything "should" be up to date.

I have no issues with text2workspace, FitDiagnostics, Significance, or -H HybridNew (until it gets to the HybridNew part). The full stack is below. I have also tested running combine datacard-2-template-analysis.txt -M HybridNew --LHCmode LHC-limits --rMax 2.0 which did not have any issues, where the datacard/workspace are in HiggsAnalysis/CombinedLimit/data/tutorials/CAT23001/...

 <<< v10.0.2 >>>
>>> Random number generator seed is 123456
>>> using the Profile Likelihood test statistic modified for upper limits (Q_LHC)
>>> Method used is HybridNew

 *** Break *** segmentation violation



===========================================================
There was a crash.
This is the entire stack trace of all threads:
===========================================================
#0  0x00007f94144d89fa in wait4 () from /lib64/libc.so.6
#1  0x00007f941444b243 in do_system () from /lib64/libc.so.6
#2  0x00007f941636743d in TUnixSystem::StackTrace() () from /cvmfs/cms.cern.ch/el9_amd64_gcc12/cms/cmssw/CMSSW_14_1_0_pre4/external/el9_amd64_gcc12/lib/libCore.so
#3  0x00007f9416366df4 in TUnixSystem::DispatchSignals(ESignals) () from /cvmfs/cms.cern.ch/el9_amd64_gcc12/cms/cmssw/CMSSW_14_1_0_pre4/external/el9_amd64_gcc12/lib/libCore.so
#4  <signal handler called>
#5  0x00007f9417ea1ef7 in RooFit::Constrain(RooArgSet const&) () from /cvmfs/cms.cern.ch/el9_amd64_gcc12/cms/cmssw/CMSSW_14_1_0_pre4/external/el9_amd64_gcc12/lib/libRooFitCore.so
#6  0x00007f9418c6cde0 in HybridNew::create(RooWorkspace*, RooStats::ModelConfig*, RooStats::ModelConfig*, RooAbsData&, RooAbsCollection const&, HybridNew::Setup&) () from /afs/crc.nd.edu/user/s/scastel2/Private/CMSSW_14_1_0_pre4/lib/el9_amd64_gcc12/libHiggsAnalysisCombinedLimit.so
#7  0x00007f9418c6ec88 in HybridNew::eval(RooWorkspace*, RooStats::ModelConfig*, RooStats::ModelConfig*, RooAbsData&, RooAbsCollection const&, bool, double) () from /afs/crc.nd.edu/user/s/scastel2/Private/CMSSW_14_1_0_pre4/lib/el9_amd64_gcc12/libHiggsAnalysisCombinedLimit.so
#8  0x00007f9418c6f5bf in HybridNew::eval(RooWorkspace*, RooStats::ModelConfig*, RooStats::ModelConfig*, RooAbsData&, double, bool, double) () from /afs/crc.nd.edu/user/s/scastel2/Private/CMSSW_14_1_0_pre4/lib/el9_amd64_gcc12/libHiggsAnalysisCombinedLimit.so
#9  0x00007f9418c70db8 in HybridNew::runLimit(RooWorkspace*, RooStats::ModelConfig*, RooStats::ModelConfig*, RooAbsData&, double&, double&, double const*) () from /afs/crc.nd.edu/user/s/scastel2/Private/CMSSW_14_1_0_pre4/lib/el9_amd64_gcc12/libHiggsAnalysisCombinedLimit.so
#10 0x00007f9418c6a3f1 in HybridNew::run(RooWorkspace*, RooStats::ModelConfig*, RooStats::ModelConfig*, RooAbsData&, double&, double&, double const*) () from /afs/crc.nd.edu/user/s/scastel2/Private/CMSSW_14_1_0_pre4/lib/el9_amd64_gcc12/libHiggsAnalysisCombinedLimit.so
#11 0x00007f9418bc29a1 in Combine::mklimit(RooWorkspace*, RooStats::ModelConfig*, RooStats::ModelConfig*, RooAbsData&, double&, double&) () from /afs/crc.nd.edu/user/s/scastel2/Private/CMSSW_14_1_0_pre4/lib/el9_amd64_gcc12/libHiggsAnalysisCombinedLimit.so
#12 0x00007f9418bcb704 in Combine::run(TString, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, double&, double&, int&, TTree*, int) () from /afs/crc.nd.edu/user/s/scastel2/Private/CMSSW_14_1_0_pre4/lib/el9_amd64_gcc12/libHiggsAnalysisCombinedLimit.so
#13 0x000000000040ce31 in main ()
===========================================================


The lines below might hint at the cause of the crash. If you see question
marks as part of the stack trace, try to recompile with debugging information
enabled and export CLING_DEBUG=1 environment variable before running.
You may get help by asking at the ROOT forum https://root.cern/forum
preferably using the command (.forum bug) in the ROOT prompt.
Only if you are really convinced it is a bug in ROOT then please submit a
report at https://root.cern/bugs or (preferably) using the command (.gh bug) in
the ROOT prompt. Please post the ENTIRE stack trace
from above as an attachment in addition to anything else
that might help us fixing this issue.
===========================================================
#5  0x00007f9417ea1ef7 in RooFit::Constrain(RooArgSet const&) () from /cvmfs/cms.cern.ch/el9_amd64_gcc12/cms/cmssw/CMSSW_14_1_0_pre4/external/el9_amd64_gcc12/lib/libRooFitCore.so
#6  0x00007f9418c6cde0 in HybridNew::create(RooWorkspace*, RooStats::ModelConfig*, RooStats::ModelConfig*, RooAbsData&, RooAbsCollection const&, HybridNew::Setup&) () from /afs/crc.nd.edu/user/s/scastel2/Private/CMSSW_14_1_0_pre4/lib/el9_amd64_gcc12/libHiggsAnalysisCombinedLimit.so
#7  0x00007f9418c6ec88 in HybridNew::eval(RooWorkspace*, RooStats::ModelConfig*, RooStats::ModelConfig*, RooAbsData&, RooAbsCollection const&, bool, double) () from /afs/crc.nd.edu/user/s/scastel2/Private/CMSSW_14_1_0_pre4/lib/el9_amd64_gcc12/libHiggsAnalysisCombinedLimit.so
#8  0x00007f9418c6f5bf in HybridNew::eval(RooWorkspace*, RooStats::ModelConfig*, RooStats::ModelConfig*, RooAbsData&, double, bool, double) () from /afs/crc.nd.edu/user/s/scastel2/Private/CMSSW_14_1_0_pre4/lib/el9_amd64_gcc12/libHiggsAnalysisCombinedLimit.so
#9  0x00007f9418c70db8 in HybridNew::runLimit(RooWorkspace*, RooStats::ModelConfig*, RooStats::ModelConfig*, RooAbsData&, double&, double&, double const*) () from /afs/crc.nd.edu/user/s/scastel2/Private/CMSSW_14_1_0_pre4/lib/el9_amd64_gcc12/libHiggsAnalysisCombinedLimit.so
#10 0x00007f9418c6a3f1 in HybridNew::run(RooWorkspace*, RooStats::ModelConfig*, RooStats::ModelConfig*, RooAbsData&, double&, double&, double const*) () from /afs/crc.nd.edu/user/s/scastel2/Private/CMSSW_14_1_0_pre4/lib/el9_amd64_gcc12/libHiggsAnalysisCombinedLimit.so
#11 0x00007f9418bc29a1 in Combine::mklimit(RooWorkspace*, RooStats::ModelConfig*, RooStats::ModelConfig*, RooAbsData&, double&, double&) () from /afs/crc.nd.edu/user/s/scastel2/Private/CMSSW_14_1_0_pre4/lib/el9_amd64_gcc12/libHiggsAnalysisCombinedLimit.so
#12 0x00007f9418bcb704 in Combine::run(TString, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, double&, double&, int&, TTree*, int) () from /afs/crc.nd.edu/user/s/scastel2/Private/CMSSW_14_1_0_pre4/lib/el9_amd64_gcc12/libHiggsAnalysisCombinedLimit.so
#13 0x000000000040ce31 in main ()
===========================================================

Can anyone provide any insight into what might be going wrong? I'm totally at a loss here. If I'm missing any information or can upload my workspace for reference then just let me know. Many thanks in advance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant