Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update processor to run on NanoAOD with globalParT stage2 #214

Open
wants to merge 80 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
80 commits
Select commit Hold shift + click to select a range
9adfc96
review xsecs with xsdb
cmantill Sep 18, 2024
04a9470
add v12v2 with glopart
cmantill Sep 18, 2024
9db37b1
use xsdb number for last vbfhh4b sample
cmantill Sep 18, 2024
3c30a2e
fix typo in vbf sample for xsec
cmantill Sep 18, 2024
2eea55b
add new nano version
cmantill Sep 18, 2024
a284e0d
delete unused trigger weights
cmantill Sep 18, 2024
39a8ea5
reorder added fatjet variables and rename parT
cmantill Sep 18, 2024
67f5941
enable bdt inference, reduce jecs, add part variables, uniformize pre…
cmantill Sep 18, 2024
c992403
style: pre-commit fixes
pre-commit-ci[bot] Sep 18, 2024
0404ec4
formatting
cmantill Sep 18, 2024
a8e134b
formatting
cmantill Sep 18, 2024
c716843
style: pre-commit fixes
pre-commit-ci[bot] Sep 18, 2024
dcd0f5a
fix format and remove duplicate xsec
cmantill Sep 18, 2024
f82ed37
style: pre-commit fixes
pre-commit-ci[bot] Sep 18, 2024
19ef762
fix format
cmantill Sep 18, 2024
887e7e5
add submit config and get rid of unused option
cmantill Sep 18, 2024
de7a290
gen match ak8 jets ordered by pt
cmantill Sep 19, 2024
cbf8e00
2nd try submission
cmantill Sep 19, 2024
a7a3ef6
style: pre-commit fixes
pre-commit-ci[bot] Sep 19, 2024
be27091
fix str
cmantill Sep 19, 2024
c98d4c6
fix str
cmantill Sep 19, 2024
613ac54
style: pre-commit fixes
pre-commit-ci[bot] Sep 19, 2024
23ae54e
add part roc curve validation
cmantill Sep 25, 2024
a23efd7
Merge branch 'update-parT' of github.com:LPC-HH/HH4b into update-parT
cmantill Sep 25, 2024
2a8e8f6
add pnet xbb option
cmantill Sep 25, 2024
d9c4408
style: pre-commit fixes
pre-commit-ci[bot] Sep 25, 2024
20f6f71
fix
cmantill Sep 25, 2024
f72c586
fix
cmantill Sep 25, 2024
b1bd077
style: pre-commit fixes
pre-commit-ci[bot] Sep 25, 2024
4cf3bb1
format
cmantill Sep 25, 2024
feb0ac8
format
cmantill Sep 25, 2024
adfe154
style: pre-commit fixes
pre-commit-ci[bot] Sep 25, 2024
36800fd
format
cmantill Sep 25, 2024
4db2328
push latest files
cmantill Sep 25, 2024
8df5720
style: pre-commit fixes
pre-commit-ci[bot] Sep 25, 2024
378fbf0
fix submit
cmantill Sep 25, 2024
2bec743
Merge branch 'update-parT' of github.com:LPC-HH/HH4b into update-parT
cmantill Sep 25, 2024
2bec1ad
add matching for vv and vjets
cmantill Sep 26, 2024
ad10445
style: pre-commit fixes
pre-commit-ci[bot] Sep 26, 2024
f81520c
change pnet txbb option
cmantill Sep 27, 2024
d9fafeb
add assertion in genselection and switch pnet txbb str
cmantill Sep 27, 2024
da12dec
Merge branch 'update-parT' of github.com:LPC-HH/HH4b into update-parT
cmantill Sep 27, 2024
d5cdf3b
style: pre-commit fixes
pre-commit-ci[bot] Sep 27, 2024
010f358
few more fixes
cmantill Sep 27, 2024
510d1e0
Merge branch 'update-parT' of github.com:LPC-HH/HH4b into update-parT
cmantill Sep 27, 2024
e8b6ff8
add options for loading with different txbb versions
cmantill Sep 27, 2024
c6b0d4a
move to run2 folder
cmantill Sep 27, 2024
74236a5
add bdt training config
cmantill Sep 27, 2024
30d501c
style: pre-commit fixes
pre-commit-ci[bot] Sep 27, 2024
dec3a05
remove legacy options
cmantill Sep 27, 2024
74828a9
fix merge
cmantill Sep 27, 2024
c61d3aa
style: pre-commit fixes
pre-commit-ci[bot] Sep 27, 2024
51994e7
add bdt training command
cmantill Sep 27, 2024
9beae06
Merge branch 'update-parT' of github.com:LPC-HH/HH4b into update-parT
cmantill Sep 27, 2024
5ae42f0
style: pre-commit fixes
pre-commit-ci[bot] Sep 27, 2024
2a41d4a
add all years
cmantill Sep 27, 2024
15fb8c3
add all years
cmantill Sep 27, 2024
08a73de
style: pre-commit fixes
pre-commit-ci[bot] Sep 27, 2024
b94e7d1
fix logging
cmantill Sep 27, 2024
cedd6d1
Merge branch 'update-parT' of github.com:LPC-HH/HH4b into update-parT
cmantill Sep 27, 2024
e297e46
temp fix to submit w/o trigger selection
cmantill Sep 27, 2024
b67f361
add logging
cmantill Sep 29, 2024
9df9867
style: pre-commit fixes
pre-commit-ci[bot] Sep 29, 2024
ffd9682
sync ROC curve
cmantill Sep 30, 2024
54b61e0
Merge branch 'update-parT' of github.com:LPC-HH/HH4b into update-parT
cmantill Sep 30, 2024
8d6929f
style: pre-commit fixes
pre-commit-ci[bot] Sep 30, 2024
7b0ea79
BDT trained and minor modifications to plotting (#216)
dprim7 Sep 30, 2024
5fea702
revert trigger selection in place
cmantill Sep 30, 2024
dd2a21f
Merge branch 'update-parT' of github.com:LPC-HH/HH4b into update-parT
cmantill Sep 30, 2024
a9ff472
comparison script
cmantill Sep 30, 2024
7c42472
style: pre-commit fixes
pre-commit-ci[bot] Sep 30, 2024
04a7610
working version of ValidateBDT.py, next: evaluate with scale&smear (#…
dprim7 Oct 3, 2024
c6a45d9
edit requirements
cmantill Oct 3, 2024
ac86cd5
Merge branch 'update-parT' of github.com:LPC-HH/HH4b into update-parT
cmantill Oct 3, 2024
b6803a4
edit legend
cmantill Oct 3, 2024
6b8ca72
style: pre-commit fixes
pre-commit-ci[bot] Oct 3, 2024
cb32d0c
performed validation on latest three BDTs, cleaned up code (#219)
dprim7 Oct 3, 2024
57bbb18
Merge branch 'main' into update-parT
cmantill Oct 3, 2024
efc8060
Merge branch 'main' into update-parT
cmantill Oct 7, 2024
8287fab
Merge branch 'main' into update-parT
cmantill Oct 7, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -178,7 +178,7 @@ src/HH4b/postprocessing/**/*.pdf
src/HH4b/boosted/**/*.png
src/HH4b/boosted/**/*.pdf
src/HH4b/boosted/**/*roc_dict.pkl

src/HH4b/boosted/**/*.pkl

running_jobs.txt

Expand Down
38 changes: 4 additions & 34 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -81,6 +81,8 @@ pip install -e .
# for committing to the repository
pip install pre-commit
pre-commit install
# install requirements
pip3 install -r requirements.txt
```

### Troubleshooting
Expand All @@ -101,18 +103,10 @@ python3 -m pip install -e .
For submitting to condor, all you need is python >= 3.7.

For running locally, follow the same virtual environment setup instructions
above and install `coffea`
above

```bash
micromamba activate hh4b
pip install coffea
```

Clone the repository:

```
git clone https://github.com/LPC-HH/HH4b/
pip install -e .
```

### Running locally
Expand Down Expand Up @@ -192,31 +186,6 @@ python -u -W ignore src/run.py --year 2022EE --yaml src/condor/submit_configs/sk

## Postprocessing

### Setup

Make sure to install the package (#installing-package) and install all the
requirements in your conda environment:

```bash
pip3 install -r requirements.txt
```

### BDT Training

Multi-class BDT training:

```bash
python -W ignore TrainBDT.py --data-path /ceph/cms/store/user/rkansal/bbbb/skimmer/24Apr19LegacyFixes_v12_private_signal/ --model-name 24Apr21_legacy_vbf_vars --legacy --sig-keys hh4b vbfhh4b-k2v0 --no-pnet-plots
```

### Creating templates / FOM Scan / BDT ROC curve

From inside the src/HH4b/postprocessing directory:

```bash
python PostProcess.py --templates-tag 24Apr17pT300Cut --tag 24Mar31_v12_signal --legacy --mass H2PNetMass --bdt-model 24Apr21_legacy_vbf_vars --bdt-config 24Apr21_legacy_vbf_vars --txbb-wps 0.99 0.94 --bdt-wps 0.94 0.68 0.03 (--no-fom-scan) (--no-fom-scan-bin1) (--no-fom-scan-bin2) (--no-fom-scan-vbf) (--no-templates) (--bdt-roc)
```

## Condor Scripts

### Check jobs
Expand All @@ -241,6 +210,7 @@ Combine all output pickles into one:
for year in 2016APV 2016 2017 2018; do python src/condor/combine_pickles.py --tag $TAG --processor trigger --r --year $year; done
```


## Combine

### CMSSW + Combine Quickstart
Expand Down
410 changes: 408 additions & 2 deletions data/make_filelists.py

Large diffs are not rendered by default.

78,183 changes: 78,183 additions & 0 deletions data/nanoindex_v12v2_private.json

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ pandas==2.0.3
pyarrow==12.0.1
PyYAML==6.0.1
scikit-learn
setuptools<71
tabulate
tqdm==4.65.0
uproot==4.3.7
Expand Down
Loading
Loading