-
Notifications
You must be signed in to change notification settings - Fork 0
Sync meeting 2023 09 05 with CernVM FS developers on Best Practices for CernVM FS on HPC tutorial
Kenneth Hoste edited this page Sep 5, 2023
·
2 revisions
- https://github.com/multixscale/cvmfs-tutorial-hpc-best-practices
- online tutorial, focused on (Euro)HPC system administrators
- aiming for Fall 2023 (Sept-Oct-Nov)
- collaboration between MultiXscale/EESSI partners and CernVM-FS developers
- tutorial + improvements to CernVM-FS docs
- similar approach to introductory tutorial by Kenneth & Bob in 2021, see https://cvmfs-contrib.github.io/cvmfs-tutorial-2021/
- format: tutorial website (+ CVMFS docs) + accompanying slide deck
Attending:
- CernVM-FS: Jakob, Valentin, Laura
- EESSI/MultiXscale: Kenneth, Lara, Bob
- GitHub repository @ https://github.com/multixscale/cvmfs-tutorial-hpc-best-practices
- Progress on tutorial contents is fairly limited so far
- open (WIP) PR by Kenneth for "What is CernVM-FS?" page (PR #13)
- first draft of "In a nutshell" subsection done
- "Features" subsection is WIP
- PR in current status was reviewed by Jakob
- TODO: "Terminology", "Use cases", "Example repositories" subsections
- Input for example repositories?
- What are the "flagship" repositories at CERN/Fermilab?
- LHC experiments (ATLAS, CMS), unpacked, sft lcg builds (see default CVMFS config + https://twiki.cern.ch/twiki/bin/view/CvmFS/ClientSetupCERN)
- Production vs nightly builds
- Auxilary data: extra stuff that comes with software, like reference data (cfr. LHC experiments, genomic datasets, Geant4, LHC detector description, CMS grid data (/cvmfs/cms-griddata.cern.ch/))
- What are the "flagship" repositories at CERN/Fermilab?
- Visuals?
- Anything else for this page?
- feedback
- should really focus on software use case (although other use cases can mentioned)
- comparison with cluster FS for software use case
- default Stratum-1's vs recommended Stratum-1's, public vs private Stratum-1's
- main aspects: de-duplication, on-demand streaming, HTTP transport
- open PR by Lara for "EESSI" page (PR #12)
- to be reviewed by Kenneth
- info on performance benchmark used for CHEP provided by Laura in issue #8
- open (WIP) PR by Kenneth for "What is CernVM-FS?" page (PR #13)
- schedule date for online tutorial?
- stay away from Nov'23 (clash with SC'23)
- options:
- Oct'23 (not feasible at this point)
- Dec'23 (first half)?
- Mon 4 Dec 2023 (13:30-17:00 CET with 30min break)
- OK for Jakob, Laura, Valentin, Bob, Kenneth, Lara
- need to check with Alan, Thomas
- Mon 4 Dec 2023 (13:30-17:00 CET with 30min break)
- Jan/Feb'24?
- too early to set a date already?
- is 2023 still realistic?
- we can consider submitting the tutorial for ISC'24
- deadline is 8 Dec 2023, see https://www.isc-hpc.com/submissions-2024.html
- next sync meeting
- 1 month from now, Mon 25 Sept at 15:00 CEST? OK for Jakob, Kenneth, Valentin, Laura, Lara, Bob
Notes available at https://github.com/multixscale/meetings/wiki/Sync-meeting-2023-07-07-with-CernVM-FS-developers-on-Best-Practices-for-CernVM-FS-on-HPC-tutorial
Bob, Lara, Kenneth
- next sync meeting early Sept'23
- test tutorial with SURF?
- split up in subsections, based on notes in https://github.com/multixscale/meetings/wiki/Sync-meeting-2023-05-25-with-CernVM-FS-developers-on-Best-Practices-for-CernVM-FS-on-HPC-tutorial (Kenneth) What is CernVM-FS? (Lara) EESSI (Kenneth) Accessing a repository (Kenneth) Configuration on HPC systems (Bob) Troubleshooting and debugging (Alan?) Performance aspects (Bob) Storage backends (Bob) Containers (Getting started with CernVM-FS)
Notes available at https://github.com/multixscale/meetings/wiki/Sync-meeting-2023-05-25-with-CernVM-FS-developers-on-Best-Practices-for-CernVM-FS-on-HPC-tutorial