-
Notifications
You must be signed in to change notification settings - Fork 0
Sync meeting 2024 04 09
Kenneth Hoste edited this page May 2, 2024
·
1 revision
- Monthly, every 2nd Tuesday of the month at 10:00 CE(S)T
- Notes of previous meetings at https://github.com/multixscale/meetings/wiki
- Tue 14 May 2024 10:00 CEST
- clashes with ISC'24!
- reschedule to Tue 7 May?
attending:
- Neja (NIC)
- Xin, Maksim, Satish (SURF)
- Alan (UB)
- Richard, Thomas (UiB)
- Bob (RUG)
- Nadia, Eli, Susana, Helena (HPCNow!)
- Lara (UGent)
- Julian (BSC)
project planning overview: https://github.com/orgs/multixscale/projects/1
- link to notes during last sync meeting https://github.com/multixscale/meetings/wiki/Sync-meeting-2024-03-12#eurohpc-summit-2024-antwerp-18-21-march-2024
- overall impressions:
- lots of possibilities to show EESSI
- noticed presence (particularly during CoE/NCC session on Thursday)
- great to socialize with project partners
- many CoEs have the same problem "How to get software distributed"
- ambassadors within CoEs?
- contact with Thor Wikfeldt (ENCCS, Sweden)
- topic "how to use EESSI"
- onboard people
- applications
- POP (CoE), Extrae tool (Kenneth worked on it, but wasn't successful, see https://github.com/easybuilders/easybuild-easyconfigs/pull/20153)
- QuantumEspresso (work started before, met developers, got some contacts, Davide can get in contact with them)
- was slow to build (ConfigureMake)
- new method (CMake)
- also performance improvements (related to non-optimized configuration)
- also use of GPUs? QE is Fortran code, they need NVHPC toolchain is needed
- good follow-up possibilities with developers
- Kenneth is going to write a post about the Summit
- discussion of status, implications of review, work plan for this year
- set up closer collaboration between technical partners and scientific partners
- goal: help them using EESSI during development, understand their needs, implement adjustments such as
dev.eessi.io
repository and workflow - "use cases": see notes in OneDrive (https://onedrive.live.com/view.aspx?resid=B581D622A3AEE01A!18907&cid=b581d622a3aee01a&authkey=!AIapSmHlsMwk3PM&CT=1712650794662&OR=ItemsView)
- goal: help them using EESSI during development, understand their needs, implement adjustments such as
- need EESSI-extend module
- shipped via EESSI
- need a way to handle EasyBuild hooks (eb_hooks.py)
- putting it under
init
directory (may end up with similar issue like updating Lmod cache)?
- putting it under
- next GA near Barcelona (1st/2nd week of April '25)
- ...
- Hackathon (March 26) was very useful in getting some (large/long-standing) PRs merged
- Add functionality for rebuilding software (software-layer PR #488)
- Automatically update Lmod caches on Stratum 0 (filesystem-layer PR #175)
- Split off LUA hooks into SitePackage.py (software-layer PR #496)
- OpenFOAM easyblock (easyblocks pr #3232)
- run test suite during bot build step (software-layer PR #467)
- Update to debugging failed builds docs PR #168
- paper submission to RISC-V workshop at ISC'24 accepted!
- Preparing to Hit the Ground Running: Adding RISC-V support to EESSI
- Submission to Arm HPC User Group workshop at ISC'24 accepted!
- Extending Arms reach by going EESSI
- EasyBuild 4.9.1 was released and made available in EESSI
- Noteworthy feature for EESSI: add support for
--from-commit
and--include-easyblocks-from-commit
- how do we use it? start with
--from-pr
but before merging fix it? - need to update contribution policy
- can we use CI to document/enforce which commit is used?
- cannot convert existing --from-pr to --from-commit?
- check_missing_installation.sh
- EB version is specific to easystack file
- could change that so 4.9.1 or newer is used
- do not run checks for previous EB versions?
- needs some CI/checks to ensure that no legacy easystack files are used
- good task for next hackathon?
- how do we use it? start with
- Noteworthy feature for EESSI: add support for
- Lots of additions to the repository, e.g.:
- OpenFOAM v10
- R-bundle-CRAN
- R v4.2.2
- Modflow
- Qt5 v5.15.13
- ImageMagick v7.1.1-15
- Several PRs to improve the configuration of Lmod hooks/customizations (both internal ones and for sites/users)
- Also see slides of last week's EESSI mothnly update meeting: https://github.com/EESSI/meetings/blob/main/meetings/EESSI_meeting_20240404.pdf
- Ongoing work on tests for LAMMPS, QuantumEspresso, and PyTorch, and GROMACS (working with the developers, issues on neoverse_v1)
- test suite
- open PRs for QE, PyTorch
- see documentation for setting testing up on your local HPC (hint to NESSI people)
WP5 (Building, Supporting and Maintaining a Central Shared Stack of Optimized Scientific Software Installations)
- Please check the proposal for the support rotation for July-September: https://gitlab.com/eessi/support/-/wikis/Proposal-support-rotation
- Ongoing: weekly support sync meetings
- bot:
- some upcoming new release making it more agnostic to what it builds, other smaller changes (checking configuration)
- improve the ingestion (more flexible, more efficient)
- support dev.eessi.io ?
- working on getting Ambassador program going
- tutorial at SC?
- deadline April 19
- need people who go
- Alan cannot go this year
- MultiXscale cannot pay for most of the costs
- SC covers flights for two presenters
- discussion about joint workshop of scientific partners
- discussing with CECAM (advertisement, support, ...)
- end of May (Norwegian Bioinformatics)
- presenting EESSI + MultiXscale
- Nextflow demo
- direnv
- attending TeraTec Paris?
- discuss next week
- two tickets: Eli & maybe Lara
- flyer for MultiXscale
- discuss with Neja
- share within general
- abstract for presentation at POP3 workshop at ISC
- sent material, postcard and stickers to baltic HPC
- ISC
- poster (Pauline, EuroHPC)
- video
- Task 7.1
- scientific applications on demand
- mention Norwegian AI Cloud (PoC)
- script in demo repository to install EESSI
- https://github.com/EESSI/eessi-demo/blob/main/scripts/install_cvmfs_eessi.sh
- good to mention on EESSI docs (Native Installation)?
- AWS appstore
- Quarterly Reports due by April 26
- link
- COLA signatures received for technical partners
- in contact with new Project Officer
- for delaying deliverables we should put this in the amendment
- tech WPs: drop one task and divert effort to collaboration (WP8)
- not sure when we'll get the report from the review
- for delaying deliverables we should put this in the amendment
- meeting CI/CD
- Wednesday, April 10, 10:00am or 11:00am (UTC+2)
- https://github.com/multixscale/meetings/wiki/Sync-meeting-2024-03-12
- https://github.com/multixscale/meetings/wiki/Sync-meeting-2024-02-13
- https://github.com/multixscale/meetings/wiki/Sync-meeting-2024-01-09
- https://github.com/multixscale/meetings/wiki/Sync-meeting-2023-12-12
- https://github.com/multixscale/meetings/wiki/Sync-meeting-2023-11-14
- https://github.com/multixscale/meetings/wiki/Sync-meeting-2023-10-10
- https://github.com/multixscale/meetings/wiki/Sync-meeting-2023-09-12
- https://github.com/multixscale/meetings/wiki/Sync-meeting-2023-08-08
- https://github.com/multixscale/meetings/wiki/Sync-meeting-2023-07-11
- https://github.com/multixscale/meetings/wiki/Sync-meeting-2023-06-13
- https://github.com/multixscale/meetings/wiki/Sync-meeting-2023-05-09
- https://github.com/multixscale/meetings/wiki/Sync-meeting-2023-04-11
- https://github.com/multixscale/meetings/wiki/Sync-meeting-2023-03-14
- https://github.com/multixscale/meetings/wiki/Sync-meeting-2023-02-14
- https://github.com/multixscale/meetings/wiki/sync-meeting-2023-01-10