-
Notifications
You must be signed in to change notification settings - Fork 144
Conference call notes 20230607
Kenneth Hoste edited this page Jun 7, 2023
·
2 revisions
(back to Conference calls)
Notes on the 223rd EasyBuild conference call, Wednesday 7 June 2023 (15:00 UTC)
List of attendees (17):
- Sebastian Achilles (JSC, Germany)
- Simon Branford (Univ. of Birmingham, UK)
- Alex Domingo (Vrije Universiteit Brussel, Belgium)
- Jasper Grimm (University of York, UK)
- Sven Hansen (RWTH, Germany)
- Kenneth Hoste (HPC-UGent, Belgium)
- Terje Kvernes (University of Oslo, Norway)
- Sam Moors (Vrije Universiteit Brussel, Belgium)
- Sebastien Moretti (SIB, Switzerland)
- Alan O'Cais (CECAM, Univ. of Barcelona)
- Mikael Öhman (Chalmers University of Technology, Sweden)
- Bart Oldeman (Digital Research Alliance of Canada)
- Jurij Pečar (EMBL, Germany)
- Jörg Saßmannshausen (Imperial College London, UK)
- Alexandre Strube (JSC, Germany
- Caspar van Leeuwen (SURF, Netherlands)
- Davide Vanzo (Microsoft)
- overview of recent developments + outlook to next release
- progress on 2023a update of common toolchains
- Q&A
- release timeline
- latest release: EasyBuild v4.7.2 (28 May 2023)
- ETA next release (EasyBuild v4.7.3?): end of June'23
- progress on EasyBuild 5.0
- recent changes
- docs (merged PRs)
-
framework (merged PRs)
-
bug fixes
- ...
-
enhancements
- ...
-
changes
- stop running tests with Python 2.7 since it is no longer supported in GitHub Actions (PR #4267)
- we could restore running tests for EasyBuild 4.x via a CentOS 7 container - see also PR #3968 to ads end-to-end test for running EasyBuild in different Linux distros using containers
- it's quite possible that support for running tests on top of Python 3.6 (EOL since Dec'21) will removed soon as well... 😱
- stop running tests with Python 2.7 since it is no longer supported in GitHub Actions (PR #4267)
-
EasyBuild 5.0 (to
5.0.x
branch)- ...
-
bug fixes
-
easyblocks (merged PRs)
-
bug fixes
- update GCC easyblock to ensure that
--sysroot
is passed to linker (but only when it needs to be) (PR #2921) - enhance Cargo constructor to avoid processing list of crates multiple times into sources (PR #2934)
- update OpenBLAS easyblock since
make shared
is necessary and sufficient with OpenBLAS 0.3.23 + recent parallel build fixes (PR #2944)
- update GCC easyblock to ensure that
-
enhancements
- ...
-
updates
- ...
-
changes
- stop running tests with Python 2.7 since it is no longer supported in GitHub Actions (PR #2943)
- new software
- ...
-
EasyBuild 5.0 (to
5.0.x
branch)- ...
-
bug fixes
-
easyconfigs (merged PRs)
- >XXX easyconfig PRs were merged since last conf call
- bug fixes
- enhancements
- (noteworthy) new software
- noteworthy software updates
- changes
- work in progress
-
docs (open PRs + issues)
- project board to perform yearly review cycle of all documentation pages: https://github.com/orgs/easybuilders/projects/17/views/1
- add page with overview of changes in EasyBuild v5.0 (PR #137)
- rank down release notes page in search results (PR #159)
- review of
log-files
page (PR #163) - review of
locks
page (PR #166) - Suggestion: List of common easyblocks (issue #164 + issue #154)
-
framework (open PRs + issues)
-
reported bugs / bug fixes
- Python packages are being installed to
local/lib/python*/dist-packages
due to tweaks tosysconfig.py
in OS (issue #4128) - stop relying on
imp
(will no longer be available in Python 3.12) (issue #4264)-
importlib
is a "drop-in" replacement
-
- Python packages are being installed to
-
enhancements
- change
tar
command used inget_source_tarball_from_git
to get reproducible tarballs (PR #4248)- considering this for EasyBuild 5.0
- change
-
changes
- use version suffixes in PR title instead of Python versions when using
--new-pr
(PR #4253)
- use version suffixes in PR title instead of Python versions when using
-
EasyBuild 5.0 (to
5.0.x
branch)- enable
--trace
by default (PR #4250)- significant effort needed to avoid broken tests due to extra output being generated
- almost there: test suite passes, but there's some unexpected additional output not being captured/ignored
- also need to verify whether GitHub tests (which are skipped in a PR) need some love
- enable
-
reported bugs / bug fixes
-
easyblocks (open PRs + issues)
- bug reports/fixes
- improve depot management in
JuliaPackage
(PR #2935)- see also issue #17455
- Bart: should check use of
:
in$JULIA_DEPOT_PATH
- add check to make sure that easyblocks that derive from
Extension
and customizesanity_check_step
have areturn
statement (WIP PR #2940) - improve handling of
optarch
inCargo
easyblock (PR #2947) - fixes issue in sympy test step when tmpdir is a symlink (PR #2949)
- improve depot management in
- enhancements
- add support for NVIDIA Hopper CC 9.0 in LAMMPS (PR #2941)
-
updates
- handle new directory structure for Intel Advisor (PR #2942)
- new easyblocks
-
changes
- ...
- bug reports/fixes
-
easyconfigs (open PRs + issues)
- still over 800 open easyconfig PRs...
- bug fixes/reports
- set user depot
~/.julia
as top entry in$JULIA_DEPOT_PATH
(PR #17976) - netCDF 4.9.0 tests fail when RPATH support is enabled (issue #17983)
- set user depot
- enhancements
- improve check for multi-variant dependencies per generation of easyconfigs (PR #12687)
- new software
- noteworthy software updates
- changes
- ...
-
docs (open PRs + issues)
- see PRs marked with
2023a
label - using GCC 12.3.0 as a base
- see https://github.com/easybuilders/easybuild-easyconfigs/labels/2023a
- Perl 5.36.1 with minimal set of extensions in merged PR #17946
-
Perl-bundle-CPAN
easyconfig (PR #17970)
-
- Python 3.11.3 with minimal set of extensions in merged PR #17955
- only included
setuptools
+pip
+wheel
as extensions - TODO:
-
Python-bundle-PyPI
easyconfig for other extensions - separate easyconfig for
virtualenv
- figure out what to do with build tools like
poetry
,hatchling
, etc.: separate easyconfig or include inPython-bundle-PyPI
-
- only included
- next PRs:
- see also notes in https://github.com/easybuilders/easybuild/wiki/EasyBuild-5.0-working-group + https://hackmd.io/K1QhWGfdQWa2ZtlXlWVCCA
- we'll stay away from OpenMPI 5.0 for foss/2023a, and go with latest OpenMPI 4.x
- PMIx v4.2.4 release is close (?)
- UCC 1.1.2 release should be out soon
- problem for candidate for intel/2023a
- intel-compilers 2023.1 depends on GCCcore/12.2.0
- Simon: testing has mostly been done on RHEL8-derivatives
- should also test on Ubuntu, CentOS 7, etc.
- CUDA version for 2023a?
- CUDA 12.1 should be compatible with GCC 12.x, so OK
- support for sm35 (K40) + sm37 (K80) are being dropped
- Jörg: configure problem with OpenMPI 4.1.4 on system with PBSPro
- done via a hook
- pre-configure
self.cfg['configopts'] = self.cfg['configopts'] + '--with-tm=/opt/pbs --enable-ipv6 '
- pre-prepare
-
self.cfg['preconfigopts'] = self.cfg['preconfigopts'] + 'LIBS="/lib64/libcrypto.so.1.1.1k $LIBS "'
- can pbs be asked how to link to it (via
pkg-config
?) - should try with
-lpbs -lcrypto
? - shouldn't be linking to
.so.1.1.1k
, but.so
- can pbs be asked how to link to it (via
-
- pre-configure
- libpbs is pulling in the OpenSSL dependency
- including
OpenSSL/1.1
as a dependency for OpenMPI could help, because it will affect which paths are considered bypkg-config
- should also test OpenMPI v4.1.5 - https://github.com/easybuilders/easybuild-easyconfigs/pull/18053
- done via a hook
- Jurij: Any plans for ROCm?
- Mikael: setup done for UCC/UCX should also be applicable to ROCm
- see work done by JSC + LUMI
- Sebastian: easyconfig for ROCm for source => https://github.com/easybuilders/JSC/blob/2022/Overlays/jureca_mi200_overlay/r/ROCm/ROCm-5.4.0-gobliflaf-11.2.0-3.2.eb