Skip to content

6th EasyBuild User Meeting

Jump to bottom
Kenneth Hoste edited this page Dec 11, 2020 · 66 revisions

Collecting ideas for next EasyBuild User Meeting, to be held online some time early 2021.

Practical info

  • online meeting (Zoom + YouTube)
  • dates: week of Jan 25-29 2021 (multiple sessions spread over the week)

Talks

Agenda

The intention is to have multiple sessions, spread out across the entire week (not full days), with sufficient time for Q&A + buffer in between individual talks.

Monday Jan 25th 2021 (all times are UTC)

There will be ample time for Q&A + informal chat + switching to the next speaker in between talks.

  • [16:00-16:30] ReFrame

    • by Vasileios Karakasis (CSCS, Switzerland)

  • [17:00-17:30] CernVM-FS

    • by Jakob Blomer (CERN, Switzerland)

  • [18:00-19:30] EasyBuild: State of the Union

    • by Kenneth Hoste (HPC-UGent, Belgium)

Tuesday Jan 26th 2021 (all times are UTC)

  • [09:00-09:45] CernVM-FS tutorial (part 1/4)

    • by Kenneth Hoste (HPC-UGent, Belgium) and Bob Dröge (Univ. of Groningen, The Netherlands)

  • [10:15-10:45] Easy-Build Singularity Containers: lecture

    • by Jörg Saßmannshausen (Guy's and St Thomas' NHS Foundation Trust and King's College London, UK)

  • [11:00-11:30] Gentoo Prefix

    • by Fabian Groffen (Gentoo)

  • [12:00-12:30] ReFrame tutorial (part 1/3)

    • by Vasileios Karakasis (CSCS, Switzerland)

  • [13:00-13:45] European Environment for Scientific Software Installations (EESSI)

    • by Bob Dröge (Univ. of Groningen, The Netherlands)

Wednesday Jan 27th 2021 (all times are UTC)

  • [09:00-10:00] CernVM-FS tutorial (part 2/4)

    • by Kenneth Hoste (HPC-UGent) and Bob Dröge (Univ. of Groningen)

  • [15:00-15:30]* PRACE Best Practice Guide [TO BE CONFIRMED]

    • by by Ole Saastad (Univ. of Oslo, Norway)

  • [16:00-16:40] Lmod and XALT: Updates

    • by Robert McLay (TACC, US)
    • Lmod is the modern Environment Module Tool. Sysadmins define packages and let users choice which package and which version of that package. This part of the talk will include a brief overview of Lmod. This will be followed up with the new features such as extensions for connecting modules to packages. (e.g. the python module and packages such as numpy and scipy). This is also include a discussion of the changes to Lmod 8+.
    • XALT is a tool to take the census of what programs and libraries are run on your cluster. This talk will briefly cover what XALT does and how it does it. It will include some "war" stories of XALT usage. Finally I'll cover XALT move to version 3 namely tracking usage in containers and package tracking from R, Python and MATLAB.

  • [17:00-17:30] Magic Castle

    • by Félix-Antoine Fortin (Université Laval, Compute Canada)

  • [18:00-18:45] BLIS

    • by Field G. Van Zee (University of Texas at Austin, US)

  • [19:15-19:30] (open slot)

Thursday Jan 28th 2021 (all times are UTC)

  • [09:00-09:45] CernVM-FS tutorial (part 3/4)

    • by Kenneth Hoste (HPC-UGent) and Bob Dröge (Univ. of Groningen)

  • [10:15-10:45] ReFrame tutorial (part 2/3)

    • by Vasileios Karakasis (CSCS, Switzerland)

  • [11:00-11:15] LearnHPC

    • by Alan O'Cais (JSC, Germany)

  • [11:25-11:40] Site presentation from Jülich Supercomputing Centre

    • by Anke Kreuzer (JSC, Germany)

  • [12:00-12:30] Cluster-in-the-Cloud

    • by Matt Williams (Univ. of Bristol, UK)

  • [13:00-13:15] Site presentation from LuxProvide

    • by Valentin Plugaru (LuxProvide)

Friday Jan 29th 2021 (all times are UTC)

  • [09:00-10:00] CernVM-FS tutorial (part 4/4)

    • by Kenneth Hoste (HPC-UGent, Belgium) and Bob Dröge (Univ. of Groningen, The Netherlands)

  • [13:00-13:30] Easy-Build Singularity Containers: tutorial

    • by Jörg Saßmannshausen (Guy's and St Thomas' NHS Foundation Trust and King's College London, UK)

  • [14:00-14:30] ReFrame tutorial (part 3/3)

    • by Vasileios Karakasis (CSCS, Switzerland)

  • [15:00-15:30] buildtest: Testing Framework for HPC systems

    • by Shahzeb Siddiqui (NERSC, US)
    • Buildtest is an HPC testing framework to aid HPC facilities to perform acceptance testing for their system. HPC systems are growing in complexity, with a tightly coupled software and system stack that requires a degree of automation and continuous testing. In the past decade, two build frameworks (Spack, EasyBuild) have emerged and widely used in HPC community for automating build & installation process for scientific software. On the contrary, testing frameworks for HPC systems are limited to a few handful (ReFrame, Pavilion2, buildtest) that are in active development. In buildtest, users will write test recipes in YAML called buildspecs that is the primary interface for writing tests. buildtest utilizes a JSON Schema for validating buildspecs. In this talk we will present an overview of buildtest and how one can write buildspecs. Furthermore, we will discuss Cori Testsuite in buildtest with several real examples on testing various components for Cori system at NERSC. Finally, we will present an overview of the E4S Test Suite, which is an ECP project to help test the Spack E4S software stack, and how buildtest integrates with E4S Testsuite.

  • [15:40-15:55] Automate Module Testing with Lmodule

    • by Shahzeb Siddiqui (NERSC, US)
    • HPC software stacks have become increasingly complex and significantly grown in size with some sites having up to 5,000+ modulefiles. It's imperative that all modules are tested because it is the primary interface for users to interact with the software stack. Lmodule is a Python API for Lmod, with a focus on automating module testing. Lmodule is able to query a software stack via the 'spider' Lmod tool, and individually test each module using "module load". The API consist of three Python classes: Module, Spider, and ModuleLoadTest. Lmodule works with Environment Modules. In this talk we will present an overview of the Lmodule API at Cori (environment-modules) and OLCF (Lmod), to demonstrate how we can automate module testing of software stacks.

  • [16:15-17:00] Spack update

    • by Todd Gamblin (LLNL, US)

Ideas

(if you add an idea for a talk topic, mention name as "source"; suggestions for speakers are welcome!)

  • EESSI [Kenneth]
    • speaker (to invite): Bob Droge (Groningen Univ.)
  • OpenHPC 2.0 [Kenneth]
  • ReFrame 3.x [Kenneth]
    • speaker (to invite): Vasileios Karakasis (CSCS)
    • hands-on tutorial?
  • Cluster in the cloud [Kenneth]
    • speaker (to invite): Matt Williams (Univ. of Bristol)
      • OK, 45min (incl demo + Q&A) would be good
      • pref for afternoon + earlier in the week
    • also Magic Castle (Maxime), AWS (Christian), Azure (Davide)?
  • XALT 3 [Kenneth]
    • speaker (to invite): Robert McLay (TACC)
  • workshop on building Singularity container images with EasyBuild [Jörg]
    • doodle poll to assess interest (Jörg)
  • talk on Gentoo Prefix (Fabian Groffen)
    • status: invited by Kenneth
  • talk on PRACE Best Practice Guide by Ole Saastad (UiO)
    • status: invited by Kenneth
  • talks on buildtest + lmodule (Shahzeb Siddiqui)
  • talk on BLIS (lead dev, contact via Sebastian Achilles, JSC)

Discussion topics

  • EasyBuild on AMD
    • speaker(s): Sebastian Achilles (JSC)?
    • toolchain & libraries, experiences, ...
  • EasyBuild on aarch64/Arm64
    • speaker(s): ???
      • maybe Terje?
    • current status of support in EasyBuild, what (doesn't) work, etc.
  • restructuring common toolchains in diamond DAG (Mikael)
  • better error reporting in EasyBuild
Clone this wiki locally