CODE-RADE build images - Foundation Release 4

This is a major update to the role which builds the CODE-RADE build containers.
The containers have a common OpenSSH installation and test coverage has been improved.
This is the first release in the Foundation Release 4 series.

CODE-RADE Build Container

A somewhat OS-independent role to build CODE-RADE slaves for use in a continuous integration environment, using Ansible-Container.

Tools

This role ensures that an image corresponding to the EGI execution environment is built so that applications can be built against it.
The image is used in the continuous integration environment in order to build applications which are subsequently delivered to a CVMFS repository.

Included in the image are:

• a generic user to execute the builds - jenkins
• build tools (compilers, testing programs and libraries, etc)
• a consistent SSH installation built from source to be the same across images

The ssh service is used by the Jenkins server to start the connection to the master, it listens on port 2222, which can be tweaked in the variables.
The bare minimum of libraries and dependencies are installed, so as to make the image itself lightweight and ensure that unmet dependencies are not requested in the production environment.

Building

Adds a CODE-RADE build container service to your Ansible Container project. To be used in conjunction with CODE-RADE Build Containers. For galaxy info, see meta/main.yml

Run the following commands
to install the service:

# Set the working directory to your Ansible Container project root
$ cd myproject

# Install the service
$ ansible-container install AAROC.code-rade-build-containers

Testing

The role is tested with molecule across a few well-known scenarios - Docker environments, virtualised environments and cloud installations.
Testing is done with TestInfra and checks whether the image is valid for the continuous integration environment:

• build user exists
• SSH daemon exists, is properly configured and responds on the required port
• build, deploy and module directories are present and belong to the correct user

Requirements

• Ansible Container

• An existing Ansible Container project. To create a project, simply run the following:

  # Create an empty project directory
  $ mkdir myproject
  
  # Set the working directory to the new directory
  $ cd myproject
  
  # Initialize the project
  $ ansible-contiainer init
  

Role Variables

Variables are all in vars/main.yml :

• modules_path - The OS-dependent path where environment-modules keeps its base configuration by default.
• modules - CODE-RADE specific modulefiles ci and deploy which set up the build, test and deploy shells. These contain OS-specific variables, using anisble_os_family
• module_domains - The domain-specific modulefile paths to which CODE-RADE can write application modulefiles. Contain :
  • astronomy
  • bioinformatics
  • compilers
  • languages
  • libraries
  • physical_sciences
  • hep
  • chemistry
• prerequisites: OS-specific dependencies that need to be in the build environment in order to execute compilation and tests. Intentionally kept small.

Dependencies

None

License

Apache-2.0

Author Information

Bruce Becker | bbecker@csir.co.za | C.S.I.R. Meraka Institute
Africa-Arabia Regional Operations Centre
Bruce Becker | bruce.becker@egi.eu | EGI Foundation

Citing

If you use this role in an academic or research context, please cite :
Bruce Becker. (2017). AAROC/CODE-RADE-container: DevOps for CODE-RADE - Build Container role [Data set]. Zenodo. http://doi.org/10.5281/zenodo.572278

AAROC/CODE-RADE-container: CODE-RADE Build Container - Static Host Keys

This is an Ansible role for expressing build environments for the CODE-RADE project. This role can be used to build Docker containers for the supported operating systems, as well as Virtual Machines, in an OpenStack environment. Major changes from the previous release are made to they way ssh host keys are generated. These are now pre-generated and statically managed. Private keys are encrypted with Ansible Vault prior to being committed to the repo.

CODE-RADE Build Container

A somewhat OS-independent role to build CODE-RADE slaves for use in a continuous integration environment, using Ansible-Container.

Adds a CODE-RADE build container service to your Ansible Container project. To be used in conjunction with CODE-RADE Build Containers. For galaxy info, see meta/main.yml

Run the following commands
to install the service:

# Set the working directory to your Ansible Container project root
$ cd myproject

# Install the service
$ ansible-container install AAROC.code-rade-build-containers

Requirements

• Ansible Container
• An existing Ansible Container project. To create a project, simply run the following:

  # Create an empty project directory
  $ mkdir myproject
  
  # Set the working directory to the new directory
  $ cd myproject
  
  # Initialize the project
  $ ansible-contiainer init
  

Role Variables

Variables are all in vars/main.yml :

• modules_path - The OS-dependent path where environment-modules keeps its base configuration by default.
• modules - CODE-RADE specific modulefiles ci and deploy which set up the build, test and deploy shells. These contain OS-specific variables, using anisble_os_family
• module_domains - The domain-specific modulefile paths to which CODE-RADE can write application modulefiles. Contain :
  • astronomy
  • bioinformatics
  • compilers
  • languages
  • libraries
  • physical_sciences
  • hep
  • chemistry
• prerequisites: OS-specific dependencies that need to be in the build environment in order to execute compilation and tests. Intentionally kept small.

Dependencies

None

License

Apache-2.0

Author Information

Bruce Becker
Africa-Arabia Regional Operations Centre

Citing

If you use this role in an academic or research context, please cite :
Bruce Becker. (2017). AAROC/CODE-RADE-container: DevOps for CODE-RADE - Build Container role [Data set]. Zenodo. http://doi.org/10.5281/zenodo.572278

CODE-RADE Build Container - Java8

Overview

This is the update to the CODE-RADE build containers, which now include Java 1.8 as their standard runtime.

The upgrade to Java 1.8 was necessary in order to accomodate the upgrade to the Jenkins version of the build server, which is at 2.69.

A few fixes were made to the containers too, specifically relating to modulefules, which were created on a per-domain basis.

This release contains a refactoring of the Ansible tasks, which were previously included in a single main.yml file, but are now split into :

- include: config-inventory.yml
- include: install-packages.yml
- include: config-users.yml
- include: config-ssh.yml
- include: config-code-rade.yml

Quality Assurance

Furthermore, the role is now tested on Jenkins, whereas before only the Ansible Container was tested
This release corresponds to build 84 which has passed.

Community Health

In order to improve the community health of the project, a CONTRIBUTING.md and code of conduct (based on the Contributor Covenant) have been aded.

References

1. Bruce Becker. (2017, May 6). AAROC/CODE-RADE-build-containers: CODE-RADE Foundation Release 3 - Build Containers. Zenodo. http://doi.org/10.5281/zenodo.572275

DevOps for CODE-RADE - Build Container role

CODE-RADE Build Container

A somewhat OS-independent role to build CODE-RADE slaves for use in a continuous integration environment, using Ansible-Container.

Adds a CODE-RADE build container service to your Ansible Container project. To be used in conjunction with CODE-RADE Build Containers. For galaxy info, see meta/main.yml

Run the following commands
to install the service:

# Set the working directory to your Ansible Container project root
$ cd myproject

# Install the service
$ ansible-container install AAROC.code-rade-build-containers

Requirements

• Ansible Container
• An existing Ansible Container project. To create a project, simply run the following:

  # Create an empty project directory
  $ mkdir myproject
  
  # Set the working directory to the new directory
  $ cd myproject
  
  # Initialize the project
  $ ansible-contiainer init
  

Role Variables

Variables are all in vars/main.yml :

• modules_path - The OS-dependent path where environment-modules keeps its base configuration by default.
• modules - CODE-RADE specific modulefiles ci and deploy which set up the build, test and deploy shells. These contain OS-specific variables, using anisble_os_family
• module_domains - The domain-specific modulefile paths to which CODE-RADE can write application modulefiles. Contain :
  • astronomy
  • bioinformatics
  • compilers
  • languages
  • libraries
  • physical_sciences
  • hep
• prerequisites: OS-specific dependencies that need to be in the build environment in order to execute compilation and tests. Intentionally kept small.

Dependencies

None

License

Apache-2.0

Author Information

Bruce Becker | bbecker@csir.co.za | C.S.I.R. Meraka Institute
Africa-Arabia Regional Operations Centre

Citing

If you use this role in an academic or research context, please cite :
Bruce Becker. (2017). AAROC/CODE-RADE-container: DevOps for CODE-RADE - Build Container role [Data set]. Zenodo. http://doi.org/10.5281/zenodo.572278