Skip to content

The Itential Ansible Deployer can be used to deploy validated Itential architectures.

License

Notifications You must be signed in to change notification settings

kvelarde-itential/deployer

 
 

Repository files navigation

Ansible Collection - itential.deployer

Table of contents

  1. Overview
  2. Supported Architectures
    1. All-in-one Architecture
    2. Minimal Architecture
    3. Highly Available Architecture
    4. Active/Standby Architecture
  3. Deployer Prerequisites
    1. Required Python, Ansible, and Ansible modules
    2. Required Public Repositories
    3. Ports and Networking
    4. Certificates
    5. Passwords
    6. Obtaining the Itential Binaries
  4. Installing and Upgrading the Deployer
    1. Online Installation
    2. Offline Installation
  5. Running the Deployer
    1. Confirm Requirements
    2. Determine the Working and Deployer Directories
    3. Create the Files and Inventories Directories
    4. Download Installation Artifacts
    5. Copy Installation Artifacts into the Files Directory
    6. Create a Symlink to the Files Directory
    7. Create the Inventory File
    8. Run the Itential Deployer
    9. Confirm Successful Installation
  6. Sample Inventories
    1. All-in-one Architecture Inventory
    2. Minimal Architecture Inventory
    3. Highly Available Architecture Inventory
    4. Active/Standby Architecture Inventory
  7. Component Guides
    1. MongoDB
    2. Redis
    3. RabbitMQ
    4. Hashicorp Vault
    5. IAP
    6. IAG
  8. Patching IAP and IAG
  9. Using Internal YUM Repositories
  10. Running the Deployer in Offline Mode
  11. Appendix A: Definition of "Highly Available" Dependencies

Overview

An Itential environment is composed of several applications working in conjunction with one another, including:

  • Itential Automation Platform (IAP)
  • Itential Automation Gateway (IAG)
  • Redis
  • RabbitMQ (when using IAP version 23.1 and older)
  • MongoDB

In many environments, these applications are installed across multiple systems to improve resiliency and performance. To assist users with such installations, Itential provides the Itential Deployer.

The Itential deployer can deploy supported Itential architectures.

Supported Architectures

  • All-in-one Architecture
  • Minimal Architecture
  • Highly Available Architecture
  • Active/Standby Architecture
  • Blue Green Architecture

All-in-one Architecture

The All-In-One architecture is an architecture where all components are installed on the same instance. This architecture lends itself well to development environments and “throw away” environments like those found in a CI/CD pipeline. Security considerations are non-existent or use simple default passwords as the emphasis is placed on simplicity.

Minimal Architecture

A Minimal Architecture is an architecture where all or most components are single instances and can not gracefully tolerate failures. This architecture lends itself well to development environments. It favors the engineer with its simplicity and enables them to do their work with few restrictions. Security considerations should lean towards openness and ease of use but at the same time capture the spirit of the other higher environments. In this architecture, each of the required Itential components is a single instance. This architecture will exercise the network connectivity between the components and can be advantageous to deploy as a development environment.

The ideal minimal architecture will have 5 VM's with each hosting a single instance of the required components. An acceptable variation is to have 1 VM with everything hosted on it. The number of VM's and what is hosted where is less of a concern with the MA because the intent is simplicity and to enable engineers to build automations and not be a highly-available environment.

Itential recommends applying security principles to ALL environments. In the MA, this would include configuring all components to use authentication. Optionally, we recommend using SSL when communicating with components on other VMs but recognize that this should be enabled at the discretion of the customer.

Highly Available Architecture

A Highly Available Architecture is an architecture where all or most components are redundant and can gracefully tolerate at least 1 catastrophic failure. This architecture is the recommended architecture for testing environments and simple production environments. The intent is to provide an environment that is as close to production as possible so that testing automations can provide confidence and expose potential problems sooner in the development lifecycle. Security considerations should mimic production requirements. In this architecture, each of the required Itential components is installed in clusters to provide stability, mimic production, and expose any issues with the clustering of the components. This could also serve as a production architecture.

The ideal HA2 environment will have 12 VMs:

  • 2 VMs hosting IAP.
  • 3 VMs hosting MongoDB configured as a replica set.
  • 3 VMs hosting Redis configured as a highly available replica set using Redis Sentinel.
  • 3 VMs hosting Rabbitmq configured as a rabbit cluster (when installing IAP version 23.1 and older).
  • 1 VM hosting IAG.

Itential recommends applying sound security principles to ALL environments. This would include configuring all components to use authentication within the HA2. Additionally, we recommend using SSL when communicating with components on other VMs and across clusters.

Active/Standby Architecture

An Active/Standby Architecture (ASA) is an architecture (that is normally used for making HA2 architectures redundant) reserved for production environments where Disaster Recovery is required. It is not required that they be geographically redundant but they could be. The intent is to provide a standby environment that can be used in the event of a disaster on the active stack. The standby stack should be preconfigured to be quickly made into the active stack. Care needs to be taken that the same level of access to 3rd party systems existing in the standby stack matches those in the active stack. Security must be taken into account if this is used as a production environment.

The ideal ASA architecture will appear as two HA2 stacks except for MongoDB. One or more of the MongoDB instances must be hosted in the standby location as a replica of the primary. Ideally, the MongoDB cluster will consist of 5 members: 4 data-bearing members and a MongoDB arbiter. This will allow for a cluster of three mongos in the worst-case disaster scenario.

Itential recommends applying sound security principles to ALL environments. In the ASA, this would include configuring all components to use authentication and use SSL when communicating with components on other VMs and across clusters.

Alternative Architectures

Its not unusual to "outsource" the management of the dependencies (Redis, RabbitMQ, MongoDB) to either other internal teams or to external vendors such as AWS. Itential provides a way to leverage these solutions simply by configuring them accordingly and as long as these solutions comply with the basic requirements. For example, if Elasticache is chosen to fulfill the Redis needs then it must use the "Redis" version and not "Memcache". Likewise for MongoDB, Mongo Atlas is supported but not DynamoDB which is not the same. See the examples for how to implement.

Deployer Prerequisites

The Itential Deployer is an Ansible project and as such requires running on a control node. That node has its own set of dependencies.

Control Node Specifications

Itential recommends using a dedicated node running the requirements listed below as the ansible control node for the deployer project. That node should meet or exceed the following specifications:

Component Value
OS RHEL8/9 or Rocky 8/9
RAM 4 GB
CPUs 2
Disk 20 GB

Required Python, Ansible, and Ansible modules

The Ansible Control Node must have the following installed:

  • Python

    • python >= 3.9
  • Python Modules

    • jmespath
  • Ansible

    • ansible-core >= 2.11, < 2.17

To see which Ansible version is currently installed, execute the ansible --version command as shown below.

Example: Confirming Ansible Version

$ ansible --version
  ansible [core 2.12.2]
  config file = None
  configured module search path = ['/var/home/yourname/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
  ansible python module location = /usr/local/lib/python3.9/site-packages/ansible
  ansible collection location = /var/home/yourname/.ansible/collections:/usr/share/ansible/collections
  executable location = /usr/local/bin/ansible
  python version = 3.9.9 (main, Nov 19 2021, 00:00:00) [GCC 11.2.1 20210728 (Red Hat 11.2.1-1)]
  jinja version = 3.0.3
  libyaml = True
  • Ansible Modules: The following ansible modules are required on the control node for the deployer to run.
    • 'ansible.posix': '>=0.0.1'
    • 'community.mongodb': '>=0.0.1'

ⓘ Note: The Itential Deployer is an Ansible collection. As such, a familiarity with basic Ansible concepts is suggested before proceeding.

Required Public Repositories

In general the Deployer will install packages using the standard YUM repositories on the target servers. When packages are not available for the distribution, the Deployer will either install the required repository or download the packages.

Component Hostname Protocol Notes
Redis rpms.remirepo.net http When installing Redis from the Remi repository
When installing on Redhat/CentOS 7
Redis rpms.remirepo.net https When installing Redis from the Remi repository
When installing on Redhat/Rocky 8+
Redis dl.fedoraproject.org https When installing Redis from the Remi repository
Redis github.com https When installing Redis from source
RabbitMQ packagecloud.io https When installing IAP version 23.1 and older
MongoDB repo.mongodb.org https
MongoDB www.mongodb.org https
Vault rpm.releases.hashicorp.com https
IAP repo.mongodb.org https
IAP www.mongodb.org https
IAP rpm.nodesource.com https When installing on Redhat/CentOS 7
IAP www.python.org https When installing on Redhat/CentOS 7
IAP www.openssl.org https When installing on Redhat/CentOS 7
IAG www.python.org https When installing on Redhat/CentOS 7
IAG www.openssl.org https When installing on Redhat/CentOS 7

If internal YUM repositories are used, refer to the Using Internal YUM Repositories section.

Ports and Networking

In a clustered environment where components are installed on more than one host, the following network traffic flows need to be allowed.

Source Destination Port Protocol Description
Desktop Devices IAP 3000 TCP Web browser connections to IAP over HTTP
Desktop Devices IAP 3443 TCP Web browser connections to IAP over HTTPS
Desktop Devices IAG 8083 TCP Web browser connections to IAG over HTTP
Desktop Devices IAG 8443 TCP Web browser connections to IAG over HTTPS
Desktop Devices Vault 8200 TCP Web browser connections to Hashicorp Vault
IAP MongoDB 27017 TCP IAP connections to MongoDB
IAP RabbitMQ 5672 TCP IAP connections to RabbitMQ
IAP RabbitMQ 5671 TCP IAP connections to RabbitMQ with TLS
IAP Redis 6379 TCP IAP connections to Redis
IAP Redis 26379 TCP IAP connections to Redis Sentinel
IAP IAG 8083 TCP IAP connections to IAG over HTTP
IAP IAG 8443 TCP IAP connections to IAG over HTTPS
IAP Vault 8200 TCP IAP connections to Hashicorp Vault
IAP LDAP 389 TCP IAP connections to LDAP
When LDAP adapter is used for authentication
IAP LDAP 636 TCP IAP connections to LDAP with TLS
When LDAP adapter is used for authentication
IAP RADIUS 1812 UDP IAP connections to RADIUS
When RADIUS adapter is used for authentication
MongoDB MongoDB 27017 TCP MongoDB replication
RabbitMQ RabbitMQ 5672 TCP RabbitMQ AMQP for HA
RabbitMQ RabbitMQ 5671 TCP RabbitMQ AMQP for HA with TLS
RabbitMQ RabbitMQ 25672 TCP RabbitMQ inter-node and CLI tools communication
RabbitMQ RabbitMQ 4369 TCP RabbitMQ epmd, a peer discovery service used by RabbitMQ nodes and CLI tools
RabbitMQ RabbitMQ 15672 TCP RabbitMQ HTTP API clients, management UI and rabbitmqadmin
RabbitMQ RabbitMQ 15671 TCP RabbitMQ HTTP API clients, management UI and rabbitmqadmin with TLS
Redis Redis 6379 TCP Redis replication
Redis Redis 26379 TCP Redis Sentinel for HA

Notes

  • Not all ports will need to be open for every supported architecture
  • Secure ports are only required when explicitly configured in the inventory
  • RabbitMQ ports are only required when installing IAP version 2023.1 and older

Certificates

The itential deployer is not responsible for creating any SSL certificates that may be used to further tighten security in the Itential ecosystem. However, if these certificates are provided it can upload and configure the platform to use them. The table below describes the certificates that can be used and what their purpose is.

Certificate Description
IAP webserver Enables HTTPS communications with the IAP webserver.
IAG webserver Enables HTTPS communications with the IAG webserver.
MongoDB Enables secure communications with the MongoDB server. Also used for intra-node mongo replication.
Redis Enables secure communications with the Redis server. Also used for intra-node redis replication.
LDAP Enables secure communications with LDAP server.

Passwords

The deployer will create several user accounts in the dependent systems. It uses default passwords in all cases and those passwords can be overridden with the defined ansible variables. To override these variables just define the variable in the deployer host file.

User Account Default Password Variable Name Description
MongoDB
admin admin mongo_user_admin_password Has full root access to the mongo database.
itential itential mongo_user_itential_password Has read and write access to the “itential” database only.
localaaa localaaa mongo_user_localaaa_password Has read and write access to the “LocalAAA” database. This is used by the Local AAA adapter for local, non-LDAP logins.
Redis
admin admin redis_user_admin_password Has full root access to the Redis database, all channels, all keys, all commands.
itential itential redis_user_itential_password Has full access to the Redis database, all channels, all keys, EXCEPT the following commands: asking, cluster, readonly, readwrite, bgrewriteaof, bgsave, failover, flushall, flushdb, psync, replconf, replicaof, save, shutdown, sync.
repluser repluser redis_user_repluser_password Has access to the minimum set of commands to perform replication: psync, replconf, ping.
admin sentineladmin redis_user_sentineladmin_password Full root access to Redis Sentinel.
sentineluser sentineluser redis_user_sentineluser_password Has access to the minimum set of commands to perform sentinel monitoring: multi, slaveof, ping, exec, subscribe, config|rewrite, role, publish, info, client|setname, client|kill, script|kill.
RabbitMQ (When installing IAP version 23.1 and older)
admin admin rabbitmq_admin_password The admin user with root permissions in this rabbit install.
itential itential rabbitmq_password The itential user used by IAP to connect. This user is assigned the "monitoring" tag.

Obtaining the Itential Binaries

SaaS Customers

The latest IAG whl file is available to download from hub.itential.io.

On prem customers

The IAP and IAG binary files are hosted on the Itential Nexus repository. An account is required to access Itential Nexus. If you do not have an account, contact your Itential Sales representative.

Installing and Upgrading the Deployer

Online Installation

The Itential Deployer can be installed via the ansible-galaxy utility.

On your control node, execute the following command to install the Itential Deployer:

ansible-galaxy collection install itential.deployer

When a new version of the Deployer is available, you can upgrade using the following command:

ansible-galaxy collection install itential.deployer --upgrade

Offline Installation

If your control node does not have Internet connectivity, the Itential Deployer and its dependencies can be downloaded via another system, copied to your control node, and installed manually.

ⓘ Note: Some of the following collections may already be installed on your control node. To verify, use the ansible-galaxy collection list command.

  1. Download the following collections from the provided links:

  2. Copy the downloaded collections to your control node.

  3. Install the collections using the following command:

    ansible-galaxy collection install <COLLECTION>.tar.gz

Running the Deployer

Once you have have installed the Itential Deployer, run it to begin deploying Itential to your environment. This section details a basic deployment using required variables only.

Confirm Requirements

Before running the deployer we must ensure the following:

  • Compatible OS: Any managed nodes to be configured by the Itential Deployer must use an operating system that is compatible with the target version of IAP (and, if applicable, IAG). For more information, refer to the [Itential Dependencies] page.
  • Hostnames: Any hostnames used by managed nodes must be DNS-resolvable.
  • Administrative Privileges: The ansible user must have administrative privileges on managed nodes.
  • SSH Access: The control node must have SSH connectivity to all managed nodes.
  • Additional CentOS 7 Requirements: Ensure that Python setuptools-2.0 is installed on any CentOS 7 managed nodes.

ⓘ Note: Although the Itential Deployer can be used to configure nodes that use any supported operating system, it is optimized for RHEL 8 and 9.

Determine the Working and Deployer Directories

The Itential Deployer will be installed into the user's collection directory. Because the Deployer collection will be overwritten when it is upgraded, users should not store any inventory files, binaries or artifacts in the Deployer collection directory. Instead, users should create a working directory to store those files.

The working directory can be any directory on the control node and will be referred to as the WORKING-DIR in this guide.

Determine what directory the Itential Deployer is installed to by using the ansible-galaxy collection list command. In the following example, the Deployer directory is /Users/<USER>/.ansible/collections/ansible_collections/itential/deployer.

Example: Determining the Deployer Directory

% ansible-galaxy collection list

# /Users/<USER>/.ansible/collections/ansible_collections
Collection        Version
----------------- -------
ansible.netcommon 4.1.0
ansible.posix     1.5.4
ansible.utils     2.9.0
arista.avd        3.8.2
arista.cvp        3.6.0
arista.eos        6.0.0
community.general 7.3.0
community.mongodb 1.6.1
itential.deployer 1.0.0

The Deployer directory will be referred to as the DEPLOYER-DIR in this guide.

Create the Inventories Directory

The inventories directory should be a sub-directory of the working directory. It will contain the hosts files.

cd <WORKING-DIR>
mkdir inventories

Determine Installation Artifacts Method

Choose one of the following installation methods based on your requirements:

  1. Manual Upload: Manually download the required files onto the control node in a files directory. The deployer will move these artifact files to the target nodes.
  2. Repository Download: Provide a repository download URL with either a username/password or an API key. The deployer will make an API request to download the files directly onto the target nodes.

Manual Upload

Create the Files Directory

The files directory should be a sub-directory of the working directory. It will contain the Itential binaries and artifacts.

cd <WORKING-DIR>
mkdir files

Download Installation Artifacts

Download the IAP binary along with any desired IAP adapters (and, if applicable, the IAG binary) from the [Itential Nexus Repository] to local storage.

ⓘ Note: If you are unsure which files should be downloaded for your environment, contact your Itential Professional Services representative.

Copy Installation Artifacts into the Files Directory

Next, copy the files downloaded in the previous step to the files subdirectory.

Example: Copying to the Files Directory

cd <WORKING-DIR>/files
cp ~/Downloads/itential-premium_2023.1.1.linux.x86_64.bin .
cp ~/Downloads/automation_gateway-3.198.19+2023.1.0-py3-none-any.whl .

Create a Symlink to the Files Directory

Navigate to the playbooks directory in the Deployer directory and create a symlink to the files directory in the working directory.

cd <DEPLOYER-DIR>/playbooks
ln -s <WORKING-DIR>/files .

Repository Download

Obtain the Download URL

You can obtain the download URL from either a Sonatype Nexus Repository or JFrog. Follow the steps below based on the repository type:

  • For Sonatype Nexus: Navigate to the file you wish to use and locate the Path parameter. Copy the link provided in the Path field to obtain the download URL.
  • For JFrog: Locate the file in the JFrog repository and copy the File URL.

This download method supports both the IAP (bin/tar) files and the IAG (whl) files.

Configure Repository Credentials

Depending on the repository you are using, you will need to provide the appropriate credentials:

  • For Nexus: Set the repository_username and repository_password variables.
  • For JFrog: Set the repository_api_key variable.

ⓘ Note: To secure sensitive information like passwords or API keys, consider using Ansible Vault to encrypt these variables.

Create the Inventory File

Using a text editor, create an inventory file that defines your deployment environment. To do this, assign your managed nodes to the relevant groups according to what components you would like to install on them. In the following example:

  • All required variables have been defined.
  • The managed node example1.host.com has been assigned to all groups, with the exception of the gateway group. As such, all components except IAG will be installed on this node.
  • The managed node example2.host.com has been assigned to the gateway group. As such, IAG will be installed on this node.

ⓘ Note: Itential recommends that all inventories follow the best practices outlined in the [Ansible documentation][Ansible Best Practices].

Example: Creating the Inventory File

cd <WORKING-DIR>
mkdir -p inventories/dev
vi inventories/dev/hosts

Example: Inventory File (YAML Format)

ⓘ Note: There will not be a rabbitmq group or variables when installing IAP version 2023.2 and newer.

all:
  vars:
    iap_release: 2023.1

  children:
    redis:
        hosts:
            example1.host.com:

    rabbitmq:
        hosts:
            example1.host.com:

    mongodb:
        hosts:
            example1.host.com:

    platform:
        hosts:
            example1.host.com:
        vars:
            iap_archive_download_url: https://registry.aws.itential.com/repository/itential-premium/2023.2/2023.2.8/itential-premium_2023.2.8.linux.x86_64.tar.gzx
            repository_username: user.name
            repository_password: !vault |
                  $ANSIBLE_VAULT;1.1;AES123
                  12341234123412341234123412341234123412341234123412341234123412341234123412341234
                  12341234123412341234123412341234123412341234123412341234123412341234123412341234
                  12341234123412341234123412341241234123412341234123412341234123412341234123412341
                  1234123412341324

    gateway:
        hosts:
            example2.host.com:
        vars:
            iag_release: 2023.1
            iag_whl_file: automation_gateway-3.227.0+2023.1.9-py3-none-any.whl

Run the Itential Deployer

Navigate to the working directory and execute the following run command.

Example: Running the Itential Deployer

cd <WORKING-DIR>
ansible-playbook itential.deployer.site -i inventories/dev -v

Confirm Successful Installation

After the Itential Deployer is finished running, perform the following checks on each component to confirm successful installation.

IAP and IAG

Use a web browser to navigate to the login page of your IAP/IAG servers. By default, it is located at http://<hostname>:3000 or http://<hostname>:8083, respectively. If the IAP/IAG login page is displayed, the installation was successful.

If the login page is not displayed, check that the relevant service is running on the affected server using the sudo systemctl status automation-platform or sudo systemctl status automation-gateway command, respectively. The output should look similar to the following examples.

Example Output: IAP System Status

$ sudo systemctl status automation-platform
● automation-platform.service - Itential Automation Platform Service
   Loaded: loaded (/usr/lib/systemd/system/automation-platform.service; enabled; vendor preset: disabled)
   Active: active (running) since Wed 2023-02-01 15:21:45 UTC; 21h ago
 Main PID: 177517 (Pronghorn core)
    Tasks: 203 (limit: 23501)
   Memory: 1.0G
   CGroup: /system.slice/automation-platform.service
           ├─177517 Pronghorn core
           ├─177556 Pronghorn AGManager Application
           ├─177577 Pronghorn AdminEssentials Application
           ├─177588 Pronghorn AppArtifacts Application
           ├─177606 Pronghorn AutomationCatalog Application
           ├─177622 Pronghorn AutomationStudio Application
           ├─177659 Pronghorn ConfigurationManager Application
           ├─177674 Pronghorn FormBuilder Application
           ├─177690 Pronghorn JsonForms Application
           ├─177708 Pronghorn Jst Application
           ├─177725 Pronghorn MOP Application
           ├─177738 Pronghorn OperationsManager Application
           ├─177758 Pronghorn Search Application
           ├─177784 Pronghorn Tags Application
           ├─177800 Pronghorn TemplateBuilder Application
           ├─177820 Pronghorn WorkFlowEngine Application
           ├─177833 Pronghorn WorkflowBuilder Application
           └─177860 Pronghorn local_aaa Adapter

Example Output: IAG System Status

$ sudo systemctl status automation-gateway
● automation-gateway.service - Itential Automation Gateway
   Loaded: loaded (/etc/systemd/system/automation-gateway.service; enabled; vendor preset: disabled)
   Active: active (running) since Tue 2023-01-17 16:48:29 UTC; 1 months 0 days ago
 Main PID: 94842 (automation-gate)
    Tasks: 10 (limit: 23435)
   Memory: 168.8M
   CGroup: /system.slice/automation-gateway.service
           ├─94842 /opt/automation-gateway/venv/bin/python3 /opt/automation-gateway/venv/bin/automation-gateway --properties-file=/etc/automation-gateway/propert>
           └─94844 /opt/automation-gateway/venv/bin/python3 /opt/automation-gateway/venv/bin/automation-gateway --properties-file=/etc/automation-gateway/propert>

MongoDB, Redis, and RabbitMQ

From the command line of each dependency server, use the sudo systemctl status <service> command to confirm that the relevant service is running. When executing the command, replace <service> with one of the following:

  • MongoDB: mongod
  • Redis: redis
  • RabbitMQ: rabbitmq-server

The output should look similar to the following examples.

Example Output: MongoDB Status

$ sudo systemctl status mongod
● mongod.service - MongoDB Database Server
     Loaded: loaded (/usr/lib/systemd/system/mongod.service; enabled; preset: disabled)
     Active: active (running) since Thu 2023-06-22 04:49:56 CST; 20h ago
       Docs: https://docs.mongodb.org/manual
   Main PID: 54594 (mongod)
     Memory: 156.7M
        CPU: 46.078s
     CGroup: /system.slice/mongod.service
             └─54594 /usr/bin/mongod -f /etc/mongod.conf

Example Output: Redis Status

$ sudo systemctl status redis
● redis.service - Redis persistent key-value database
     Loaded: loaded (/usr/lib/systemd/system/redis.service; enabled; preset: disabled)
    Drop-In: /etc/systemd/system/redis.service.d
             └─limit.conf
     Active: active (running) since Thu 2023-06-22 04:47:39 CST; 20h ago
   Main PID: 15723 (redis-server)
     Status: "Ready to accept connections"
      Tasks: 5 (limit: 22862)
     Memory: 9.7M
        CPU: 13.409s
     CGroup: /system.slice/redis.service
             └─15723 "/usr/bin/redis-server 127.0.0.1:6379"

Example Output: RabbitMQ Status

ⓘ Note: Valid only when installing IAP version 2023.1 and older.

$ sudo systemctl status rabbitmq-server
● rabbitmq-server.service - RabbitMQ broker
     Loaded: loaded (/usr/lib/systemd/system/rabbitmq-server.service; enabled; preset: disabled)
    Drop-In: /etc/systemd/system/rabbitmq-server.service.d
             └─limits.conf
     Active: active (running) since Thu 2023-06-22 04:48:15 CST; 20h ago
   Main PID: 24244 (beam.smp)
      Tasks: 25 (limit: 22862)
     Memory: 138.6M
        CPU: 1min 28.641s
     CGroup: /system.slice/rabbitmq-server.service
             ├─24244 /usr/lib64/erlang/erts-13.2.2.1/bin/beam.smp -W w -MBas ageffcbf -MHas ageffcbf -MBlmbcs 512 -MHlmbcs 512 -MMmcs 30 -pc uni>
             ├─24257 erl_child_setup 64000
             ├─24284 /usr/lib64/erlang/erts-13.2.2.1/bin/epmd -daemon
             ├─24307 /usr/lib64/erlang/erts-13.2.2.1/bin/inet_gethost 4
             ├─24308 /usr/lib64/erlang/erts-13.2.2.1/bin/inet_gethost 4
             └─24311 /bin/sh -s rabbit_disk_monitor

Sample Inventories

Below are simplified sample host files that describe the basic configurations to produce the supported architectures. These are intended to be starting points only.

All-in-one Architecture Inventory

Simple environment. IAP and all of its dependencies all on one host.

Example: All-in-one Inventory File (YAML Format)

ⓘ Note: There will not be a rabbitmq group or variables when installing IAP version 2023.2 and newer.

all:
  vars:
    iap_release: 2023.1

  children:
    redis:
        hosts:
            example1.host.com:

    rabbitmq:
        hosts:
            example1.host.com:

    mongodb:
        hosts:
            example1.host.com:

    platform:
        hosts:
            example1.host.com:
        vars:
            iap_bin_file: itential-premium_2023.1.1.linux.x86_64.bin

    gateway:
        hosts:
            example2.host.com:
        vars:
            iag_release: 2023.1
            iag_whl_file: automation_gateway-3.227.0+2023.1.9-py3-none-any.whl

Minimal Architecture Inventory

Similar to All-in-one but installs components on separate hosts.

Example: Minimal Architecture Inventory File (YAML Format)

ⓘ Note: There will not be a rabbitmq group or variables when installing IAP version 2023.2 and newer.

all:
  vars:
    iap_release: 2023.1

  children:
    redis:
        hosts:
            redis.host.com:

    rabbitmq:
        hosts:
            rabbitmq.host.com:

    mongodb:
        hosts:
            mongodb.host.com:

    platform:
        hosts:
            automation-platform.host.com:
        vars:
            iap_bin_file: itential-premium_2023.1.1.linux.x86_64.bin

    gateway:
        hosts:
            automation-gateway.host.com:
        vars:
            iag_release: 2023.1
            iag_whl_file: automation_gateway-3.227.0+2023.1.9-py3-none-any.whl

Highly Available Architecture Inventory

Fault tolerant architecture.

Example: Highly Available Architecture Inventory File (YAML Format)

ⓘ Note: There will not be a rabbitmq group or variables when installing IAP version 2023.2 and newer.

all:
  vars:
    iap_release: 2023.1
    # Instructs deployer to build a cluster of each
    redis_replication: true
    rabbitmq_cluster: true
    mongodb_replication: true

  children:
    redis:
        hosts:
            redis1.host.com:
            redis2.host.com:
            redis3.host.com:

    rabbitmq:
        hosts:
            rabbitmq1.host.com:
            rabbitmq2.host.com:
            rabbitmq3.host.com:

    mongodb:
        hosts:
            mongodb1.host.com:
            mongodb2.host.com:
            mongodb3.host.com:

    platform:
        hosts:
            automation-platform1.host.com:
            automation-platform2.host.com:
        vars:
            iap_bin_file: itential-premium_2023.1.1.linux.x86_64.bin

    gateway:
        hosts:
            automation-gateway1.host.com:
        vars:
            iag_release: 2023.1
            iag_whl_file: automation_gateway-3.227.0+2023.1.9-py3-none-any.whl

Highly Available Architecture Inventory leveraging external dependencies

Fault tolerant architecture using external dependencies.

Example: Highly Available Architecture Inventory File using external dependencies (YAML Format)

ⓘ Note: There will not be a rabbitmq group or variables when installing IAP version 2023.2 and newer.

all:
  vars:
    iap_release: 2023.1
    # Instructs deployer to use external dependencies.
    # The replication for each of these should be set to false but the auth and
    # tls properties may be utilised to suit your needs.
    redis_replication: false
    redis_auth: true
    redis_tls: true
    redis_svc_url: <The-FQDN-to-the-Redis-service>
    redis_user: itential
    redis_password: <The-Redis-password>
    rabbitmq_cluster: false
    rabbitmq_ssl: false
    rabbit_user: itential
    rabbit_password: <The-RabbitMQ-password>
    rabbit_svc_url: <The-FQDN-to-the-RabbitMQ>
    mongodb_replication: false
    mongodb_auth: false
    mongodb_tls: false
    mongobdb_svc_url_itential: <The-connection-string-for-the-itential-database>
    mongobdb_svc_url_localaaa: <The-connection-string-for-the-localaaa-database>
  children:
    redis:
    rabbitmq:
    mongodb:
    platform:
      hosts:
        automation-platform1.host.com:
        automation-platform2.host.com:
      vars:
        iap_bin_file: itential-premium_2023.1.1.linux.x86_64.bin

    gateway:
      hosts:
        automation-gateway1.host.com:
      vars:
        iag_release: 2023.1
        iag_whl_file: automation_gateway-3.227.0+2023.1.9-py3-none-any.whl

Active/Standby Architecture Inventory

Example: Active/Standby Architecture Inventory File (YAML Format)

ⓘ Note: There will not be a rabbitmq group or variables when installing IAP version 2023.2 and newer.

all:
  vars:
    iap_release: 2023.1

  children:
    redis:
        hosts:
            datacenter1.redis1.host.com:
            datacenter1.redis2.host.com:
            datacenter1.redis3.host.com:

    redis_secondary:
        hosts:
            datacenter2.redis1.host.com:
            datacenter2.redis2.host.com:
            datacenter2.redis3.host.com:

    rabbitmq:
        hosts:
            datacenter1.rabbitmq1.host.com:
            datacenter1.rabbitmq2.host.com:
            datacenter1.rabbitmq3.host.com:

    rabbitmq_secondary:
        hosts:
            datacenter2.rabbitmq4.host.com:
            datacenter2.rabbitmq5.host.com:
            datacenter2.rabbitmq6.host.com:

    mongodb:
        hosts:
            datacenter1.mongodb1.host.com:
            datacenter1.mongodb2.host.com:
            datacenter2.mongodb3.host.com:
            datacenter2.mongodb4.host.com:

    mongodb_arbiter:
        hosts:
            datacenter3.mongodb-arbiter.host.com:

    platform:
        hosts:
            datacenter1.automation-platform1.host.com:
            datacenter1.automation-platform2.host.com:
        vars:
            iap_bin_file: itential-premium_2023.1.1.linux.x86_64.bin

    platform_secondary:
        hosts:
            datacenter2.automation-platform3.host.com:
            datacenter2.automation-platform4.host.com:
        vars:
            iap_bin_file: itential-premium_2023.1.1.linux.x86_64.bin

    gateway:
        hosts:
            datacenter2.automation-gateway1.host.com:
        vars:
            iag_release: 2023.1
            iag_whl_file: automation_gateway-3.227.0+2023.1.9-py3-none-any.whl

Component Guides

In addition to the itential.deployer.site playbook, there are playbooks for each component.

Each component installed by the Itential Deployer can be granularly configured by defining additional variables in the relevant inventory file. These additional playbooks, roles and their corresponding variables are detailed in the following guides.

MongoDB

MongoDB Guide

Redis

Redis Guide

RabbitMQ

ⓘ Note: Valid only when installing IAP version 2023.1 and older.

RabbitMQ Guide

Hashicorp Vault

Hashicorp Vault Guide

IAP

IAP Guide

IAG

IAG Guide

Patching IAP and IAG

The Deployer supports patching IAP and IAG. Refer to the following guide for instructions on running the patch playbooks.

Patch IAP Guide

Patch IAG Guide

Using Internal YUM Repositories

By default the Deployer will install YUM repositories which point to external URLs. If the customer hosts repositories internally, the Deployer can be configured to skip installing the repositories.

ⓘ Note: The customer will be reposible for configuring the repo files in /etc/yum.repos.d.

To use internal repositories, set install_yum_repos to false in the all vars section. For example:

all:
    vars:
        install_yum_repos: false

Running the Deployer in Offline Mode

The Deployer supports installations in air-gapped environments. Refer to the following guide for instructions on running the Deployer in offline mode.

Offline Installation Guide

Appendix A: Definition of "Highly Available" Dependencies

Highly Available MongoDB

MongoDB clusters operate a primary/secondary model where data written to the primary will replicate to the secondary. There is much literature on the internet about Mongo clusters. That will not be covered here. However, it's important to note that Itential’s preferred MongoDB cluster will assume the following requirements:

  • Authentication between the replica members done with either a shared key or X.509 certificate.
  • The database will have an admin user able to perform any operation.
  • The database will have an “itential” user that is granted the least amount of privileges required by the application.

Initial passwords are intended to be changed.

Highly Available Redis

Redis clusters operate a primary/secondary model where data written to the primary will replicate to the secondary. There is much literature on the internet about Redis clusters. That will not be covered here. However, it's important to note that Itential’s preferred Redis cluster will assume the following requirements:

  • Authentication between the replica members is done with users defined in the Redis config file.
  • Redis will have an admin user able to perform any operation.
  • Redis will have an “itential” user that is granted the least amount of privileges required by the application.
  • Redis will have a replication user that is granted the least amount of privileges required by the replication process.
  • Initial passwords are intended to be changed.
  • Redis Sentinel will be included to monitor the Redis cluster and will be colocated with Redis.
  • Redis Sentinel will have an admin user able to perform a Sentinel task.
  • Redis nodes maintain a low latency connection between nodes to avoid replication failures.

Highly Available Rabbitmq

Rabbitmq clusters operate independently of one another but they do require knowledge of one another. There is much literature on the internet about Rabbitmq clusters. That will not be covered here. However, it's important to note that Itential’s preferred Rabbitmq cluster will assume the following requirements:

  • Rabbitmq nodes depend on DNS resolution. Itential will be using host files to accomplish this.
  • Rabbitmq will have an admin user able to perform any operation.
  • Rabbitmq will have an “itential” user that is granted the least amount of privileges required by the application.

Rabbitmq nodes maintain a low latency connection between nodes to avoid replication failures.

About

The Itential Ansible Deployer can be used to deploy validated Itential architectures.

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jinja 98.9%
  • Python 1.1%