Skip to content

Latest commit

 

History

History
349 lines (285 loc) · 12.2 KB

bosh-install-with-credhub.md

File metadata and controls

349 lines (285 loc) · 12.2 KB

The following guide provides details on how to deploy a BOSH Director with CredHub so that you may use credential variables in your deployments manifests. Once configured, any variable in a BOSH deployment manifest with the syntax ((variable)) will cause the Director to retrieve the variable value at deploy-time from CredHub.

If you use bosh-deployment to deploy your director, including the ops file credhub.yml will enable CredHub on the director.


Setup Before Deployment

  1. Setup a BOSH Director

    The following configuration steps assume that you have an existing BOSH Director. If you do not have a running director, you may reference this BOSH initialization guide for more details. You may also choose to use one of the sample manifests (init-aws-director.yml or init-gcp-director.yml) shown here.

  2. Configure UAA on your Director

    UAA is used by CredHub for user and client authentication. A UAA server must be configured on the director to enable CredHub. You may read more on how to provision UAA on the Director in the following guide.

  3. [Optional] Configure an external database

    If you chose to store CredHub data in an external database, as recommended, you must create a database and user on your database server before deployment. You may use the internal Director database to store CredHub data, however care must be taken to avoid data loss during updates to or provisioning of the Director VM.

  4. [Optional] Configure a Luna SafeNet HSM

    In the recommended production configuration, cryptographic operations are performed for CredHub via an external Luna SafeNet hardware security module (HSM). The HSM must be configured to allow access from the deployed CredHub instance and the operator must have all of the required credentials from the HSM. For more information on the required HSM values and how to configure an HSM, see the configuring a Luna HSM document.


Configuring the Director

  1. Update the deployment manifest to include the CredHub release

    You may obtain the latest CredHub release at the following location.

    releases:
    - name: bosh
      url: https://bosh.io/d/github.com/cloudfoundry/bosh?v=261.4
      version: 261.4
      sha1: 4da9cedbcc8fbf11378ef439fb89de08300ad091
    # ...
    - name: credhub # <---
      url: https://bosh.io/d/github.com/pivotal-cf/credhub-release?v=0.8.0
      version: 0.8.0
      sha1: 0bd0058486fe1d650b42406834fc57349063bf71
  2. Add the CredHub job to the Director instance

    instance_groups:
    - name: bosh
      instances: 1
      jobs:
      - {name: nats, release: bosh}
      - {name: redis, release: bosh}
      - {name: postgres, release: bosh}
      - {name: blobstore, release: bosh}
      - {name: director, release: bosh}
      - {name: health_monitor, release: bosh}
      - {name: uaa, release: uaa-release}
      - {name: credhub, release: credhub} # <---
      resource_pool: default
      # ...
  3. [Optional] Add variable generation specifications for CredHub properties

    Values required by the CredHub configuration may be generated automatically by the BOSH v2 CLI. To enable generation, you must add the variable specifications to the manifest as shown below. These may be adjusted or removed if you prefer to provide your own values.

    variables: 
    - name: credhub-ca
      type: certificate
      options: 
        is_ca: true 
        common_name: 'CredHub CA'
    - name: credhub-tls
      type: certificate
      options: 
        ca: credhub-ca 
        common_name: credhub.example.com
        alternative_names: 
        - 10.0.0.10
        - 127.0.0.1
    - name: credhub-encryption-password
      type: password
  4. Add CredHub properties to the deployment manifest

    properties:
      credhub:
        port: 8844
        log_level: info
        tls:
          certificate: ((credhub-tls.certificate))
          private_key: ((credhub-tls.private_key))
        data_storage:
          type: mysql
          host: mysql.example.com
          port: 3306
          database: credhub
          username: user
          password: example-password
          require_tls: true
          tls_ca: |
            -----BEGIN CERTIFICATE-----
            ...
            -----END CERTIFICATE-----
        authentication:
          uaa:
            url: "https://uaa.example.com:8443"
            verification_key: |
              -----BEGIN PUBLIC KEY-----
              ...
              -----END PUBLIC KEY-----
          mutual_tls: 
            trusted_cas: 
            - |
              -----BEGIN CERTIFICATE-----
              ...
              -----END CERTIFICATE-----
        encryption: 
          keys: 
          - provider_name: corp-hsm
            encryption_key_name: key-name
            active: true
          providers:
          - name: corp-hsm
            type: hsm
            partition: partition-name
            partition_password: partition-password
            client_certificate: |
              -----BEGIN CERTIFICATE-----
              ...
              -----END CERTIFICATE-----
            client_key: |
              -----BEGIN RSA PRIVATE KEY-----
              ...
              -----END RSA PRIVATE KEY-----
            servers: 
            - host: hsm.example.com
              port: 1792
              partition_serial_number: 123456
              certificate: |
                -----BEGIN CERTIFICATE-----
                ...
                -----END CERTIFICATE-----

    The above sample includes a configuration to use a hardware security module for encryption. Alternatively, you may select to use the internal software-based encryption provider with the following configuration. This method derives a 256 bit key from the provided encryption password and utilized AES256-GCM encryption.

    ...
      encryption:
        providers: 
        - name: main
          type: internal
        keys: 
        - provider_name: main
          encryption_password: ((credhub-encryption-password))
          active: true
    ...

    For the full list of CredHub properties and default values, visit the job spec properties page.

  5. Add CredHub CLI and Director/CredHub UAA clients

    properties:
      uaa:
        clients:
          credhub_cli:
            override: true
            authorized-grant-types: password,refresh_token
            scope: credhub.read,credhub.write 
            authorities: uaa.none
            access-token-validity: 120 
            refresh-token-validity: 1800
            secret: "" # <--- CLI expects this secret to be empty
          director_to_credhub:
            override: true
            authorized-grant-types: client_credentials
            scope: uaa.none
            authorities: credhub.read,credhub.write
            access-token-validity: 43200
            secret: example-secret # <--- Replace with custom client secret
  6. Enable the config server feature on the Director and configure it to utilize CredHub

    properties:
      director:
        address: bosh.example.com
        name: director-name
        config_server:
          enabled: true
          
          # URL must contain /api/ path with trailing slash
          url: "https://127.0.0.1:8844/api/"
          
          ca_cert: |
            -----BEGIN CERTIFICATE-----
            ...
            -----END CERTIFICATE-----
          uaa:
            url: "https://127.0.0.1:8443"
            client_id: director_to_credhub
            client_secret: example-secret
            ca_cert: |
              -----BEGIN CERTIFICATE-----
              ...
              -----END CERTIFICATE-----
  7. Optional: Configure the Director Postgres server to have an additional database called credhub

    If you are using the internal Director database, you must provision an additional database for the CredHub data. If you are using an external database, you must create the database on your database server before deploying.

    properties:
      postgres: &db
        host: 127.0.0.1
        port: 5432
        user: postgres
        password: postgres-password
        database: bosh
        additional_databases: [credhub] # <---
        adapter: postgres
  8. Optional: Seed initial CredHub users to UAA

    properties:
      uaa:
        scim:
          users:
          - name: credhub-user
            password: user-password
            groups:
            # Users must have both credhub.read and credhub.write access
            - credhub.read             # <---
            - credhub.write            # <---
          - name: credhub-user2
            password: user-password
            groups:
            - credhub.read
            - credhub.write
  9. Deploy!


Updates After Deployment

  1. Create CredHub users in UAA

    To authenticate with CredHub to manage credentials, you must have a UAA user account with the scopes credhub.read and credhub.write. You may create users manually in UAA, as described here, or you may configure UAA with an external LDAP provider.

    A sample process for creating 2 users in UAA is shown below.

    user$ uaac token client get admin -s example-password
      Successfully fetched token via client credentials grant.
      Target: https://uaa.example.com:8443
      Context: admin, from client admin
    
    user$ uaac user add user1 --emails email@example.com
      Password:  ********
      Verify password:  ********
      user account successfully added
    
    user$ uaac user add user2 --emails email@example.com
      Password:  ********
      Verify password:  ********
      user account successfully added
    
    user$ uaac member add credhub.read user1 user2
      success
    
    user$ uaac member add credhub.write user1 user2
      success
    
  2. Install CredHub CLI

    CredHub CLI offers a simple and scriptable interface to manage stored credentials. You can download the latest release here.

  3. Place or generate some credentials in CredHub using the CLI

    credhub set --type ssh --name /static/ssh_key --public ~/ssh.pub --private ~/ssh.key
    credhub generate --type ssh --name /static/ssh_key
    
  4. Update BOSH deployment manifests

    Now that you have a Director that integrates with CredHub, you can update your deployment manifests to leverage this feature. An example is shown below of a deployment manifest using two credentials - one stored and one generated by CredHub. Credentials that you wish to be generated automatically should be defined in the variables section with their desired generation parameters. More information on automatic generation can be found here.

    name: Sample-Manifest
    
    releases:
    - name: shell
      url: https://bosh.io/d/github.com/cloudfoundry-community/shell-boshrelease?v=3.2.0
      sha1: 893b10af531a7519da99bb8656cc07b8277d1692
    
    #...
    
    variables: 
    - name: generated/ssh_key
      type: ssh
    
    jobs:
      - name: shell
        instances: 1
        persistent_disk: 0
        resource_pool: vms
        networks:
          - name: private
            static_ips: 10.0.0.100
            default: [dns, gateway]
        templates:
          - name: shell
            release: shell
            properties:
              shell:
                users:
                  - name: shell
                    ssh_keys:
                      - ((/static/ssh_key))
                      - ((generated/ssh_key))