Skip to content

Commit

Permalink
Merge pull request #2 from data-platform-hq/feat/EPMADPAFIC-779-Datab…
Browse files Browse the repository at this point in the history 
…ricks-development

feat: updated module
  • Loading branch information
@owlleg6
owlleg6 authored Aug 21, 2023
2 parents 193e004 + a35988b commit d076bbe
Show file tree
Hide file tree
Showing 5 changed files with 296 additions and 49 deletions.
46 changes: 28 additions & 18 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -7,15 +7,15 @@ Terraform module for creation Google Composer Environments
## Requirements

| Name | Version |
| ------------------------------------------------------------------------- | --------- |
|---------------------------------------------------------------------------|-----------|
| <a name="requirement_terraform"></a> [terraform](#requirement\_terraform) | >= 1.0.0 |
| <a name="requirement_google"></a> [google](#requirement\_google) | >= 4.24.0 |
| <a name="requirement_google"></a> [google](#requirement\_google) | >= 4.69.1 |

## Providers

| Name | Version |
| ---------------------------------------------------------------- | --------- |
| <a name="requirement_google"></a> [google](#requirement\_google) | >= 4.24.0 |
|------------------------------------------------------------------|-----------|
| <a name="requirement_google"></a> [google](#requirement\_google) | >= 4.69.1 |

## Modules

Expand All @@ -24,29 +24,39 @@ No modules.
## Resources

| Name | Type |
| --------------------------------------------------------------------------------------------------------------------------------------- | -------- |
| [google_composer_environment.main](https://registry.terraform.io/providers/hashicorp/google/latest/docs/resources/composer_environment) | resource |
|-----------------------------------------------------------------------------------------------------------------------------------------|----------|
| [google_composer_environment.this](https://registry.terraform.io/providers/hashicorp/google/latest/docs/resources/composer_environment) | resource |

## Inputs

| Name | Description | Type | Default | Required |
| ----------------------------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------- | -------- | ------------------------------- | :------: |
| <a name="input_product_base_name"></a> [product\_base\_name](#input\_product\_base\_name) | Cloud resources base name (used to create services) | `string` | n/a | yes |
| <a name="input_env"></a> [env](#input\_env) | Variable to mark the environment of the resource (used to create services) | `string` | n/a | yes |
| <a name="input_network"></a> [network](#input\_network) | The Compute Engine network to be used for machine communications | `string` | n/a | yes |
| <a name="input_subnet"></a> [subnet](#input\_subnet) | The Compute Engine subnetwork to be used for machine communications | `string` | n/a | yes |
| <a name="input_sa_email"></a> [sa_email](#input\_sa_email) | The Google Cloud Platform Service Account to be used by the node VMs | `string` | n/a | yes |
| <a name="input_image_version"></a> [image\_version](#input\_image\_version) | The version of the software running in the environment | `string` | "composer-2.0.22-airflow-2.2.5" | no |
| <a name="input_environment_size"></a> [environment\_size](#input\_environment\_size) | The environment size controls the performance parameters of the managed Cloud Composer infrastructure that includes the Airflow database | `string` | "ENVIRONMENT_SIZE_SMALL" | no |
| <a name="input_enable_private_endpoint"></a> [enable\_private\_endpoint](#input\_enable\_private\_endpoint) | If true, access to the public endpoint of the GKE cluster is denied | `bool` | true | no |
| <a name="input_labels"></a> [labels](#input\_labels) | The labels associated with this dataset. You can use these to organize and group your datasets | `bool` | true | no |
| Name | Description | Type | Default | Required |
|---------------------------------------------------------------------------------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|---------------|-----------------------------------|:--------:|
| <a name="input_product_base_name"></a> [product\_base\_name](#input\_product\_base\_name) | Cloud resources base name (used to create services) | `string` | n/a | yes |
| <a name="input_project"></a> [project](#input\_project) | ID of the project in which the resources should be created | `string` | null | yes |
| <a name="input_region"></a> [region](#input\_region) | The location or cloud resources region for the environment | `string` | null | yes |
| <a name="input_env"></a> [env](#input\_env) | Variable to mark the environment of the resource (used to create services) | `string` | n/a | yes |
| <a name="input_suffix"></a> [suffix](#input\_suffix) | Suffix for resource names | `string` | "" | no |
| <a name="input_node_config"></a> [node\_config](#input\_node\_config) | An optional object containing Google Cloud Composer node configuration settings. You can set network, subnetwork, service_account, tags, ip_allocation_policy, and enable_ip_masq_agent parameters. All parameters are optional and can be individually skipped | `object` | {} | no |
| <a name="input_software_config"></a> [software\_config](#input\_software\_config) | An optional object containing Google Cloud Composer software configuration settings. You can set airflow_config_overrides, pypi_packages, env_variables, image_version, and cloud_data_lineage_integration parameters. All parameters are optional and can be individually skipped | `object` | null | no |
| <a name="input_private_environment_config"></a> [private\_environment\_config](#input\_private\_environment\_config) | This variable allow to configure your Google Cloud project networking for Private IP environments | `object` | {enable_private_endpoint = false} | yes |
| <a name="input_kms_key_name"></a> [kms\_key\_name](#input\_kms\_key\_name) | Customer-managed Encryption Key available through Google's Key Management Service.<br> It must be the fully qualified resource name, i.e. projects/project-id/locations/location/keyRings/keyring/cryptoKeys/key. Cannot be updated | `string` | null | no |
| <a name="input_maintenance_window"></a> [maintenance\_window](#input\_maintenance\_window) | The configuration settings for Cloud Composer maintenance windows | `object` | null | no |
| <a name="input_recovery_config"></a> [recovery\_config](#input\_recovery\_config) | The configuration settings for recovery | `object` | null | no |
| <a name="input_scheduler"></a> [scheduler](#input\_scheduler) | Configuration for resources used by Airflow schedulers | `object` | null | no |
| <a name="input_web_server"></a> [web\_server](#input\_web\_server) | Configuration for resources used by Airflow web server | `object` | null | no |
| <a name="input_worker"></a> [worker](#input\_worker) | Configuration for resources used by Airflow workers | `object` | null | no |
| <a name="input_environment_size"></a> [environment\_size](#input\_environment\_size) | The environment size controls the performance parameters of the managed Cloud Composer infrastructure that includes the Airflow database. Possible values are ENVIRONMENT_SIZE_SMALL, ENVIRONMENT_SIZE_MEDIUM, and ENVIRONMENT_SIZE_LARGE | `string` | null | no |
| <a name="input_resilience_mode"></a> [resilience\_mode](#input\_resilience\_mode) | The resilience mode states whether high resilience is enabled for the environment or not. Value for resilience mode is HIGH_RESILIENCE. If unspecified, defaults to standard resilience | `string` | null | no |
| <a name="input_master_authorized_networks_config"></a> [master\_authorized\_networks\_config](#input\_master\_authorized\_networks\_config) | Configuration options for the master authorized networks feature. Enabled master authorized networks will disallow all external traffic to access Kubernetes master through HTTPS except traffic from the given CIDR blocks, Google Compute Engine Public IPs and Google Prod IPs | `object` | null | no |
| <a name="input_labels"></a> [labels](#input\_labels) | The labels associated with this dataset. You can use these to organize and group your datasets | `map(string)` | {} | no |

## Outputs

| Name | Description |
| ----------------------------------------------------------------------- | ------------------------------------------------------------------- |
|-------------------------------------------------------------------------|---------------------------------------------------------------------|
| <a name="output_airflow_url"></a> [airflow\_url](#output\_airflow\_url) | The URI of the Apache Airflow Web UI hosted within the environment. |
| <a name="output_dags_bucket"></a> [dags\_bucket](#output\_dags\_bucket) | The Cloud Storage prefix of the DAGs for the environment. |

<!-- END_TF_DOCS -->

## License
Expand Down
Loading

0 comments on commit d076bbe

Please sign in to comment.