redshift
This component provisions an AWS Redshift cluster and seeds relevant database information (hostnames, username, password, etc.) into AWS SSM Parameter Store.
Usage
Stack Level: Regional
Here's an example snippet for how to use this component.
components:
terraform:
redshift:
vars:
enabled: true
name: redshift
database_name: redshift
publicly_accessible: false
node_type: dc2.large
number_of_nodes: 1
cluster_type: single-node
ssm_enabled: true
log_exports:
- userlog
- connectionlog
- useractivitylog
admin_user: redshift
custom_sg_enabled: true
custom_sg_rules:
- type: ingress
key: postgres
description: Allow inbound traffic to the redshift cluster
from_port: 5439
to_port: 5439
protocol: tcp
cidr_blocks:
- 10.0.0.0/8
Variables
Required Variables
region(string) requiredAWS region
Optional Variables
admin_password(string) optionalPassword for the master DB user. Required unless a snapshot_identifier is provided
Default value:
nulladmin_user(string) optionalUsername for the master DB user. Required unless a snapshot_identifier is provided
Default value:
nullallow_version_upgrade(bool) optionalWhether or not to enable major version upgrades which are applied during the maintenance window to the Amazon Redshift engine that is running on the cluster
Default value:
falseautomated_snapshot_retention_period(number) optionalThe number of days that automated snapshots are retained. If the value is 0, automated snapshots are disabled
Default value:
1availability_zone(string) optionalOptional parameter to place Amazon Redshift cluster instances in a specific availability zone. If left empty, will place randomly
Default value:
nullavailability_zone_relocation_enabled(bool) optionalWhether or not the cluster can be relocated to another availability zone, either automatically by AWS or when requested. Available for use on clusters from the RA3 instance family
Default value:
falsecluster_identifier(string) optionalThe Redshift Cluster Identifier. Must be a lower case string. Will use generated label ID if not supplied
Default value:
""cluster_parametersoptionalList of Redshift parameters to apply
Type:
list(object({
name = string
value = string
}))Default value:
[ ]cluster_type(string) optionalThe cluster type to use. Either
single-nodeormulti-nodeDefault value:
"single-node"custom_sg_allow_all_egress(bool) optionalWhether to allow all egress traffic or not
Default value:
truecustom_sg_enabled(bool) optionalWhether to use custom security group or not
Default value:
falsecustom_sg_rulesoptionalAn array of custom security groups to create and assign to the cluster.
Type:
list(object({
key = string
type = string
from_port = number
to_port = number
protocol = string
cidr_blocks = list(string)
description = string
}))Default value:
[ ]database_name(string) optionalThe name of the first database to be created when the cluster is created
Default value:
nullencrypted(bool) optionalSpecifies whether the cluster is encrypted at rest
Default value:
falseengine_version(string) optionalThe version of the Amazon Redshift engine to use. See https://docs.aws.amazon.com/redshift/latest/mgmt/cluster-versions.html
Default value:
"1.0"enhanced_vpc_routing(bool) optionalIf true, enhanced VPC routing is enabled
Default value:
falsefinal_snapshot_identifier(string) optionalThe identifier of the final snapshot that is to be created immediately before deleting the cluster. If this parameter is provided,
skip_final_snapshotmust befalseDefault value:
nulliam_roles(list(string)) optionalA list of IAM Role ARNs to associate with the cluster. A maximum of 10 can be associated to the cluster at any time
Default value:
[ ]kms_alias_name_ssm(string) optionalKMS alias name for SSM
Default value:
"alias/aws/ssm"kms_key_arn(string) optionalThe ARN for the KMS encryption key. When specifying
kms_key_arn,encryptedneeds to be set totrueDefault value:
nulllogging_bucket_name(string) optionalThe name of an existing S3 bucket where the log files are to be stored. Must be in the same region as the cluster and the cluster must have read bucket and put object permissions
Default value:
nulllogging_enabled(bool) optionalIf true, enables logging information such as queries and connection attempts, for the specified Amazon Redshift cluster
Default value:
falselogging_s3_key_prefix(string) optionalThe prefix applied to the log file names
Default value:
nullnode_type(string) optionalThe node type to be provisioned for the cluster. See https://docs.aws.amazon.com/redshift/latest/mgmt/working-with-clusters.html#working-with-clusters-overview
Default value:
"dc2.large"number_of_nodes(number) optionalThe number of compute nodes in the cluster. This parameter is required when the ClusterType parameter is specified as multi-node
Default value:
1pause_resume_enabled(bool) optionalWhether to create scheduled actions that pause and resume the cluster
Default value:
falsepause_resume_schedulesoptionalNamed up-windows for the cluster, each a resume and pause cron pair. A map rather than a
single pair becausepreferred_maintenance_windowmust fall inside an up-window, since AWS
cannot maintain a paused cluster. That usually means one window for the workload and a
separate one for maintenance. Cron is UTC, in the Redshift format
cron(Minutes Hours Day-of-month Month Day-of-week Year).Type:
map(object({
resume_cron = string
pause_cron = string
}))Default value:
{ }port(number) optionalThe port number on which the cluster accepts incoming connections
Default value:
5439preferred_maintenance_window(string) optionalWeekly time range during which system maintenance can occur, in UTC. Format: ddd:hh24:mi-ddd:hh24:mi
Default value:
nullpublicly_accessible(bool) optionalIf true, the cluster can be accessed from a public network
Default value:
falsescheduled_action_iam_role_arn(string) optionalARN of the IAM role Redshift assumes to run the scheduled actions. Must trust
scheduler.redshift.amazonaws.comand allowredshift:PauseClusterandredshift:ResumeClusterDefault value:
nullsecurity_group_ids(list(string)) optionalAn array of security group IDs to associate with the endpoint.
Default value:
nullskip_final_snapshot(bool) optionalDetermines whether a final snapshot of the cluster is created before Amazon Redshift deletes the cluster
Default value:
truesnapshot_cluster_identifier(string) optionalThe name of the cluster the source snapshot was created from
Default value:
nullsnapshot_identifier(string) optionalThe name of the snapshot from which to create the new cluster
Default value:
nullssm_enabled(bool) optionalIf
truecreate SSM keys for the database user and password.Default value:
falsessm_key_database_name(string) optionalThe SSM key to save the database name. See
var.ssm_path_format.Default value:
"admin/db_name"ssm_key_format(string) optionalSSM path format. The values will be used in the following order:
var.ssm_key_prefix,var.name,var.ssm_key_*Default value:
"/%v/%v/%v"ssm_key_hostname(string) optionalThe SSM key to save the hostname. See
var.ssm_path_format.Default value:
"admin/db_hostname"ssm_key_password(string) optionalThe SSM key to save the password. See
var.ssm_path_format.Default value:
"admin/db_password"ssm_key_port(string) optionalThe SSM key to save the port. See
var.ssm_path_format.Default value:
"admin/db_port"ssm_key_prefix(string) optionalSSM path prefix. Omit the leading forward slash
/.Default value:
"redshift"ssm_key_user(string) optionalThe SSM key to save the user. See
var.ssm_path_format.Default value:
"admin/db_user"subnet_ids(list(string)) optionalSubnet IDs to place the cluster in. When set, these are used directly and the
vpccomponent is not looked up, which allows the component to be used in stacks that have no CloudPosse managed VPCDefault value:
nulluse_private_subnets(bool) optionalWhether to use private or public subnets for the Redshift cluster
Default value:
truevpc_component_name(string) optionalVPC component name
Default value:
"vpc"vpc_id(string) optionalVPC the cluster's security group belongs to. Only needed alongside
subnet_ids, which bypasses thevpccomponent lookup, and only whencustom_sg_enabledistrue. Left null, the ID comes from thevpccomponent as beforeDefault value:
null
Context Variables
The following variables are defined in the context.tf file of this module and part of the terraform-null-label pattern.
context.tf file of this module and part of the terraform-null-label pattern.additional_tag_map(map(string)) optionalAdditional key-value pairs to add to each map in
tags_as_list_of_maps. Not added totagsorid.
This is for some rare cases where resources want additional configuration of tags
and therefore take a list of maps with tag key, value, and additional configuration.Required: No
Default value:
{ }attributes(list(string)) optionalID element. Additional attributes (e.g.
workersorcluster) to add toid,
in the order they appear in the list. New attributes are appended to the
end of the list. The elements of the list are joined by thedelimiter
and treated as a single ID element.Required: No
Default value:
[ ]context(any) optionalSingle object for setting entire context at once.
See description of individual variables for details.
Leave string and numeric variables asnullto use default value.
Individual variable settings (non-null) override settings in context object,
except for attributes, tags, and additional_tag_map, which are merged.Required: No
Default value:
{
"additional_tag_map": {},
"attributes": [],
"delimiter": null,
"descriptor_formats": {},
"enabled": true,
"environment": null,
"id_length_limit": null,
"label_key_case": null,
"label_order": [],
"label_value_case": null,
"labels_as_tags": [
"unset"
],
"name": null,
"namespace": null,
"regex_replace_chars": null,
"stage": null,
"tags": {},
"tenant": null
}delimiter(string) optionalDelimiter to be used between ID elements.
Defaults to-(hyphen). Set to""to use no delimiter at all.Required: No
Default value:
nulldescriptor_formats(any) optionalDescribe additional descriptors to be output in the
descriptorsoutput map.
Map of maps. Keys are names of descriptors. Values are maps of the form
\{<br/> format = string<br/> labels = list(string)<br/> \}
(Type isanyso the map values can later be enhanced to provide additional options.)
formatis a Terraform format string to be passed to theformat()function.
labelsis a list of labels, in order, to pass toformat()function.
Label values will be normalized before being passed toformat()so they will be
identical to how they appear inid.
Default is{}(descriptorsoutput will be empty).Required: No
Default value:
{ }enabled(bool) optionalSet to false to prevent the module from creating any resources
Required: NoDefault value:
nullenvironment(string) optionalID element. Usually used for region e.g. 'uw2', 'us-west-2', OR role 'prod', 'staging', 'dev', 'UAT'
Required: NoDefault value:
nullid_length_limit(number) optionalLimit
idto this many characters (minimum 6).
Set to0for unlimited length.
Set tonullfor keep the existing setting, which defaults to0.
Does not affectid_full.Required: No
Default value:
nulllabel_key_case(string) optionalControls the letter case of the
tagskeys (label names) for tags generated by this module.
Does not affect keys of tags passed in via thetagsinput.
Possible values:lower,title,upper.
Default value:title.Required: No
Default value:
nulllabel_order(list(string)) optionalThe order in which the labels (ID elements) appear in the
id.
Defaults to ["namespace", "environment", "stage", "name", "attributes"].
You can omit any of the 6 labels ("tenant" is the 6th), but at least one must be present.Required: No
Default value:
nulllabel_value_case(string) optionalControls the letter case of ID elements (labels) as included in
id,
set as tag values, and output by this module individually.
Does not affect values of tags passed in via thetagsinput.
Possible values:lower,title,upperandnone(no transformation).
Set this totitleand setdelimiterto""to yield Pascal Case IDs.
Default value:lower.Required: No
Default value:
nulllabels_as_tags(set(string)) optionalSet of labels (ID elements) to include as tags in the
tagsoutput.
Default is to include all labels.
Tags with empty values will not be included in thetagsoutput.
Set to[]to suppress all generated tags.
Notes:
The value of thenametag, if included, will be theid, not thename.
Unlike othernull-labelinputs, the initial setting oflabels_as_tagscannot be
changed in later chained modules. Attempts to change it will be silently ignored.Required: No
Default value:
[
"default"
]name(string) optionalID element. Usually the component or solution name, e.g. 'app' or 'jenkins'.
This is the only ID element not also included as atag.
The "name" tag is set to the fullidstring. There is no tag with the value of thenameinput.Required: No
Default value:
nullnamespace(string) optionalID element. Usually an abbreviation of your organization name, e.g. 'eg' or 'cp', to help ensure generated IDs are globally unique
Required: NoDefault value:
nullregex_replace_chars(string) optionalTerraform regular expression (regex) string.
Characters matching the regex will be removed from the ID elements.
If not set,"/[^a-zA-Z0-9-]/"is used to remove all characters other than hyphens, letters and digits.Required: No
Default value:
nullstage(string) optionalID element. Usually used to indicate role, e.g. 'prod', 'staging', 'source', 'build', 'test', 'deploy', 'release'
Required: NoDefault value:
nulltags(map(string)) optionalAdditional tags (e.g.
{'BusinessUnit': 'XYZ'}).
Neither the tag keys nor the tag values will be modified by this module.Required: No
Default value:
{ }tenant(string) optionalID element (Rarely used, not included by default). A customer identifier, indicating who this instance of a resource is for
Required: NoDefault value:
null
Outputs
arnAmazon Resource Name (ARN) of cluster
cluster_identifierThe Cluster Identifier
cluster_parameter_group_nameThe name of the parameter group associated with the cluster
cluster_revision_numberThe Redshift engine revision number the cluster is running
database_nameThe name of the default database in the Cluster
dns_nameThe DNS name of the cluster
endpointThe connection endpoint
idThe Redshift Cluster ID
portThe Port the cluster responds on
redshift_database_ssm_key_prefixSSM prefix
vpc_security_group_idsThe VPC security group IDs associated with the cluster
Dependencies
Requirements
terraform, version:>= 1.0aws, version:>= 4.17, < 6.0.0random, version:>= 3.0
Providers
aws, version:>= 4.17, < 6.0.0random, version:>= 3.0
Modules
| Name | Version | Source | Description |
|---|---|---|---|
iam_roles | latest | ../account-map/modules/iam-roles | n/a |
redshift_cluster | 1.7.0 | cloudposse/redshift-cluster/aws | n/a |
redshift_sg | 2.2.0 | cloudposse/security-group/aws | n/a |
this | 0.25.0 | cloudposse/label/null | n/a |
vpc | 2.0.0 | cloudposse/stack-config/yaml//modules/remote-state | n/a |
Resources
The following resources are used by this module:
aws_redshift_scheduled_action.pause(resource)aws_redshift_scheduled_action.resume(resource)aws_ssm_parameter.redshift_database_hostname(resource)aws_ssm_parameter.redshift_database_name(resource)aws_ssm_parameter.redshift_database_password(resource)aws_ssm_parameter.redshift_database_port(resource)aws_ssm_parameter.redshift_database_user(resource)random_password.admin_password(resource)random_pet.admin_user(resource)
Data Sources
The following data sources are used by this module: