Pipeline: Correct S3 buckets without lifecycle policy

Overview

S3 Buckets without a lifecycle policy will not move objects between storage layers or expire objects, causing them to remain in their initial tier perpetually, this is inefficient and can be costly.

This pipeline allows you to specify a collection of S3 buckets without lifecycle policies and then either send notifications or attempt to perform a predefined corrective action upon the collection.

Whilst it is possible to utilise this pipeline standalone (see below), it is usually called from either:

Run the pipeline

To run this pipeline from your terminal:

flowpipe pipeline run aws_thrifty.pipeline.correct_s3_buckets_without_lifecycle_policy \
  --arg 'items=<list(object({
      title  = string
      name   = string
      region = string
      conn   = string
    }))>'

Use this pipeline

To call this pipeline from your pipeline, use a step:

step "pipeline" "step_name" {
  pipeline = aws_thrifty.pipeline.correct_s3_buckets_without_lifecycle_policy  
  args = {
    items = <list(object({
      title  = string
      name   = string
      region = string
      conn   = string
    }))>
  }
}

Triggers

Detect & correct S3 buckets without lifecycle policy

Params

Name	Type	Required	Description	Default
items	list(object({ title = string name = string region = string conn = string }))	Yes		-
lifecycle_configuration	string	Yes	Lifecycle configuration to apply to the S3 bucket, if 'apply' is the chosen response.	`{ "Rules": [ { "ID": "Transition to STANDARD_IA after 90 days", "Status": "Enabled", "Filter": {}, "Transitions": [ { "Days": 90, "StorageClass": "STANDARD_IA" } ] }, { "ID": "Transition to GLACIER after 180 days", "Status": "Enabled", "Filter": {}, "Transitions": [ { "Days": 180, "StorageClass": "GLACIER" } ] }, { "ID": "Transition to DEEP_ARCHIVE after 365 days", "Status": "Enabled", "Filter": {}, "Transitions": [ { "Days": 365, "StorageClass": "DEEP_ARCHIVE" } ] } ] }`
notifier	notifier	Yes	The name of the notifier to use for sending notification messages.	`notifier.default`
notification_level	string `info`, `verbose`, `error`	Yes	The verbosity level of notification messages to send. Valid options are 'verbose', 'info', 'error'.	`info`
approvers	list(notifier)	Yes	List of notifiers to be used for obtaining action/approval decisions.	`notifier.default`
default_action	string `notify`, `skip`, `apply_lifecycle_configuration`	Yes	The default action to use for the detected item, used if no input is provided.	`notify`
enabled_actions	list(string) `skip`, `apply_lifecycle_configuration`	Yes	The list of enabled actions to provide to approvers for selection.	`[ "skip", "apply_lifecycle_configuration" ]`

Outputs

This pipeline has no outputs.