Pipeline: Correct Logging Buckets with high retention period

Correct Logging buckets with high retention

Overview

Logging buckets can be costly to run, especially if they're rarely used, buckets with high retention periods should be reviewed to determine if they're still required.

This pipeline allows you to specify a collection of Logging buckets with high retention periods and then either send notifications or attempt to perform a predefined corrective action upon the collection.

Whilst it is possible to utilise this pipeline standalone, it is usually called from either:

Run the pipeline

To run this pipeline from your terminal:

flowpipe pipeline run gcp_thrifty.pipeline.correct_logging_buckets_with_high_retention \
  --arg 'items=<list(object({
      bucket_name = string
      location    = string
      project     = string
      conn        = string
      title       = string
    }))>'

Use this pipeline

To call this pipeline from your pipeline, use a step:

step "pipeline" "step_name" {
  pipeline = gcp_thrifty.pipeline.correct_logging_buckets_with_high_retention  
  args = {
    items = <list(object({
      bucket_name = string
      location    = string
      project     = string
      conn        = string
      title       = string
    }))>
  }
}

Triggers

Detect & correct Logging Buckets with high retention period

Params

Name	Type	Required	Description	Default
items	list(object({ bucket_name = string location = string project = string conn = string title = string }))	Yes		-
notifier	notifier	Yes	The name of the notifier to use for sending notification messages.	`notifier.default`
notification_level	string `info`, `verbose`, `error`	Yes	The verbosity level of notification messages to send.	`info`
approvers	list(notifier)	Yes	List of notifiers to be used for obtaining action/approval decisions.	`notifier.default`
default_action	string `notify`, `skip`, `update_retention`	Yes	The default action to use for the detected item, used if no input is provided.	`notify`
enabled_actions	list(string) `skip`, `update_retention`	Yes	The list of enabled actions to provide to approvers for selection.	`[ "skip", "update_retention" ]`
retention_days	string	Yes	The new retention period in days for the Logging Bucket. Optional.	`10`

Outputs

This pipeline has no outputs.