Detect & correct Storage buckets without lifecycle policy

Overview

Storage buckets can be costly to run, especially if they're rarely used, buckets without a lifecycle policy should be reviewed to determine if they're still required.

This pipeline detects storage buckets without a lifecycle policy and then either sends a notification or attempts to perform a predefined corrective action.

Getting Started

By default, this trigger is disabled, however it can be configured by setting the below variables

storage_buckets_without_lifecycle_policy_trigger_enabled should be set to true as the default is false.
storage_buckets_without_lifecycle_policy_trigger_schedule should be set to your desired running schedule
storage_buckets_without_lifecycle_policy_default_action should be set to your desired action (i.e. "notify" for notifications or "delete_bucket" to delete the bucket).

Then starting the server:

flowpipe server

or if you've set the variables in a .fpvars file:

flowpipe server --var-file=/path/to/your.fpvars

Pipeline

Correct Storage buckets without lifecycle policies

Query

select
  concat(name, ' [', location, '/', project, ']') as title,
  name,
  project,
  _ctx ->> 'connection_name' as cred
from
  gcp_storage_bucket
where
  lifecycle_rules is null;

Schedule

15m