Resource Cleanup
Fix Inventory is very good at helping you find problematic resources in your infrastructure. Sometimes, you only want to notify when such resources are found; but other times, you may wish to clean them up.
By default, Fix Inventory Worker does not delete resources marked for deletion.
Resources marked with | clean will stay this way without getting deleted unless cleanup is enabled.
Cleanup can be performed manually in Fix Inventory Shell with the clean command or using a cleanup infrastructure app.
See Cleanup How-To Guides for step-by-step instructions to clean up various types of resources.
Let's say that you have a CI account where your CI system is allowed to automatically create worker compute instances. You might have a rule that says, "CI worker compute instances in this account may not live longer than 24 hours." Your CI system usually shuts down long-running instances, but sometimes things go wrong. The cloud API could return an error when trying to shut down the instance, the IaC tool could abort halfway through its run, the API credentials might be expired or unavailable, etc. In these situations, Fix Inventory can serve as a safety net.
A manual search and cleanup in this situation could look like this:
> search is(aws_ec2_instance) and name =~ "^jenkins-worker-.*" and age > 24h | clean "instance older than 24h"
To automate things, you could create a job that runs whenever cleanup is planned and searches for compute instances with a certain name that are older than 24 hours and automatically deletes them.
The same search turned into an automated cleanup job:
> jobs add --id cleanup_old_ci_workers --wait-for-event cleanup_plan 'search is(aws_ec2_instance) and name =~ "^jenkins-worker-.*" and age > 24h | clean "instance older than 24h"'
Additional search criteria like and /ancestors.account.reported.id = "1234567" to further restrict the search could be given.
See Cleanup How-To Guides for step-by-step instructions to clean up various types of resources.
Make a mistake in marking resources for cleanup? To remove clean markers from all resources, execute:
> search /desired.clean = true | set_desired clean=false
You can also target specific resources to un-mark. For example, to quickly undo of marking all aws_ec2_volumes:
> search is(aws_ec2_volume) | set_desired clean=false
Enabling Cleanup​
When a resource is marked for cleanup, it is not immediately deleted. Rather, it is flagged for deletion during the collect_and_cleanup workflow, which runs each hour by default.
Resources can only be cleaned up if they are not protected.
To enable cleanup, execute the following command in Fix Inventory Shell to open the Fix Inventory Worker configuration for editing:
> config edit fix.worker
Then, modify the fixworker section of the configuration as follows:
fixworker:
# Enable cleanup of resources
cleanup: true
# Do not actually cleanup resources, just create log messages
cleanup_dry_run: false
# How many cleanup threads to run in parallel
cleanup_pool_size: 16
When cleanup is enabled, marked resources will be deleted as a part of the collect_and_cleanup workflow, which runs each hour by default.
Set cleanup_dry_run to true to simulate cleanup without actually deleting resources.