2026-09-27 02:00:01 [INFO] Log file: /data/log/aws_prod-EGProd1-backup_archive_delete.3443473.log
2026-09-27 02:00:01 [INFO] ******** LIVE MODE ********
2026-09-27 02:00:01 [INFO] Starting backup pruning for plan 'prod-EGProd1-backup'
2026-09-27 02:00:01 [INFO] Found credentials in shared credentials file: ~/.aws/credentials
2026-09-27 02:00:01 [INFO] Found backup plan ID 5001e588-08a7-40af-87c6-a468ceee7b62 for 'prod-EGProd1-backup'.
2026-09-27 02:00:01 [INFO] Vaults used by this plan: backup-daily
2026-09-27 02:00:01 [INFO] Retrieving recovery points from vault 'backup-daily'...
2026-09-27 02:00:01 [INFO]   Found 8 recovery points in backup-daily
2026-09-27 02:00:01 [INFO] Total recovery points found: 8
2026-09-27 02:00:01 [INFO] Monthly archive months: 2026-09, 2026-08, 2026-07, 2026-06, 2026-05, 2026-04, 2026-03, 2026-02, 2026-01, 2025-12, 2025-11, 2025-10
2026-09-27 02:00:01 [INFO] Weekly retention Mondays: 2026-09-07, 2026-09-14, 2026-09-21
2026-09-27 02:00:01 [INFO] ==================================================
2026-09-27 02:00:01 [INFO] KEEP: 6 recovery points
2026-09-27 02:00:01 [INFO] KEEP: arn:aws:ec2:us-west-2::image/ami-087288e98d1ad7bb5 | 2026-09-07 04:00:00+00:00 | EC2
2026-09-27 02:00:01 [INFO] KEEP: arn:aws:ec2:us-west-2::image/ami-0c3dff7b608fb4f87 | 2026-09-14 04:00:00+00:00 | EC2
2026-09-27 02:00:01 [INFO] KEEP: arn:aws:ec2:us-west-2::image/ami-0d1e423ff8f067c04 | 2026-09-21 04:00:00+00:00 | EC2
2026-09-27 02:00:01 [INFO] KEEP: arn:aws:ec2:us-west-2::image/ami-044c7e662b79a8d09 | 2026-09-25 04:00:00+00:00 | EC2
2026-09-27 02:00:01 [INFO] KEEP: arn:aws:ec2:us-west-2::image/ami-02b0e5a9ab30f05a8 | 2026-09-26 04:00:00+00:00 | EC2
2026-09-27 02:00:01 [INFO] KEEP: arn:aws:ec2:us-west-2::image/ami-0404455f91c75f88f | 2026-09-27 04:00:00+00:00 | EC2
2026-09-27 02:00:01 [INFO] ==================================================
2026-09-27 02:00:01 [INFO] ARCHIVE: 1 recovery points
2026-09-27 02:00:01 [INFO] ARCHIVE: arn:aws:ec2:us-west-2::image/ami-01a80ec4c8b80f826 | AMI=ami-01a80ec4c8b80f826 | 3080.00 GB | METHOD=S3-DEEP-ARCHIVE | 2026-09-01 04:00:00+00:00
2026-09-27 02:00:01 [INFO] ==================================================
2026-09-27 02:00:01 [INFO] SKIP: 0 recovery points
2026-09-27 02:00:01 [INFO] ==================================================
2026-09-27 02:00:01 [INFO] DELETE: 1 recovery points
2026-09-27 02:00:01 [INFO] DELETE: arn:aws:ec2:us-west-2::image/ami-0babc38de0b5c4576 | 2026-09-24 04:00:00+00:00 | EC2
2026-09-27 02:00:01 [INFO] Waiting for global AMI archive lock...
2026-09-27 02:00:01 [INFO] AMI archive lock acquired.
2026-09-27 02:00:01 [INFO] Starting S3 Deep Archive workflow for ami-01a80ec4c8b80f826
2026-09-27 02:00:02 [INFO] AMI ami-01a80ec4c8b80f826 is 3080.00 GB <= 5000 GB. Using S3-DEEP-ARCHIVE.
2026-09-27 02:00:02 [INFO] ==================================================
2026-09-27 02:00:02 [INFO] ARCHIVING AMI: ami-01a80ec4c8b80f826
2026-09-27 02:00:02 [INFO] Creating S3 AMI store task for ami-01a80ec4c8b80f826...
2026-09-27 02:00:02 [ERROR] ARCHIVE FAILED for ami-01a80ec4c8b80f826. Recovery point WILL NOT be deleted.
Traceback (most recent call last):
  File "/home/prod/gqr/extra/env/prune_aws_backups_by_plan.py", line 1483, in main
    final_key = archive_ami_to_deep_archive(
  File "/home/prod/gqr/extra/env/prune_aws_backups_by_plan.py", line 874, in archive_ami_to_deep_archive
    response = ec2_client.create_store_image_task(
  File "/home/prod/miniconda3/envs/env1/lib/python3.9/site-packages/botocore/client.py", line 569, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/home/prod/miniconda3/envs/env1/lib/python3.9/site-packages/botocore/client.py", line 1023, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (InvalidRequest) when calling the CreateStoreImageTask operation: The AMI already exists in the bucket. You can't create multiple copies of an AMI in the same S3 bucket.
2026-09-27 02:00:02 [INFO] AMI archive lock released.
2026-09-27 02:00:02 [INFO] Deleting old recovery point: arn:aws:ec2:us-west-2::image/ami-0babc38de0b5c4576
2026-09-27 02:00:02 [INFO] Deleted old recovery point: arn:aws:ec2:us-west-2::image/ami-0babc38de0b5c4576
2026-09-27 02:00:02 [INFO] ==================================================
2026-09-27 02:00:02 [INFO] JOB COMPLETE for backup plan 'prod-EGProd1-backup'.
2026-09-27 02:00:02 [INFO] ==================================================
