CBL-IPF_S3_Object_Lifecycle_Management_(2023-05-17).docx

DOCX document 189 KB Posted

Attached to
FS3i-RFI
Solicitation number
FS3i-TBD
Issued by

About this file

This document is an UNCLASSIFIED IPF Policy for S3 Object Lifecycle Management. The policy establishes a global baseline configuration to manage object storage classes and perform related maintenance in S3 buckets.

Key details:

  • All S3 buckets shall have S3 Intelligent Tiering applied, with objects automatically transitioning between Frequent Access, Infrequent Access, and Archive Instant Access tiers based on usage.
  • Mission owners may also use Archive Access and Deep Archive Access tiers for data not planned to be accessed.
  • A standard Lifecycle rule named "S3-IT_0-Day_and_Maintenance" shall be applied to all S3 buckets, with objects transitioning to Intelligent Tiering and incomplete multipart uploads being deleted after 7 days (this period can be reduced with mission owner concurrence).
  • If using Glacier storage classes instead of Intelligent Tiering, an additional rule to apply Intelligent Tiering to the remainder of the bucket is required.
  • These are minimum configuration requirements, and not implementing requires approval from the IPF.

The document is related to a federal contract opportunity for the National Geospatial-Intelligence Agency (NGA) to provide sustainment, support, software and integration services for the current Foundation Geospatial-Intelligence (FG) system baseline and future integrated capabilities.

View the file

Other files

File Type Posted
RFI_QA_20241003.xlsx XLSX spreadsheet
CBL-SFN_Overview_Trifold_FINAL_v3.pdf PDF
CBL-FS2_TanDEM_X_Addendum_V1.docx DOCX document
CBL-IPF_EBS_Encryption_(2023-08).docx DOCX document
Science_Task_Order_20240917.docx DOCX document
CBL-SFN_APNTt_Placemats_FINAL_v2.pdf PDF
CBL-The_NGA_Software_Way_2022.pdf PDF
CBL-GNSS_As-Is_and_Aspirational_Endstate.pdf PDF
CBL-GGEPS_As-Is_and_Aspirational_Endstate.pdf PDF
CBL-GGPM SvcV-2 Diagram.jpg JPG image
CBL-IPF_Orphaned_EBS_Volume_Management_(2023-06-22).docx DOCX document
CBL-NGA_Technology_Strategy_APR_20-512.pdf PDF
CBL-IPF_Capability_Delivery_SOP--Oct2021.docx DOCX document
CBL-N2_ConOps_Final_05222024.docx DOCX document
CBL-J-03_FS2_EM_TO_Geomatics_VDA_Addendum.docx DOCX document
CBL-Data_Conditioning_SvcV-2_Diagram.jpg JPG image
CBL-IPF_Tagging_Standards_(2023-05-17).docx DOCX document
CBL-GSS_As-Is_Architecture.png PNG image
Sea_Task_Order_Rev1_20240829.docx DOCX document
Base_PWS_Rev1.3_20240903.docx DOCX document
FS3i_RFI_20240917.docx DOCX document
CBL-SMAPS_V2.pptx PPTX presentation
CBL-Maritime_Pub_SMAPS_QASP.docx DOCX document
CBL-IPF_Developer_Environment_Guidance.docx DOCX document
CBL-IPF_EBS_Provisioned_IOPS_and_Throughput_(2023-06-22).docx DOCX document
Show all 25

On GovTribe

Work with this file

  • Download the original file
  • Contacts named in this file
  • Similar government files
  • Ask GovTribe AI about this file

Text version

UNCLASSIFIED

IPF Policy S3 Object Lifecycle Management 2023-05-17 Purpose This is the IPF policy for Intelligent Tiering & a Standard Lifecycle Rule for all S3 buckets. Lifecycle rules can be used to manage object storage classes in S3 buckets which can result in a reduced cost for object storage. The goal of this policy is to establish a global baseline configuration to manage object storage classes and perform related maintenance. Use of additional Lifecycle rules or programmatic control of storage classes is still encouraged.

Policy for S3 Intelligent Tiering & Standard Lifecycle Rule

1. All S3 buckets shall have S3 Intelligent Tiering applied as described in list item #2.

0. Objects in the Intelligent-Tiering storage class are handled in the following manner and the configuration is immutable:

0. Frequent Access – Objects that are uploaded or transitioned to S3 Intelligent-Tiering are automatically stored in the Frequent Access tier.

0. Infrequent Access – Objects that have not been accessed in 30 consecutive days move to the Infrequent Access tier.

0. Archive Instant Access – Objects that have not been accessed for 90 consecutive days are automatically moved to the Archive Instant Access tier.

0. Once an object is accessed it moves back to the Frequent Access Tier and the 30 and 90 day counts start over again.

0. Mission Owners may also designate the use of Archive Access and Deep Archive Access if desired and are encouraged to do so for data that is not planned to be accessed.

0. For missions desiring to transition objects to Glacier Instant Retrieval (GIR), Glacier Flexible Retrieval (GFR), or Glacier Deep Archive (GDA) less than 90 days after objects are created, they are approved to not implement the S3 Intelligent Tiering and instead implement a Lifecycle Rule to move objects to Glacier Instant Retrieval, Glacier Flexible Retrieval, or Glacier Deep Archive less than 90 days after objects are created.

2. If GIR, GFR, or GDA are used in lieu of S3 Intelligent Tiering on filtered set of a bucket, then an additional rule shall be configured to apply the S3 Intelligent Tiering to remainder of the bucket.

1. All S3 Buckets shall have a Lifecycle rule applied to cover the entire bucket. The rule will have the following configuration:

1. Lifecycle rule configuration

0. Lifecycle rule name: S3-IT_0-Day_and_Maintenance

0. Name must be exact

0. Choose a rule scope: Apply to all objects in the bucket

0. Acknowledge: (Checked)

1. Lifecycle rule actions

1. Move current versions of objects between storage classes: (Checked)

1. Delete expired object delete markers or incomplete multipart uploads: (Checked)

1. Transition current versions of objects between storage classes

2. Choose storage class transitions: Intelligent-Tiering

2. Days after object creation: 0

1. Delete expired object delete markers or incomplete multipart uploads

3. Delete expired object delete markers: (Checked)

3. Delete incomplete multipart uploads

3. Number of days: 7

2. The 7-day period can be reduced with mission owner concurrence.

1. These are minimum configuration requirements. Not implementing requires approval from DD/IPF.

image3.png image4.png image1.png image2.png

File details come from the government source that posted it. Updated .