Atch 2_PCSM Performance Work Statement_12 Dec 23 DRAFT.pdf

PERFORMANCE WORK STATEMENT (PWS)

FOR

PERSONNEL CLASSIFICATION & SELECTION METHOD (PCSM)

TEST OF BASIC AVIATION SKILLS (TBAS)

12 Dec 2023

DRAFT

1. BACKGROUND

The TBAS measures cognitive, multi-tasking, and psychomotor attributes predictive of success in Air Force pilot (including RPA), and personnel classification & training programs. A candidate’s Air Force Officer Qualifying Test (AFOQT) score and Federal Aviation Administration certified flying hours are combined with the TBAS measurements to formulate a PCSM score. Personnel Classification & Selection boards receive each candidate’s PCSM composite score on a percentile scale of 1 to 99. PCSM assists selection boards to select candidates most likely to successfully complete undergraduate pilot training & various personnel Programs such as RPA, Air Traffic Controllers, Enlisted RPA Pilot, Air Battle Manager, and Combat Systems Operator.

2. DESCRIPTION OF SERVICES

The contractor shall provide all labor, parts, and materials necessary to maintain the TBAS as defined in this PWS except for those items specified as Government furnished property (GFP).

This level of effort shall include, but is not limited to, TBAS systems maintenance and development, generation of monthly, quarterly, and yearly status reports, phone support, and operation of the PCSM database to include tracking, scoring, and updating individual PCSM scores. Customer Service Representative (CSR) requires a working knowledge of Microsoft Office (i.e. Microsoft Word, Excel, PowerPoint, Outlook, and Access) to accomplish many of the tasks mentioned above. To answer phone calls and receive daily tasking from the PCSM Program Office, the CSR must be present at the PCSM Program Office during normal duty hours (0730- 1630 Central Standard Time).

This is a non-personal services contract. The Government will not exercise any supervision or control over the contract service providers performing the services herein. Such contract service providers shall be accountable solely to the contractor who, in turn, is responsible to the Government.

2.1. Maintain (fix/replace) all TBAS hardware as necessary. A list of the hardware is specified in Appendix A-3

2.2. When a TBAS station becomes inoperable (i.e., a test cannot be conducted in accordance with (IAW) DAFMAN 36-2664, Attachment 3) due to hardware failure or malfunction, replacement equipment must be shipped within four business days after notification. Contractor receipt of phone call, e-mail, or other informal means of communication will count as notification.

2.2.1. When a TBAS is inoperable (as defined above), the Contractor shall be responsible for re-installation of TBAS software on the station, as needed. The TBAS software includes all software necessary for operating the TBAS station (e.g., operating system, test software).

2.2.2. Replacement equipment is considered Government Furnished Equipment (GFE); however, the Contractor is responsible for acquiring the GFE, including equipment necessary to fix/replace TBAS stations such as power supplies, hard drives, floppy drives, joysticks, etc.

2.2.3. The Contractor shall insure that all TBASs are consistent (i.e., the software installed on each TBAS is identical to that installed on all other TBAS). Refer to DAFMAN 36-2664, Attachment 3 to ensure testing is conducted under uniformed conditions.

2.3. The Contractor is responsible for maintaining the Government-owned TBAS source code.

2.3.1. The source code (version 1.2.33) is written in Visual Basic 6.0. The Contractor shall be responsible for porting the code to a common, currently supported language (i.e. VB.NET, Java, C++, etc.) as requested by Air Force Personnel Operations Agency (AFPOA) and Air Force Life Cycle Management Agency (AFLCMC) via Systems Change request if the code needs to be changed.

2.3.2. The Contractor is responsible for maintaining the Test Processing Station (TPS).

Maintenance includes, but is not limited to, rewriting the code to update the TPS.

2.4. The Contractor shall generate a monthly and quarterly report, submit to the Program Manager (PM), Contracting Officer Representative (COR), and the Contracting Officer (CO), of all software/hardware problems found with a negative reply required if no work was done, as well as all hardware maintenance performed. The Monthly Progress Reports are due the 7th workday after each month following reporting period. Monthly report shall include a trip report summary as required. The Quarterly Reports on software/hardware problems are due the 7th workday after the month following reporting period.

2.5. The Contractor shall generate an annual inventory of all equipment (serial numbers must be visually verified by site representatives.) and submit inventory to the COR annually, on the 7th workday after the month following reporting period. The Contractor shall also provide storage of TBAS equipment as directed by the Government.

2.6. The Contractor shall provide support in the following areas:

2.6.1. Dissemination of PCSM scores within one business day after receipt of all supporting test documents to the examinee via the PCSM website.

2.6.2. The PCSM website. If the contractor is unable to update the PCSM website due to circumstances beyond the contractor’s control (i.e., sudden Air Force policy changes, hardware failure), then the contractor has one business day after resumption of normal website operation to update PCSM scores to the website.

2.6.3. Develop a process approach for verifying data on the PCSM website. The process should support implementation of advanced algorithms, while reducing the potential for data errors.

The Contractor shall work with the PCSM Program office to ensure data error rates from the complex algorithms are minimized and verified data are available at the PCSM website. The advanced algorithms that contribute to calculating the PCSM scoring are complex and require a longer time to score.

2.6.4. Phone and/or email, if necessary. If phones/email are offline beyond the contractor’s control, then the contractor has one business day from the resumption of phone/email service to resume disseminating scores to the examinee.

2.6.5. Provide Help Desk/ Project Support as follows: manpower is needed to support test scoring and lower tier help desk of TBAS software and hardware by providing information, answering phones, updating new equipment into the database, troubleshooting, and problem resolution related to TBAS and PCSM via phone and email.

2.6.6. Address hardware problems (hardware replacements shall be shipped within 4 business days after Contractor receipt of site notification).

2.7. Calculating PCSM scores:

2.7.1. Ensure student test files are being scored by the Test Processing Station.

2.7.2. Ensure Air Force Officer Qualifying Test (AFOQT) scores are current IAW DAFMAN 36- 2664, Attachment 4.

2.7.3. Update student flight hours within one business day after receipt with supporting documentation.

2.7.4. Assist in providing technical data to use in building briefings for Pilot Selection Boards.

2.7.5. The contractor maintains and changes the PCSM website pages as required by PCSM Program Office, AFPC DS/DSYX. These changes could be due to content changes, office symbol, phone number and/or Air Force policy changes.

2.7.6. EPQT/AFOQT/TBAS Test Administration for Validation/Development Phases

2.7.6.1. Administration of Enlisted Personnel Qualification Test (EPQT) AFOQT/TBAS) in Proctored Testing Sessions for Initial/Post Validation phases: The contractor shall proctor two testing sessions each week at the Air Force Applied Performance Assessment (APAT) Center located on Lackland AFB, TX The tests will be administered to enlisted members for validation in two weekly sessions: one session on Thursdays and one session on Saturdays. One proctor is required for the Thursday session and two proctors for the Saturday session.

Examinee Population

Length of Test Administration

Scheduled Time Approximate Number of Examinees

Number of

Proctors Required

Technical Trainees

Up to 6 hours including prep

Thursdays 1230-1630 Approximately 10-40

Basic Military Trainees

Up to 6 hours including prep

Sundays 1230-1630 Note. Examinees scheduled to transit at 1230 (arrive at APAT by 1300) and complete 2.5 hours of testing. If examinees arrive late, testing start time may be delayed until 1400.

Approximately 80-110

2.7.6.2. The contractor will ensure all proctors understand the procedures for standardized testing on the TBAS system and follow the TBAS EPQT test administration manuals provided. Proctors will arrive in a timely manner, maintain test security, manage the testing group of trainees, properly administer the test, and collect and safeguard all test materials and hardware. Proctors will annotate any anomalies likely to impact an examinee’s test results, such as an examinee falling asleep, leaving the testing room early, etc.

2.7.6.3. Track and Transfer all Test Administration Data: The contractor will safeguard all examinee test materials, download, and safeguard all test results from TBAS. The contractor shall ensure all test data is properly identified and then transfer the materials to AFPC/DSYX. The contractor will ensure test booklets are available; copies made as appropriate and process the data on a weekly basis.

2.7.6.4. EPQT/AFOQT/TBAS Administration for Initial Validation Phase —The MyVote LCD System (receiver, keypads, and software) and B-Alert EEG system and equipment is used to support test validation at the APAT Center. Basic Military Trainees and Technical Trainees at the APAT will use the MyVote LCD System to provide trackable, real-time data on applicant reactions to test content, including feedback during the test administration itself. The B-Alert EEG system will be administered to Basic Military Trainees and Technical Trainees at APAT for construct validation of the Self-Description Inventory subtest of the EPQT as an indicator of stress tolerance and other factors affecting pilot performance.

3. SERVICE SUMMARY

Performance

Objective (PO)

PWS

Paragraph

Performance Threshold

Method/Frequency

PO-1 Contractor fixed or replaced TBAS test station

2.1

99% ready before class start dates

Periodic

Inspection/Monthly

PO-2 Contractor maintains TBAS source code documentation

2.3 99% of the time

PO-3 Contractor shipped replacement equipment within 4 business days

2.2

PO-4 Contractor calculated PCSM scores and made them available on the PCSM Website within 1 business day

2.6.1 and 2.7

PO-5 Contractor updated flight hours within 1 business day after receipt

2.7.3

PO-6 Contractor maintains TPS

2.3.2 95% of the time

Periodic Inspection/Monthly

PO-7 Contractor shall generate a quarterly report of software/hardware problems detailing maintenance performed

2.4 95% of the time

Inspection/Quarterly

PO-8 Contractor shall maintain TBAS inventory list and conduct annual inventory of all equipment

2.5 95% of the time

Inspection/Annually

4. GOVERNMENT FURNISHED PROPERTY, EQUIPMENT

4.1. Facilities. Work will be accomplished at contractor facility. In the event that offsite government network access is down, the government will provide office space, which will include a desk, chair, telephone with answering machine capability.

4.2. Equipment. The government will provide laptop equipment to the contractor with Virtual Private Network (VPN) network access to an AF Network domain to run the PCSM/TBAS program at the contractor facility.

4.3 Property. The government will provide equipment listed in Appendix A-3. The contractor will provide sustainment and replacement parts for the equipment listed in Appendix A-3 for the TBAS system.

5. GENERAL INFORMATION

5.1 Quality Control. The contractor shall be responsible for establishing, implementing, and maintaining a current Quality Control Plan (QCP). The contractor shall develop a QCP that identifies, prevents, and corrects any deficiencies for all services (including all Performance Objectives and deliverables) set forth in this PWS and shall assure the requirements of this contract are provided as specified. The QCP must illustrate proposed method(s) of inspection, and actions to be taken to correct deficiencies discovered during the inspection process. Contractor shall submit their QCP to the CO as part of the technical proposal for evaluation and acceptance, prior to contract award. The contractor’s QCP will identify the standards, processes, procedures, and checklists for all tasks performed. The plan shall become a compliance document after acceptance by the CO upon contract award. The contractor shall monitor quality processes and perform technical audits and reviews in accordance with the QCP to verify adherence to organizational standards, processes, and procedures. Changes to the QCP during contract performance shall be submitted to the CO for acceptance not later than 10 business days prior to implementation. The Contractor shall establish and provide a qualified workforce capable of performing the required tasks. The Contractor shall monitor work performance, measure results, ensure delivery of contracted product deliverables and solutions, support management and decision-making and facilitate communications. The Contractor shall ensure that instances of misinformation or inaccurate answers identified by the Government (via evaluation or customer feedback) are addressed. Upon being notified of an instance of misinformation or an inaccurate answer provided to a customer, the Contractor shall have 5 business days to submit a Misinformation Report to both the COR and the Contracting Officer detailing the actions taken to correct the cause and provide the correct answer to the customer.

The Contractor's quality inspection documentation (i.e., metrics, reports, etc.) shall be made available to the COR or CO within two (2) business days after request, if requested. The reports should provide information on the methods of inspection, what was inspected, discrepancies found, and actions taken to correct and preclude recurrence.

5.2. Quality Assurance (QA). The government shall evaluate the contractor’s performance under this contract in accordance with the Quality Assurance Surveillance Plan (QASP). This plan is primarily focused on what the government must do to ensure that the contractor has performed in accordance with the performance standards. It defines how the performance standards will be applied, the frequency of surveillance, and the minimum acceptable defect rate(s).

5.3. Contract Holidays. The prices/costs in Section B of the contract include holiday observances;

accordingly, the Government will not be billed for such holidays, except when services are required by the Government and are actually performed on a holiday.

The following days are contract holidays:

New Years Day Martin Luther King Day President's Day Memorial Day Independence Day Labor Day Columbus Day Veteran's Day Thanksgiving Day Christmas Day

In addition to the days designated as holidays, the Government observes the following days:

Any other day designated by Federal Statute Any other day designated by Executive Order

5.4. Hours of Operation: The contractor is responsible for conducting business, between the hours of 7:30 a.m. and 4:30p.m. Central Standard Time, Monday through Friday, except Federal holidays or when the government facilities are closed due to local or national emergencies, administrative closings, or similar government directed facility closings.

5.5. Place of Performance: The work to be performed under this contract will be performed at the contractor’s facility.

5.6. Contracting Officer Representative (COR). The COR will be identified by separate letter.

The COR monitors all technical aspects of the contract and assists in contract administration The COR is authorized to perform the following functions: assure that the contractor performs the technical requirements of the contract: perform inspections necessary in connection with contract performance: maintain written and oral communications with the contractor concerning technical aspects of the contract: issue written interpretations of technical requirements, including government drawings, designs, specifications: monitor contractor's performance and notifies both the CO and contractor of any deficiencies; coordinate availability of government furnished property, and provide site entry of Contractor personnel. A letter of designation issued to the COR, a copy of which is sent to the contractor, states the responsibilities and limitations of the COR, especially with regard to changes in cost or price, estimates or changes in delivery dates. The COR is not authorized to change any of the terms and conditions of the resulting order

5.7. Data Rights: The government has unlimited rights to all documents/material produced under this contract. All documents and materials, to include the source codes of any software, produced under this contract shall be government owned and are the property of the government with all rights and privileges of ownership/copyright belonging exclusively to the government.

Specifically, the government owned TBAS source code version 1.2.33 written in Visual Basic 6.0.

These documents and materials may not be used or sold by the contractor without written permission from the CO. All materials supplied to the government shall be the sole property of the government and may not be used for any other purpose. This right does not abrogate any other government rights.

5.8. Performance of Services during Crisis. IAW DoDI 1100.22, DFARS 237.76 “Continuation of Essential Contractor Services” and aforementioned Air Force implementation, unless otherwise directed by an authorized government representative, it is determined that services as identified in this PWS are NOT essential for performance during a crisis. In the event of an unforeseen natural or military crisis, i.e., hurricane, insurrection, etc., the contractor’s primary responsibility is to safeguard its personnel and secure any equipment.

5.9. Contract Transition. During the mobilization and transition period, the current PCSM Contractor will retain all contractual responsibilities. The purpose of this period is to allow a “burn-in” time for the new Contractor personnel to familiarize themselves with current PCSM processes and see potential PCSM issues prior to actually assuming the responsibilities described above.

5.9.1. Phase-In. The contractor shall have access to the incumbent operations on a non-interference basis NLT 30 days prior to contract start. Instructional training, if required, will be provided by the Government/incumbent.

5.9.2. Phase-Out. The incumbent shall provide the successor reasonable access to the site, equipment, and all technical documentation and publications during the incumbent’s Phase-Out period. The contractor shall provide the next follow-on contractor training IAW this contract commencing up to 30 days prior to this contract’s completion date.

5.10. Travel. The Contractor is required to travel as requested by the contracting officer representative (COR) with final approval from contracting officer to fix/replace, set up or retrieve PCSM equipment at a test station. Travel will be in accordance with the Joint Travel Regulations (JTR) and will be reimbursed to the contractor. Trip summary will be noted in monthly report.

5.11. Training. Training may be required as directed by the Government. Government directed training will be paid for by the Government.

5.12. Contractor Management Reporting (CMR). Contractor Management Reporting (CMR). The contractor shall report ALL contractor labor hours (including subcontractor labor hours) required for performance of services provided under this contract for the Air Force via a secure data collection site. The contractor is required to completely fill in all required data fields at http://www.ecmra.mil http://www.ecmra.mil/

5.12.1. Reporting inputs will be for the labor executed during the period of performance for each Government Fiscal Year (FY), which runs 1 October through 30 September. While inputs may be reported any time during the FY, all data shall be reported no later than 31 October of each calendar year. Contractors may direct questions to the CMRA help desk.

5.12.2. While inputs may be reported any time during the FY, all data shall be reported no later than 31 October of each calendar year. Contractors may direct questions to the CMRA help desk.

5.12.3. Uses and Safeguarding of Information. Information from the secure web site is considered proprietary in nature when the contract number and contractor identity are associated with the direct labor hours and direct labor dollars. At no time will any data be released to the public with the contractor name and contract number associated with the data

5.12.4. User Manuals. Data for Air Force service requirements must be input at the Air Force CMRA link. However, user manuals for government personnel and contractors are available at the Army CMRA link at http://www.ecmra.mil

5.13. Records, Files, and Documents. All physical records, files, documents, and work papers, provided and/or generated by the Government and/or generated for the Government in performance of this PWS, maintained by the contractor which are to be transferred or released to the Government or successor contractor, shall become and remain Government property and shall be maintained and disposed of IAW AFMAN 33-363, Management of Records; AFI 33-364, Records Disposition – Procedures and Responsibilities; the Federal Acquisition Regulation, and/or the Defense Federal Acquisition Regulation Supplement, as applicable. Nothing in this section alters the rights of the Government or the contractor with respect to patents, data rights, copyrights, or any other intellectual property or proprietary information as set forth in any other part of this PWS or the Application Services contract of which this PWS is a part (including all clauses that are or shall be included or incorporated by reference into that contract).

5.14. Risk Management Framework: DoD has mandated the transition from the current DoD Information Assurance Certification and Accreditation Program (DIACAP) C&A process to the Risk Management Framework (RMF) A&A process based on National Institute of Standards and Technology (NIST) Special Publication (SP) 800-37, Rev 1, Guide for Applying the Risk Management Framework to Federal Information Systems, and NIST SP 800-53 Rev 4, Security and Privacy Controls for Federal Information Systems and Organizations (NIST Publications:

www.CSRC.NIST.gov/publications), or most current version. The AF is complying and has implemented the change in accordance with the DoD identified 1 Oct 2016 date for this transition to take full effect. Therefore, there will be a period where both the DIACAP C&A and RMF A&A processes will be required during the transition period from the DIACAP C&A and RMF A&A processes. PCSM/TBAS has Project Management Office support through the government, which will work this RMF Process. Contractor shall provide Subject Matter Expertise as needed to assist with government led accreditation and cloud migration activities.

http://www.csrc.nist.gov/publications

6. SECURITY REQUIREMENTS

6.1. Security Agreement (SA). The contractor shall enter into a security agreement if service performance is on base. This agreement shall outline how the contractor integrates security requirements for service operations with the Air Force to ensure effective and economical operation on the installation. The agreement shall include:

a. Security support provided by the Air Force to the contractor shall include storage containers for classified information/material, use of base destruction facilities, classified reproduction facilities, use of base classified mail services, investigation of security incidents, and the use of security forms and conducting inspections required by DoDM 5220.32 Vol 1, National Industrial Security Program: Industrial Security Procedures for Government Activities, Air Force Policy Directive 16-14, Security Enterprise Governance, and Air Force Manual 16- 1406, National Industrial Security Program: Industrial Security Procedures for Government Activities.

b. Security support requiring joint Air Force and contractor coordination includes packaging classified information, mailing and receiving classified materials, implementing emergency procedures for protection of classified information, security checks and internal security controls for protection of classified material and high-value pilferable property.

c. On base, the long-term installation security agreement may take the place of a Standard Practice Procedure (SPP).

6.2. Obtaining and Retrieving Identification Media.

a. DoD Common Access Card (CAC), (AFI 36-3026 Vol 2, Common Access Card), used for contracts for more than six months and requirement exists for access to the government computer systems and software. CAC applications are accomplished by Mission Partner Affiliation Sponsor (MPAS) via the Mission Partner Identity, Credential and Access Management (MP

ICAM).

6.3. Security Clearance Requirements. The contractor must possess or obtain an appropriate facility security clearance, (Secret,) prior to performing work on a classified government contract. If the contractor does not possess a facility clearance the government will request one.

The government assumes costs and conducts investigations for Top Secret, Secret, and Confidential facility security clearances. The contractor shall request personnel security clearances, at the company’s expense, for employees requiring access to classified information within 15 days after receiving a facility clearance or, if the contractor is already cleared, within 15 days after service award. Due to costs involved with security investigations, requests for personnel security clearances shall be kept to the minimum amount employees required to perform contract requirements.

6.4. List of Employees. The contractor shall maintain a current list of employees. The list shall include employee's name, social security number, and level of security clearance. The list shall be validated and signed by the company Facility Security Officer (FSO) and provided to the contracting officer and Information Protection Office (IP Office) at each performance site 30 days prior to the service start date. Updated listings shall be provided when an employee's status or information changes. A Visit Request for all employees with a security clearance is required to be sent through the Defense Information System for Security (DISS) or successor system, and must be updated at least annually. The contractor shall notify the Information Protection Office at each operating location 30 days before on-base performance of the service. The notification shall include:

a. Name, address, and telephone number of company key management representatives.

b. The contract number and contracting agency.

c. The highest level of classified information to which employees require access.

d. The location(s) of service performance and future performance, if known.

e. The date service performance begins.

f. Any change to information previously provided under this paragraph.

6.5. Suitability Investigations. Contractor personnel not requiring access to classified shall successfully complete, as a minimum, a Tier 1 (T1) investigation, before operating government furnished workstations. The contractor shall comply with the DoDM 5200.02, Procedures for the Department of Defense Personnel Security Program and AFI 17-130, Cybersecurity Program Management, requirements. T1 investigation requests are initiated using the Standard Form (SF) 85 and are submitted to the installation Information Protection Office through the using agency’s Security Assistant (SA). T1 investigations are different from the Wants and Warrants checks and are provided by the government at no additional cost to the contractor.

For contracts requiring IT-Level I and II access with no access to classified material, the contractor shall complete a Tier 5 (T5) or Tier 3 (T3) investigations, respectively. These investigations are submitted using the SF 86 and are submitted to the Information Protection Office through the using agency Unit Security Assistant within five calendar days after contract start. These investigations are provided by the government at no additional cost to the contractor.

6.6. Security Monitor Appointment. The contractor shall appoint a security representative for the on base long term visitor group. The security representative may be a full-time position or an additional duty position. The security representative shall work with the host organization to provide employees with training required by DoDM 5200.01, Information Security Program, AFPD 16-14, Security Enterprise Governance, and AFI 16-1404, Air Force Information Security Program. The contractor shall provide initial and follow-on training to contractor personnel who work in Air Force controlled/restricted areas. Air Force restricted and controlled areas are explained in AFI 31-101, Integrated Defense.

6.7. Additional Security Requirements. In accordance with DoDM 5200.01, Information Security Program and AFMAN 16-1404, the contractor shall comply with local communications squadron policy. The contractor shall comply with AFSSI 7700, Emission Security (EMSEC) Program; applicable AFKAGs, AFIs, and AFSSIs for Communication Security (COMSEC); and AFI 10-701, Operations Security (OPSEC) Instructions. The contractor will comply with DoD Standard 22/Force Protection Condition Measures, DoD Standard 25/Level I-AT Awareness Training, and associated tasking contained in DAFI 31-145-0, Antiterrorism (AT) standards.

Level I AT Awareness training is available for contractor personnel and can be requested by calling 210 652-8298 or by visiting Bldg 205 Room 13.

6.8. Freedom of Information Act Program (FOIA). The contractor shall comply with DoD Manual 5400.07_AFMAN33-302, DoD Freedom of Information Act Program, requirements.

6.9. Reporting Requirements. The contractor shall comply with AFI 71-101, Volume- 1, Criminal Investigations, and Volume-4, Counterintelligence, requirements, as referenced in AFMAN 16-1406, para 2.2.e.

6.10. Physical Security. Areas controlled by contractor employees shall comply with AFI 31-

6.11. Operating Instructions. For controlled areas used exclusively by the contractor, the contractor shall develop an Operating Instruction (OI) for internal circulation control, protection of resources and to regulate entry into Air Force controlled areas during normal, simulated and actual emergency operations. The OI shall be written in accordance with AFI 31-101, and coordinated through the Information Protection (IP) office.

6.12. Lock Combinations. The contractor shall comply with DoDM 5200.01, Vol 3 security requirements for changing combinations to storage containers used to maintain classified materials.

6.13. Controlled Unclassified Information (CUI). The contractor shall comply with DoD Instruction 5200.48, DoD Controlled Unclassified Information (CUI), requirements.

7. Appendices:

A-1: Definitions & Acronyms A-2: Applicable Publications A-3: List of TBAS Equipment A-4: List of TBAS Locations A-5: Deliverables Schedule

APPENDIX A-1

DEFINITIONS & ACRONYMS

Definitions and Acronyms:

Contractor. A supplier or vendor awarded a contract to provide specific supplies or service to the government. The term used in this contract refers to the prime.

Contracting Officer. A person with authority to enter into, administer, and or terminate contracts, and make related determinations and findings on behalf of the government. Note: The only individual who can legally bind the government.

Contracting Officer’s Representative (COR). An employee of the U.S. Government appointed by the CO to administer the contract. Such appointment shall be in writing and shall state the scope of authority and limitations. This individual has authority to provide technical direction to the contractor as long as that direction is within the scope of the contract, does not constitute a change, and has no funding implications. This individual does NOT have authority to change the terms and conditions of the contract.

Defective Service. A service output that does not meet the standard of performance associated with the Performance Work Statement.

Deliverable. Anything that can be physically delivered, but may include non-manufactured things such as meeting minutes or reports.

Key Personnel. Contractor personnel that are evaluated in a source selection process and that may be required to be used in the performance of a contract by the Key Personnel listed in the PWS.

When key personnel are used as an evaluation factor in best value procurement, an offer can be rejected if it does not have a firm commitment from the persons that are listed in the proposal.

Physical Security. Actions that prevent the loss or damage of government property.

Quality Assurance. The government procedures to verify that services being performed by the Contractor are performed according to acceptable standards.

Quality Assurance Surveillance Plan (QASP). An organized written document specifying the surveillance methodology to be used for surveillance of contractor performance.

Quality Control. All necessary measures taken by the contractor to assure that the quality of an end product or service shall meet contract requirements.

Subcontractor. One that enters into a contract with a prime contractor. The government does not have privity of contract with the subcontractor.

Work Day. The number of hours per day the contractor provides services in accordance with the contract.

Work Week. Monday through Friday, unless specified otherwise.

Acronyms:

ACOR Alternate Contracting Officer's Representative AFARS Army Federal Acquisition Regulation Supplement AFOQT Air Force Officer Qualifying Test AFPOA Air Force Personnel Operations Agency AFPC Air Force Personnel Center AR Army Regulation ATT Application Transition Tool C&A Certification & Accreditation CCE Contracting Center of Excellence CFR Code of Federal Regulations CONUS Continental United States (excludes Alaska and Hawaii) COR Contracting Officer Representative COTR Contracting Officer's Technical Representative COTS Commercial-Off-the-Shelf CSR Customer Service Representative DA Department of the Army DD250 Department of Defense Form 250 (Receiving Report) DD254 Department of Defense Contract Security Requirement List DFARS Defense Federal Acquisition Regulation Supplement DMDC Defense Manpower Data Center DOD Department of Defense EPQT Enlisted Pilot Qualification Test eMASS Enterprise Mission Assurance Support Service FAR Federal Acquisition Regulation HIPAA Health Insurance Portability and Accountability Act of 1996 IATT Interim Authority to Test KO/CO Contracting Officer OCI Organizational Conflict of Interest OCONUS Outside Continental United States (includes Alaska and Hawaii)

ODC Other Direct Costs PIPO Phase In/Phase Out POC Point of Contact PRS Performance Requirements Summary PWS Performance Work Statement PCSM Personnel Classification & Selection Method QA Quality Assurance QAP Quality Assurance Program QASP Quality Assurance Surveillance Plan QC Quality Control QCP Quality Control Program RMF Risk Management Framework RPA Remotely Piloted Aircraft TBAS Test of Basic Aviation Skills TE Technical Exhibit TPS Test Processing Station

APPENDIX A-2

APPLICABLE PUBLICATIONS

Applicable Publications (Current Editions):

The contractor must abide by all applicable regulations, publications, manuals, and local policies and procedures.

PUB NO. TITLE Date Change

SYSTEMS ENGINEERING

Industry Best Practices in Achieving Service Oriented Architecture

(SOA)

Industry Best Practices in Achieving Service Oriented Architecture (SOA) http://www.sei.cmu.edu/library/assets/soabest.pdf

Reference: All areas of the website available for review.

N/A

Federal Desktop Core Configuration (FDCC)

Federal Desktop Core Configuration (FDCC) https://usgcb.nist.gov/

Reference: Microsoft Content section located on the left margin navigation menu of the website.

This section contains links to Windows Operating System, Windows Firewall and Internet Explorer 7 and 8 configuration information

N/A

INFORMATION ASSURANCE

DoDI 8500.01 Cybersecurity http://www.esd.whs.mil/Portals/54/Documents/DD /issuances/dodi/850001_2014.pdf

Reference: Pages 27 – 51.

14 Mar 2014

DoDI 8510.01 Risk Management Framework (RMF) For DOD Information Technology (IT) http://www.esd.whs.mil/Portals/54/Documents/DD /issuances/dodi/851001_2014.pdf

Reference: Page 26-38.

12 Mar 2014

AFI 17-130.

Air Force Cybersecurity Program Management http://static.e-publishing.af. mil/ production/1/saf_cio_a6/ publication/afi17- 130/afi33-200.pdf

16 Feb 2016 http://www.sei.cmu.edu/library/assets/soabest.pdf https://usgcb.nist.gov/ http://www.esd.whs.mil/Portals/54/Documents/DD/issuances/dodi/850001_2014.pdf http://www.esd.whs.mil/Portals/54/Documents/DD/issuances/dodi/850001_2014.pdf http://www.esd.whs.mil/Portals/54/Documents/DD/issuances/dodi/851001_2014.pdf http://www.esd.whs.mil/Portals/54/Documents/DD/issuances/dodi/851001_2014.pdf

Reference: Para 1.1.1. – 1.1.2.5., 4.2.4 – 4.2.4.5., 4.2.5.2., 4.3.1.12, 4.3.4.1. – 4.3.5.3. 4.3.6.

Security Technical Implementation Guides (STIGs)

Security Technical Implementation Guides (STIGs) https://iase.disa.mil/stigs/Pages/index.aspx

Reference: STIGs Master List Link on left navigation menu of Information Assurance Support Environment (IASE) website

N/A

DoDI 8520.02 Public Key Infrastructure (PKI) and Public Key (PK) Enabling http://www.esd.whs.mil/Portals/54/Documents/DD /issuances/dodi/852002p.pdf

Reference: Pages 14 - 19

24 May 2011

Public Law 111-383 http://www.gpo.gov/fdsys/pk g/P LAW-11publ383/pdf/ PLAW -111publ383.pdf

7 Jan 2011

Database Management System

Database Management System https://iase.disa.mil/stigs/app-security/Pages/ index .aspx

Reference: STIGs Master List Link on left navigation menu of Information Assurance Support Environment (IASE) website then select Database link.

N/A

INFORMATION TECHNOLOGY STANDARDS

Federal Information Processing Standards

(FIPS)

Federal Information Processing Standards (FIPS) https://www.nist.gov/itl/popular-links/federal-information-processing-standards-fips

Reference: On the NIST home Page under ITL Publications section click on Federal Information Processing Standards (FIPS) link view FIPS guidance. Applicable guidance links are FIPS Listed By Number and FIPS Changes and Announcements (the entirety of these to sections)

N/A

National Institute for Standards and Technology (NIST)

National Institute for Standards and Technology

(NIST)

https://www.nist.gov/topics/information-technology

N/A https://iase.disa.mil/stigs/Pages/index.aspx https://iase.disa.mil/stigs/app-security/Pages/ https://www.nist.gov/itl/popular-links/federal-information-processing-standards-fips https://www.nist.gov/itl/popular-links/federal-information-processing-standards-fips https://www.nist.gov/topics/information-technology https://www.nist.gov/topics/information-technology

Reference: This website news and information content is available for visitors to the site. No particular section, link, etc. is mandated…just topical news and information for system administrators, developers, etc.

National Security Agency/The Common Criteria Evaluation/ NIST and Validation Scheme

National Security Agency/The Common Criteria Evaluation/ NIST and Validation Scheme http://www.niap-ccevs.org/

Reference: US Government section under Focus Areas on the website Home page. In the US Government section the following links apply/available for reference/guidance: About us, Products, Protection Profiles Policies that Influence Adherence to Common Criteria and Common Criteria Portal

N/A

QUALITY ASSURANCE

AFPD 33-3 Information Management http://static.e-publishing. af.mil/production/1/ saf_ cio_a6/publication/afpd33-3/afpd33-3.pdf

Reference: Para 2.4.5.

8 Sep 2011

PERSONNEL ASSESSMENT PROGRAM

DAFMAN 36-2664 Personnel Assessment Program

Reference: Para A2.1 and A3.1 https://static.e-publishing.af.mil/production/1/af_a1/publication/a fman36-2664/afman36-2664.pdf

18 Jan 2023 http://www.niap-ccevs.org/

APPENDIX A-3

List of TBAS Equipment

A.1 TBAS TEST STATIONS

There are 170 TBAS test stations covered by this effort. The configuration of the test stations is provided below:

a) Dell OptiPlex GX520 System, Intel Pentium 4, 3.20 GHz processor, 1GB RAM

b) 17" LCS Samsung Syncmaster 740N Color Monitor (1024x768)

c) Dell Optical Mouse

d) Hotas Cougar Flight Stick

e) ProPedals rudder pedals

f) Dell Keyboard with card reader

g) USB External Floppy Drive

h) TBAS Operators Manual

i) Specially designed Carrel / Desk Unit

j) Stanley Pro Strip Surge Protector

k) Cyber Acoustics (ACM940) headset

l) Chair – no rollers

A.2 TBAS Carrels (Desk Unit)

Each fielded TBAS unit will be housed within a carrel. Each structure is approximately 39"x34"x45" (LxWxH) and weighs 150 pounds with all components installed, 100 pounds empty.

The contractor will maintain spare parts for twenty TBAS systems, including carrels.

A.3 TBAS TESTS

TBAS test software (Version 1.2.33 including 10 subtests). The TBAS software is written in Visual Basic 6.0. The Test Processing Station software is written in Microsoft Visual Basic.Net. The data is maintained in a SQL 2000 database.

APPENDIX A-4

List of TBAS Locations/ Organization Location TCO # Unit Type

ALASKA

AFROTC DET 001 Anchorage 5001 ROTC

ALABAMA

42 MSS/DPMP Maxwell 1006 Active Duty Base AFROTC DET 005 Auburn 5005 ROTC AFROTC DET 010 Tuscaloosa 5010 ROTC

ARKANSAS

AFROTC DET 030 Fayetteville 5030 ROTC

ARIZONA

355 FSS/FSDE Davis-Monthan 1285 Active Duty Base 56 MSS/FSDE Luke 1530 Active Duty Base AFROTC DET 028 Prescott 5028 ROTC

CALIFORNIA

30 FSS/FSDE Vandenberg 1050 Active Duty Base 412 FSS/FSDE Edwards 1295 Active Duty Base 61 FSS/FSDE Los Angles 1620 Active Duty Base 60 FSS/FSDEW Travis 1775 Active Duty Base AFROTC DET 045 San Jose 5045 ROTC AFROTC DET 075 San Diego 5075 ROTC AFROTC DET 088 Sacramento 5088 ROTC

COLORADO

10 FSS/FSDE USAF Academy 1001 Active Duty Base

DELAWARE

436 FSS/FSDE Dover 1290 Active Duty Base

FLORIDA

96 FSS/FSMPO Eglin 1305 Active Duty Base 325 FSS/FSDET Tyndall 1780 Active Duty Base AFROTC DET 145 Tallahassee 5145 ROTC AFROTC DET 150 Gainesville 5150 ROTC AFROTC DET 155 Coral Gables 5155 ROTC AFROTC DET 157 Daytona Beach 5157 ROTC AFROTC DET 158 Tampa 5158 ROTC AFROTC DET 159 Orlando 5159 ROTC

GEORGIA

23 FSS/FSDE Moody 1580 Active Duty Base 78 FSS/FSMPD Robins 1700 Active Duty Base AFROTC DET 160 Athens 5160 ROTC AFROTC DET 165 Atlanta 5165 ROTC

GERMANY

86 FSS/DPMPT Ramstein AB 7320 Overseas Sites

GUAM

36 MSS/DPMPE Anderson 7005 Overseas Sites

HAWAII

AFROTC DET 175 Honolulu 5175 ROTC

IOWA

AFROTC DET 250 Ames 5250 ROTC AFROTC DET 255 Iowa City 5255 ROTC

IDAHO

366 FSS/FSDE Mountain Home 1585 Active Duty Base

ILLINOIS

375 FSS/FSDE Scott 1720 Active Duty Base AFROTC DET 190 Champaign 5190 ROTC

INDIANA

AFROTC DET 218 Terre Haute 5218 ROTC AFROTC DET 220 West Lafayette 5220 ROTC AFROTC DET 225 Notre Dame 5225 ROTC

ITALY

31 FSS Aviano 7055 Overseas Sites

JAPAN

374 FSS/FSDE Yokota AB 7410 Overseas Sites

KANSAS

22 FSS/FSDE McConnell 1830 Active Duty Base

KENTUCKY

AFROTC DET 295 Louisville 5295 ROTC

LOUISIANA

2 FSS/FSDET Barksdale 1200 Active Duty Base

AFROTC DET 310 Baton Rouge 5310 ROTC

MASSACHUSETTS

66 FSS/FSDE Hanscom 1510 Active Duty Base

MARYLAND

11 FSS/FSDEMT Andrews 1185 Active Duty Base

MICHIGAN

AFROTC DET 380 East Lansing 5380 ROTC AFROTC DET 400 Houghton 5400 ROTC

MINNESOTA

133 FSS/FSD St Paul 2715 Air National Guard AFROTC DET 415 Minneapolis 5415 ROTC AFROTD DET 420 Duluth 5420 ROTC

MISSOURI

509 FSS/FSDE Whiteman 1725 Active Duty Base

MISSISSIPPI

14 FSS/FSWPM Columbus 1265 Active Duty Base 81 FSS/FSD Keesler 1465 Active Duty Base

MONTANA

341 FSS/FSDE Malmstrom 1390 Active Duty Base AFROTC DET 450 Bozeman 5450 ROTC

NORTH CAROLINA

43 FSS/FSDE Pope 1675 Active Duty Base AFROTC DET 590 Chapel Hill 5590 ROTC

NORTH DAKOTA

319 FSS/FSDE Grand Forks 1065 Active Duty Base 5 FSS/FSDET Minot 1790 Active Duty Base

NEBRASKA

55 FSS/FSDE Offutt 1615 Active Duty Base

NEW JERSEY

87 FSS/FSMPD McGuire 1570 Active Duty Base

NEW MEXICO

49 FSS/FSDET Holloman 1435 Active Duty Base 377 FSS/FSDEO Kirtland 1480 Active Duty Base

NEVADA

99 FSS/FSMPD Nellis 1595 Active Duty Base

NEW YORK

AFROTC DET 538 Rochester 5538 ROTC AFROTC DET 550 Troy 5550 ROTC AFROTC DET 560 Riverdale 5560 ROTC

OHIO

88 FSS/FSDEE Wright-Patt. 1850 Active Duty Base AFROTC DET 630 Kent 5630 ROTC AFROTC DET 645 Columbus 5645 ROTC

OKLAHOMA

72 FSS/FSMPD Tinker AFB 1770 Active Duty Base AFROTC DET 670 Stillwater 5670 ROTC AFROTC DET 675 Norman 5675 ROTC

OREGON

AFROTC DET 685 Corvallis 5685 ROTC

PENNSYLVANIA

AFROTC DET 720 University Park 5720 ROTC AFROTC DET 730 Pittsburgh 5730 ROTC

PUERTO RICO

156 MSF/DPAR Carolina 2016 Air National Guard

SOUTH CAROLINA

628 FSS/FSDE JB Charleston 1255 Active Duty Base 20 FSS/FSDE Shaw 1740 Active Duty Base AFROTC DET 770 Clemson 5770 ROTC

SOUTH DAKOTA

28 FSS/FSDE Ellsworth AFB 1325 Active Duty Base AFROTC DET 780 Brookings 5780 ROTC

TENNESSEE

AFROTC DET 785 Memphis 5785 ROTC AFROTC DET 790 Nashville 5790 ROTC AFROTC DET 800 Knoxville 5800 ROTC

TEXAS

7 FSS/DPMPE Dyess AFB 1010 Active Duty Base 17 FSS/FSDE Goodfellow 1385 Active Duty Base 37 MSS/DPMPE-3 Lackland 1485 Active Duty Base 82 FSS/FSDE Sheppard 1745 Active Duty Base AFROTC DET 003 Houston 5003 ROTC

AFROTC DET 805 College Station 5805 ROTC AFROTC DET 820 Lubbock 5820 ROTC AFROTC DET 835 Denton 5835 ROTC RRGP Services, Inc San Antonio 9999 Contractor Site Lackland Lab Lackland 8500 Test Center

ENGLAND

100 FSS/FSMP RAF Mildenhall 7280 Overseas Sites

UTAH

75 FSS/FSDE Hill 1430 Active Duty Base AFROTC DET 850 Salt Lake City 5850 ROTC AFROTC DET 855 Provo 5855 ROTC

VIRGINIA

1 FSS/FSMPD Langley AFB 1490 Active Duty Base AFROTC DET 880 Lexington 5880 ROTC AFROTC DET890 Charlottesville 5890 ROTC

WASHINGTON

92 FSS/FSDE Fairchild 1330 Active Duty Base 62 FSS/FSDE McChord 1560 Active Duty Base AFROTC DET 905 Pullman 5905 ROTC

WISCONSIN

128 ARW/FSD Milwaukee 2575 Air National Guard AFROTC DET 925 Madison 5925 ROTC

WYOMING

130th Airlift Wing Charleston 2110 Air National Guard 90 FSS/FSDE F.E. Warren 1375 Active Duty Base

APPENDIX A-5

DELIVERABLES SCHEDULE

Deliverable Frequency # of Copies Medium/Format Submit To Monthly Progress Reports, PWS paragraph 2.4

7th Workday after each Month following reporting period

1 Microsoft Word or Adobe pdf document/ Electronically

COR

Quarterly Report of software/hardware problems. Negative reply required/ PWS 2.4

Quarterly on the 7th workday after month following reporting period

1 Microsoft Word or Adobe pdf document/ Electronically

PM,COR,CO

Annual Inventory Report of all equipment with serial numbers by location, PWS 2.5

Annual on the 7th workday after the month following reporting period

1 Microsoft Word or Adobe pdf document/ Electronically

PM, COR, CO

Contractor’s Quality Inspection Documentation, PWS paragraph 5.1

The Contractor's quality inspection documentation (i.e., metrics, reports, etc.)

shall be made available to the COR or CO within two (2) business days after request, if requested.

Microsoft Word or Adobe pdf document

COR and/or Contracting Officer

2.5. The Contractor shall generate an annual inventory of all equipment (serial numbers must be visually verified by site representatives.) and submit inventory to the COR annually, on the 7th workday after the month following reporting period. The Co...