FY23_DLI_ALEC_PWS-Draft_20230217_DLI-clean-ver.docx

Defense Language Institute Foreign Language Center Advanced Language Enhancement Course (ALEC) Course IV: Chinese, Course IV: Korean, and Course IV: Spanish

Performance Work Statement

Part 1 – GENERAL INFORMATION

1. General. This is a non-personal services contract to provide Training and Education (T&E) products in support of the Department of the Army (DA). The Government will not exercise any supervision or control over the contract service providers performing the services herein. Such contract service providers shall be accountable solely to the contractor who, in turn, is responsible to the Government.

1.1. Introduction. The contractor shall provide all personnel, equipment, supplies, facilities, tools, materials, and other items and non-personal services necessary to perform the creation and modification of training and education (T&E) products as defined in this Performance Work Statement (PWS) except for those items specified as Government-furnished information (GFI).

1.2. Background. Under the Defense Language Institute Foreign Language Center’s (DLIFLC) – Directorate of Continuing Education (CE) – School of Distance Learning (DL), the Foreign Area Officer (FAO) Language Program (FLP) provides advanced instructional support for the greater FAO community and similarly tasked Department of Defense (DOD) linguists.

1.2.1. The Advanced Language Enhancement Course (ALEC) consist of online self-study and facilitated instruction in a target language (TL) which provides the FAOs and DOD-related linguists with supplementary instructional support. Additionally, skilled language specialists from other Government agencies such as International Health Specialists, Civil Affairs Officers, and special operations personnel may benefit from the courses offered via the FAO Language Program. Designed to provide advanced language training resources at the point of need, these courses afford advanced language learners a way to enhance their respective target language skills and cultural competency and to support annual language training maintenance requirements either in the absence of or in combination with formal residential instruction.

1.2.2. The Advanced Language Enhancement Courses are structured as a four-course series in each target language (e.g., Course I: Arabic, Course II: Arabic, Course III: Arabic, and Course IV: Arabic). Each course in the series consists of 6 selected topical domains (24 topical domains per TL) represented as individual course modules with terminal learning objectives (TLOs) and enabling learning objectives (ELOs).

1.3. Scope. The contractor shall design and develop 508 compliant courseware using authentic material for the ALEC, Course IV in three (3) target languages: Chinese (CM), Korean (KP), and Spanish (QB). Each target language course will be comprised of 40 hours of interactive, asynchronous instruction. The courses shall be developed at the interactivity levels designated in Table 6.

1.3.1. The contractor shall design and develop each course to be composed of six (6) modules containing lessons which focus on specific topic categories (one category per module). The ALEC, Course IV courseware shall contain the following six modules in the order listed: Military Modernization; Mass Communications: Traditional and New Media; Space Issues; Cyber Security Issues; Intergovernmental and Non-governmental Organizations; and Diplomatic and Military Presentations. Adhering closely to the provided sample (see Table 5), the contractor shall create terminal and enabling learning objectives for each of the six modules with a primary emphasis on listening and reading comprehension. There should also be a speech recognition (SR) component for evaluation of pronunciation of key terms, use in spoken dialogue-driven activities and/or supported speech to text and text to speech transcription/translation for capstone skill integration production elements in the practical exercises and final practical exercises. Learning objectives which focus on speaking and writing production can also be used to increase the learning level.

1.3.2. The contractor shall provide a separate External Hard Drive version containing a SCORM® version (individual SCOs) and a non-SCORM® plug and play version of the courseware.

1.3.3. The contractor shall ensure the courseware operates on both Windows and Mac OS systems, desktops, tablets, and mobile phones in HTML5 format with responsive web design for implementation on the Joint Knowledge Online (JKO) platform.

1.3.4. The contractor shall identify Interagency Language Roundtable (ILR) level-appropriate, copyright-cleared, authentic materials to use in the development of the courseware. All course material shall be geared to the target audience (see paragraph 1.4) and at an ILR level 2+ to 3+ (or higher) proficiency level to support a scaffold, content-driven, learning approach. The content-driven approach is intended to drive the TLO-specific language learning using low frequency terminology.

1.3.5. The contractor shall design and develop learning activities (Level 2 interactivity), checks on learning (Level 2 interactivity) for each lesson, ELO-level practical exercises (1 per ELO) (Level 3 interactivity), end of module tests, end of module practical exercises (i.e., final practical exercises) (Level 3 interactivity), and a course-level posttest. Practical exercises shall serve as a capstone skill integration and language production activity incorporating reading, listening, speaking, and writing skills at ILR level 3 to 3+ to meet the terminal learning objective(s).

1.3.6. The contractor shall incorporate speech recognition (SR) technology (speech parsing, speech recognition, speech to text, text to speech transcription, etc.) for evaluation of target language production elements (e.g., pronunciation of key terms, spoken dialogue-driven activities, etc.).

1.3.7. The contractor shall add visual and/or auditory cues to the instruction. Required information or material can be produced for activities or to accompany media. Activity screen navigation-related and/or scenario-based/motivational narration/sound to be provided to the learner in the target language and/or English wherever appropriate and accompanied by on-screen transcripts for TL/English where used. Produced content is subject to review and approval by the Government including voices used for produced audio content.

1.3.8. The contractor shall design and develop the following supporting products for each course: focus points, searchable glossary, e-Mentor notes, enrichment pages, and a facilitation guide.

1.4. Target Audience. The principal intended target audience for FLP ALEC is comprised of DOD-linguists including grade O-4 through O-6 FAOs who have completed at least one operational FAO assignment (overseas) and other assets. These linguists are proficient in their primary target language at an ILR level 2/2/2 (reading/listening/speaking) minimum and up to 3/3/2. This is a highly educated group, most holding graduate and postgraduate degrees.

1.5. Type of Contract. Firm Fixed Price.

1.6. Period of Performance. The period of performance (POP) for this contract is 21 months from the contract award date. The POP includes all analysis, design, development, evaluation, and implementation tasks by the contractor and Government.

1.7. Place of Performance. The contractor shall perform work under this contract primarily at the contractor’s place of business.

1.8. Recognized Holidays. The contractor is not required to make deliveries or attend meetings on Federal holidays as recognized by the Office of Personnel Management, https://www.opm.gov/policy-data-oversight/pay-leave/federal-holidays/. The Government will not work on Federal holidays.

1.9. Classification Level. The highest level of security classification for work under this contract is UNCLASSIFIED.

1.10. OPSEC Requirements.

1.10.1. Contractor and all associated subcontractor employees shall comply with adjudication standards and procedures using the National Crime Information Center Interstate Identification Index (NCIC-III) and Terrorist Screening Database (TSDB) (Army Directive 2014-05/Army Regulation 190-13), applicable installation, facility, and area commander installation/facility access and local security policies and procedures (provided by Government representative), or, at OCONUS locations, in accordance with status of forces agreements and other theater regulations.

1.10.2. Non-disclosure Agreement (NDA). The contractor and all associated subcontractors shall complete and sign an NDA for access to JKO Nemesis which will be maintained on file with the Government and JKO administration. This action will be facilitated after post award meeting by the Government and the contractor shall ensure signed NDAs are returned to the Government within 15 calendar days upon receipt from the Government.

1.11. Meetings.

1.11.1. Meeting Documentation. The contractor shall provide a proposed meeting agenda at least two (2) business days before a meeting. The contractor shall write minutes of all meetings (scheduled or ad hoc) and provide draft minutes to attendees NLT two (2) business days following the meeting. Meetings can be held via teleconference, video conference, web conference, or in person at the contractor’s facility, Fort Eustis, or the proponent’s location.

1.11.2. Contract Post Award (PA) Meeting. PA meeting will be conducted by the Government within 15 calendar days from the PoP start date for this contract.

1.11.3. Interim Progress Review (IPR) Meetings. The contractor shall conduct weekly IPRs to review and discuss issues that affect product delivery, Government review comments, contractor correction requirements, scheduling issues, milestone schedule, and similar topics in accordance with (IAW) 5.7.5. Deliverables. If the weekly IPR is not conducted, the contractor shall submit a written project update on the regularly scheduled IPR date. The written project update shall include the week’s activities, current status, scheduling issues, and address any issues encountered or anticipated that could alter progression of work.

1.12. Monthly Status Report (MSR). The contractor shall submit a status report by the 5th of the month starting 30 calendar days after award and continuing until final acceptance of all deliverables IAW 5.7.5. Deliverables. Monthly status reports shall include the current status, the projected completion date (milestone) for each stage of development, and contractor travel (completed and projected). The report shall also describe any difficulties or problems encountered, anticipated, or which previously existed that could alter the progression of work. The report shall include recommendations for resolution of problem areas. The report shall also include a narrative of work completed in the past month and expected work completed in the upcoming month.

1.13. Milestone Schedule (MS). The contractor shall submit a milestone schedule two (2) business days prior to the post award meeting that provides a description of the work processes and timing of work effort from contract award to acceptance of final products IAW 5.7.5. Deliverables. The milestone schedule shall allow time for and depict all events of contractor performance, Government review, contractor correction of errors found, resubmission, validation, functional testing on JKO Nemesis and JKO, and acceptance of deliverables. The contractor shall coordinate with the Government to ensure sufficient time is included in the milestone schedule for Government reviews. A revised schedule may be approved by the Government provided the period of performance end date does not change. Period of performance end date will only be revised by modification to the contract.

1.13.1. The contractor shall include Government review times of initial and incremental deliverables, validation, Individual Trials, Group Trials, and Government acceptance/testing time in the milestone schedule. The time required to organize and accomplish reviews shall be coordinated with the Government and identified in the milestone schedule.

1.14. Documentation. The contractor shall ensure all documentation provided to the Government is written at a comprehension level two grades below the lowest grade level of the target audience. This documentation shall be free of grammatical, punctuation, and spelling errors. Documentation shall conform to the 11th edition of the Gregg Reference Manual and to Army Regulation (AR) 25-50. Documentation with grammar, punctuation, and spelling errors will be rejected and returned to the contractor for correction with no loss of Government review time.

1.15. Quality Control. The contractor shall develop, implement, and maintain an effective Quality Control System which includes a written Quality Control Plan (QCP). The QCP shall implement standardized procedures/methodologies for monitoring and documenting contract performance to ensure all contract requirements are met. The contractor’s QCPs must contain a systematic approach to monitor operations to ensure an acceptable level of services/products are provided to the Government. The QCP, at a minimum, shall address continuous process improvement; procedures for scheduling, conducting, and documenting inspections; discrepancy identification and correction; corrective action procedures to include procedures for addressing Government surveillance that has identified non-conformances; and procedures for root cause analysis to identify root cause(s) and implement corrective action procedures to prevent re-occurrence of discrepancies. The contractor shall establish procedures for trend analysis and procedures for collecting and addressing customer feedback/complaints. The contractor shall provide to the Government the contractor’s QCP with their proposal. At any time during contractor performance under this contract, the contractor shall ensure all changes made to their QCP are provided to the Contracting Officer (KO) and the contracting officer representative (COR) for acceptance. After acceptance of the QCP, the contractor shall receive the Contracting Officer’s acceptance in writing of the proposed change to the QCP.

1.15.1. Quality Assurance. The Government will ensure compliance of the contractor’s performance under this contract in accordance with the Quality Assurance Surveillance Plan (QASP). In addition, this plan ensures compliance with contract terms and conditions. The Performance Requirements Summary (PRS) define how the performance standards will be applied, the frequency of surveillance, and the minimum acceptable defect rate(s).

1.16. Nonconformance. The contractor shall be found in nonconformance when failing to meet terms, conditions, or specifications of the contract or the services are deficient in some manner. All instances of nonconformance will be documented by the Government in a Nonconformance Report (NCR). Nonconformance is classified as either Level 1 (minor), Level 2 (major), or Level 3 (critical).

1.16.1. The contractor shall identify and take appropriate corrective action to the root cause and correct the nonconformance within the required timeline. The KO and COR will track NCRs to ensure the contractor’s corrective action(s) resolve the nonconformance. A Corrective Action Plan (CAP) may be required for nonconformance classified as Level 2 or Level 3. In addition, repetitive nonconformance of the same or similar requirement would indicate the contractor failed to institute effective corrective action and may require submission CAP.

1.16.2. Corrective Action Plan (CAP). The contractor shall submit, when required, a Corrective Action Plan with any deliverable product returned for deficiencies within five (5) business days of the noted deficiency. The CAP shall describe the problem, how it was corrected, and steps taken to correct the Quality Control process so the problem does not reoccur. The plan shall provide the Government with information on which to base its decision to approve or disapprove the proposed corrective action and to determine if a failed test, or other previously completed tests, should be repeated.

1.17. Content Integration. The contractor shall use JKO Nemesis to validate the functionality of all content and tests for each interactive multimedia instruction (IMI) deliverable in accordance with CDRL A008 prior to submitting to the Government for review. All content playability and functionality issues shall be recorded within the Content Performance Report (Appendix D).

1.18. Deliverable Transmittal Letters. The contractor shall accompany all final version of deliverables with a transmittal letter IAW 5.7.5. Deliverables stating, at a minimum, delivery date, contract number, product name, and purpose (e.g., Government acceptance review, group validation, etc.). Deliverables submitted without a transmittal letter will not be accepted.

1.19. Final Deliverable. The contractor shall provide copies (one copy to the proponent and one copy to the COR) of the final deliverables including SCORM, non-SCORM, and standalone versions of the courseware electronically via JKO NEMESIS (turnkey version) as well as DoD SAFE (or other designated electronic means) IAW 5.7.5. Deliverables. In addition, the contractor shall provide a complete file transfer of all courseware integrated and contract administrative legacy components as a final deliverable package with a turnkey plug-n-play standalone version of all courseware on approved External Hard Drives to the COR/Proponent POC(s) -- as designated. All final deliverables shall comply with and be accompanied by a Product Delivery Checklist (provided at the post award meeting).

1.20. Warranty. The contractor shall provide a 12-month warranty after technical acceptance for fielding of the distributed learning (DL) product. All DL products furnished under this contract shall be free from defects in material and workmanship and shall conform to all requirements of this contract. This warranty shall be equal in duration and shall be in effect from the date of Government acceptance of the corrected or replaced products. The contractor shall not be required to correct or replace products if the facilities, tooling, drawings, or other equipment or supplies necessary to accomplish the correction or replacement have been made unavailable to the contractor by action of the Government. The contractor shall promptly notify the Contracting Officer in writing of all unavailability issues.

1.21. Contracting Officer’s Representative (COR). The COR will be identified by separate letter. The COR monitors all technical aspects of the contract and assists in contract administration. The COR is authorized to perform the following functions: assure that the contractor performs the technical requirements of the contract, perform inspections necessary in connection with contract performance, maintain written and oral communications with the contractor concerning technical aspects of the contract, and issue written interpretations of technical requirements (within contract scope). The COR also monitors contractor's performance and notifies both the KO and contractor of any deficiencies, and coordinates availability of government furnished property. A letter of designation issued to the COR, a copy of which is sent to the contractor, states the responsibilities and limitations of the COR, especially with regard to changes in cost or price, estimates, or changes in delivery dates. The COR is not authorized to change any of the terms and conditions of the contract.

1.22. Key Personnel. The contractor shall manage the overall program so that contractor points of contact are available on a day-to-day basis to conduct operations and interact with Government representatives. The contractor shall provide a minimum of two weeks’ notification of any key personnel changes. Key personnel replacements must be made within two weeks so there is no break in continuity of services. At the post award meeting, the contractor shall provide a listing of key personnel along with their positions that will provide work during the analysis, design, development, implementation, and evaluation of this contract. The following personnel are considered key personnel by the Government.

1.22.1. Program Manager. The Program Manager shall have full authority to act for the contractor on all contract matters relating to daily operation of this project. The Program Manager must be knowledgeable of the program acquisition life cycle process as addressed in the DoDD 5000 series. This position also requires knowledge of the Federal Acquisition Regulations (FAR), Department of Defense (DOD) regulations, requirements, policies and procedures, cost and schedule estimating, systems disciplines, engineering specifications, and commercial practices relating to advanced foreign language course production. The Program Manager shall be knowledgeable of overall organization, direction, and requirements of the contract efforts. Experience in interfacing directly with the Government designated representatives and supervising various contract activities is also required.

1.22.2. Project Manager. The Project Manager must possess a Bachelor of Science/Bachelor of Arts (BS/BA) in business, management, engineering or science, foreign language, area studies, or linguistics (especially applied linguistics). The Project Manager is a senior level manager within the company who shall have a minimum of fifteen (15) years of experience, including ten (10) years of demonstrated management experience or project level management. The contractor shall identify a Project Manager for this effort, who shall be responsible for the performance of the work for the duration of the contract.

1.22.3. Software Systems Engineer (Computer and Mobile Simulations). B.S. of Computer Science (specialization in Modeling and Simulation including computer and mobile simulations). In addition to the degree requirement, the Software Systems Engineer shall have five years’ paid experience developing successful scoring computer and mobile DL games and simulations in DL training environments for the DOD.

1.22.4. Software Developer (Digital Learning Content Object Applications). B.S. of Computer Science or Computer Engineering. In addition to the degree requirement, the Software Developer’s (Applications) resume shall reflect a minimum of five years’ experience developing successful SCORM® 2004 3rd Edition scoring distributed learning (DL) and five years’ paid experience developing successful xAPI scoring DL.

1.22.5. Software Developer (Section 508 Conformance). B.S. of Computer Science (specialization in Human Computer Interactions and 508 Conformance). In addition to the degree requirement, the Software Developer (508) shall have a minimum of three years’ paid experience developing successful Web Content Accessibility Guide and Section 508 DL for IMI computer managed instruction, mobile learning, serious gaming, and simulations.

1.22.6. Software Developer (Digital Learning and User Experience). B.S. of Computer Science or Computer Engineering. In addition to the degree requirement, the Software Developer’s (Digital Learning and User Experience) resume shall reflect a minimum of three years’ experience developing successful SCORM® 2004 3rd Edition scoring distributed learning (DL).

1.22.7. Instructional Designer and Technologist. Master of Science (M.S.) of Education (specialization in Instructional Systems Design or Instructional Design Technology). In addition to the degree requirement, the Instructional Designer and Technologist’s resume shall reflect a minimum of five (5) years’ paid experience developing distributed learning content at novice through expert levels using interactive instructional multimedia. Language learning experience would be ideal.

1.22.8. Multimedia Artist and Animator. B.S. of Computer Science (specialization in Computer Graphics). In addition to the degree requirement, the Multimedia Artist and Animator’s resume shall reflect a minimum of five (5) years’ paid experience developing Army IMI.

1.22.9. Multimedia Specialist (Audio). Associate’s degree in multimedia design, digital media, or related field. In addition to the degree requirement, the Multimedia Specialist (Audio) shall have a minimum of three years’ experience incorporating audio and speech recognition technology into IMI courseware. Experience with foreign language audio preferred.

1.22.10. Subject Matter Expert (SME). The contractor shall provide technically and doctrinally knowledgeable subject matter experts for each language and/or subject area. SMEs shall have defined and documented responsibilities throughout the period of performance. SME resumes and the SME Utilization Plan shall be provided to the Government two (2) business days prior to the post award meeting. The SME Utilization plan shall document the role of the subject matter experts in ensuring the doctrinal accuracy of the product during the entire period of performance and shall include well-defined tasks, expected meeting attendance, and deliverables.

1.22.10.1. SMEs shall remain available for the duration of this contract and the contractor shall notify the COR when a SME is no longer working on the project. The contractor shall replace the SME within five (5) business days of departure.

1.22.10.2. SME Qualifications. The qualifications of the subject matter experts are subject to Government review to ensure compliance with this work statement. A subject matter expert with the following qualifications is presumed to meet the requirements of this work statement.

1.22.10.3. Language Speakers. The SME shall be a native speaker of the target language with five (5) years of experience in foreign language curriculum development and two (2) years recent (within the last three years) experience in advanced foreign language curriculum development. The SME shall also have professional and academic experience in online language learning, curriculum development, and instructional design. The SME shall have documented experience developing advanced language-specific curriculum in the requisite ILR skill level range for the target audience as outlined in the PWS.

1.22.10.4. Foreign Area Officer. The contractor shall provide a former Foreign Area Officer (FAO) or person with extensive FAO-related experience as a principal key personnel and point of reference for this contract. This subject matter expert is deemed essential by the Government in order to better assure alignment of the training exercises to the specific linguistic needs of the primary target audience.

1.22.10.5. SME Responsibilities. SMEs shall be responsible for selecting and assembling instructional materials; writing the corresponding activities, tasks, and assessments; and advising instructors/facilitators on the development of synchronous lesson plans to complement the online lessons. SMEs shall sign off on deliverables prior to delivery and a signed SME review document shall be provided to the Government.

1.22.11. Quality Control (QC) Specialist. Bachelor’s degree with major study in quality assurance, education, education technology, or related field. The QC Specialist shall have four (4) years of work experience in quality control of IMI products.

1.23. Contractor Travel. The Government may require the contractor to travel in performance of this contract. The Government will reimburse travel at the amounts not to exceed the Joint Travel Regulation (JTR) rates IAW FAR 31.205-46. All travel must be approved in advance by the COR.

1.23.1. Location and number of trips to be determined based on contract need. Anticipated travel to Fort Eustis, VA or the proponent’s location for the PA meeting, up to 3 IPRs, validation, and/or information gathering.

1.23.2. Travel costs shall not exceed the contract line item number (CLIN) for this contract.

1.23.3. Receipts shall be sent to the COR. No payment will be made without receipts.

1.23.4. The contractor shall submit a trip report to the COR within five (5) business days of completion of travel.

1.24. Data Rights.

1.24.1. The Government has unlimited rights to all documents and materials produced under this contract. All documents and materials, to include the source codes of any software, produced under this contract will be Government owned and are the property of the Government with all rights and privileges of ownership and copyright belonging exclusively to the Government. These documents and materials may not be used or sold by the contractor without written permission from the Contracting Officer. All materials supplied to the Government shall be the sole property of the Government and may not be used for any other purpose. This right does not abrogate any other Government rights.

1.24.2. The contractor shall indemnify the Government for any liability arising as a result of the unauthorized use of patented or copyrighted items. The contractor shall indemnify the Government and its officers, employees, and agents against liability, including costs, for actual or alleged direct or contributory infringement, or inducement to infringe, of any United States or foreign patent, trademark, or copyright, arising out of the performance of this contract, provided the contractor is reasonably notified of such claims and proceedings. The contractor shall provide legal certification, or license, from the owner that permits the Government use if copyrighted material is delivered.

1.25. Copyright Materials. The contractor shall use copyright free materials whenever possible. If copyrighted materials are used, the contractor shall contact the authors, publishers, and/or copyright holders (e.g., authors, photographers, media outlets, etc.) of the authentic materials to secure copyright permissions for those authentic, target language materials considered for selection for courseware development. The contractor shall verify that only copyright free or copyright cleared materials are included in the final deliverables. All copyright cleared resources must indicate permission granted within the courseware and/or point to the copyright source list as delivered by the contractor and kept on file by the Government. Copyright permissions are due with the courseware delivery.

1.26. Organizational Conflict of Interest. Contractor and subcontractor personnel performing work under this contract may receive, have access to, or participate in the development of proprietary or source selection information (e.g., cost or pricing information, budget information or analyses, specifications, work statements, etc.) or perform evaluation services which may create a current or subsequent Organizational Conflict of Interests (OCI) as defined in FAR Subpart 9.5. The contractor shall notify the Contracting Officer immediately whenever it becomes aware that such access or participation may result in any actual or potential OCI and shall promptly submit a plan to the Contracting Officer to mitigate any such OCI. The contractor’s mitigation plan will be reviewed and accepted by the Contracting Officer. In the event the Contracting Officer determines that the OCI cannot be mitigated, the Contracting Officer may use other remedies as required, to include prohibiting the contractor from participation in subsequent requirements which may be affected by the OCI.

Part 2 – DEFINITIONS & ACRONYMS

2. Definitions and Acronyms.

2.1. Definitions

3D ANIMATION. Animated objects that appear in a three-dimensional space. 3D animated objects can be rotated and moved like real objects (Level 3).

APPLICATION PROGRAM INTERFACE (API). A communication mechanism for informing the Learning Management Systems (LMS) of the state of the learning resource (e.g., initialized, finished or in an error condition). SCORM® LMS’s must provide an API that Learning Content Objects, or Sharable Content Objects (SCO) use for getting and setting data (e.g., score, time limits, etc.).

AUTHENTIC MATERIAL. Multimedia resources created by native speakers of a foreign language for use by native speakers of that same foreign language in the respective target country.

ARTIFICIAL INTELLIGENCE. Artificial intelligence (AI) is the intelligence exhibited by machines or software. It is also the name of the academic field of study which studies how to create computers and computer software that are capable of intelligent behavior (Level 4).

ASSET. Learning content in its most basic form is composed of assets that are electronic representations of media, text, images, sound, web pages, assessment objects, or other pieces of data that can be delivered to a Web client. An asset can be described with asset metadata to allow for search and discovery within online repositories, thereby enhancing opportunities for reuse and repurposing. The mechanism for binding assets to asset metadata is the Content Package.

AUGMENTED REALITY. Augmented reality (AR) is a live, direct or indirect view of a physical, real-world environment whose elements are augmented (or supplemented) by computer-generated sensory input such as sound, video, graphics, or GPS data. It is related to a more general concept called mediated reality, in which a view of reality is modified (possibly even diminished rather than augmented) by a computer (Level 4).

AUTHORED CONTENT SOURCE FILES. Authored content source files are source files (for example, Dreamweaver™, Captivate™, Articulate™, etc.) that are used to produce web content through some export/conversion method. These authored source files generally contain numerous files in a folder structure needed for the export/conversion process.

BUSINESS DAYS. Monday through Friday, excluding Federal holidays and weekends.

CONTENT AGGREGATION. Content aggregation is a map (content structure) that can be used to aggregate learning resources into a cohesive unit of instruction (e.g. course, chapter, module, etc.), apply structure and associate learning taxonomies. The content structure defines the taxonomic representation of the learning resources. Content aggregation can reference content aggregation metadata to allow for search and discovery within online repositories, thereby enhancing opportunities for reuse and repurposing. The mechanism for binding content aggregations to content aggregation metadata is the Content Package.

CONTENT AGGREGATION MODEL (CAM). Represents a pedagogically neutral means for designers and implementers of instruction to aggregate learning resources for the purpose of delivering a desired learning experience. A learning resource is any representation of information that is used in a learning experience. Learning experiences consist of activities that are supported by electronic or non-electronic learning resources.

CONTENT INTEGRATION. Integrating all components (interface, text, media, narration, graphics, etc.) together into a functional lesson, module, and/or course.

CONTENT PACKAGE. Used to move digital learning resources or collections of learning resources between Learning Management Systems (LMS), development tools and content repositories. The Instructional Management System (IMS) Content Packaging specification provides a common “input/output” format that any system can support. SCORM® Content Packaging is a set of specific use case examples, or application profiles, of the Instructional Management System (IMS) Content Packaging Specification. SCORM® packaging adheres strictly to the IMS Content Packaging Specification but provides additional explicit implementation guidance for packaging digital learning resources (Assets, Sharable Content Objects and Content Aggregations).

CONTRACTOR. A supplier or vendor awarded a contract to provide specific supplies or service to the Government. The term used in this contract refers to the prime.

CONTRACTING OFFICER. A person with authority to enter into, administer, and/or terminate contracts, and make related determinations and findings on behalf of the Government. Note: The only individual who can legally bind the Government.

CONTRACTING OFFICER'S REPRESENTATIVE (COR). An employee of the U.S. Government appointed by the Contracting Officer to administer the contract. Such appointment will be in writing and will state the scope of authority and limitations. This individual has authority to provide technical direction to the contractor as long as that direction is within the scope of the contract, does not constitute a change, and has no funding implications. This individual does NOT have authority to change the terms and conditions of the contract.

CORRECTIVE ACTION PLAN. A plan developed by the Contractor describing their organizations processes taken to eliminate causes of non-conformities in contract deliverables. The plan should describe what the problem was, how it was corrected and the steps taken to correct Contractor’s Quality Control Program so problem does not reoccur.

DATA MODEL. A standard set of data elements used to define the information being communicated, such as, the status of the learning resource. For example, the SCORM® data model defines elements that must be known to both the LMS and content (SCOs). The LMS must maintain the state of learner progress and the value of required data elements across learner sessions, and learning content uses only these predefined data elements to facilitate reuse across multiple SCORM® compliant systems.

DEFECTIVE SERVICE. A service output that does not meet the standard of performance associated with the Performance Work Statement.

DELIVERABLE. Anything that can be physically delivered but may include non-manufactured items such as meeting minutes or reports.

DEPARTMENT OF DEFENSE IMAGERY. An online, unrestricted, full-text searchable, standard DOD-wide database containing content-descriptive production acquisition, inventory, distribution, currency status, archival control, and other data on visual information (VI) and IMI products on the DOD inventory.

EXPERIENCE APPLICATION PROGRAMMING INTERFACE (xAPI). xAPI is Advanced Distributed Learning’s (ADL) specification that describes an interface and the storage/retrieval rules to enable the tracking of learning experiences. Statements of experience are delivered to and stored in a Learning Record Store (LRS).

FIELDING. This term applies to the act of making the content available for access by learners. For DL courseware this occurs after successful functional testing on the delivery platform.

FINAL CONTENT SUBMISSION PACKET. This is the contractor submitted files submitted for Group Trials and Functional Testing. This packet includes: all required consumables for loading on the production fielding environment or similar hosting environment; all product supporting documentation and instructions necessary for implementing and constructing courseware; and all quality assurance documentation submitted for Government review.

FUNCTIONAL TESTING (FT). This is the process of testing the functionality of courseware on the specified delivery platform utilizing a computing environment that is representative of that used by the target audience.

GROUP TRIALS (GT). The process used to validate a lesson/lesson plan’s individual objectives, based on observations and statistical analysis, provide statistical validity that the lessons teach the objectives, and provide data needed to establish academic and total times.

INDIVIDUAL TRIALS (IT). The process used to ensure that the learning activities actually work, and provide the first chance to test operability of the product on a representative computing environment.

INSTRUCTIONAL MEDIA PACKAGE (IMP). The IMP (DI-SESS-81526C) provides visual, text-based, and audio products used in the development and delivery of T&E products. It also includes the fully integrated instructional media presentation packages, also referred to as interactive multimedia instruction (IMI).

INTERACTIVE MULTIMEDIA INSTRUCTION (IMI). A term applied to a group of interactive media, electronically delivered Distributive Learning (DL) as training and education products.

DRAFT IMI. If the IMI development process includes storyboard delivery and review, the Draft IMI is the first reviewable IMI delivered. On-screen text, narration, graphics, animation, branching, etc., are exactly as approved by the Government during the storyboard phase of the design. Draft IMI is fully-functioning IMI that meets all instructional requirements including computer management/learner score reporting requirements. Draft IMI is tested during individual trials (IT).

FINAL IMI. Final IMI is the IMI that incorporates Government review comments (if any) on the Draft/Beta IMI delivery. Final IMI meets all instructional and technical requirements and is ready for fielding. Final IMI is tested during group trials (GT) and functional testing (FT).

INSTRUCTION. The process of systematically providing or improving the capability of an individual to perform a task to include application of supporting skills and knowledge. For purpose of this document, instruction includes both education and training.

INTERACTIVITY FOR IMI. Interactivity for IMI describes the interaction between a learner and the media which leads directly to meaningful learning. Sensory stimuli requirements or interactions between the learner and the instructor and/or the learner and peers do NOT influence the level of interactivity.

Explanation. It is undesirable, and probably not possible in most cases, to produce any level of interactivity without use of some sensory stimuli/media such as audio, video, animation, or graphic. The use of sensory stimuli by themselves does not justify higher levels of interactivity; however, the complexity of the sensory stimuli is normally increased as interactivity level is increased. Therefore, the more media used does not necessarily mean the higher the level of interactivity; it is how it is used in the context of presenting instruction that makes the difference. Using collaboration that has interactions between the learner and instructor and/or the learner and peers also does not influence the level of interactivity. While collaboration is interactive, it is not interactivity between the media and the learner but between two or more individuals.

Level 0 Interactivity – Passive – In Level 0, the learner acts solely as a receiver of information. Level 0 interactivity typically requires the learner to do the following:

Read text on screen or listen to limited narration View graphics, photographs, illustrations, simple charts and diagrams Initiate simple animated demonstrations of operations and/or procedures when cued Use navigation buttons to progress in a linear sequence forward and back through the instruction Demonstrate very limited, if any, recall of information.

Level 1 Interactivity – Limited Participation – In Level 1, the learner recalls information and responds to instructional cues. Level 1 interactivity typically allows/requires the learner to do activities similar to the following examples:

Exercise some control over the presentation of content (e.g., access hyperlinks to navigate a related series of screens; select an icon or avatar to hear tips, techniques, and procedures; discover information via an image map with multiple hotspots).

Participate in drill and practice activities. Perform simple procedures to complete tasks and/or operate systems, sub-systems, or equipment (e.g., use the mouse to manipulate a dial setting or drag a vehicle gearshift into the correct position).

Demonstrate recall, comprehension, and simple application of information in both formative and summative assessments/evaluations.

Process feedback in the form of simple equipment animation or verbal/textual information. Self-remediate by reviewing content via an alternative presentation or method of instruction.

Level 2 Interactivity – Complex Participation – In Level 2, the learner applies information to scenarios and interacts with simulations. Level 2 typically allows/requires the learner to do such as in the following examples:

Exercise substantial control over a nonlinear presentation in order to explore, discover, process, and respond to complex information, often alternating between multiple screens and to keep pace with the instruction Participate in a limited real-time simulation of performance or gaming in an operational setting Process scenario based instructional cues, make decisions and/or take actions, and respond to rapidly presented, authentic consequences in order to progress through multiple levels of branched instruction and/or accomplish complex tasks that emulate real job performance Analyze, apply, synthesize, and/or evaluate complex information and perform complex skills within acceptable parameters (e.g., time limits, number of errors) in both formative and summative assessments/evaluations Process feedback in the form of intrinsic consequences Self-remediate by making different choices or taking alternative actions to progress through branched instruction Level 3 Interactivity - Real-Time Participation – In Level 3, the learner engages in a life-like set of complex cues and responses such as in the following examples:

Exercise total control over the presentation. The learner operates in the environment without instructional cues. This level is used to simulate highly complex operational and maintenance procedures that often support certification.

Maximum flexibility and multi-level branching allow a high degree of interactivity in the form of simulator and gaming environments. This level is capable of real-time simulation of performance in the operational setting and after action and natural consequences are given based on performance.

This level incorporates artificial intelligence components and employs state-of-the art technology for simulation and communication.

This level can be used for computer evaluation of learner performance and intellectual skills using computer-based predictive and performance test items and the capability to generate time and error scores for performance test items.

Where the learner operates in a game like environment that may involve other players, computer-generated team players, The learner works in an environment simulating decision-making incorporating multiple tasks.

Level 4 IMI - Immersive multimedia or computer-simulated virtual or augmented reality – In level 4, the learner engages in a real life scenario responding to sensory cues:

A computer replicated environment, real or imagined, in which the learner moves and responds to sensory cues.

A computer simulated environment replicating the learner’s physical presence and environment in a way that allows the user to interact with it using sight, touch, hearing, and smell.

Maximum flexibility and multi-level branching allow a high degree of interactivity in a real-time simulation of performance in the operational setting, and after action and natural consequences are given based on performance.

This level incorporates artificial intelligence components and employs state-of-the art technology for simulation and communication.

This level can be used for computer evaluation of learner performance and intellectual skills using computer-based predictive and performance test items and the capability to generate time and error scores for performance test items.

Where the learner operates in a game like environment that may involve other players, computer-generated team players, The learner works in an environment simulating decision-making incorporating multiple tasks.

LAUNCH. A common way for LMS to start Web-based learning resources. This mechanism defines the procedures and responsibilities for the establishment of communication between the delivered learning resource and the LMS. The communication protocols are standardized through the use of a common API.

LEARNING CONTENT OBJECT (LCO). A Learning Content Object may be one single small file or a large functional aggregation of files which deliver a rich simulation. Learning Content Objects usually combine many assets into sensible instructional units. LCOs are also called content objects, chunks, educational objects, etc. Learning Content Objects are complete and are portable between comparable learning environments. Learning Content Objects are complete and are important “building blocks” necessary to build strong effective instructional lessons. To create a bank of instructional items with discoverability, portability, and interoperability is the core idea behind creating learning content objects. Examples include: videos, models, animations, simulations. A Learning Content Object may or may not be a SCORM® object. SCORM® Learning Content Objects are: coded for browser presentation; encoded with SCORM® content to LMS communication; designed for independent operation; and use context neutral content.

LEARNING RECORD STORE (LRS). The implementation of the server-side requirements associated with the xAPI specification. The LRS is a key component of the xAPI architecture. It is the application interface for storing, accessing, and often visualizing the data about learning experiences, activities, and performance.

MASTER MATERIALS. The materials necessary to reproduce or modify all components of the IMI product, including all video and audio source materials as originally supplied to the mastering facility. Reproduction master materials also include the appropriate associated development documentation necessary to reproduce or modify the IMI product (e.g., flow charts, scripts, and storyboards cross-referenced to the video shot list, edit decision list, programming/ source code, runtime program, CMI functionality, etc.).

METADATA. Data that describes other data. Meta is a prefix that in information technology generally means an underlying definition or description.