PWS Appendix A Online Review System.docx

Appendix A Online Review System The contractor shall provide the Government access to an online review system for the review and submission of comments on all courseware. The purpose of an online review system is to provide content reviewers with the ability to review, resolve conflicting comments, and submit comments to courseware developed by the contractor. The system shall provide digital tracking of each comment. Reviewers will submit comments electronically through a web browser rather than creating single files. The system shall allow reviewers access to the courseware under development and the ability to enter comments from any location. This system shall be hosted at contractors’ locations and accessible via standard internet browsers. The review system shall control access through log-in and password protection. The system shall provide the ability for managers and reviewers to also view all related documents provided for the course, such as the course TO, IMDP, course schedules, status reports, and lessons (linked or in the review system).

1. Required Functionality. The online review system shall have the following features:

1.1. Allow users to submit comments directly from the courseware (reviewer/validation subject does not leave the courseware to add a comment and the courseware is visible on the review’s/validation subject’s screen while adding the comment).

1.2. Contain multi-level permissions and roles.

1.3. Allow authorized users to view, add, and approve/disapprove comments submitted via the content comment submission capability.

1.4. Have the capability for lesson comment submission and lesson comment review and/or administration capability.

2. Comment Submission Capability. The online review system shall have the following lesson comment submission capability:

2.1. The system shall require a unique login ID and password combination to gain access to the courseware commenting capability for each user/individual. (The same ID and password can be used throughout a course/phase).

2.2. Any comments received from the online lesson comment capability shall be given a unique identifier and shall capture the data provided from the lesson commenting form.

2.3. The system shall record the date, time, and login ID of anyone who updates the comment or changes the status.

2.4. The system shall have the ability to provide a comment on each courseware page and track the comment by page without the reviewer having to add the page identifier.

2.5. The user shall click on a provided link or button to send a comment to a central database (the lesson comment review/administration capability).

2.6. The comment submission form shall be self-populated with the following information:

2.6.1. The lesson under review.

2.6.2. The topic of the lesson under review.

2.6.3. The page number under review.

2.6.4. The date and time of the comment.

2.6. 5. The commenter’s name or login identification.

2.7. For each comment, the system shall allow the commenter to provide the following information:

2.7.1. Whether the change is a global change (applicable to the entire lesson) or a local change (applicable to the lesson slide being reviewed).

2.7.2. The reviewer will be allowed to copy and paste large sections of text into the comment field.

2.8. Upon submission of the comment, the system shall automatically close the form.

3. Comment Review/Administration Capability. The online review system shall have the following lesson comment review and/or administration capability:

3.1. Security. The system shall provide for three levels of access to the comments:

3.1.1. Reviewer - who shall have access to view their and others comments.

3.1.2. Approver - acts as a master reviewer and identifies which of the Reviewer’s comments are to be addressed by the contractor. Receives lesson notifications and assigns lessons to Reviewers.

3.1.3. Administrators - who shall have access to the entire system and act as a systems administrator in providing password/log-in information to reviewers. Administrators may be developers or system administrators. Administrators shall also be able to add new reviewers and deactivate others. The system shall allow reviewers to view all their comments for a lesson or for all lessons. (Note: The Administrator is the role of the contractor.)

3.2. The system shall contain a reports mechanism that has the ability to see all comments at once, regardless of status, for a lesson or all lessons.

3.3. The system shall provide different views of the comments for a lesson or lessons based on the approval status (that is, approved, disapproved, approved with comments, pending).

3.4. The system shall make the following features available to Approvers:

3.4.1. The system provides the Approver the ability to review all comments and approve them following review.

3.4.2. The system shall allow the approver to ‘approve’ (Approver has agreed comment needs to be addressed and has assigned it to the contractor), ‘disapprove’ (Approver has determined comment is not to be addressed by contractor), or ‘approve with comment’ (Approver has agreed comment needs to be addressed and has added further clarification to the contractor) a particular comment.

3.4.3. The system shall provide Approvers with the ability to provide additional information in text for any comment as a separate comment field.

3.4.4. The system shall provide Approvers the ability to change the status of any comment at any time. Status shall include at a minimum approved, disapproved, approved with comments, and submitted/pending (indicates Government Reviewer has provided input on the lesson). Submitted/pending status shall be the automatic status upon entering a comment before the approver’s review.

3.4.5. The system shall provide an approval feature so that all selected comments may be approved with a single submission.

3.5 The system shall make the following features available to Administrators:

3.5.1. The system shall provide Administrators access to all of the capabilities of Reviewers and Approvers.

3.5.2. The system shall provide Administrators with the ability to review the comments and Approver annotations but will not provide them with the ability to change any of the content from the Reviewer or Approver.

3.5.3. The system shall provide Administrators with the ability to review each comment and to provide tracking status for each comment.