DMV Proctoring Service Q and As 07262021.docx

PR 871021Q8108 – DMV PROCTORING SERVICE

QUESTIONS & ANSWERS

1. Will the supplier be provided with background information regarding the key topics to be covered in the Diplomatic Motor Vehicle Program including?

Driver Services

Answer: No.

2. Are individual live proctoring services acceptable?

Answer: The contractor will provide live proctoring services.

3. How long does it take the average individual to complete the exam?

Answer: This is a new requirement; the Department doesn’t know the average time to complete the exam.

4. Is it necessary to enter the test taker's computer or is using a live proctor and our own Learning Management System adequate control for verification of proctoring?

Answer: Live proctor and LMS system is adequate.

5. Is the OFM driver exam always to be provided in English?

Answer: English; however, the contractor needs to either provide translation services or be prepared for the applicant to be assisted by a translator.

6. Over the last four years what has been the annual payment to the contractor per year?

Answer: This is a new requirement.

7. Is there a current fair market value estimate for this contact?

Answer: The Offeror shall base their price on the total cost, to include profit, to fulfill the requirements of the SOO.

8. Are all questions by all bidders and the responses being shared with people who received the RFQ?

Answer: Questions and answers will be posted on FBO.

9. Since the OFM is supplying the driver's test, how many questions are asked? Are these questions multiple choice, true/false, fill in the blanks, etc.?

Answer: There are three versions of the exam. Each version of the exam consists of two parts. Part I is 10 questions (multiple choice and true/false). The applicant must score a 100% on Part I prior to being given Part II. If the applicant does not score a 100% on Part I of the exam, the applicant is considered to have failed the exam and will be required to retest (the applicant will need to schedule a new exam time). Part II consists of 35 true/false and multiple choice questions.

10. Are we correct in assuming we will put the test on our own Gold Cross LMS?

Answer: Yes.

11. What problems have been encountered over the last few years in fulfilling this RFQ?

Answer: This is a new requirement.

12. Will the exam be forwarded to the driver by the state department or by the successful bidder?

Answer: The successful bidder.

13. Is the test the same regardless of the state in which the Foreign Mission personnel is operating out of?

Answer: Yes, the three versions of the OFM exam will be used nation-wide.

14. Am I correct in assuming we should have a support telephone number available if the drivers have a question or test problem?

Answer: The contractor must provide customer support if there is a testing issue.

15. What is the anticipated award date?

Answer: Anticipated award date is mid to late August.

16. What is the anticipated contract start date?

Answer: Contract start date will probably initiate in September.

17. What is the anticipated test administration start date?

Answer: An administration date has not yet been established.

18. Who owns the examinations to be administered, e.g., are the examinations developed and owned by OFM? Does OFM license third-party examinations?

Answer: OFM owns the exams.

19. Regarding the “written knowledge examinations,” how many versions or forms of the DMV knowledge examination will be loaded for test administration?

Answer: There are three versions.

20. Are retake candidates assigned a different examination form?

Answer: Yes, they are assigned another exam.

21. How many items are included on each version or form of the written knowledge examination?

Answer: There are three versions of the exam. Each version of the exam consists of two parts. Part I is 10 questions (multiple choice and true/false). The applicant must score a 100% on Part I prior to being given Part II. If the applicant does not score a 100% of Part I of the exam, the applicant fails the exam and will be required to retest (they will need to schedule a new exam time). Part II consists of 35 true/false and multiple choice questions.

22. What item types are included on the written knowledge examination?

Answer: The written knowledge exam consists of two parts: Part I, which tests knowledge of traffic signs; Part II, general knowledge.

23. Does the written knowledge examination Include attachments, graphics, photographs? If so, please detail the type of files and the number of files.

Answer: Part I of each version will have 10 simple graphics/illustrations for each question about signs. Part II of each version will vary. Graphics are included within the Word document.

24. How is the written knowledge examination scored, e.g., one point per correct answer, raw scores reported to the applicant, scaled scores reported to the applicant, overall scores, domain/content area scores? Can OFM share a copy of the applicant score report?

Answer: The written knowledge exam consists of two parts: Part I, which tests knowledge of traffic signs; Part II, general knowledge. An applicant must correctly answer all ten traffic sign questions in Part I of the exam (100% passing rate) before proceeding to Part II of the exam. Successful completion of Part II requires at least 80 percent of the questions answered correctly (35 questions total). Results as reported to the applicant as pass/re-take.

25. What is the test administration time, e.g., seat time, time in test, for the written knowledge examination? Do applicants have 180 minutes, 240 minutes, etc. to complete the examination?

Answer: Applicants are given 60 minutes to complete Parts I and II.

26. Are candidates allowed to take a break during the test administration? If so, does the test timer continue to run? Or, is there a scheduled break of a fixed length?

Answer: No breaks are permitted.

27. How does OFM currently send the examination content to the local DMV office to support applicant testing, e.g., using third-party software like Blackboard, sending a paper examination)?

Answer: OFM does not provide the exam to any local DMV. The local DMV uses its own exam.

28. Can OFM support webservices / API from its database to send eligible applicants to the vendor and receive test results from the vendor?

Answer: Yes; however, it will take considerable time and effort for OFM to establish this connection due to the required security measures the Department must take.

29. How long does an applicant have to schedule and complete testing, e.g., what is the applicant’s eligibility period – 60 days, 180 days, 365 days?

Answer: The applicant schedules and immediately takes the exam on the scheduled date. There is no “eligibility” period.

30. Is the vendor collecting any fees from the applicant for test administration?

Answer: No fees will be collected from applicant.

31. Is applicant date of birth a required field for reporting?

Answer: Yes, required fields include Name, DOB, PID, Mission (the PID is a unique number assigned to the applicant by the Office of Foreign Missions)

32. Is the PID a unique identifier for each applicant and will be retained by the applicant throughout his/her testing history?

Answer: Yes.

33. To confirm, OFM would like applicants to be offered the opportunity for test administration via remote proctoring with a live proctor or test administration at a brick and mortar facility with a live proctor? Is brick and mortar testing within the United States only or worldwide?

Answer: OFM is not interested in incorporating brick and mortar testing. This contract is for remote proctoring only.

34. How many applicants completed the written knowledge examination in 2017, 2018, 2019, and 2020?

Answer: 2018 = 861; 2019 = 870; 2020 = 505. Numbers unknown for 2017.

0. Is the 600 examinations listed in the pricing table illustrative, past volume, or a guaranteed volume?

Answer: Indicative of past volume with current policy changes accounted for.

0. What is the OFM policy for exceeding 600 examinations annually, if this is a fixed and guaranteed volume? Can the vendor bill for overages?

Answer: This is not a fixed/guaranteed volume. OFM will pay per exam.

0. Can OFM estimate the number of international candidates by country or region?

Answer: OFM is unable to provide this information.

0. Can OFM estimate the number of accommodations candidates in each testing year and the most frequently requested accommodations?

Answer: This is a new contract. We do not know what accommodations will be requested.

35. How many missions are currently active, e.g., how many data points for tracking and reporting? Will each applicant be tied to a mission as part of the eligibility data sent from OFM to the vendor?

Answer: Each applicant is assigned to a mission. There are roughly 175 missions but not every mission will need to utilize this service.

36. Can OFM share any current candidate communications, e.g., candidate guide, information on testing process, information on the written knowledge examination?

Answer: The Virginia DMV driver’s manual is suggested as a resource for potential applicants to prepare for the exam. This is available online through the Virginia DMV.

37. Does the vendor need to be registered in SAM to qualify for award?

Answer: The vendor must be registered in SAM to be eligible for award.

38. On the Past Performance Profile, is the vendor detailing any previous work for OFM only, OFM and any other division of the US Department of State, OFM, any other division or the US Department of State, and any other department of the US government?

Answer: The vendor is detailing similar work as DMV Proctoring Service SOO.

39. Does OFM require any statistical analysis, e.g., summary or item statistics on the written knowledge examination?

Answer: Yes, as outlined in section 9 of the SOO, progress reports should include the following information:

· Number of exams scheduled

· Broken down by a total number of exams overall as well as number of exams by mission

· Monthly number of exams proctored

· Broken down by a total number of exams overall as well as number of exams by mission

· Number of missed appointments

· Broken down by a total number of exams overall as well as number of exams by mission

· Number of exams with a passing score

· Number of exams with a failing score

40. Is the past performance profile required to be returned? It doesn't appear to be called out in any of the documents.

Answer: The Past Performance profile must be returned as part of your technical proposal. It is mentioned in the Technical Evaluation criteria.

41. Do the resumes for the key personnel count against the 25-page page count from the technical volume or part of the staffing plan inside the cost volume?

Answer: The resumes do not count against your 25-page count limit.