Copy of RFP Questions and Answers 3.20.23.xlsx

XLSX spreadsheet 27 KB Posted

Attached to
Notice Regarding the Psychological Testing Services RFP
Solicitation number
OBICR202300001
Issued by

View the file

Other files

File Type Posted
Attachment Two.pdf PDF
Attachment Four.doc DOC document
QSU OBICR202300001.pdf PDF
Attachment Three.doc DOC document
Attachment Five.pdf PDF
Attachment One.pdf PDF

On GovTribe

Work with this file

  • Download the original file
  • Contacts named in this file
  • Similar government files
  • Ask GovTribe AI about this file

Text version

Sheet1

Question #RFP SectionQuestionAnswer
1Section L.2: Technical Proposal InstructionsCan the government clarify if the Table of Contents section is included in the page count of the Technical Proposal?Yes, the Table of Contents is included in the page count.
2Section L.2: Technical Proposal InstructionsFor the Table of Contents section, can the government clarify the requirement "an impression of the offeror's understanding of the requirements, objectives, scope of work, and intended services"? Is this content meant to act as a paraphrase of the narrative in addition to a standard Table of Contents that just shows proposal sections and page numbers?Yes, we are requesting that the offeror provide an understanding of the requirement based on what is requested in the proposal in addition to the Table of Contents.
3B.2.1What do you mean by psychological "retesting?" Please clarify.Psychological retesting needs to occur when there is an instance where an individual needs to be re-tested. Retesting may be needed when an applicant is determined to be temporarily non-clinically appropriate due to a life situation that has caused trauma and continuation of medication or treatment is needed for re-evaluation. Retesting may occur when a timeframe of 12 months has passed to re-evaluate the applicant. Also, situations beyond the applicant's control (for example, technical difficulties) may allow for retesting.
4C.3 Objective

and

C.5.1.2 Throughout the solicitation, USCP uses the phrase "computer-based test battery." In other areas it refers to test administration and interview in a "virtual format."

Can the government confirm that USCP is open to in-person psychological testing and interviewing so long as the contractor can have a virtual process for test administration and clinical interview within 5 working days of the request from USCP (as suggested in C.5.1.2)?Yes, in-person psychological testing is preferred. However, in the post-pandemic environment, or at the request of USCP for operational or scheduling requirements, the contractor should be able to pivot, within appropriate time frames, to virtual should the situation arise.
4C.3 Objective

and

C.5.1.2 Throughout the solicitation, USCP uses the phrase "computer-based test battery." We are hoping that the government can provide additional detail on what is desired, more specifically:

Does the government require the electronic administrationof tests or electronic scoringof tests?

Given that the most valid psychological tests available for pre-employment screening in law enforcement populations were normed using written (vs. computer-administered) tests, would the government also be open to written proctored administation?

The USCP prefers all testing to be computer based and interviews conducted virtually or in-person. This will ensure the contractor is able to perform the testing in a virtual environment if needed due to USCP operational and scheduling needs.
5C.4.1.2.2

and

C.5.1.1 and

C.5.2 The USCP solicitation states that personnel must be licensed, master’s level clinician(s). Further, it states that "The Contractor shall provide a licensed master’s level clinician to provide oversight of the psychological screening and testing for all applicants." However, as written, this requirement is inconsistent with International Association of Chiefs of Chief Pre-employment Psychological Evaluation Guidelines which specficially state "Because pre-employment evaluations rely upon administration and interpretation of psychological tests, agency administrators should use a licensed, doctoral-level psychologist to conduct pre-employment evaluations."

Given the necessity of providing services that are in line with all ethical, legal and professional guidelines, can the USCP revise the requirements to include that staff be doctoral-level psychologists?

(see: https://www.theiacp.org/sites/default/files/all/p-r/Psych-PreemploymentPsychEval1.pdf)No, the requirement stands as written. It is the USCP's requirement that the contractor must be licensed at the master's level. The IACP is a best practices agency and the USCP is not bound by their guidelines.
6C.4.1.2.4Since IACP requires doctoral level psychologists, not masters level, for the implementation of psychological pre-employment evaluations, can the USCP revise the requirements according to IACP best standards?No, the requirement stands as written. It is the USCP's requirement that the contractor must be licensed at the master's level. The IACP is a best practices agency and the USCP is not bound by their guidelines.
7C.4.1.2.10

and

C.4.2 The solicitation states "The Contractor shall submit testing protocols for every test conducted prior to implementation in the screening process.

This will include the criteria in which the test is standardized and validated as well as measured outcomes of the tests," and then also states "The Contractor shall include a copy of all assessment tests/questions used as part of their methodology and process."

Can the USCP provide additional detail about what is meant by "submit testing protocols?" Providing test questions or test stimuli may be in violation of copyright laws and/or in violation of ethicial guidelines for psychologists. Would a summary of the proposed tests standardization and validaiton be sufficient?What is meant by a submission of USCP testing protocols is a review of the process and the methods used by the contractor to develop the tools and testing questions to meet USCP testing requirements for law enforcement positions. The USCP wants to know the purpose of the offeror's testing protocols. For example, what is the objective for each test provided to applicants and how are the tests measured to get the final result? A summary would be sufficient.
8C.4.2

and

C.5.1.4 The solicitation states " The results for Pre-Employment Examinations will be the standardized psychological assessment “ranking system” as follows:

“Clinically appropriate”, “Not clinically appropriate” or “Temporarily not clinically appropriate”.

Given the proposed ranking system's focus on "clinical" aspects of the evaluation, it implies that the pre-employment evaluation is to provide a diagnostic conclusion or determination of a condition or disability. As such, this ranking system could be perceived as inconsistent with the Americans with Disability Act (ADA) and IACP guidelines that require a determination be based on the candidates strenghts and not solely on a clinical diagnosis and therefore introduces significant legal liability for the USCP. As such, would the USCP be open to other validated ranking systems that are consistent with legal and ethical guidelines and that mitigate this unnecessary legal risk?

The USCP would be open to other validated processes as long as we have the results within 48 hours.
10C.4.3.6The solicitation states "the results of the computer-based test battery should be verified by the Contractor’s clinician and shared with the USCP designee(s) 48 hours after the clinical assessment has been conducted.

The sharing of psychological test scores themselves, and doing so without interpretation of other contextual information, would be a violation of the American Psychological Association's Guidelines for Psychological Assessment and Evaluation. As such, would USCP be open to other validated processes for the timely delivery of assessment findings that would include consideration of test scores but that would be in-line with ethical guidelines?

11 C.4.3.7 The solicitation states "All tests should integrate standard information regarding the applicant’s relevant history (e.g., school, work, interpersonal, family, legal, financial, substance use, mental health)"

Few, if any, psychological tests validated for use in the psychological screening of law enforcement candidates address all of this information. This is why processes routinely utilize a number of tests and include a psychological interview. As such, would the USCP be amenable to reading this requirement as: "All assessments should integrate standard information regarding the applicant’s relevant history (e.g., school, work, interpersonal, family, legal, financial, substance use, mental health)"We will change this portion of the solicitation to state "all tests/assessments".
12C.4.3.8The solicititation states: "All psychological interviews shall be audio recorded and shall have a duration of forty-five (45) to sixty (60) minutes " and then later "Conduct a two-hour Clinical Interview for each employee" for Fitness for Duty evaluations.
Requiring a specific interview length may inadvertantly introduce variability into the interview process which should, according to legal guidelines and standards of practice, be standardized in terms of content (not duration). Therefore requiring an interview duration may introduce unnecssary legal liability. As such, would the USCP be open to considering a standardized interview process that would, on average, take candidates 45mins - 60mins to complete and take employees undergoing fitness for duty evaluations 2 hours to complete, but that would better adhere to applicable legal and ethical guidelines?Yes, the USCP is open to considering a standardized interview process that would, on average, take 45-60 minutes for candidates to complete and take employees undergoing fitness for duty evaluations 2 hours to complete.
13C.4.3.13The solicitation states: "All psychological tests shall independently add to the strength of the applicant’s application process but shall not be redundant in scope or measured outcome."

The utility of the psychological evaluation can be improved by the careful selection of instruments and assessment methods designed to have some overalp in areas being assessed. The use of "multi-method" assessment approaches is considered to be the gold-standard in psychological assessment and according to APA guidelines, is to be used whenever possible. As stated in the American Psychological Association's Guidelines for Psychological Assessment and Evaluation, "psychologists strive to recognize that more than one reliable and valid measure is appropriate to assess all relevant domains of functioning to examine convergence and deviation of findings. Convergence and divergence of information from multiple sources informs the assessment process and increases confidence in and appropriate utility of test results."

As such, is the USCP open to assessment methods with carefully designed areas of overlap so long as the methods do not become unnecessarily redundant or price prohibitive?

The USCP would be in agreement to this type of methodology.
14C.5.1.1 *The solicitation states, "The Contractor shall be able to provide screenings for large groups of applicants (maximum of 50), to include testing and clinical interviews, and individuals in professional offices conveniently accessible from the District of Columbia, Maryland and Virginia. The Contractor will receive a 30-day request in advance for preparation.
How often does the USCP estimate the need for screening large group of candidates (e.g., once a month? once every six months?). Can this large group be screened over two days?Twice a year. No, all in one day is the requirement.
15C.5.1.4The solicitation states:

Within forty-eight (48) hours, after completion of the psychological review, the Contractor shall provide the following:

• The results of the testing via email to the USCP designated Program Manager

• Provide whether a candidate is deemed “clinically appropriate” or “not clinically appropriate”.

• If additional information is required impacting the forty-eight (48) results, the contractor will advise “the candidate is undecided until further clinical review”

Questions about the rating system and concerns about providing psychological tests scores were proposed previously. However, as it relates to providing initial findings, would the USCP be amenable to a "preliminary recommendation" based on the psychologist's interpretation of test scores and interview, with a more detailed follow-on report for call candidates provided within 5 or 12 business days?The USCP is amenable to the Contractor providing its determination as to whether a candidate is deemed "clinically appropriate" or "not clinically appropriate" within forty-eight (48) hours with the Contractor emailing a more detailed follow-on report 5-12 business days later.
16C.5.2.1.1*The solicitation calls for three types of Fitness for Duty Evaluations: (1) without medical consult; (2) with medical consult; and (3) with Medical Consult and Non-Practitioner’s Response as well as (4) Follow-up Fitness for Duty Evaluations.
Would the USCP be open to an alternative proposed methodology for Fitness For Duty evaluations so long as the contractor addresses all of the requirements noted in the solicitation (i.e., reviewing checklist requirements, administering testing and conducting the interview, consulting with previous providers and supervisors as applicable, referring for psychiatric consultation and/or medication review as needed, approach to dealing with non-responsive employee practioners, follow-up (return to duty) evaluations, and submision of the final report within 10 business days)?Yes, the USCP is open to an alternative proposed methodology for Fitness for Duty evaluations as stated.
17C.5.2.1.2The solicitation states: "Within ten (10) business days after the completion of the FFDE, the contractor shall submit a treatment plan checklist, if a treatment plan is recommended, that the Department will provide to the employee. Checklist will contain enough information for the employee’s treating practitioners to understand what specific areas of concern require addressing. Treatment plan checklist should contain an estimated time frame for completion understanding that the treating practitioner shall develop his/her own plan in consultation with the employee."
The contractor providing Fitness for Duty services is not, and should not, be driving treatment decisions, which are best addressed by the treating provider and the employee within a doctor-patient relationship. As such, and to ensure clarity around roles and responsbilities, would USCP be amenable to other proposed methods for ensuring that treatment providers are aware of concerning clinical information that could inform their treatment but that are not "treatment plans" or other documents that could be perceived as directing treatment approaches?Yes, the USCP is amenable to other proposed methods as stated.
18B.2.1 0005For the Pharmaceutical Evaluation CLIN, can the USCP please describe what is needed here?Evaluation of prescribed medication, dosage, length of use, and impact on their ability to perform job duties.
19C.8"Contractor shall be locally available for Real-Time Consultations" Can clinicians be both locally and CONUS to serve on this contract? In short, is it okay to have most clinicians locally based, with some who conduct interviews via telehealth and are still available as needed to speak to USCP?Yes, it is acceptable to have some clinicians who conduct interviews via telehealth. However, when necessary, there must be clinicians locally based who will be available to perform services in person.
20Page 7The estimated time for Pre-Employment Psychological Screening is specified for one hour on page 7. The solicitation states as follows: "All psychological interviews shall be audio recorded and shall have a duration of forty-five (45) to sixty (60) minutes.All psychological interviews means all testing identified shall have a duration of forty-five (45) to sixty (60) minutes.
What time would be estimated for Pre-Employment Psychological Screening Testing?
What time would be estimated for Fitness for Duty Follow-up Psychological Evaluation?
What time would be estimated for Pharmaceutical Evaluations?
21C.5.1.1The Solicitation delineates the requirements for Pre-Employment Psychological Screening in section C.5.1.1. on page 8.No, the requirement for the Pre-Employment Psychological Screenings is not the same as the one for Pharmaceutical Evaluations and therefore does not require a similar description.
Section C.5.1.1. states as follows:
“ C.5.1.1. Clinical Interviews and Pre-Employment Psychological Screenings
The Contractor shall provide a licensed master’s level clinician to provide oversight of the psychological screening and testing for all applicants which includes applicants for specialized assignments.
The scheduling of these services is to be flexible to meet the demands of the USCP, as the USCP is episodically required to meet student apportionments at the Federal Law Enforcement Training Center.
The Contractor shall be able to provide screenings for large groups of applicants (maximum of 50), to include testing and clinical interviews, and individuals in professional offices conveniently accessible from the District of Columbia, Maryland and Virginia. The Contractor will receive a 30-day request in advance for preparation.”
Would the Government please provide a similar requirement description for Pharmaceutical Evaluations?
22Page 3The Solicitation describes Supplies or Services and Prices/Costs on page 3.
The Solicitation states as follows:
"The USCP is seeking the services of a professional licensed clinical organization
to provide psychological screening and testing for all applicants".
This does raise a latent ambiguity, as the Solicitation does not state that the
Contractor itself must be a professional licensed clinical organization, but onlyThe Contractor does not need to be professionally licensed; however, the Contractor must ensure all services are performed by professional licensed clinical organization and the contractor will be accountable for all services perform in whatever capacity they so choose (such as subcontracting).
that the services actually performed would be performed by one or more professional licensed clinical organizations.
The question that will resolve this latent ambiguity is as follows:
If all services are furnished by professional licensed clinical organizations, may the
Contractor be an outside agency that contracts with the professional licensed
clinical organizations that will actually provide the requested services?

File details come from the government source that posted it. Updated .