Question_technical_related_to_RFP_283-17-1000_responses.pdf

Technical Questions & Responses from the field and 11/2/16 SAMHSA IDIQ Pre-Proposal Meeting

1. Some requirements were detailed in the scenario, but not scored on IDIQ Section M. How will SAMHSA handle these items on the evaluation? See revised Attachment 1 and evaluation criteria.

2. We assume that, to reduce redundancy, items a, b, and d of the Management section apply to the IDIQ as a whole, whereas item C of the Management section and the second set of criteria (a-e) under the Technical Approach apply only to the scenario/sample task order. Is that correct? Yes but please see revised Attachment 1 and evaluation criteria.

3. The Domain 1 scenario (Attachment 1) specifies 7 sites for the feasibility study, 30 sites for the pilot study and 30 sites for the evaluation. Can SAMHSA confirm they intend the pilot study to include 30 sites? The timeframe of the pilot study would not allow for OMB/PRA clearance, so not all 30 sites could be included in the pilot study. Yes, the pilot study should include 30 sites.

Please assume that SAMHSA has already received all clearance- this note has been added to the revised scenario.

4. This question is in reference to Task 4 under Domain II. Does SAMHSA intend for Task 4 under the scenario proposal to take place after Task 1-3 are completed or would Task 4 be performed concurrently with other tasks? Task 4 will be completed concurrently. Please see revised Attachment 1.

5. Are the quality tools discussed in Task 4, Domain II considered tools that are used as part of the intervention (for implementing the intervention) or are these tools used to evaluate the intervention (its effectiveness, success, etc.)? Both.

6. Could SAMHSA provide some examples of tools they are envisioning being considered for Task 4, Domain II? A data manual or data guide.

7. If staff have multidisciplinary training, is it permissible to propose someone under more than one labor category? Yes.

8. Can you confirm that each task under the SOW is building off of one another? For example, in Communications domain, we don’t cover program knowledge until Task 3. Within each domain, this appears to be the case.

9. Can you confirm labor hours for management section is based on estimated hours for the hypothetical scenario? If for example we don’t anticipate a statistician for hypothetical but want this person on IDIQ for future projects, how should this be treated? Please see revised evaluation criteria, as the evaluation criteria (The Offeror shall provide a staff loading chart, delineated by labor category and tasks in the sample scenario/task order) has been revised and moved from the Management section to the Technical Approach section.

10. You described that for evaluation criteria 1 and 2, that personnel and management need to be described as related to the scenario “as well.” So should we also be speaking in general about our personnel and management as suited to the overall domain? Or only deal with personnel and management in context of the scenario? Please see revised evaluation criteria.

11. You’ve said that SAMHSA has provided a common scenario to help ensure everyone is on the same playing field. The “behavioral health intervention” discussed in the scenario is generic.

Are we compliant if we are operationalizing that intervention to be able to describe how we’d approach the activities in the domain with respect to a tangible intervention? Yes so long as the characteristics of the “tangible intervention” match what is outlined in the scenario/sample task order. For example, in Domain I, the “tangible intervention” should reduce symptoms and increase function and be implemented in community-based organizations in urban settings.

12. Can you clarify whether technical approach should discuss general ability/approach to perform in the domain or only describe approach to the scenario? Please see revised evaluation criteria.

13. How closely do we follow the scenarios? Are we answering a) generic, fictitious- “the pilot program” b) fictitious with details we create- “the pilot program for kids, which…” Offerors are asked to following the scenario/sample task order and the characteristics outlined in the yellow highlighted areas but may add other details.

14. When scenario references specific deliverables (i.e., 4 page report) are we supposed to address our capacity or provide an actual example. If an example, is it real or fictitious? Please address the Offeror’s capacity.

15. The scenario description is not that specific- for example, it does not describe the behavioral intervention. Are we supposed to choose a specific topic/intervention, audience, etc? Or are we supposed to describe our approach more generically? The scenario/sample task order was meant to be generic. Offerors are asked to following the scenario/sample task order and the characteristics outlined in the yellow highlighted areas but may add other details.

16. Attachment 1, pg. 7-8, Attachment 1. SAMHSA refers to “public-private partnerships.” Please provide a definition of this term. A partnership that includes a public entity (e.g., Federal, State or local government) and a private entity (e.g., foundation, health care organization) working together towards a common goal/objective.

17. Attachment 1 (Domain Descriptions with scenario), page 9-10, Domain IV Communications Projects: The description of Task 3 (Program Knowledge) activities appears to overlap with activities that would be necessary to accomplish Task 1 (Planning and Evaluation). How does SAMHSA distinguish the work to be accomplished in Task 3 from the formative research activities to be undertaken in Task 1? Please see revised Attachment 1.

18. What is the anticipated job description for the Senior Telecommunications Specialist referenced on page 99 of 109 in the Evaluation Criteria for Domain IV. Communications Projects as key personnel? Please see revised evaluation criteria.

19. Please clarify if there are page limits for each of the tasks in the Scenarios – specifically, on page 9 of 17, Attachment 1, Domain IV Communications Projects, Task 1: Planning and Evaluation includes a parenthetical page limit (no more than 15 pages). Is this a required page limit? Are there are other page limits for Tasks 2, 3 and 4 as no other page limits are indicated. Other limits are included in the scenario- please see the yellow highlighted areas.

20. On page 14 of 17, Attachment 1, Domain V, Task 4c it states that the Contractor shall develop service performance reports to meet federal accountability requirements. Where can the Contractor locate the standard requirements or sections that must be provided by the Contractor in the service reports? This question is unclear. Task 4C states to “develop service performance reports to meet federal accountability requirements and monitor and improve the quality of TA and/or training service provision.” There are no standard requirements or sections that must be provided by the Contractor, as noted in this question.

21. In Attachment 1, Domain V scenario it states “For the purpose of the scenario, assume annually:

one call per grantee per month”, who will be setting the agenda for these calls and what will be the nature of them? Offerors may identify this in their proposals.

22. In Attachment 1, Domain V scenario you state “four emails per grantee per month”, what will be the content of these emails, will there be specific requests? Offerors may identify this in their proposals.

23. In Attachment 1, Domain V scenario you state there will be “four virtual trainings available to all grantees”, what will be the length of these trainings, what is their relationship with Task 2c materials development, specifically in-person and self-paced online training courses. Offerors may identify this in their proposals.

24. In Attachment 1, Domain V scenario for Task 4d “establish and maintain a continuous performance measurement component that assesses process, capacity, and impacts of TA and/or training…..collaborate with SAMHSA data contractors and….work with the COR to determine if the data collected should be included in any of the official data collection platforms used by SAMHSA and provide the data in a format that can be used by that system.” Does the government intend to take data and feed into a bigger system or SAMHSA performance evaluation? It is possible.

25. Page 14 of 17- Domain V, Task 5b: “The Contractor shall maintain, update, promote, and develop/enhance a website and its content to diffuse knowledge, resources, tools, toolkits, and online learning courses to the target audience and the broader field. This will be completed using the SAMHSA website.” I think this needs clarification/elaboration. We cannot modify or enhance a SAMHSA website. We can submit content for uploading. Is this the intent of this task? Yes, please see revised Attachment 1.

26. Scenario for Domain IV Communications Projects: Should we assume 20 grantees for this scenario? In Domain III, it is stated that 20 awards were made to community-based organizations in rural areas, and in Domain V, it is stated that technical assistance and training shall be delivered to 20 grantees. No reference is made to the number in Domain IV. Yes, please see revised Attachment 1.

27. Scenario for Domain V: Page 13 states that contractor should assume “20 onsite technical assistance visits and/or training at each of the grantee sites…” Please clarify whether this means 1 visit to each of the grantees for a total of 20 visits, or 20 visits to each grantee, for a total of 400 visits. One visit to each of the grantees for a total of 20 visits. Please see revised Attachment 1.

28. Scenario for Domain IV Task 2d:

a. For budgeting purposes, what types of materials should be included for the scenario and at what quantity for each? Please see revised Attachment 1.

b. This task mentions mailings; how many mailings are to be budgeted, how many addresses are each to be sent to, and if the contractor is to copy the materials, how many pages and in color or black and white should be included? Please see revised Attachment 1.

c. This task indicates dissemination at conferences; how many events will occur each year?

Please see revised Attachment 1.

29. Scenario for Domain V:

a. Task 3: How many days will each onsite TA visit be budgeted? Please see revised Attachment 1.

b. Task 3: Grantee meeting: i. How many days will the grantee meeting be scheduled? Please see revised Attachment 1.

ii. Task 3: How many total people should be expected? Please see revised Attachment 1.

iii. Task 3: Is there a preferred city to be budgeted? Please see revised Attachment 1.

30. Scenario for Domain V, Task 2a: Is there a preferred city for the 3rd event? Assuming this question is referring to Domain VI, the answer is Washington, DC.

31. Attachment 1; Domain IV, Task 1a. Is SAMHSA open to methods other than focus groups and message testing to determine appropriate methods? For the purpose of this scenario/sample task order, no.

32. Attachment 1; Domain IV, Task 1b. Shall we provide our estimate of time for Office of Management and Budget package approval or do you have a suggested time frame? Nine months- this has been noted in the revised Attachment 1.

33. Attachment 1; Domain IV, Task 1c. Are there any limitations on the format for documenting success stories? No.

34. Attachment 1; Domain IV, Task 2a. Does SAMHSA have assumptions for the number of messages and materials to be developed? No.

35. Attachment 1; Domain IV, Task 2a. Does SAMSHA have assumptions for the type and budget for production of media, as these costs can vary greatly between print, broadcast, electronic, digital, etc.? No.

36. Attachment No. 1 Domain IV, Task 2c. Is SAMSHA intent to pay for travel for attendees of the two face-to-face meetings for no more than five people each, and for the recognition event (one face-to-face event for 50 people)? For the purpose of this scenario/sample task order, no.

37. Attachment No. 1Domain IV, Task 2d. Does SAMHSA have budget assumptions for the production of materials, as the production of print and web based content can vary greatly from the production of videos, podcasts, and PSAs for example. No.

38. Attachment No. 1 Domain IV, Task 2d. Does SAMHSA have budget assumptions for the dissemination or placement of media (e.g. out of home, print, broadcast, etc.)? No.

39. Attachment 1. For Domain III scenario-based tasks, could SAMHSA provide clarification on the roles of the contractor vs. the role of the agency in supporting the funding opportunity? For example, would the contractor provide content for the funding announcement while SAMHSA will determine final text and issue the announcement? Will the contractor recommend (based on application review) which community-based projects should be awarded while SAMHSA makes the final determination and manages the awards? In the example provided above, the Contractor would not provide content for the funding announcement but rather analysis or conducting focus groups/engaging experts. Also in the above example provided, the Contractor would not recommend which projects should be awarded but rather assist with grant application review.

40. Attachment 1. In several places in Attachment 1’s scenarios, parenthetical page limits are provided, e.g., Domain I, Task 1.c “(no more than five pages)”. We assume that such statements are intended to quantify the anticipated length of a report or product described in a given subtask. Is that the correct interpretation? These statements could alternatively be interpreted to imply a page length for the write-up of that specific subtask in our proposal response. Please clarify the intent. Both are correct.

41. Attachment 1. For the scenario intervention in Domain 1, will another entity be responsible for implementation of the intervention. Yes.

42. Attachment 1. For Domain IV scenario-based tasks, the attachment says “it is estimated that these tasks will take three years”. Can SAMHSA clarify whether “these tasks” refers to all of the tasks listed for the Domain IV scenario (i.e., tasks 1-4 together should take 3 years) or whether the three-year timeframe applies only to task 1, which immediately follows the statement? If only task 1 is included in the three year span, can SAMHSA provided an anticipated time frame for tasks 2, 3, and 4? Refers to all the tasks.

43. Attachment 1. For Domain V scenario-based tasks, the attachment says “it is estimated that these tasks will take five years”. Can SAMHSA clarify whether “these tasks” refers to all of the tasks listed for the Domain V scenario (i.e., tasks 1-5 together should take 5 years) or whether the three-year timeframe applies only to task 1, which immediately follows the statement? If only task 1 is included in the five year span, can SAMHSA provided an anticipated time frame for tasks 2, 3, 4 and 5? Refers to all the tasks.

44. In Attachment 1, Domain Descriptions with Scenarios, for Domain III, states: Task 1a: The Contractor shall organize, convene, and conduct focus groups, technical groups, or consultations to provide information on select topics of interest including but not limited to:

mental/substance use disorders, healthcare financing, behavioral health disparities, latest clinical/medical practices for those with behavioral health conditions. Can we propose a scenario that focuses on only one of these topics or must it be all of them? Yes may focus on only one.

45. Regarding Attachment 1, the scenario for Domain IV includes a Task 3 called “Program Knowledge” but the task has no associated evaluation criterion. Would the government please clarify any associated evaluation criteria and/or point value associated with this task? This is no longer a task but has been combined with Knowledge of Communications.

46. Page 105, 4. Facilities/Equipment: The text reads, “This may include but not be limited to evidence of ownership or access to adequate facilities, office equipment, computer hardware (e.g., mainframe/servers, PCs, printers, etc.), computer software, and other equipment necessary to perform the tasks.” What would be acceptable “evidence of ownership or access”?

“Evidence of” has been removed from this evaluation criteria.

47. Page 9, Attachment No. 1, 2017 SAMHSA IDIQ Domain Descriptions-with scenario: The scenario for Domain IV: Communications states: “. . . the grantees need assistance with widely distributing information. . .” Is the Task Order awardee assisting them with developing a plan for widely distributing information or is the Task Order awardee distributing the information on the grantee’s behalf? Please clarify. This question is unclear. There is currently no Task Order but rather RFP for the SAMHSA IDIQ. If this question refers to the latter, than the answer is both.

48. Page 10, Attachment No. 1, 2017 SAMHSA IDIQ Domain Descriptions-with scenario: Task 1c.

reads: “The Contractor shall develop plans documenting “success stories” from constituents and programs . . .” Is your intent to ask the contractor to develop plans for document success stories, or is your intent to ask the contractor to document the success stories? Please advise.

The latter.

49. Page 10, Attachment No. 1, 2017 SAMHSA IDIQ Domain Descriptions-with scenario: Throughout Attachment 1, certain tasks are assigned page limits, but others are not. For example, the description of Task 1a under Domain IV, Communications Projects, indicates a page count of “no more than 15 pages”. However, the description of Task 1b does not indicate any page count.

Please confirm that the tasks and sub-tasks that do not indicate a page count in their description are not subject to page count limitations. Correct.

50. Pages 11-14, Attachment No. 1, 2017 SAMHSA IDIQ Domain Descriptions-with scenario:

Regarding Task 3, for the one national grantee meeting referenced here, is the contractor responsible for providing logistical support? If so, can additional clarification be provided for the services required? What is the duration of the event? Only logistical support if related to TA and/or training. Please see revised Attachment 1.

51. Should the sample task be completely separate from the IDIQ response or integrated? It can be either way.

52. Domain 1. On page 1 of Attachment 1, Tasks 1a & 1b reference the study units. Does SAMHSA define these units as the Organizations implementing the intervention/under study or the participants/clients in the intervention/programs? If SAMHSA defines units as the implementing organizations, then in task 1b is SAMHSA suggesting that the offeror only collect data from a sample of those 7 organizations? Organizations implementing the intervention.

53. Although the Task 3 scenario (page 2 of Attachment 1) provides a timeline to execute the evaluation scenario, it is NOT clear what the timeline is to execute the feasibility or the pilot studies (page 1 of Attachment 1). Should the offeror provide our own timeline or will SAMHSA furnish these details? Please see the yellow highlight areas.

54. The feasibility study scenario and the pilot scenario (pages 1 and 2 of Attachment 1) do not indicate that OMB clearance package is required; however, both studies will require data collection from more than nine individuals. Should the offeror assume that OMB is NOT required for these purposes of the scenarios or does SAMHSA wish offerors to limit data collection to nine individuals? Given that a typical OMB clearance package requires 6–9 months, if the timeline for the feasibility or pilot study is less than 18 months, we must assume that this is not required for these studies, correct? Please assume SAMHSA has already received OMB clearance. Please see revised Attachment 1.

55. On page 93 of 109 in the RFP, the second set of evaluation criteria for the technical approach for Domain I, item “a) reporting approach that includes…” references communication with the COR;

however, only Task 3 (Evaluation) references communication with the COR. Does this mean this technical criteria only applies to Task 3? Should Tasks 1 and 2 in the technical approach also include language on collaborating with and reporting to the COR? All tasks require communication with the COR.

56. On page 93 of 109 in the RFP, the second set of evaluation criteria for the technical approach for Domain I, item “a) reporting approach that includes…” also indicates that the offeror shall provide a sample of the monthly status and financial reports. Where should these materials go?

In the appendices? In the business proposal? If SAMHSA requires these materials to go in the technical approach, we would like to request additional pages to accommodate these materials.

The materials have been removed from the evaluation criteria.

57. Domain V. Are the 20 grantees requesting TA in the Domain V scenario (page 12 of Attachment

1) the same as the 20 new grantees mentioned in Task 4 of Domain III? Yes.

58. Can the government please clarify the difference between Task 2b: “The Contractor shall identify the TA and/or training needs of the target audience…” AND Task 3a: “The Contactor shall develop and implement a process to assess the TA and/or training needs of the target audience.”? Task 2 is related to developing training and/or TA materials and mechanisms. Task 3 is related to providing training and/or TA

59. . When the government refers to page limits in Attachment No. 1 (e.g., “no more than 15 pages” in Domain III: Task 1b on page 5), is it referring to how long the contractor’s response should be to this task or how long they want the deliverable produced from this task to be? There are other similar references to page lengths that are unclear in Tasks 1e and 1f of Domain III as well.

The latter.

60. RFP Attachment 1, p. 11 of 17: Domain IV, Task 4a. Will the Government want to have materials translated into other languages in addition to Spanish (e.g., Hmong, Chinese, Arabic), to reach a broader range of audiences? No.

61. In RFP Attachment 1, p. 11 of 17: Domain IV, Task 4a, the RFP states “The Contractor shall develop and provide publications or products as web-based and/or print-based materials, and disseminate these to the field.” However, RFP p. 19 states that “Unless SAMHSA exercises the SAMHSA exercise the right to produce/print hard copies, products produced under this contract/task order will be developed for electronic and web-based distribution only in accordance with the Executive Order on Promoting Efficient Spending.” Please clarify whether the Contractor will be responsible for any production, distribution and/or warehousing of hard copy materials. For the purpose of this scenario/sample task order, there will be no print-based materials.

62. Technical Proposal: Domain II. Page 94 of the RFP lists the following positions as key personnel:

Project Director, Program Manager, Senior Statistician/Survey Methodologist, Data Analyst/Modeler, Database Manager, Senior Research Analyst, and Senior Policy/Public Health Advisor/Analyst. On page 5, in the B.4. Labor section, it lists labor classifications that are anticipated to be the primary labor categories necessary to perform contract tasks orders. Some of them have an asterisk (*) to indicate that they are “Key Personnel and must be proposed regardless of the Domain.” Question: Do we have to add the Labor Categories from page 5 as key personnel that are not mentioned on page 94 (e.g., Senior Systems Analyst, Senior Statistical Programmer, Senior Economics, Senior Social Marketing Specialist, Senior Database Programmer, Senior Web Programmer)? No.

63. Technical Proposal: Domain III Page 28: The last paragraph states: “The Contractor shall develop a clear statement of the issue and/or a new hypothesis and concepts in planning, conducting, and evaluating long-term projects and proposals for the solution of complex public policy questions;

compile qualitative and quantitative data, available analyses, available policy/mission statements including but not limited to civil rights, language and discrimination policy, referral policies, health insurance policies, and other federal policies, and other relevant information; and prepare an analysis of policy/program alternatives, together with the pros and cons of each and a statement of their likely future success.” However, no points were assigned to this in the evaluation criteria. Is this task associated with any points? Yes, it associated with points under Personnel and Technical Approach.

64. Page 29: the second to last paragraph states: “The Contractor shall, with input from the COR, identify and engage available experts in the field. The Contractor shall convene and conduct meetings, focus groups, technical groups or consultations; prepare and support federal presentations at conferences and workshops; examine solutions to parallel problems in other fields; and use available means to define appropriate structures, processes and develop products. The Contractor shall make all logistical arrangements for non-federal participants, prepare meeting agenda and summaries, and conduct all follow-up activities.” However, no points were assigned to this in the evaluation criteria. Is this task associated with any points? Yes, it associated with points under Personnel and Technical Approach.

65. Page 98 of RFP: Some bullets of the evaluation criteria are associated with two sentences instead of one and assigned 2 points. Should we assume they have equal weight (1 point each)?

No.

66. Page 98 of RFP Bullet e combines two very different things “Experience proposing and implementing federal program and/or federal-private sector partnership scenarios” and “Experience identifying and performing analysis of performance measures that demonstrate the impact of program success.” Should those have two separate sets of points? No.

67. Page 99 of RFP Bullet h combines two very different things: “Approach to proposing and implementing federal program and/or federal-private sector partnership scenarios” and “Approach to identifying and performing analysis of performance measures that demonstrate the impact of program success.” Should those have two separate sets of points? No.

68. Technical Proposal: Domain IV - Task 3 subtask: “Approach to the production of live, satellite, and virtual conferences. (2 points)” is listed in the evaluation criteria of the RFP (p102) but is not in the Section C Scope of Work or in Attachment 1. Is this subtask part of the scope of work?

No. This has been removed from the evaluation criteria.

69. Task 3 subtask: “Approach to organizing recognition events for the entertainment industry for activities/campaigns. (4 points)” is listed in the evaluation criteria of the RFP (pp101-102), but is not in the Section C Scope of Work section of the RFP. Is this subtask part of the scope of work?

Please see Task 2c.

70. Task 3 subtask: “Develop a campaign for the behavioral health intervention” – No points are listed for this in the evaluation criteria of the RFP. Are any points offered for the approach to this subtask? Please see revised evaluation criteria.

71. For sample scenario, Domain I:

a. What is the minimum sample size required for a feasibility study? (Task 1, Page 1 of Attachment No. 1) Seven organizations.

b. Should the small sample for the feasibility study be randomly selected? (Task 1, Page 1 of Attachment No. 1) No.

c. Is the Experimental Group vs. Control Group design an option for the pilot study (as a new behavioral health intervention is involved)? (Task 2, Page 1 of Attachment No. 1) For the purpose of this scenario/sample task order, no.

d. On Page 14 Task 2, Page 1 of Attachment No. 1, out of Domain V, Task 5b, the RFP stated:

“The Contractor shall maintain, update, promote, and develop/enhance a website and its content to diffuse knowledge, resources, tools, toolkits, and online learning courses to the target audience and the broader field. This will be completed using the SAMHSA website.” Will this website be hosted by the SAMHSA website or the Contractor’s website? SAMHSA website.

72. For sample scenario Domain V:

a. Page 12 of 17, 3rd paragraph: “This may include TA and/or training at grantee meetings.” In addition to the new grantee meeting, how many grantee meetings will the contractor be required to conduct? See Task 3b.

b. Page 12 of 17, Task 1: How many TA and/or training programs will the contractor be required to conduct? For the purpose of this scenario/sample task order, one program.

c. Page 13 of 17, Task 2d: How many comprehensive resource documents will the contractor be required to develop? Two. Please see revised Attachment 1.

73. For sample scenario Domain VI:

a. Task 1 page 15 of 17, In reference to the third meeting, will there be 350 attendees in addition to the grantees and stakeholders OR is 350 the total inclusive number of attendees?

The latter.

b. In reference to the third meeting, will the virtual grantee meeting also be held on the last day as well as the in person plenary session? No.

c. Task 3c, Will the contractor be provided with a list of preferred speakers for the event OR will the contractor be require to reach out and solicit SMEs in a particular area? Both.

d. How many travelers are anticipated? For the first event, assume 10 travelers. For the second event, zero travelers. For the third event, assume 75 travelers.

e. Will any of the travelers be internal? This question is not clear. If the question is asking if internal Federal staff will be traveled, the response is no.

f. Task 3d, How many pages of materials are anticipated to be reproduced? Providing a page number is difficult. Please assume an average of 25 pages per person.

g. How many days will the event take place? Please see revised Attachment 1.

74. Domain I Question - During the preliminary question period conducted by SAMHSA on November 2, 2016, SAMHSA indicated that it was not necessary to write to a specific intervention for the purpose of preparing the technical approach response. However, for Domain 1, the design of the feasibility and pilot studies and the evaluation will be highly dependent on the specifics related to the intervention that is deployed. Should the offeror describe the approach that they would take in general for designing feasibility and pilot studies and program evaluations without giving specifics (e.g., measures, key questions, etc.), or should the offeror propose a hypothetical intervention and prepare a technical response that is tailored to that specific intervention? Either approach is acceptable.

75. Domain IV, Task 1a (page 9 of 17 of Attachment 1) says the new grant program awards grants to 20 community-based organizations in rural areas. Is it the contractor’s responsibility to help all 20 organizations with planning and executing a communications program? Is it only the focus group and message testing activities that are to be limited to no more than four grant sites? Are we to assume that the grantees have already decided their target audience for their program?

Yes to all three questions.

76. Domain IV, Evaluation Criterion 3i (page 102 of 109 of the RFP) evaluates the contractor’s approach to developing and providing publications or products that include but are not limited to monographs, web content and interactive web pages, infographics, video, audio, television and radio programming, newsletters, promotional kits, booklets, flyers, promotional webinars/videos, mobile apps, multimedia products such as PSAs, and podcasts. However, the scenario for Domain IV, Task 4 (page 11 of 17 of Attachment 1) says that the publications or products consist of no more than five four-page booklets and two two-page flyers. Is the evaluation criterion not in conflict with the domain requirements? Where would we detail our approach to the other materials? Please see revised evaluation criteria.

77. Domain IV, Task 1: Planning and Evaluation (page 31 of 109 of the RFP) — For cost and writing purposes, in what part of the region will the four grant sites be located? Please see revised Attachment 1.

78. Domain V, Establish and Maintain a Technical Assistance and Training Program (page 32 of 109 of the RFP) states: “The Contractor may provide TA and/or training to SAMHSA grantees and sub-recipients, the behavioral health field, and the general public. Specific populations may include but are not limited to consumers of services, including families and their children, individuals in recovery, age-specific, racial, ethnic, tribal, sexual, and gender minority populations, public health agencies, national organizations, providers, employer organizations, accreditation associations, the managed care industry, researchers, evaluators, business, and labor organizations, mental and SUD constituency groups, community-based organizations, states, territories, jurisdictions, sub-state (e.g., county), and …” Will the grantees be public, community/faith-based organizations, or a combination of the two? For the purpose of this scenario/sample task order, the grantees will be community-based organizations.

79. Domain V, Establish and Maintain a Technical Assistance and Training Program (page 33 of 109 of the RFP) states: “The Contractor may utilize a variety of methods and multi-disciplinary teams to provide TA and/or training, including Training of Trainers (TOT), TA and/or training teams, consisting of experts in the areas described herein, state to state, provider to provider, etc. TA and/or training may be provided simultaneously to multiple programs or sites through a wide range of customized virtual and in-person TA and/or consultations and services. This may include TA and/or training at grantee meetings. The TA and/or training approach may incorporate social marketing techniques and utilizes culturally competent health communications, which includes the potential for translation into multiple languages when appropriate.” Is it anticipated that the Domain V grantee meeting will be an annual grantee meeting? Yes.

80. Domain II states that the work may include focus groups. Is the government able to clarify if the scope of these focus groups might be larger than informing survey development? For the purpose of this scenario/sample task order, no.

81. Domain II mentions large scale data collections (e.g., 10,000 mental health organizations) – does the government anticipate the contractor providing the sampling frame for such efforts? Yes.

82. Reference: Section M, item 1 Personnel, Proposals shall be evaluated based on relevant past and/or current experience, education, training and/or other qualifications and competences directly related to developing and providing training and technical assistance on mental health and/or substance abuse issues to SAMHSA grantees and sub-recipients, the behavioral health field and the general public as evidenced by subparagraphs a thru h. Question 1: Please confirm that all areas should be organized by key personnel and consultant and other personnel labor categories. For example, a Chief of Evaluation/Epidemiology may not have experience h) Experience arranging telephone, video conferencing, internet, and travel logistics in support of the TA and/or training. (2 points) but will have experience developing and utilizing data collection instruments and procedures to evaluate the effectiveness of TA and/or training efforts. (2 points). This is the discretion of the Offerors.

83. Reference: Section M, item 2 Management, subfactor c The Offeror shall provide a staff loading chart, delineated by labor category and tasks in the sample scenario/task order. (4 points)Question 1: Is this requirement relating to the sample scenarios as there is no RFTOP identified herein so we cannot provide a labor loading chart for the IDIQ as we don’t know what the task orders will entail? Related to the scenario/sample task order.

84. Reference: Attachment 1, Domain 5: Question 1: How many grantees does SAMSHA serve under this domain? For the purpose of this scenario/sample task order, 20.: Question 2: Are the 20 grantees to receive onsite technical assistance central to one location or are they spread across the US? Across the US: Question 3: How long is a typical onsite technical assistance visit? Two days.:Question 4: Will the national meeting be held in the greater Washington metropolitan area? Yes.

85. Domain II. Data Analysis and Statistical Project, Task 3. Analyses of Complex Quantitative Data, it says “The Contractor shall be required to use appropriate statistical software (e.g., SUDAAN, Westvar, STATA) in performing analytic tasks.” Are these the only three statistical software packages being considered, or alternatives such as SAS or R acceptable? These are not the only three software packages being considered.

86. Domain IV. Communications Projects, Task2a. The Contractor shall disseminate appropriately packaged messages, including but not limited to a vast array of print, broadcast, digital, electronic, and other media, to appropriate target audiences, and also effect appropriate change to achieve project and organization goals. Is the Contractor expected to pay for printing and media buys? For the purpose of this scenario/sample task order, printing, no. Media buys, yes.

87. For the Domain V. TECHNICAL ASSISTANCE AND TRAINING PROJECTS: The scenario states: “At the new grantee meeting, the 20 new grantees have also requested technical assistance and training in the areas of workforce development, building organizational capacity, reaching age-specific, racial, ethnic, tribal, sexual and gender minority populations, and sustainability. Additionally, non-grantees have requested some training on the purpose of the new rural behavioral health grant program and how to assess if the behavioral health intervention would be applicable to their setting. It is estimated that these tasks will take five years. “ Then everything is broken down by tasks, including a breakdown of points for this section. The section referenced above doesn’t seem to be addressed anywhere in the delineated tasks. Please provide additional direction because we are not sure what is being asked for since everything about the first sentence (20 new grantees) seems to be spelled out pretty clearly. This question is unclear. Please incorporate the scenario/sample task order into the technical proposal.

88. Domain VI – Technical Proposal - Please provide descriptions of labor categories called out for Domain VI (Page 105 of 109). Please include requirements for education and years of experience, as well as roles and responsibilities for each labor category. This is the discretion of the Offerors.

89. Can an individual serve in two Key Personnel roles (e.g., Project Director and Senior Meeting Manager)? Yes.

90. Please clarify your use of the term “virtual event”. Not a face-to-face event and where no travel funding is needed.

91. Is this limited to conference calls and webinars, or does it include webcasts requiring video cameras, live streaming equipment etc.? May include webcasts.

92. For logistic and costing purposes, will virtual events be conducted using SAMHSA infrastructure resources (webinar and webcast platforms, computers/video cameras) or contractor resources?

For the purpose of this scenario/sample task order, contractor resources.

93. In the description of Domain VI, (page 34 of 106), the Space section states that the contractor “shall negotiate and implement a contract to obtain meeting space”. Will the government or the contractor sign the contract? Contractor. If the contractor, will SAMHSA accept contract language that protects the contractor from risks related to event cancellations? Yes.

94. Attachment 1, Domain 5, Task 5a. Are there any off-the-shelf products that could be customized to fit the bill here, or does it have to be a system developed entirely by us? For the purpose of this scenario/sample task order, a system developed by the Offeror.

95. Attachment 1, Domain 5, Task 5b. The RFP mentions that “this will be completed using the SAMHSA website.” Is there already in place? Who would be hosting the (LMS?) site in question?

SAMHSA. Please see revised Attachment 1.

96. Domain 5. What is the anticipated volume of TA and Training needs? How many groups/organizations may request technical assistance per week, month or year? How many should we be prepared to serve? For the purpose of the scenario/sample task order, 20 grantees and 10 non-grantees. Please refer to the yellow highlight section for additional information.

97. Domain 5. How many groups/individuals might need training? For the purpose of the scenario/sample task order, 20 grantees and 10 non-grantees.

98. Domain 5. For training that can be delivered online, about how many simultaneous users should we assume? Assume an average of 20 users.

99. Domain 5. For facilitator-led training, approximately how many classes might need to be delivered per week, month or year? Please refer to the yellow highlight section for additional information.

100. Domain 5. For potential training and TA, what languages are likely to be needed? For the purpose of the scenario/sample task order, English. To accommodate culture-specific needs, what cultures should be considered? This is the discretion of the Offerors.

101. Domain I Hypothetical. Task 2 Pilot study. The task 3 evaluation refers to “30 new grants.” Should the offeror assume that SAMHSA would be providing grants or other support to the task 2 pilot sites to support implementation of the intervention? (Otherwise, it’s unclear how sites would be able to implement the program.) Correct.

102. Domain I Hypothetical. Task 3 Evaluation. Can there be overlap with the 30 pilot sites and the 30 evaluation sites, or should the 30 evaluation sites be different from the pilot sites?

Different.

103. In Domain 1, does the contractor have to find funding to support the underlying feasibility and pilot studies? No.

104. In Domain 1, does the contractor have to demonstrate experience in all three areas of feasibility studies, pilot studies and evaluations to qualify? No.

105. In previous years how has Domain 4, Communications, been characterized? SAMHSA’s Pre-proposal Conference presentation shows Domain 4 to be Technical Assistance and Training;

have there been IDIQ Communications vendors in the recent past? Yes.

106. For Domain VI, for comparison purposes can the following be clarified (responses may impact staff level of effort/labor loading): Scenario 1 – Recognition Event - Will the contractor need to assume sponsored travel for the individuals coming from the 3 community based organizations? If so how many from each? Assume 10 travelers. Is this an all-day event? Yes, one day event. Will there be speakers/consultants that will need to be compensated? If so, how many should we assume for this exercise? For the purpose of the scenario/sample task order, assume none. What type of recognitions/awards? For the purpose of the scenario/sample task order, plaques and certificates.

107. Scenario 2 – Virtual Grantee Meeting - Shall we assume this meeting be webcasted with multiple virtual meeting rooms? This is the discretion of the Offerors.Shall we assume the virtual meeting is 1 day? Two days. Will there be paid consultants/facilitators? If so how many should we assume? For the purpose of the scenario/sample task order, assume none.

108. Scenario 3 The events on the last day of which grantee meeting-- Will participants from the grantee meeting attend? Yes. How many days? One day. When conducting the site search should the contractor assume the space in the Washington, DC Area or SAMHSA or other Federal facility? Yes. Expert Panel- should we assume that the expert will receive consulting fees for the 3 meetings. For the purpose of the scenario/sample task order, yes.

109. Attachment No. 1 – scenarios. How does SAMHSA expect to measure awareness and education amongst the two target audiences? Task 1b under Domain IV would need to be completed.

110. Attachment No. 1 – scenarios. Given that urban and rural populations have very different experiences and cultural differences, how do we ensure we get the data we need in order to properly develop and execute a comprehensive communications plan when there's a different firm collecting the information? This question is unclear. Please assume everyone is cooperative.

111. Attachment No. 1 – scenarios. Under Domain IV is Task 4 applicable to rural grant sites only or the nation-wide campaign mentioned in Task 2c? Nation-wide campaign.

112. In the evaluation criteria in Section M for Domain V, under “Technical Approach,” bidders are instructed to “provide a sample of a monthly status and financial report, tracking costs by task and projecting future budget needs.” Below are two questions about this requirement: Is SAMHSA looking for a hypothetical status report based on the scenario for this Domain, or does the government want an example of a typical status report that the bidder might use (e.g., an example from another project)? And Section L.2.a.4 specifies that “the technical proposal must not include pricing data relating to individual salary information, indirect cost rates or amounts, fee amounts (if any), and total costs.” The request for a sample financial report would seem to violate the L.2.a.4 stipulation to not make any reference to costs in the technical proposal. Please clarify. This has been removed from the evaluation criteria.

113. In the Technical Approach section of the Evaluation Criteria (Section M) for Domain V, the RFP lists a set of items (a-h) related to “activities as outlined in the scenario/sample task order.” There is then a second set of items (a-e) related to “training and technical assistance on mental health and/or substance abuse issues to SAMHSA grantees and sub-recipients, the behavioral health field, and the general public…” Does this second set of requested information also relate back to the specific scenario in the hypothetical Task Order, or does it refer to the Bidder’s approach to such activities in general? Please see the revised evaluation criteria.

114. In Attachment 1, Domain 5, Task 5.b. notes that the vendor will “develop/enhance a website and its content…” but then goes on to specify that “this will be completed using the SAMHSA website.” Is the vendor simply developing web-ready content, or will the vendor also be doing web development and maintenance work for SAMHSA? Please clarify. Developing web-ready content. Please see revised Attachment 1.

115. Domain II Scenario, general. It is estimated that Task 1 will take 0.5 year, Tasks 2a-2c will take two years, Task 2d will take three years, Task 3 will take one year, and Task 4 will take one year. Are these recommended time periods sequential or do they overlap? Sequential. Please see revised Attachment 1.

116. Domain V Scenario, task 2.c. This shall include developing in-person (for one 10 page guide), online (for one self-paced online training course and one online toolkit), ... The reference to "developing in-person (for one 10 page guide)" is unclear. Can you please clarify if you are requiring development of a 10 page guide only or is it to be in conjunction with some sort of in-person training? The latter. Please see revised Attachment 1.

117. Domain II Scenario, task 1. The Contractor shall provide expertise and consultation on the design of complex survey design, sampling procedures, variance estimation, compound weights, simulation studies, and statistical methods for analyses of sample survey data with a range of complex designs…The Contractor shall provide expertise in evaluating data quality from censuses and sample surveys in the domains of sampling and measurement error, nonresponse and coverage bias, and the effect of data processing and statistical disclosure methods on data quality. Is Task 1 entirely separate from Tasks 2a – 2d or is Task 1 complementary to Task 2a – 2d? Complementary. By complementary, we mean that Task 1 can be addressed in the process of answering the specific activities described in 2a – 2d. Our concern is that Task 1 is more general in its description and it overlaps with the more concrete tasks described in Task 2a – 2d.

118. Domain V, Task 2c- states “The Contractor shall develop or adapt TA and/or training material (no more than four materials)”. Is this four materials a year or four materials over the course of the 5 year contract? The former. Please see revised Attachment 1.

119. Domain V, Task 3b – Are the “4 virtual trainings, 20 onsite TA visits, and 1 national meeting” over the course of the contract or on an annual basis? The latter. Please see revised Attachment 1.

120. Reference: Special Notice, Attachment 1, 2017 SAMHSA IDIQ Domain Descriptions: Domain V. Technical Assistance and/or Training Support. The solicitation states, "The Contractor may provide TA and/or training to SAMHSA grantees and sub-recipients, the behavioral health field, and the general public." Will the government please specify how many grantees and sub-recipients does SAMHSA anticipate? 20 grantees and zero sub-recipients.

Please see revised Attachment 1.

121. Reference: Attachment 1 Domain V. Technical Assistance and/or Training Support. Task 4c: The solicitation states, "The Contractor shall prepare event summary evaluations within five days after event." Will the government please clarify, how many and what types events? Please refer to Task 3b. Please see revised Attachment 1.

122. Page 50 - H.12, OMB Clearance: Please confirm whether this requirement is applicable to infrastructure systems used by the contractor in execution on contract tasks (e.g. conference registrations, surveys etc.). Please see revised OMB Clearance section of RFP and Attachment 1 SOW scenarios.

123. Is the Implementation Plan described on page 77 different than the work plan detailed on page 74? Yes.

124. Please clarify the bolded language below, which was taken from Task 4a in the scenario for Domain III (Attachment No.