Responses_to_Inquiries_for_RFQNLM2013659SRE_Social_Media_and_Engagement_Tool.doc

Response to Inquiries

Request for Quote (RFQ) NIHLM2013659SRE

Social Media and Engagement Tool

February 25, 2013

Q1.

Software-only solutions often include many erroneous results and frequently have limited accuracy in categorizing coverage by topic and scoring for tone. Does NLM require, or have interest in applying human judgment in the analysis of topics appearing in media coverage, to improve the accuracy of measurement and better extract management insights?

A1.

For this one year contract NLM was expecting to provide the required human judgment through its own staff. An offerer who proposes including human judgment should explain the plan and price this portion of the service.

Q.2 What are the most important metrics NLM would like to generate with the new solution?

A2.

Relative popularity of sources consulted by those seeking health information on daily basis, in response to news items, and in emergency circumstances; Analysis of the variation in quality of the information held by the sampled population for a number of specific health topics; Distribution of information beliefs geographically for a number of health topics.

Q3.

Please provide examples of important actions NLM anticipates taking with the information from these projects.

A3.

Possible re-allocation of information resources among web site, social media, print publication options; Possible changes in the semantics of the information NLM now provides; Addition to our offerings of specific authoritative counters to the most prevalent misconceptions about a variety of health topics.

Q4.

What other sources of content beyond social media need to be analyzed – if any?

A4.

The work of this contract will be limited to analysis of social media.

Q5.

Which competing organizations does NLM wish to track?

A5.

Federal sites as maintained by other NIH Institutes, DHHS, CDC, and popular private sector information sources such as Google, Mayo Clinic, WebMD, various user/patient communities.

Q6.

How important is the comprehensiveness of content analyzed vs. project cost?

A6.

Comprehensiveness is important as are cost limitations Q7.

Does NLM wish to include content that may not be accessible on the web (example, limited access publications available through services like Factiva and/or Lexis Nexis)? If so, how important is this?

A7.

Not contemplated within the scope of this contract.

Q8.

What types of pricing models are acceptable to NLM? Is a structure comprised of a yearly fee (based on user seats) and a volume-driven content analysis fee acceptable?

A8.

A fixed total cost is contemplated so a yearly fee based on user seats is preferred.

Q9.

How will the success of this program be measured?

A9.

Extent to which persuasive, if not definitive, increase occurs in our understanding of health information seeking/management by consumers, clinicians, researchers.

Q10.

Does NLM also desire media analytics in addition to monitoring? (Things like tone, message pickup, analysis of influencers, etc.) If so, what types of metrics would NLM desire and in what format?

A10.

NLM is intending to perform analysis itself. If offerer wants to include analysis, the plan and the pricing should be clear.

Q11.

Please list the search terms and key word Booleans the NLM currently uses (or wants to use) for media monitoring.

A11.

The contemplated list is large and includes diseases, remedies, health topics in the news, etc. because public reaction to current health issues is one of NLM’s priorities.

Q12.

How and by whom will the results provided from this monitoring service be used?

A12.

At this time, results are intended for internal use by NLM; some results may be shared with sister Institutes at the National Institutes of Health. At some future time some results may be submitted for publication in appropriate medical journals.

Q13.

Does the NLM want the vendor to provide a complete solution (software, media content, and analysis/curation of that content), or does the department plan to provide some of the resources/tools the vendor to work with? If the department will provide some of these resources, which ones?

A13.

NLM is intending to do analysis/curation Q14.

The RFQ states an interest in learning the impact of NLM interface design on usage by customers. Please describe the kind of analysis you envision, as this seems to quite distinct from analyzing the media references to NLM resources.

A14.

Depending on results obtained, NLM may wish to evaluate the extent to which alterations in its interface or semantics influences media references. Interface design is not expected to be conducted in the resultant contract.

Q15.Based on what metrics or analysis would you like to evaluate the public’s interest in using social media for health-related purposes?

A15.

Frequency of mentions, sentiment analysis, quality of information selected.

Q16.

What kinds of demographic variables would you like to analyze with respect to the messages being evaluated?

A16.

Location, number of followers, academic degree.

Q17.

The RFQ seeks insights with respect to citations of published papers available in NLM databases and text references. Please describe the types of metrics and insights you seek, as well as any resources/search tools you wish the contractor to use.

A17.

Aggregating messages that contain citations or references is sufficient.

Q18.

Please describe the types of insights you would like to obtain regarding the following items mentioned in the RFQ:

a. Information-seeking behavior of clinicians and scientists Aggregating messages that cite publications by M.D., R.N., or Ph.D will provide NLM with an opportunity to explore analytic options.

b. Effects on usage of modifying database design features Changes in database design, if done at all, will be done by NLM. Contractor’s essential tasks will not change.

c. Professional comments about value of NLM's resources NLM would be interested in sentiment analysis of messages from physicians, nurses, or scientists who mention NLM resources.

d. Comparison of use of NLM resources to use of those provided by "competitors" For a given concept to be analyzed NLM would be interested in relative usage of NLM, other Federal health sites, and private sector sites as sources of information by consumers.

e. Regional and international differences in information-seeking behavior by professionals NLM would like to compare information sources utilized by U.S. clinicians and scientists to those most popular with foreign clinicians and scientists.

Q19. The RFQ states the need for the contractor to train government personnel in use of the software. Does the NLM wish to continue to use the software beyond the 12 month term of the engagement? And if so, does the NLM wish to take on all tasks handled by the contractor after the 12 month term (e.g., maintaining Booleans, sourcing appropriate feeds, curating content, preparing analysis and insights) or does NLM envision the contractor continuing in a support role, with NLM handling higher-level analysis of outputs?

A19.

NLM has no specific plans at this time for continuing past the 12 months of the contract. Should NLM decide to continue, the question asked would be considered at that time.

Q20.

What are the National Library of Medicine's (NLM) goals and objectives for this project? While we have read the posted information, we would like to get a deeper understanding.

A20.

The overarching objective of these studies is to obtain a richer understanding of how consumers, clinicians, researchers actually look for the health-related information they seek, and what they do with what they find.

Q21.

What tools does the NLM currently use to handle this work?

A21.

NLM uses standard metrics to measure “hits”, responses to tweeted information etc but is not currently doing specific data-mining of social material.

Q22.

To what degree is the NLM looking for off the shelf software vs. a custom developed solution?

A22.

Whatever works is acceptable but NLM believes it likely that OTS is more practical for a one-year contract.

Q23.

Does the NLM envision an ongoing services engagement with the successful partner?

A23.

At this NLM has not identified any need beyond the stated scope and period of the RFQ. Additionally, via this RFQ NLM only seeks to solicit the services of a Contractor to provide the stated services. NLM is not soliciting a partnership nor shall any partnership be established through the resultant contract.

Q24.

What is the relative importance of project one vs. project two?

A2.

Both are important to NLM, but Task One is considered to be of particular initial interest.

Q25.

How large is the list of sites the NLM considers to be competitors?

A25.

About a dozen, including other Federal sites, and some private sector sites.

Q26.

Over what time period will the successful partner be expected to maintain the universe of social media database?

A26.

NLM would welcome discussion and recommendations about this issue. Additionally, via this RFQ NLM only seeks to solicit the services of a Contractor to provide the stated services. NLM is not soliciting a partnership nor shall any partnership arise be established through the resultant contract.

Q27.

Are any secondary usage data sources (i.e. visitor statistics) available to the system?

A27.

NLM has visitor statistics. What is meant by “the system”?

Q28. Task 1: Will NLM consider a completely cloud-based approach or does it have to be a hybrid approach with analytical software installed locally, supported by access to a remote cloud-based media aggregation service?

A28.

Either approach is acceptable.

Q29.

Task 2: What is the historical expectation of social media content from queries to be saved: 90 days, rolling 12 months, other? Does NLM need historical access to social media when doing queries?

A29.

Rolling 12 months should be sufficient, but NLM welcomes offerers propose suggestions. For task 2, historical access would have considerable value.

Q30.

In its reference in the RFQ to “video” as one of the social media sources of interest, is NLM referring to social video like YouTube, Vimeo, etc., or is it referring to broadcast news video feeds?

A30.

Reference is to social video but NLM realizes that exploitation of such may require work beyond the period of this contract.

Q31.

With any product comes initial setup and training consultation. Can you confirm that you are looking for ongoing domain subject matter expertise (as it relates to government) that goes beyond product vendor support (i.e., setup, training, and ongoing).

A31.

NLM expects provide its own domain subject matter expertise.

Q32.

Most of the monitoring solutions are currently web-based. Is this allowable?

A32.

Yes.

Q33.

What tool(s) are in use as part of the current "potpourri"?

A33.

Standard web site metrics but no data-mining of social media.

Q34.

Can you confirm that you are looking for two topic profiles and ad hoc queries?

A34.

Yes.

Q35.

Do you have any historical data on mentions for each topic?

A35.

No.

Q36.

Who does the National Library of Medicine (NLM) consider to be a “competitor?” Are other government agencies included?

A36.

Other sources of health-relevant information as provided by other NIH Institutes, DHHS, CDC, and such private sector sources as general search engines, Mayo, WebMD, and user community sites.

Q37.

Does NLM have any closed community social media sites (i.e., specific to researchers, specialist, etc.) or is NLM planning on implementing such sites?

A37.

No. No.

Q38.

How does NLM currently monitor use of its resources (i.e., subscription based, free, or otherwise)?

A38.

Through contractors experienced in Web usage metrics.

Q39.

Will NLM allow the social media mining software to be hosted, with appropriate access granted to the specified two Government users?

A40.

Yes.

Q41.

Could the government please describe the current “potpourri of monitoring tools” referred to in the 3rd paragraph of the synopsis?

A41.

Standard metrics for monitoring Web site usage.

Q42.

What social media platforms/accounts are currently in use by NLM?

A42.

NLM uses Twitter and Facebook to push certain types of health information. No data-mining is on-going.

Q43.

How do you define your customers? How do you define your competitors?

A43.

“Customers” are a very large population in U.S. and abroad of consumers, clinicians and biomedical researchers. NLM databases receive many millions of “hits” per year. “Competitors” are others in government or private sector who make health-relevant information available.

Q44.

The sixth dot point under the deliverables paragraph states “ A delivery schedule will be provided by the Contractor within thirty (30) days of the contract” . Is it correct to assume that the government expects up to a 30 day delay from contract award until contract start date? Please clarify expectations for delivery.

A44.

No. Considering that there may be a need to conference with the successful Contractor upon award, this provision provides flexibility in finalizing an adequate delivery schedule.

Q45.

Does NLM wish to have personnel monitoring and responding to social media sites 24/7 or only during specific hours?

A45.

Only during specific hours.

Q46.

The software license should cover two (2) users, however how many computers and/or other devices (i.e. tablets, mobile devices, etc.) does NLM expect to have the software accessible on?

A46.

Two desk machines, one laptop.

Q47.

Are the computers that will be used to track the social media engagement PCs or Mac?

A47.

Both if feasible. NLM can adjust if offerer is restricted to PC or Mac.

Q48.

Is there any expectation of expanding the number of users beyond just two during or past the performance period of this contract? Will these two users be the same two users throughout the period of performance?

A48.

Only two users are contemplated. The same two users are expected for the period of performance but NLM reserves the right to make a change if such became necessary.

Q49.

What kind of ongoing support will be required during or past the performance period of this contract? How many FTEs do you expect this ongoing support to require?

A49.

No support is expected beyond the period of performance. NLM expects contractor to advise on FTE equivalents that will be needed.

Q50.

What are the technical specifications of the Government computers on which our licensed software will be installed? Will these be limited to desktops or include laptops and tablets?

A50.

NLM would prefer to use two desktops, one laptop- all Macs. If offerer is restricted to PCs, NLM can accommodate.

Q51.

Would there be added value for the solution to be leveraged throughout NLM for other projects outside the social media scope, but still dealing with analytics of various unstructured data sources (i.e., medical journals, academic publications, etc.)?

A51.

Not at this time.

Q52.

Will the National Library of Medicine want the capability to store data captured from various social media outlets for historical analysis of the data as well?

A52.

Yes.

Q53.

Is there a certain volume of data that the Library of Medicine is expecting to see with this solution (depending on the proposed solution, data volume may be important to be able to accurately price out the solution)?

A53.

NLM cannot predict volume at this time, although huge quantities are not likely.

Q54.

The solicitation specifies software alone, but often these types of solutions have large data volumes given the amount of data available in the social media space.

Many times there are hardware considerations that come into play. Would any discussion on a hardware architecture be disregarded as irrelevant content or be taken into consideration as part of a potential overall solution?

A54.

NLM is not expecting hardware issues, but if essential to a useful approach, offerer is welcome to explain and price out this option.

Q55.

Is there an incumbent or is this a new project?

A55.

No.

Q56.

Is this a budgeted line item and has funding been allocated? If so, how much funding has been set aside?

A56.

Award will be made subject to the availability of funds. The government cost estimate will not be provided.

Q57.

Will NLM definitely choose one of the outside vendors for this work, or will they consider doing it manually in-house?

A57.

The NLM is soliciting an independent Contractor to provide the services specified in the RFQ.

Q58.

Can the government provide an anticipated award date for this requirement?

A58.

On or about March 12, 2013

Q59.

Can the government provide an anticipated work start date for this requirement?

A59.

On or about March 12, 2013.

Q60.

Does the government have a preferred cost template format or should bidder’s use their own format?

A60.

Offerors may use their own firm fixed price template.

Q61.

In terms of formatting, are there any other style restrictions, such as font type or size, which should be observed?

A61.

Arial, Times New Roman, or Cambria are acceptable font types. Font size should be no less than 12.

Q62.

For the electronic submission, what is the file size limit for email attachments? Is there a filename format preference or document type preference?

A62.

File size limit is 10 MB. In addition, Offerors should ensure their submissions comply with the page and space limit specified in the RFQ.