Web testing and Monitoring Solution

Added: May 14, 2013 12:01 pm

Below are questions asked about the RFQ and corresponding answers.
Question 1
What is the number of concurrent users during the busy hour for testing the base test? Is it 1250 users?
Answer
Section C.4.4.1 of the SOW describes the number of peak visitors required during each two hour test, as well as the ramp up period to achieve that peak level.
Question 2
Using the table on page 9, Base level only, are you looking for 15,000 concurrent users? Or taking into consideration the 5 minute anticipated visitor duration, if 1,250 concurrent users is what they need.
Answer
See question 1.
Question 3
The base test would be for 15,000 users visits per hour is making an estimation per hour of 1250 users being in the web for five minutes. Each concurrent user is making 12 web connects in one hour. This number appears considerably less than the average 2.1 million per hour. Please expand or clarify?
Answer
The requirements for the web load testing scenarios are articulated in SOW Section C.4.4.1.
Question 4
The number of page views per visitor shall be 4 per test case , is that correct?
Answer
The number of page views per visitor shall be 4. The 10 pages per test may not necessarily be linked to one another. The Offeror should assume 1 to 2 test case to page coverage (5 different test cases will need to be developed for the Base year requirement of 10 pages per test), and that test scripts created in the base year can be reused in the option years.
Question 5
To achieve 10 pages per test will require 3 test cases?
Answer
The government does not understand the question.
Question 6
Will the SEC have resources available during the load testing to monitor the web services, databases, and networks band utilization during the testing?
Answer
The SEC will either actively monitor the internal servers and networks during the load test executions, or will review health reports the following morning.
Question 7
Post analysis results between testing: what is the expected time?
Answer
The test results should be available within an hour of the test completion. Any recommendations that result from those results should be delivered within 1 business day of the test completion.
Question 8
What is the expectation of post analysis support to deliver the results after the load test?
Answer
See question 7
Question 9
What is the estimated time line between the five base tests for the two hour test? Please clarify the estimate time between the specific tests: is it an hour, a day, a week?
Answer
The time between tests will vary based on overall project schedule constraints. The estimated time between test executions will likely be no less than 1 day.
Question 10
If the test fails what is the expected turnaround time before the next test?
Answer
The turnaround time for a failed test will vary based on project schedule constraints, and could be the same day or the following day.
Question 11
"What is your expectation of the 7x24 for 1 year monitoring service:
a. How many visits per hour?
b. Would we use the same test case?"
Question 12
a. Visits are expected every 5 minutes to each of the pages or apps being monitored from each of the required points of presences.
B. The quoter should recommend what test case(s) to use for this monitoring requirement.
Question 13
What is the process if the quoted tool is not totally 508 compliant?
Answer
Per section 6012.02 of the RFQ, a product that is not 508 compliant may be eliminated from further consideration for award. However, per the final paragraph of this section, offerors should submit a VPAT for their products to identify the areas that are and are not compliant and articulate whether a plan is in place to correct the product's deficiencies.