USMC CBM plus RFI QA.pdf

CONDITION BASED MAINTENANCE PLUS (CBM+) DATA ANALYTICS, DATA

VISUALIZATIONS, DATA CAPTURE HARDWARE, AND DATA TRANSPORT METHODS

M67854-24-I-5121

Questions and Answers

Q1: Is this is an entirely new effort or is there an incumbent currently providing these services? If so, would you please provide the incumbent contract details?

A1: This is a new effort.

Q2: Could you please clarify if the data sources for this project will be provided by the

MARCORSYSCOM, or will we need to find and integrate them ourselves?

A2: MARCORSYSCOM will provide the data sources for the project.

Q3: Does the comment on labelling material that should not be disclosed and providing a redacted copy refer to the questions only, or is that true for the quad chart and white paper which will include past performance and technical descriptions of commercial product?

Does the Government plan to publicize any of the responses received?

A3: Any information that should not be disclosed should be redacted in both the quad chart and the white paper. The Government does not plan to publicize the responses.

Q4: Will the Government be changing the Solicitation Number upon Request for Proposal

(RFP) release?

A4: If a solicitation is released it is possible the solicitation number will be different from the

Request for Information number.

Q5: Will the Government consider set-aside for (8a, WOSB, EDWOSB, HUBZone, etc.)?

A5: The determination regarding set-aside has not been made at this time.

Q6: When does the Government plan to release the RFP?

A6: The Government does not have an estimated date of release for the RFP if a solicitation is released.

Q7: Will the Government be making the award for this requirement in FY24?

A7: If a solicitation is released, it is not anticipated that this will be a FY24 award.

Q8: There is mention of uploading data to the cloud. Is this a constant data stream or a bulk push when connection is available?

A8: Data uploaded to the cloud will be a daily data stream.

Q9: Do you want it pushed to a cloud site or another onprem site?

A9: All data will be in the cloud there will be no onprem site(s)

Q10: We note there should be no subscription fees. Does this mean there will not be any updates to the system?

A10: There will be constant system updates using the DEV-SEC-OPS approach to software development. The subscription fees mentioned here refer to ownership of the predictive models created. Once paid for the USMC shall retain unlimited usage rights.

Q11: Do you have more details on what fluid analysis system you are looking for? Is this oil, water etc. and what specific things do you want to monitor?

A11: The USMC has fielded a Fluid Analysis system that will provide data into the CBM+ pipeline.

Q12: We saw the requirement for a 9 or 6pin Deutsch connector. Is this a screw connector or water tight push connector?

A12: The Deutsch connector is a “turn to lock” connector.

Q13: There is a requirement for everything to function for an indefinite period of time. Does this mean historical data will roll over after data storage is full, or do you want to be able to store historical data forever? Some limitations to this if we are fully onprem. Cloud would be indefinably expandable.

A13: All data will be stored in the cloud indefinitely. Historical data may be archived if not required to support current analysis.

Q14: How many assets do you intend to measure at a time?

A14: The USMC has thousands of assets, and the goal is to make them all part of this program.

However, updated data files will only be sent when the platform is “turned on” and is near enough to the data entry point.

Q15: What is the required polling frequency for data? We generally take data at a maximum of

1x/sec.

A15: 1x/sec is frequent enough as a general rule.

Q16: How much data in total is expected to be stored? i.e., 1x/sec for 10 data points for 5 years?

A16: All data will be stored indefinitely. Historical data may be archived if not required to support current analysis.

Q17: We did not see a requirement for it, but is there interest in work instructions tied directly to any detected issues?

A17: There is interest to tie the detected issue to the work package in the platform technical manual.

Q18: Page 1, Paragraph 1: Will the Government make a representative sample of source data

(e.g., CANbus data, maintenance records, meter readings, etc.) available to respondents for inclusion in product demonstrations?

A18: No. The expectation is that a product demonstration can and will use data available to the respondent.

Q19: Page 2 Paragraph 5: How can respondents gain access to the government cloud environments described in the RFI (e.g., Advana, AWS, Azure)?

A19: The government will sponsor Common Access Cards and support the process of onboarding personnel into the environments if and after award.

Q20: Page 2 Paragraph 5: Please provide more detail, including an architecture diagram, if possible, on extant networks, computing environments (e.g. .MCEN, mission computing environments, etc.) and computing hardware that the Marine Corps seeks to deploy CBM+ capabilities across.

A20: The government will provide this information if and after award is made.

Q21: Page 2 Paragraph 2: Does the Government anticipate needing the proposed CBM+ solution to support other vehicle communication protocols (e.g., DDS) in the future?

A21: Yes. The Government anticipate needing the proposed CBM+ solution to support other vehicle communication protocols in the future.

Q22: Page 2 Paragraph 1: Will the Government provide a list of key user roles for the desired

CBM+ capability, including a description of the role and example decisions that user is authorized to and expected to make?

A22: Yes. The Government will provide a list of key user roles for the capability if and after award is made.

Q23: Page 2 Paragraph 1: How does the Marine Corps currently measure readiness as a KPI?

A23: Readiness is measured as Operational Availability of platforms.

Q24: Page 2 Paragraph 2: How frequently does the Marine Corps plan to retrieve logged data from monitored military vehicles / assets?

A24: The intent is to collect data when the vehicle is powered on, has data to transmit and is in range of a receiver. The frequency of these events will vary.

Q25: Page 1 Paragraph 1: How will the Marine Corps allow/share GCSS-MC data? If not live link, will there be a scheduled access? What other information systems should the proposed CBM+ capability integrate with? How interconnected are they?

A25: Historical GCSS-MC data is available in the cloud and accessible by the program. There is also a daily update from GCSS-MC provided to CBM+. There are a significant number of information systems to integrate that will be part of an integrated management framework when all data is accessible on the cloud. Systems like the Total Force Management System, the Dispatching System, the Logistics Data System will all be incorporated in the future.

Q26: Page 2 Paragraph 2: What bandwidth restrictions are in place in current communications?

Are there bandwidth and/or access restrictions for current government cloud applications?

A26: The current communication is Wi-Fi and is limited to that bandwidth. Access restrictions to all government applications exist but access will be provided with a Common Access Card after award is made.

Q27: Page 2 Paragraph 2: Is data logger to be considered black box to crew and maintainers or can it be accessed by maintenance technicians for diagnostic actions?

A27: Data logger should be a “black box” and not interfere with a maintenance technician’s actions on the platform.

Q28: Page 1 Paragraph 3: Clarify that although data and information input into solution is customer property, that respondents may retain IP of solution software, algorithms/models for prediction.

A28: The intent is that the USMC owns and has the right to use algorithms and models input into the solution, but the USMC understands that the vendor can use these same algorithms and models in support of other efforts.

Q29: Page 2 Paragraph 2: Confirm that direct wireless access to vehicle data is allowed?

A29: It is allowed pending approval of USMC Cyber Security. Any solution will have to comply with all cyber security requirements to authenticate to the Marine Corps Enterprise Network.

Q30: Page 3 Paragraph 1: Will information marked Company Private and Proprietary be handled as such?

A30: Each participant must clearly and accurately label any information that you wish to protect from public disclosure, identifying the reason for objecting to disclosure, and provide a sanitized (e.g., redacted) copy of the document, which you authorize the Government to publish. Information marked will be handled as such.

Q31: Page 2 Paragraph 2: How does the Marine Corps plan to retrieve logged data from monitored military vehicles / assets? Where does the retrieved data go next?

A31: Data is retrieved wirelessly and will go to a cloud environment on the Marine Corps

Enterprise Network

Q32: Can you please share the Quad Chart template?

A32: CBM plus Quad Template is an attachment to the RFI posting on SAM.gov.

Q33: Is there any sample data set that we can model to demonstrate our tool capabilities?

A33: The government will not provide data for the demonstration. The expectation is that a product demonstration can and will use data available to the respondent.

Q34: What is the expected Impact Level of the data? Will all the data be categorized as

UNCLASS and/or CUI or will there be classification requirements?

A34: CBM+ data will be CUI, but parts of the program could reach IL6 in the future.

Q35: Will all devops work be conducted within the MCEN from the start or is devops permitted within other secure GovClouds?

A35: Devops work will be conducted within the MCEN from the start.

Q36: What will be the plan to protect companies’ intellectual property?

A36: Intellectual property will be protected through controlled access and Non-Disclosure agreements.

Q37: Does the USMC expect a single award for hardware and a single award for data analytics or will there be multiple awards for each portion?

A37: The determination regarding a single vs multiple award has not been made at this time.

MARCORSYSCOM recognizes that a single company may not be able to provide a holistic solution.

Q38: Regarding this statement in the RFI, “The customer (or its qualified, authorized representative, subject to an appropriate non-disclosure agreement) will have the technical data necessary to validate and verify the solution’s output, and is both legally and contractually permitted to do so.” Is it the government’s intention that either the government or a third-party will require full access to the underlying code/workflows and/or procedures for any process-based analytics solution in order to validate the resulting output?

A38: It is not anticipated that a third-party validator will be used. The government will require access.

Q39: Would the Government please confirm that offeror may submit a cover-page that will not count as part of the two-page response limit?

A39: Yes, a cover-page may be included that will not count toward the two-page limit.

Q40: Provided the quad-chart format remains, would the Government please confirm that offeror may modify header titles and layout of the provided Quad Chart Template in order to best present the solution?

A40: Modifications as described in this question are acceptable.

Q41: It appears that you are interested in receiving a response that includes a PPT quad slide and text narrative limited to two pages. Is that correct or can we submit beyond the two pages text limit?

A41: The expectation is that both a Power Point (PPT) quad slide and an information paper will be received. An offeror may submit up to three solutions, each on its own quad slide.

The information paper is limited to two pages and should address the information requested under the Requested Information paragraph of the RFI.

Q42: Can you clarify the total submission length. Is it 2 pages per each best in class solution up to 3 submissions of 2 pages each? Does each solution require a quad chart?

A42: Each solution requires a quad chart. The information paper is limited to two pages.

Q43: Can you clarify the font, size, and margins rules?

A43: Submission should be in Microsoft Word or Office compatible format with “Times New

Roman” 12-point font style on 8½ x 11 inch white paper. Tables and illustrations may use a reduced font style not less than 8-point. Foldouts are not allowed. Margins shall be 1 inch on all sides. All material submitted may be single-spaced.

Q44: Do pictures/graphics count against page count or is an appendix for visuals acceptable. If yes what are the limits?

A44: Pictures and graphics count against page count.

Q45: There is a request for testimonials. Do these count against total page count?

A45: Yes, this counts toward the page total.

Q46: Is there a preferred format for the quad chart categories?

A46: No there is no preferred format for the quad chart.

Q47: When anticipating features that could be made available in 12 months are those features to be assumed funded? Or is the question related to unfunded natural development?

A47: Anticipated features is anticipated funded, assuming funding is available.

Q48: Can you provide a diagram illustrating your preferred network architecture and point of connection to third party vendors?

A48: A diagram cannot be provided if and until an award is made. No connections to third party vendors are anticipated. All work will be completed in the government provided environment.

Q49: "...the solution must be able (with or without minor modification) to operate completely within Marine Corps Enterprise Network (MCEN)..." How do you define a "minor" modification?

A49: Minor modifications would be security patches etc. that would be required for the solution to be cyber compliant on the MCEN.

Q50: Will USMC have traffic that leaves the instance deployed within the Marine Corps AWS environment and, if so, what? (i.e, are you shipping data to another instance for processing or is all processing done within the MCEN based environment?)

A50: All processing will be done within the MCEN based environment.

Q51: How will providers connect into the MCEN to manage the proposed solution?

A51: MARCORSYSCOM will sponsor Common Access Cards if/when and award is made and sponsor access to the MCEN.

Q52: Page 1, Paragraph 1."...with respect to accuracy and timeliness of predictive capabilities, and which have the ability to evolve to remain best-in-class." Development of predictive technologies can be very specific to the item of interest. Will the performer have access to failure databases/ logistics histories and key engineering/ operational range data for the subcomponents of interest? Recommend performer have access to all required information for historical failure databases/ logistics histories and range data to better capture data analytics for the subcomponents of interest.

A52: Failure and logistics histories will be made available. Engineering/operational range data on subcomponents will be provided if the data is available to the USMC.

Q53: For the submission of more than one (1) solution, can all solutions be submitted in one document, or must they be separate documents?

A53: For each solution you identify, please enclose: (i) a Quad Chart (template provided); (ii) a product information paper, which does not exceed two (2) pages.

Q54: Page 1 – Paragraph 1. Is it the expectation that the solution would secure an Interim

Authority to Test (IATT) or an Authority to Operate (ATO) within the 12-month period?

A54: Yes, the solution would secure an Interim Authority to Test (IATT) or an Authority to

Operate (ATO) within the 12-month period.

Q55: Page 1 – Paragraph 2. For clarity, is the 9-pin deutsch connector described the same as the heavy duty truck 9-pin circular J1708/J1930 diagnostic connector commonly found on military vehicles?

A55: Yes, the 9-pin deutsch connector described is the same as the heavy-duty truck 9-pin circular J1708/J1930 diagnostic connector commonly found on military vehicles.

Q56: Page 1 – Paragraph 3. Three models are industry standard for commercial software to

DoD customers: (1) Fixed product version in perpetuity with no rights to new releases for capability, obsolescence, or vulnerability releases. New product versions require a subsequent purchase; (2) Product sale with annual maintenance fees granting continuous updates as long as maintenance is maintained and the last version installed remains in perpetuity if maintenance is terminated; (3) Software as a Service subscriptions encompassing hosting environment, updates, new capability releases, security updates, scalable user pool, and data retention by subscription in perpetuity as long as some minimum number of annual subscriptions is maintained.

Each of these has advantages and challenges for DoD customers maintaining an

Authority to Operate (ATO) at an affordable cost. Some apply more effectively for edge computing and others for enterprise cloud-based portals. Can you clarify which of these industry standard models satisfy the desired intent of the RFI statement?

A56: No decision on this question has been made. The RFI’s intent is the gather enough information on this topic to make an informed decision.

Q57: Page 2, Paragraph 4. The submission is on July 17 and the Industry Day starts on July 30.

How many days after submittal will the Government respond with invites so that invitees can schedule travel?

A57: The government will notify invitees 7 Calendar Days after receipt of submissions.

Q58: Page 2, Paragraph 5. Some demonstrations of end-to-end capabilities for disconnected, intermittent, and limited-bandwidth integrated solutions are difficult to demonstrate with a single portal-type tool. Would the Government entertain one or more short video vignettes that demonstrate integrated tool workflows for optimizing maintenance operations, improving material availability, and lifecycle sustainment?

A58: Assuming an invitation is extended, videos are acceptable at the industry day product demo, but initial submissions must comply with the quad chart and 2 page information paper. Videos will count against the 60-minute time allotment.

Q59: What specific types of data from the CAN bus are stored already historically for the analytics? Like format (Files, Tables, images) and storage area (in-house, Cloud, database, data warehouse)?

A59: Data is stored in Data Bricks Tables in the cloud environment.

Q60: Can you provide the historical data volume that can be generated daily or monthly from each vehicle or equipment?

A60: The Data volume right now is a total of 1TB. Max file size from a single data file is

10MB. Data collection is intermittent due to the way the USMC vehicle are operated but as an estimate 50GB per month.

Q61: Are there specific data integration platforms or middleware that the Marine Corps currently uses or prefers for aggregating data from different sources?

A61: The government does not have a preference.

Q62: How is the data being transferred today and in what schedule? Are high-level architectural details of the current process available?

A62: Data is transferred via Wi-Fi when the vehicles are powered on and in range of the wireless access point. There is no set schedule for transfer.

Q63 What are the expected data processing capabilities, particularly in terms of latency and throughput, for the analytics platform? Is data loss a concern?

A63: The goal for latency is 8 hours.

Q64: Any preferences on new data feeds like batch vs near real-time, data security, encryption methods, data download plans?

A64: The government does not have a preference.

Q65: We have listed some high-level use cases such as Predictive Maintenance, Large

Language Model and NLP, Supply Chain Optimization, and Anomaly Detection. Are you also considering similar use cases, and is a list already created and prioritized, or will these details be discussed during workshop sessions?

A65: We are considering similar use cases. Details will be discussed if and after award.

Q66: What types of predictive maintenance models are you currently considering, and are there specific machine learning or statistical techniques you prefer?

A66: No preference. We are looking for best in class techniques.

Q67: How frequently do you anticipate the predictive models will need to be updated or retrained?

A67: The predictive models will need to be updated continuously.

Q68: Is there a preference or restrictions on using open-source algorithms vs standard algorithms for analytical model building?

A68: Standard algorithms are preferred as open-source algorithms usually present cyber security challenges.

Q69: Do we have qualitative and quantitative metrics defined for the evaluation of AI/ML outputs? What metrics will be used to evaluate the accuracy and effectiveness of the predictive models?

A69: There are no defined metrics at this stage.

Q70: Are there established baselines or historical performance data available to aid in model training and validation?

A70: Yes, there are established baselines or historical performance data available to aid in model training and validation.

Q71: Can you describe the end-user requirements for the visualization dashboards? For instance, who are the primary users, and what specific functionalities do they need?

A71: Primary users are maintenance technicians and managers at the organization level and decision makers at the command and staff level.

Q72: Are there mobile or remote access requirements for the visualization tools, considering potential field deployments?

A72: Yes, there are mobile or remote access requirements.

Q73: How important is real-time data visualization in the operational context of the CBM+ solutions?

A73: The goal of the visualization is to provide “near real-time” information. The importance of real-time data has not yet been determined.

Q74: What capabilities are required to integrate historical data analytics with real-time data streams for a comprehensive maintenance dashboard?

A74: The RFI’s intent is the gather enough information on this topic to make an informed decision.

Q75: How should the data analytics, predictive models, and visualization tools integrate with existing maintenance management systems or enterprise resource planning (ERP) systems used by the Marine Corps?

A75: In the future we expect CBM+ tools to integrate with GCSS-MC to provide parts orders, failure codes, and update EOTC readings.

Q76: What are the scalability requirements for the analytics and visualization platform, especially considering potential expansions to more vehicles or different types of equipment in the future?

A76: The USMC could potentially expand to 30,000 platforms and the solution would have to scale to accommodate that data size.

Q77: What are the specific security protocols for data analytics operations, especially when handling sensitive operational data?

A77: Security protocols are set by the impact level of the data. IL5 and IL6 are the anticipated data impact levels.

Q78: How does the Marine Corps envision managing data governance, especially in terms of data access, privacy, and compliance within the CBM+ solutions?

A78: Data governance policies are set by the Service Data Office and the Advana/Jupiter platform. Data access is controlled by MARCORSYSCOM through Common Access Cards, Privacy is not an immediate concern as the data set does not contain PII currently.

Q79: Is the industry day exclusively to those companies responding to the RFI? If so, will the final solicitation be available to those who were selected to attend the industry day?

A79: The Government will review submissions received in response to this RFI (Responses), and determine whether to invite some, all, or none of the respondents to participate in an individual session. After reviewing the responses received to this RFI, the Government will contact selected invitees to schedule an appointment date and time. Not responding to this RFI or participating in the industry day does not preclude participation in any future RFP, if any is issued.