Attachment 0004 Appendix A T and E LCAT Table 11Feb21.xlsx
XLSX spreadsheet 32 KB Posted
- Attached to
- Joint Artificial Intelligence Center Test and Evaluation Blanket Purchase Agreement Request for Proposal
- Solicitation number
- W52P1J21R0029
About this file
This document outlines a request for proposal for blanket purchase agreements to provide test and evaluation services for artificial intelligence to the Joint Artificial Intelligence Center and Department of Defense. The solicitation seeks multiple awardees to provide services described in the performance work statement such as evaluating AI products, developing test plans and reports, and ensuring ethical issues are documented. Offerors are required to complete a questionnaire, and proposals will be evaluated based on instructions and criteria provided in the attachments. The agreement will be open for ordering by the U.S. government to support AI test and evaluation. Relevant agencies include the Joint Artificial Intelligence Center and Department of the Army Materiel Command Contracting Command.
View the file
Other files
Show all 13
On GovTribe
Work with this file
- Download the original file
- Contacts named in this file
- Similar government files
- Ask GovTribe AI about this file
Text version
T&E MAC LCATs
| JAIC T&E Multi-Award Contract Labor Category Descriptions | ||||||
| Labor Category | Work Description/Functional Responsibility | Skill Level | Minimum Education Level | Minimum Years | Substitute for Minimum Education/Years | |
| Program Management | ||||||
| Program Manager | Provide management, direction, administration, quality management, and leadership of the execution of the TO. The PM shall act as the overall lead, manager, and administrator for the effort. The PM shall direct efforts of cross-competency teams including Contractors at multiple locations and shall serve as the primary interface and POC with Government program authorities and representatives on technical and project issues. The PM shall be responsible for regularly briefing leadership on program status and milestones, and ensuring robust documentation, including on AI ethical risks, is completed for each testing stage. The PM shall oversee Contractor personnel project operations by developing procedures, planning and directing execution of the contractual, technical, multi-disciplinary engineering, programming, maintenance, and administrative support effort, and monitoring and reporting progress. The PM shall manage acquisition and employment of project resources and control financial and administrative aspects of the project. | |||||
| Senior/Lead | BA/BS with the following Certifications: | |||||
| PMP, FAC P/PM Level 3, DAWIA Level III Program Management | 10+ years | |||||
| Artificial Intelligence (AI)/Machine Learning (ML) Engineer | ||||||
| AI/ML Engineer III | The AI Engineering Lead shall act as the lead for architecting, positioning, designing, developing, and deploying solutions, which include components of all product lines including the oversight of all integration efforts into their intended systems and subsystems. The AI Engineering Lead shall direct the efforts of all product line teams including Contractors at multiple locations and shall serve as the primary interface and POC for all AI-related matters. | Senior/Lead | Masters degree or PhD in data science, machine learning, statistics, computer science, applied math, or related highly quantitative field |
| 8+ years of research experience in machine learning, speed, multimodal sensing, or related areas | 8+ years | |||
| AI/ML Engineer II | The AI Engineering Lead shall provide architecting, positioning, designing, developing, and deploying solutions, which include components of all product lines including the oversight of all integration efforts into their intended systems and subsystems. The AI Engineering Lead shall direct the efforts of all product line teams including Contractors at multiple locations and shall serve as the primary interface and POC for all AI-related matters. | Intermediate/Mid-Level | - Bachelors Degree in data science, machine learning, statistics, computer science, applied math, or related highly quantitative field | |
| - 4-8 years of research experience in machine learning, speed, multimodal sensing, or related areas | 4+ years | |||
| Test Engineer |
tc={F93CF59E-C45A-4D0F-B136-CF84F50562A3}: [Threaded comment]
Your version of Excel allows you to read this threaded comment; however, any edits to it will get removed if the file is opened in a newer version of Excel. Learn more: https://go.microsoft.com/fwlink/?linkid=870924
Comment:
Ethics is only mentioned in the role of the test engineer. Is that appropriate?
| Test Engineer III | The T&E Lead shall act as the lead for overseeing the evaluation of each AI products, ensuring requirements are testable and measurable, developing metrics and evaluation criteria, developing the test program, developing the test tools and test standards, conducting performance evaluations and writing reports documenting product strengths and weaknesses, writing and delivering Test and Evaluation Master Plans (TEMPs), Test Plans, and Test Reports, and ensuring best practices and lessons learned are sufficiently captured to be shared across the Department. The T&E Lead shall direct the efforts of all product line teams including Contractors at multiple locations and shall serve as the primary interface and POC for all T&E-related matters. The T&E Lead shall ensure that any T&E capabilities incorporated into or developed under the CO do not conflict with the program baseline. The T&E Lead shall also ensure that the most advanced vendors are engaged in the process ensuring that the program has reach across industry to engage the best solutions. With the AI Engineering Lead, the T&E Lead shall help manage the public-facing aspect of the technologies contemplated under the CO to ensure that ethical issues and associated mitigation strategies are documented. |
| Senior/Lead | Bachelors degree (engineering preferred) |
| 10+ years of relevant work experience, with 4+ years of DoD specific experience | 10+ years | |||
| Test Engineer II | The T&E Lead shall provide, with minimal supervision, the evaluation of each AI products, ensuring requirements are testable and measurable, developing metrics and evaluation criteria, developing the test program, developing the test tools and test standards, conducting performance evaluations and writing reports documenting product strengths and weaknesses, writing and delivering Test and Evaluation Master Plans (TEMPs), Test Plans, and Test Reports, and ensuring best practices and lessons learned are sufficiently captured to be shared across the Department. The T&E Lead shall direct the efforts of all product line teams including Contractors at multiple locations and shall serve as the primary interface and POC for all T&E-related matters. The T&E Lead shall ensure that any T&E capabilities incorporated into or developed under the CO do not conflict with the program baseline. The T&E Lead shall also ensure that the most advanced vendors are engaged in the process ensuring that the program has reach across industry to engage the best solutions. With the AI Engineering Lead, the T&E Lead shall help manage the public-facing aspect of the technologies contemplated under the CO to ensure that ethical issues and associated mitigation strategies are documented. | |||
| Intermediate/Mid-Level | - Bachelors degree (engineering preferred) | |||
| - 5-10 years of relevant work experience | 5+ years | |||
| Test Engineer I | The T&E Lead shall provide, with supervision, the evaluation of each AI products, ensuring requirements are testable and measurable, developing metrics and evaluation criteria, developing the test program, developing the test tools and test standards, conducting performance evaluations and writing reports documenting product strengths and weaknesses, writing and delivering Test and Evaluation Master Plans (TEMPs), Test Plans, and Test Reports, and ensuring best practices and lessons learned are sufficiently captured to be shared across the Department. The T&E Lead shall direct the efforts of all product line teams including Contractors at multiple locations and shall serve as the primary interface and POC for all T&E-related matters. The T&E Lead shall ensure that any T&E capabilities incorporated into or developed under the CO do not conflict with the program baseline. The T&E Lead shall also ensure that the most advanced vendors are engaged in the process ensuring that the program has reach across industry to engage the best solutions. With the AI Engineering Lead, the T&E Lead shall help manage the public-facing aspect of the technologies contemplated under the CO to ensure that ethical issues and associated mitigation strategies are documented. | Junior/Entry-Level | - Bachelors degree (engineering preferred) | |
| - <5 years of relevant work experience | <5 years | |||
| Software Engineer | ||||
| Software Engineer III | Oversees technical design, development, and implementation of large projects and/or major software products and systems. Assists in defining architecture requirements and establishing standards for design and development. Consults with management and customers regarding product feasibility and viability of product plans and designs. Factors emerging technologies and product supportability into design and implementation. Serves as primary technical resource to development team. May act as team leader in prioritizing group tasks, determining individual assignments, and reviewing work of lower-level developers. Provides product demonstrations and participates in trade shows, seminars, industry panels, and user group meetings. Interacts with customers regarding strategies, requirements, problem solving, and support. | Senior/Lead | Masters degree or PhD in computer engineering, computer science, electrical engineering, applied math, or related highly quantitative field |
| 10+ years of relevant experience in software development, leading development teams, agile development, cloud computing, software factories, machine learning, or related areas | 10+ years | |||
| Software Engineer II | Develops technical designs and specifications for software products. Researched and integrated design strategies, product specifications, development schedules, and user expectations into product capabilities. Uses software development technologies and tools to build, test, and maintain product modules, components, and subsystems. Provides technical leadership to lower-level developers. May provide product demonstrations and participate in trade shows and seminars. May require interaction with customers, vendors and external development partners. Familiar with a variety of the field's concepts, practices, and procedures. Relies on experience and judgment to plan and accomplish goals. Performs a variety of complicated tasks. A wide degree of creativity and latitude is expected. | Intermediate/Mid-Level | Master’s degree in computer engineering, computer science, electrical engineering, applied math, or related highly quantitative field |
| 5-10 years of relevant experience in software development, leading development teams, agile development, cloud computing, software factories, machine learning, or related areas | 5+ years | |||
| Software Engineer I | Designs and codes software components, units, and modules that meet product specification and development schedules. Tests and debugs assigned components www.lynkercom 33 and units, Participated in large system and subsystem planning. Adheres to product build and release schedules and strategies. Acts as a technical resource for lower level developers. Requires comprehensive knowledge of one or more platforms and operating systems, and of programming languages. Requires knowledge of one or more systems architectures. Familiar with a variety of the field's concepts, practices, and procedures. Relies on experience and judgment to plan and accomplish goals. Performs a variety of complicated tasks. A wide degree of creativity and latitude is expected. Works under general supervision. | Junior/Entry-Level | Bachelor’s degree in computer engineering, computer science, electrical engineering, applied math, or related highly quantitative field |
| 0-5 years of relevant experience in software development, leading development teams, agile development, cloud computing, software factories, machine learning, or related areas | <5 years | |
| Machine Learning Scientist | ||
| Machine Learning Scientist III | A software specialist with a strong mathematics background and a knowledge of coding, who’s core responsibilities may include: |
- Designing and developing machine learning and deep learning systems.
- Running machine learning tests and experiments.
- Implementing appropriate ML algorithms
- Development of AI algorithms and devices
- Inventing and deploying innovative technologies Senior/Lead PhD in Machine Learning, Neural Networks, Data Science, Computer Science, applied math, or related quantitative field -OR-
| 10+ years of work experience leading and managing teams/projects related to Machine Learning, Neural Networks, and Artificial Intelligence. | 10+ years | |
| Machine Learning Scientist II | A software specialist with a strong mathematics background and a knowledge of coding, who’s core responsibilities may include: |
- Designing and developing machine learning and deep learning systems.
- Running machine learning tests and experiments.
- Implementing appropriate ML algorithms
- Development of AI algorithms and devices
- Inventing and deploying innovative technologies Intermediate/Mid-Level Masters or Bachelors Degree in Machine Learning, Neural Networks, Data Science, Computer Science, applied math, or related quantitative field -OR-
| 10+ years of work experience leading and managing teams/projects related to Machine Learning, Neural Networks, and Artificial Intelligence. | 10+ years | |||||
| Administration Assistant | ||||||
| Administrative Assistant III | Provide administrative support specifically dedicated to the requirements of the project team with no supervision. Plan and produce correspondence, reports, proposals, memos, and other documentation using a personal computer. Operate spreadsheet software such as Excel to produce finished documents. Proofread completed documents. Provide copying and production support as needed. Commensurate experience and education. | Senior/Lead | Bachelors Degree | 8+ years | 6+ with Masters Degree | |
| Administrative Assistant II | Provide administrative support specifically dedicated to the requirements of the project team with minimal supervision. Plan and produce correspondence, reports, proposals, memos, and other documentation using a personal computer. Operate spreadsheet software such as Excel to produce finished documents. Proofread completed documents. Provide copying and production support as needed. Commensurate experience and education. | Intermediate/Mid-Level | Bachelors Degree | |||
| 4+ years | ||||||
| Administrative Assistant I | Provide administrative support specifically dedicated to the requirements of the project team under supervision. Plan and produce correspondence, reports, proposals, memos, and other documentation using a personal computer. Operate spreadsheet software such as Excel to produce finished documents. Proofread completed documents. Provide copying and production support as needed. Commensurate experience and education. | Junior/Entry-Level | Associates Degree | |||
| <4 years | ||||||
| Contract Administrator | ||||||
| Contract Administrator | Performs project support work such as Data Management, Business Management, Contract Management, Cost Variance Analysis, General Management, Procurement Strategy and Analysis. Perform analysis, planning, establishment of contract compliance and accounting requirements, development of procedures and other related management and technical duties. | Intermediate/Mid-Level | Bachelors Degree | 5+ years | ||
| Technical Writer | ||||||
| Technical Writer III | Write and/or edit technical documents, including business proposals, reports, user manuals, briefings and presentations, functional descriptions, system specifications, guidelines, special reports, and other project deliverables to meet contract requirements. Develop outlines and drafts for review and approval by technical specialists and project management ensuring that final documents meet applicable contract requirements and regulations. Research and gather technical and background information for inclusion in project documentation and deliverables. Consult relevant information sources, including library resources, technical and financial documents, and client and project personnel, to obtain background information, and verify pertinent guidelines and regulations governing project deliverables. Commensurate experience, education and no supervision and direction required. | Senior/Lead | Bachelors Degree in a technical field or English or Journalism |
| 8+ years of relevant work experience (6+ with Masters Degree) | 8+ years | |||
| Technical Writer II | Write and/or edit technical documents, including business proposals, reports, user manuals, briefings and presentations, functional descriptions, system specifications, guidelines, special reports, and other project deliverables to meet contract requirements. Develop outlines and drafts for review and approval by technical specialists and project management ensuring that final documents meet applicable contract requirements and regulations. Research and gather technical and background information for inclusion in project documentation and deliverables. Consult relevant information sources, including library resources, technical and financial documents, and client and project personnel, to obtain background information, and verify pertinent guidelines and regulations governing project deliverables. Commensurate experience, education, and with minimal supervision and direction. | Intermediate/Mid-Level | Bachelors Degree in a technical field or English or Journalism |
| 4-8 years of relevant work experience | 4+ years | |||
| Technical Writer I | Write and/or edit technical documents, including business proposals, reports, user manuals, briefings and presentations, functional descriptions, system specifications, guidelines, special reports, and other project deliverables to meet contract requirements. Develop outlines and drafts for review and approval by technical specialists and project management ensuring that final documents meet applicable contract requirements and regulations. Research and gather technical and background information for inclusion in project documentation and deliverables. Consult relevant information sources, including library resources, technical and financial documents, and client and project personnel, to obtain background information, and verify pertinent guidelines and regulations governing project deliverables. Commensurate experience, education, and with supervision and direction. | Junior/Entry-Level | Associates Degree in a technical field or English or Journalism |
| <4 years of relevant work experience | <4 years | ||||
| Budget Analyst | |||||
| Budget Analyst III | Identifies, analyzes, and resolves a range of budgetary problems in a lead role. Develops alternative methods of funding. Formulates budget estimates for programs in which objectives, work processes, staffing needs, and funding requirements have changed to the extent that substantial re-budgeting is required each year. Develops and administers the budget execution plans for industrially funded activities subject to fluctuating revenues and changing demand for services, which necessitate reprogramming actions throughout the fiscal year. Possesses extensive knowledge of government accounting practices, Government appropriation processes, and the Office of Management and Budget 300 development support. | Senior/Lead | Bachelor’s Degree in Accounting or Business. | 8+ years | |
| Budget Analyst II | Identifies, analyzes, and resolves a range of budgetary problems with minimal supervision. Develops alternative methods of funding. Formulates budget estimates for programs in which objectives, work processes, staffing needs, and funding requirements have changed to the extent that substantial re-budgeting is required each year. Develops and administers the budget execution plans for industrially funded activities subject to fluctuating revenues and changing demand for services, which necessitate reprogramming actions throughout the fiscal year. Possesses knowledge of government accounting practices, Government appropriation processes, and the Office of Management and Budget 300 development support. | Intermediate/Mid-Level | Bachelor’s Degree in Accounting or Business. | 4+ years | |
| Budget Analyst I | Identifies, analyzes, and resolves a range of budgetary problems with supervision. Develops alternative methods of funding. Formulates budget estimates for programs in which objectives, work processes, staffing needs, and funding requirements have changed to the extent that substantial re-budgeting is required each year. Develops and administers the budget execution plans for industrially funded activities subject to fluctuating revenues and changing demand for services, which necessitate reprogramming actions throughout the fiscal year. Possesses some knowledge of government accounting practices, Government appropriation processes, and the Office of Management and Budget 300 development support. | Junior/Entry-Level | Bachelor’s Degree in Accounting or Business. | <4 years | |
| Data Scientist | |||||
| Data Scientist III | The Data Scientist develops innovative and effective approaches to solve intelligence problems and effectively communicates results and methodologies. The Data Scientists conduct advanced data analysis, designs experiments and builds analytic models to validate findings or test hypotheses. utilizes patterns and variations in the volume, speed, type of data (e.g. images, text, etc.) and other characteristics of data in predictive analysis, identifies/creates the appropriate algorithm to discover patterns. Applies highly complex algorithms that incorporate AI techniques in machine learning, computer vision planning and NLP, utilizes advanced statistical and predictive modeling techniques to improve mission analytics. Collaborates with subject matter experts to select the relevant sources of information and techniques to answer mission problems. May direct multiple teams through to project completion. Provides guidance and direction to lower level technicians, specialists, and managers. | Senior/Lead | Masters degree in a highly quantitative field (Computer Science, Machine Learning, Operational Research, Statistics, Mathematics, etc.) or equivalent professional or military experience | ||
| 8+ years | |||||
| Data Scientist II | The Data Scientist develops innovative and effective approaches to solve intelligence problems and effectively communicates results and methodologies. The Data Scientists conduct advanced data analysis, designs experiments and builds analytic models to validate findings or test hypotheses. utilizes patterns and variations in the volume, speed, type of data (e.g. images, text, etc.) and other characteristics of data in predictive analysis, identifies/creates the appropriate algorithm to discover patterns. Applies highly complex algorithms that incorporate AI techniques in machine learning, computer vision planning and NLP, utilizes advanced statistical and predictive modeling techniques to improve mission analytics. Collaborates with subject matter experts to select the relevant sources of information and techniques to answer mission problems. May direct multiple teams through to project completion. Provides guidance and direction to lower level technicians, specialists, and managers. | Intermediate/Mid-Level | Bachelors degree in a highly quantitative field (Computer Science, Machine Learning, Operational Research, Statistics, Mathematics, etc.) or equivalent professional or military experience | ||
| 4+ years | |||||
| Data Scientist I | The Data Scientist develops innovative and effective approaches to solve intelligence problems and effectively communicates results and methodologies. The Data Scientists conduct advanced data analysis, designs experiments and builds analytic models to validate findings or test hypotheses. utilizes patterns and variations in the volume, speed, type of data (e.g. images, text, etc.) and other characteristics of data in predictive analysis, identifies/creates the appropriate algorithm to discover patterns. Applies highly complex algorithms that incorporate AI techniques in machine learning, computer vision planning and NLP, utilizes advanced statistical and predictive modeling techniques to improve mission analytics. Collaborates with subject matter experts to select the relevant sources of information and techniques to answer mission problems. May direct multiple teams through to project completion. | Junior/Entry-Level | Associates degree in a highly quantitative field (Computer Science, Machine Learning, Operational Research, Statistics, Mathematics, etc.) or equivalent professional or military experience | ||
| <4 years | |||||
| UI/UX Engineer/Developer | |||||
| UI/UX Designer III | • | Works with mission teams to engage with potential customers within the DOD and identifies and evaluates prospective projects. | |||
| • | Applies the principles, methods and techniques of user-based design with an in-depth knowledge of complex computer-based systems to support capabilities that include development of artificial intelligence solutions. | ||||
| • | Gathers and formalizes requirements for the Mission Initiatives (MI) from participating services and agencies that will transform capability needs into requirements that are detailed, actionable, testable, and support the definition of discrete work tasks. | ||||
| • | Works with end-users to build and analyze user stories to identify common users’, system, software and interface requirements for capability design and development. | ||||
| • | Works closely with Data Engineers and MI performers to create and manage a Requirements Traceability Matrix and an Intended Use Statement. | ||||
| • | Identifies end user processes, software and other mission issues that could be improved using AI. | ||||
| • | Captures and formulates final articulation of user needs that will define the broader user experience by gathering and incorporating end-user feedback from user interviews, usability tests, surveys, data analysis, and similar methods. | ||||
| • | Translates/transforms user research information into actionable user interface requirements and workflows. | ||||
| • | Designs and prototypes specific AI or ML solutions. Understands user needs, behaviors, and motivations. Through empathizing with the user, the analyst can inform design decisions and advocate for the user. | ||||
| • | Works closely with Mission and Capability Delivery teams to help determine product goals. | ||||
| • | Supports technical activities of the end users identifying mission goals, desired metrics, data standards and user workflows. | ||||
| • | Works with National Mission Initiative (NMI) teams to define and prioritize systems requests, define project scope, goals, and deliverables that support end user goals. | ||||
| • | Coordinates research efforts involving voice of the customer, qualitative and usability-oriented customer feedback, and industry trends. | ||||
| • | Produces high quality solutions through hybrid wireframe and visual designs, flow diagrams, storyboards, site maps and prototypes. | ||||
| • | Collaborates with team members on user research, customer testing, and iterative feedback loops. | ||||
| • | Rapidly iterates on design prototypes and working applications that contribute to the design, development, and testing of AI/ML tools and delivery methods. | ||||
| • | Develops mock-up solutions that can be implemented quickly. | ||||
| • | Tests and validates usability by monitoring and reporting metrics, determining potential, leveraging research and analytics to drive product updates and improved user experience. | ||||
| • | Coordinates technical requirements for the capability design, with an emphasis on interface definition with government and commercial stakeholders and organizations to evolve requirements and to establish MOU/MOAs for interfaces with existing external systems. | ||||
| • | Performs work involving new concepts and ideas for achieving particular missions and goals, technological trends, significant advancements in operational and mission requirements. | ||||
| • | Formulates overall design concepts and criteria, explores and evaluates advanced proposals, reviews and assesses the overall progress in the development effort; and coordinates efforts of other representatives who are recognized as technical specialists, as well as, representatives from other government agencies and industry pursuing research and development projects involved with the assignment. Converts overall objectives into development programs and policies for others to use. | Senior/Lead | - Bachelors Degree in human factors, psychology, communications, computer science, visual design, or related field |
- 8+ years of relevant work experience (6+ with Masters Degree)
| 8+ years | |||||
| UI/UX Designer II | • | Works with mission teams to engage with potential customers within the DOD and identifies and evaluates prospective projects. | |||
| • | Applies the principles, methods and techniques of user-based design with an in-depth knowledge of complex computer-based systems to support capabilities that include development of artificial intelligence solutions. | ||||
| • | Gathers and formalizes requirements for the Mission Initiatives (MI) from participating services and agencies that will transform capability needs into requirements that are detailed, actionable, testable, and support the definition of discrete work tasks. | ||||
| • | Works with end-users to build and analyze user stories to identify common users’, system, software and interface requirements for capability design and development. | ||||
| • | Works closely with Data Engineers and MI performers to create and manage a Requirements Traceability Matrix and an Intended Use Statement. | ||||
| • | Identifies end user processes, software and other mission issues that could be improved using AI. | ||||
| • | Captures and formulates final articulation of user needs that will define the broader user experience by gathering and incorporating end-user feedback from user interviews, usability tests, surveys, data analysis, and similar methods. | ||||
| • | Translates/transforms user research information into actionable user interface requirements and workflows. | ||||
| • | Designs and prototypes specific AI or ML solutions. Understands user needs, behaviors, and motivations. Through empathizing with the user, the analyst can inform design decisions and advocate for the user. | ||||
| • | Works closely with Mission and Capability Delivery teams to help determine product goals. | ||||
| • | Supports technical activities of the end users identifying mission goals, desired metrics, data standards and user workflows. | ||||
| • | Works with National Mission Initiative (NMI) teams to define and prioritize systems requests, define project scope, goals, and deliverables that support end user goals. | ||||
| • | Coordinates research efforts involving voice of the customer, qualitative and usability-oriented customer feedback, and industry trends. | ||||
| • | Produces high quality solutions through hybrid wireframe and visual designs, flow diagrams, storyboards, site maps and prototypes. | ||||
| • | Collaborates with team members on user research, customer testing, and iterative feedback loops. | ||||
| • | Rapidly iterates on design prototypes and working applications that contribute to the design, development, and testing of AI/ML tools and delivery methods. | ||||
| • | Develops mock-up solutions that can be implemented quickly. | ||||
| • | Tests and validates usability by monitoring and reporting metrics, determining potential, leveraging research and analytics to drive product updates and improved user experience. | ||||
| • | Coordinates technical requirements for the capability design, with an emphasis on interface definition with government and commercial stakeholders and organizations to evolve requirements and to establish MOU/MOAs for interfaces with existing external systems. | ||||
| • | Performs work involving new concepts and ideas for achieving particular missions and goals, technological trends, significant advancements in operational and mission requirements. | ||||
| • | Formulates overall design concepts and criteria, explores and evaluates advanced proposals, reviews and assesses the overall progress in the development effort; and coordinates efforts of other representatives who are recognized as technical specialists, as well as, representatives from other government agencies and industry pursuing research and development projects involved with the assignment. Converts overall objectives into development programs and policies for others to use. | Intermediate/Mid-Level | - Bachelors Degree in human factors, psychology, communications, computer science, visual design, or related field | ||
| - 4-8 years of relevant work experience | 4+ years | ||||
| UI/UX Designer I | • | Works with mission teams to engage with potential customers within the DOD and identifies and evaluates prospective projects. | |||
| • | Applies the principles, methods and techniques of user-based design with an in-depth knowledge of complex computer-based systems to support capabilities that include development of artificial intelligence solutions. | ||||
| • | Gathers and formalizes requirements for the Mission Initiatives (MI) from participating services and agencies that will transform capability needs into requirements that are detailed, actionable, testable, and support the definition of discrete work tasks. | ||||
| • | Works with end-users to build and analyze user stories to identify common users’, system, software and interface requirements for capability design and development. | ||||
| • | Works closely with Data Engineers and MI performers to create and manage a Requirements Traceability Matrix and an Intended Use Statement. | ||||
| • | Identifies end user processes, software and other mission issues that could be improved using AI. | ||||
| • | Captures and formulates final articulation of user needs that will define the broader user experience by gathering and incorporating end-user feedback from user interviews, usability tests, surveys, data analysis, and similar methods. | ||||
| • | Translates/transforms user research information into actionable user interface requirements and workflows. | ||||
| • | Designs and prototypes specific AI or ML solutions. Understands user needs, behaviors, and motivations. Through empathizing with the user, the analyst can inform design decisions and advocate for the user. | ||||
| • | Works closely with Mission and Capability Delivery teams to help determine product goals. | ||||
| • | Supports technical activities of the end users identifying mission goals, desired metrics, data standards and user workflows. | ||||
| • | Works with National Mission Initiative (NMI) teams to define and prioritize systems requests, define project scope, goals, and deliverables that support end user goals. | ||||
| • | Coordinates research efforts involving voice of the customer, qualitative and usability-oriented customer feedback, and industry trends. | ||||
| • | Produces high quality solutions through hybrid wireframe and visual designs, flow diagrams, storyboards, site maps and prototypes. | ||||
| • | Collaborates with team members on user research, customer testing, and iterative feedback loops. | ||||
| • | Rapidly iterates on design prototypes and working applications that contribute to the design, development, and testing of AI/ML tools and delivery methods. | ||||
| • | Develops mock-up solutions that can be implemented quickly. | ||||
| • | Tests and validates usability by monitoring and reporting metrics, determining potential, leveraging research and analytics to drive product updates and improved user experience. | ||||
| • | Coordinates technical requirements for the capability design, with an emphasis on interface definition with government and commercial stakeholders and organizations to evolve requirements and to establish MOU/MOAs for interfaces with existing external systems. | ||||
| • | Performs work involving new concepts and ideas for achieving particular missions and goals, technological trends, significant advancements in operational and mission requirements. | ||||
| • | Formulates overall design concepts and criteria, explores and evaluates advanced proposals, reviews and assesses the overall progress in the development effort; and coordinates efforts of other representatives who are recognized as technical specialists, as well as, representatives from other government agencies and industry pursuing research and development projects involved with the assignment. Converts overall objectives into development programs and policies for others to use. | Junior/Entry-Level | - Associates Degree in human factors, psychology, communications, computer science, visual design, or related field | ||
| - <4 years of relevant work experience | <4 years | ||||
| Project Management | |||||
| Project Manager III | Responsible for all aspects of the development and implementation of assigned projects and provides a single point of contact for those projects. Takes projects from original concept through final implementation. Interfaces with all areas affected by the project including end users, computer services, and client services. Defines project scope and objectives. Develops detailed work plans, schedules, project estimates, resource plans, and status reports. Conducts project meetings and is responsible for project tracking and analysis. Ensures adherence to quality standards and reviews project deliverables. Manages the integration of vendor tasks and tracks and reviews vendor deliverables. Provides technical and analytical guidance to project team. Recommends and takes action to direct the analysis and solutions of problems. | Senior/Lead | MA/MS (PMI certification required) | 10+ years | |
| Project Manager II | Under general direction, responsible for all aspects of the development and implementation of assigned projects and provides a single point of contact for those projects. Takes projects from original concept through final implementation. Interfaces with all areas affected by the project including end users, computer services, and client services. Defines project scope and objectives. Develops detailed work plans, schedules, project estimates, resource plans, and status reports. Conducts project meetings and is responsible for project tracking and analysis. Ensures adherence to quality standards and reviews project deliverables. Manages the integration of vendor tasks and tracks and reviews vendor deliverables. Provides technical and analytical guidance to project team. Recommends and takes action to direct the analysis and solutions of problems. | Intermediate/Mid-Level | BA/BS (PMI certification desired) | 5+ years | |
| Project Manager I | Under direct supervision, responsible for assigned aspects of the development and implementation of assigned projects and provides a single point of contact for those aspects. Interfaces with all areas affected by the project including end users, computer services, and client services. Ensures adherence to quality standards and reviews project deliverables. Manages the integration of vendor tasks and tracks and reviews vendor deliverables. Recommends action to direct the analysis and solutions of problems. | Junior/Entry-Level | BA/BS | <5 years | |
| Safety Engineer | |||||
| Safety Engineer III | Applies extensive technical expertise, and has full knowledge of system safety engineering related disciplines. Able to communicate effectively and clearly present technical approaches and findings. Develops technical solutions to complex problems which require the regular use of ingenuity and creativity. Exercises considerable latitude in determining technical objectives of assignment. Interacts with senior external personnel on significant technical matters often requiring coordination between organizations. | Senior/Lead | Experience: Master’s in Engineering or Applied Mathematics |
| 10+ years of work experience in Safety Evaluation of complex systems, fault analysis, or safety critical systems | 10+ years | ||||
| Safety Engineer II | Applies extensive system safety expertise in relevant disciplines. Provides scientific, technical and managerial skills to hazard identification, hazard analysis, and elimination, control, or management of hazards throughout the life-cycle of a system, program, project or an activity or a product. Able to communicate effectively and clearly present technical approaches and findings. | Intermediate/Mid-Level | Bachelors degree n Engineering or Applied Mathematics | 5+ years | |
| Safety Engineer I | Applies system safety expertise in relevant disciplines. Provides scientific and technical skills to hazard identification, hazard analysis, and elimination, control, or management of hazards throughout the life-cycle of a system, program, project or an activity or a product. Able to communicate effectively and clearly present technical approaches and findings. | Junior/Entry-Level | Bachelors degree n Engineering or Applied Mathematics | <5 years | |
| Operations Research and Systems Analyst (ORSA) | |||||
| ORSA III | Lead data collection and analysis of operational problems to inform Artificial Intelligence product development. Summarize operational benchmarks to determine potential returns on investment from AI implementations. Model current and anticipated workflows to predict changes in roles and processes from new technologies. Plan and support operational assessment activities with design of experiments and data analysis to describe the impacts of AI products on user groups. |
Specific Duties:
- Analyze operational activities using mathematical, statistical, and engineering methodologies
- Develop data collection and analysis methodologies for operationally relevant artificial intelligence systems
- Design quantitative and qualitative metrics and measures of effectiveness for assessment of artificial intelligence systems
- Conducts post-deployment operational assessment to determine actual impacts of delivered products
- Provides ORSA subject matter expertise to a JAIC Mission team
- Identifies technical risks associated with product delivery
- Works with the JAIC Test and Evaluation team in the creation of Test & Evaluation Master Plans (TEMP)
- Uses deep technical skills in mathematics, statistics, and engineering to translate operation requirements for artificial intelligence systems to testing requirements
| - Writes reports and generates briefings to communicate technical aspects of data collection and analysis to the JAIC team, senior military, DoD, and Civilian agencies | Senior/Lead | Masters or Ph.D. in Operations Research or Mathematics is required. A background in AI, software development or data science is preferred. | 8+ years |
| ORSA II | Provide data collection and analysis of operational problems to inform Artificial Intelligence product development with minimal supervision. Summarize operational benchmarks to determine potential returns on investment from AI implementations. Model current and anticipated workflows to predict changes in roles and processes from new technologies. Plan and support operational assessment activities with design of experiments and data analysis to describe the impacts of AI products on user groups. |
Specific Duties:
- Analyze operational activities using mathematical, statistical, and engineering methodologies
- Develop data collection and analysis methodologies for operationally relevant artificial intelligence systems
- Design quantitative and qualitative metrics and measures of effectiveness for assessment of artificial intelligence systems
- Conducts post-deployment operational assessment to determine actual impacts of delivered products
- Provides ORSA subject matter expertise to a JAIC Mission team
- Identifies technical risks associated with product delivery
- Works with the JAIC Test and Evaluation team in the creation of Test & Evaluation Master Plans (TEMP)
- Uses deep technical skills in mathematics, statistics, and engineering to translate operation requirements for artificial intelligence systems to testing requirements
| - Writes reports and generates briefings to communicate technical aspects of data collection and analysis to the JAIC team, senior military, DoD, and Civilian agencies | Intermediate/Mid-Level | Masters or Bachelors in Operations Research or Mathematics is required. A background in AI, software development or data science is preferred. | 5+ years |
| ORSA I | Provide data collection and analysis of operational problems to inform Artificial Intelligence product development with supervision. Summarize operational benchmarks to determine potential returns on investment from AI implementations. Model current and anticipated workflows to predict changes in roles and processes from new technologies. Plan and support operational assessment activities with design of experiments and data analysis to describe the impacts of AI products on user groups. |
Specific Duties:
- Analyze operational activities using mathematical, statistical, and engineering methodologies
- Develop data collection and analysis methodologies for operationally relevant artificial intelligence systems
- Design quantitative and qualitative metrics and measures of effectiveness for assessment of artificial intelligence systems
- Conducts post-deployment operational assessment to determine actual impacts of delivered products
- Provides ORSA subject matter expertise to a JAIC Mission team
- Identifies technical risks associated with product delivery
- Works with the JAIC Test and Evaluation team in the creation of Test & Evaluation Master Plans (TEMP)
- Uses deep technical skills in mathematics, statistics, and engineering to translate operation requirements for artificial intelligence systems to testing requirements
| - Writes reports and generates briefings to communicate technical aspects of data collection and analysis to the JAIC team, senior military, DoD, and Civilian agencies | Junior/Entry-Level | Bachelors in Operations Research or Mathematics is required. A background in AI, software development or data science is preferred. | <5 years | |
| Subject Matter Expert (SME) | ||||
| Subject Matter Expert (SME) III | Provide technical, managerial, and administrative direction for problem definition, analysis, requirements development, and implementation for complex to extremely complex systems in the subject matter area. Make recommendations and advise on organization-wide system improvements, optimization or maintenance efforts in the following specialties: test and evaluation; artificial intelligence; machine learning; information systems architecture; networking; telecommunications; automation; communications protocols; risk management/electronic analysis; software; lifecycle management; software development methodologies; and modeling and simulation. Commensurate experience in IT and in new and related older technology that directly relates to the required area of expertise. | Senior/Lead | Masters or Bachelors Degree with relevant experience or an equivalent combination of education and training that provides the required knowledge, skills, and abilities. |
| 10+ years | |||
| Subject Matter Expert (SME) II | Analyze user needs to determine functional requirements and define problems and develop plans and requirements in the subject matter area for moderately complex to complex systems related to test and evaluation, artificial intelligence, machine learning, information systems architecture, networking; telecommunications, automation, communications protocols, risk management/electronic analysis, software, lifecycle management, software development methodologies, and modeling and simulation. Perform functional allocation to identify required tasks and their interrelationships. Identify resources required for each task. Possess requisite knowledge and expertise so recognized in the professional community that the government is able to qualify the individual as an expert in the field for an actual task order. Demonstrate exceptional oral and written communication skills. Commensurate experience in IT and in new and related older technology that directly relates to the required area of expertise. | Intermediate/Mid-Level | Masters or Bachelors Degree with relevant experience or an equivalent combination of education and training that provides the required knowledge, skills, and abilities. |
| 5+ years | |
| Subject Matter Expert (SME) I | Provide technical knowledge and analysis of highly specialized applications and operational environment, high-level functional systems analysis, design, integration, documentation and implementation advice on moderately complex problems that require an appropriate level of knowledge of the subject matter for effective implementation. Apply principles, methods and knowledge of the functional area of capability to specific task order requirements, advanced mathematical principles and methods to exceptionally difficult and narrowly defined technical problems in engineering and other scientific applications to arrive at automated solutions. Assist other senior consultants with analysis and evaluation and with the preparation of recommendations for system improvements, optimization, development, and/or maintenance efforts in the following specialties: test and evaluation, artificial intelligence, machine learning, information systems architecture, networking; telecommunications, automation communications protocols, risk management/electronic analysis, software; lifecycle management, software development methodologies, and modeling and simulation. Commensurate experience in IT and in new and related older technology that directly relates to the required area of expertise. |
| Junior/Entry-Level | Bachelors Degree with relevant experience or an equivalent combination of education and training that provides the required knowledge, skills, and abilities. |
<5 years
File details come from the government source that posted it. Updated .