Downloaded from https://www.everyspec.com and assessment activities. The MATDEV should maintain a written record of the nature of these contractor and Government discussions. c. Results of DT using contractor personnel or results of contractor in-house testing may be considered in evaluation and assessments along with OT data collected (see paras a and b above). 5–7. Equipment disposition after operational testing Disposition of C4I/IT and ancillary test equipment after the completed test is decided on a case-by-case basis by the MATDEV and the test unit/evaluator.
The testing unit may retain the C4I/IT after a LUT or an IOT is completed for use as a CE testbed or other use pending a formal fielding decision. The T&E WIPT will document the disposition of equipment in the TEMP to ensure feasibility, supportability, and funding. After completion of the test, a MOA will be signed by the MATDEV, system evaluator, and testing unit to confirm the use of the system. Any O&M supportability and funding issues will be included in the MOA. Chapter 6 Evaluation 6–1. Independent evaluation and assessments Independent system evaluation and assessment are designed to provide unbiased advice of system development to the Army or DOD decision-maker.
The system evaluator, who is organizationally separated from the MATDEV and CBTDEV, provides such advice thereby ensuring a completely objective perspective. While in cooperation with the MATDEV, CBTDEV, and other T&E WIPT members, the evaluator must always maintain a professional and emotional detachment from the system so as to ensure complete objectivity. 6–2. Evaluation process a. The evaluation process consists of early and frequent assessments of system status during development. Early involvement can significantly reduce test time and cost through comparative analysis, data sharing, and use of all credible data sources.
The purpose of an evaluation is to ensure that only operationally effective, suitable, and survivable systems are delivered to the users. b. The system evaluation integrates experimentation, demonstration, and M&S information with available test data to address the evaluation issues (that is, COIC and additional issues (for example, evaluation focus areas)). Through the SEP, the need for testing is determined and unnecessary testing eliminated. System assessment reports will occur at key points during the acquisition, before and after each milestone decision.
As the system approaches a milestone or the FRP decision review, the system evaluator will produce a SER to advise the decision review principals and milestone decision authority concerning the adequacy of testing, the system’s effectiveness, suitability, and survivability, as well as recommendations for future T&E and system improvements. The system evaluation in support of the FRP decision review will use data resulting from the IOT, when conducted, as a major data source integrated with other credible data sources as defined in the SEP. (See para 6–4.) c. The products of continuous evaluation are the SER and the SA. (See para 10–15.) 6–3. Evaluation objectives a.
The primary objective of the independent system evaluation is to address the demonstrated effectiveness, suitability, and survivability of Army and multi-service systems for use by typical users in realistic operational environments. The primary objective of the independent system assessment is to address system potential effectiveness, suitability, and survivability. Other objectives are— ( 1 ) A s s i s t t h e m a t e r i e l d e v e l o p e r b y p r o v i d i n g i n f o r m a t i o n r e l a t i n g t o t e c h n i c a l p a r a m e t e r s a n d c o n t r a c t o r performance.
(2) Assist combat and materiel developers by providing information relative to operational performance, doctrine, tactics, techniques, procedures, logistics, MANPRINT, system safety, health hazard, technical publications, RAM, correction of hardware and software deficiencies, and refinement of requirements. (3) Ensure that only operationally effective, suitable, and survivable systems are delivered to users. (4) Ensure the effectiveness of the manufacturing process, equipment, and procedures through production qualifica- tion T&E.
(5) Confirm readiness for OT by ensuring that the system is stressed to at least the levels expected in the operating environment, demonstrate a level of achievement of system performance, safety, health hazards, survivability, human factors engineering, reliability, availability, and maintainability (RAM), and integrated logistics support. The primary purpose is to ensure that OT will be successfully and safely completed. (6) Provide timely information to the decision authority about system performance capabilities, effectiveness, suitability, and survivability, and readiness to proceed to the next phase of acquisition as well as recommendations for future efforts.
24 AR 73–1 • 1 August 2006