Downloaded from https://www.everyspec.com d. Appropriate OT will be conducted to provide data for system evaluations and/or system assessments, with the IOT being conducted to determine operational effectiveness, suitability, and survivability of the system under realistic conditions. e. The MATDEV will ensure that appropriate testing is planned, coordinated, and executed to provide the system evaluator the data necessary to develop a System Evaluation Report (SER) or a System Assessment (SA) to support the acquisition LCM. f. The SER will document system effectiveness, suitability, and survivability based on the requirements stated in the CDD (or CPD) and COIC derived from the CDD (or CPD).
This allows the Milestone Decision Authority to make an informed decision on system production. This applies to all systems regardless of ACAT level—to include C4I/IT, commercial and non-developmental items (NDIs), system production items (product improvements (PIs) or preplanned product improvements, engineering change proposals, and items intended for General Services Administration procure- ment if the system change causes a change to the baseline or has an operational impact. 3–3. Test and evaluation in support of system changes a. Changes (modifications and upgrades) to an existing system must be adequately tested and evaluated.
A modifica- tion is a change to a system that is still in production. An upgrade is a change to a system that is out of production. Such changes can be improvements to system capabilities or fixes to correct deficiencies after the FRP decision review. System modifications and upgrades include multi-system changes (that is, the application of horizontal technology integration, block changes, preplanned product improvements, Class I Engineering Change Proposals and system change packages). (See AR 70–1.) b. The integrated T&E strategy developed for a given system change will depend on the operational impact of the change.
When the change is a new or revised requirement, preplanned product improvement, or when the combat developer or functional proponent determines the change to have (or have significant potential for) operational impact, then the level of the integrated T&E will be determined by the T&E WIPT. (See chap 8.) c. If a change does not have operational impact, the procuring command will determine the action necessary to support the decision to apply the change. In all cases, the level of the evaluation that is required to address the impact of the change will determine the necessary testing.
In particular, for computer resources (software, hardware, or firmware), the proportion of change and the criticality of affected computer software units must be considered. d. If a change compromises the baseline or causes an operational impact to the system, to include the user’s operation or maintenance of the system, the system TEMP will be updated. (See para 10–2.) 3–4. Test and evaluation of commercial items and nondevelopmental items All commercial items and NDI programs must establish a T&E WIPT and have an approved TEMP that will adhere to the policies and procedures for new acquisition T&E programs.
The MATDEVs, combat developers, and system evaluators will make maximum use of prior test information (including information from commercial manufacturers, users, other services, agencies, or countries) supporting commercial items and/or NDI. The results of market investiga- tions may be used to satisfy some evaluation requirements. Market investigations supporting commercial items and/or NDI acquisition (including reprocurements) may include testing and experimentation when determined necessary. 3–5.
Test and evaluation in support of reprocurements Reprocurement of an item is authorized when a continuing need has been identified and validated by the combat developer (or functional proponent). T&E requirements for reprocurements vary depending on whether the reprocure- ment is for a commercial item, NDI, a Government controlled technical data package (TDP), an item from a different contractor than the original item contractor, or an item with a significant break in production (more than 2 years). The following applies to systems procured under AR 70–1: a.
Reprocurements to a current military TDP require only the appropriate DT determined by the procuring agency to verify production compliance with the specifications. If either the MATDEV or combat developer introduces system modifications or upgrades relating to the current military TDP, the system modifications or upgrades will be treated as system changes and the T&E requirements, as described in paragraph 3–3, will apply. The T&E requirements for both the system changes and the reprocurement will be integrated. b.
Reprocurement of a commercial item (off-the-shelf or modified off-the-shelf) or NDI to a current performance specification from the original contractor (make and model) without significant break in production (more than 2 years), normally requires only the appropriate DT, determined by the procuring agency and the CBTDEV, to verify production compliance with the specifications. c. Reprocurement of a commercial item (off-the-shelf or modified off-the-shelf) or NDI requires appropriate testing (1) A current performance specification from a contractor is different than the original contractor’s performance specification (different make).
(2) The original contractor intends to field a different model. (3) A performance specification is modified or upgraded by the MATDEV or CBTDEV. This determination will be 15 AR 73–1 • 1 August 2006