• Military Menu                       

• Introduction
• Systems
• Facilities
• Agencies
• Industry
• Operations
• Countries
• Hot Documents
• News
• Reports
• Policy
• Budget
• Congress
• Links

• WMD
• Intelligence
• Homeland Security
• Space

	Director, Operational Test & Evaluation
	FY98 Annual Report

The Live Fire Test and Evaluation (LFT&E) Program was enacted into law by Congress beginning in FY86. From its inception, the program has required realistic survivability and lethality testing on platforms and weapons to assure that major systems perform as expected and that combat forces are protected. The number of LFT&E systems on OSD oversight reached 80 programs over the past year, the highest number since the program was enacted. This increase is primarily due to numerous upgrades to existing major systems. Nearly evenly divided between weapons and combat platforms, these programs embrace systems as small as a machine-gun bullet and as large as the National Missile Defense program. It includes fixed and rotary wing aircraft, ships and submarines, and a variety of land combat systems.

The Joint Live Fire (JLF) Program, chartered by the Office of the Secretary of Defense in 1984, is the responsibility of the LFT office. This program is a natural adjunct to the LFT&E program since it tests the vulnerability and lethality of U.S. platforms and weapons that have already been fielded, in contrast to the LFT&E program which evaluates systems still in development. The JLF program has enabled a wide range of testing, including the evaluation of fielded systems to emerging threats and to threats that have been known, but previously unavailable for testing. It has also provided many opportunities to upgrade our vulnerability and lethality models by comparing pre-shot predictions with actual test outcomes and making the needed corrections where possible.

One of the themes that the Secretary of Defense has articulated to the T&E community is the need to combine testing and training where possible. The LFT&E program has taken action on this theme and formulated a Live Fire Testing and Training Initiative with congressional funding beginning in FY97; again in FY98 and FY99. Through a Senior Advisory Group comprised of the Deputy Director, OT&E/LFT and the Commanders of the Service training and simulation commands, this program provides mutual benefits to both the LFT and Training/Readiness communities. These shared benefits are described in more detail later in this section.

Another of the Secretary's themes is to make more effective use of modeling and simulation opportunities. The LFT&E program supports this in several ways. First, requiring pre-shot predictions for each and every LFT&E and JLF test and comparing predictions to test outcomes, continues to provide valuable empirical data to upgrade our vulnerability/lethality models. Secondly, the Target Interaction Lethality/Vulnerability (TILV) program brings together technical experts from the military services and the Defense Special Weapons Agency to examine their plans in the 6.1, 6.2, and 6.3A areas to assure that there is neither unnecessary overlap nor serious gaps in the vulnerability/lethality technology base program. The TILV is co-chaired by DDR&E and the DDOT&E/LFT. A third effort is to produce computer models with physical underpinnings that not only improve the understanding of current systems, but also more accurately predict test results. Through an agreement between the Director, OT&E and the Assistant Secretary of Energy for Defense Programs, advanced computer codes applied in the Accelerated Strategic Computing Initiative are being used to help make pre-shot predictions for the wide variety of LFT and JLF test opportunities. This effort has proven to be mutually beneficial for both programs and continues to grow in importance.

In July, this office proposed a forum to discuss and consider LFT&E policy. Our premise has been that the requirements for survivable and lethal systems have not diminished, if anything, they are increasing. Greater collaboration between OSD and the Services can clarify LFT&E policy to improve the acquisition process and improve the overall effectiveness of LFT&E programs consistent with statute. This forum has reached an agreement on a new DoD 5000.2R revision.

This policy has several benefits including the clarification of several terms, as well addressing the live fire testing of commercial off-the-shelf and non-developmental items to be used by our military forces.
 
 

LESSONS LEARNED

A central theme in the conduct of any Live Fire program is in documenting "lessons learned." This provides a mechanism by which the acquisition and test communities can incorporate new understanding of system performance under realistic combat conditions.

The Army's M1A2 Tank program provides a good illustration of how LFT&E can contribute to system improvement.

The table below summarizes "lessons learned" from Abrams LFT&E.
 

• Engine Air Intake.



• Engine PM III-Transmission Shift Select and Fuel Control ("Limp-Home").



• GPS Head Mirror.



• CITV Azimuth Drive.

• There continue to be surprises even on system upgrades when testing at the full-up level.



• It is not too late to make small fixes that have a big impact, even after you have built the entire vehicle.



• LFT&E at the full-up level also has major positive impact on tactics, training, and doctrine.

JOINT LIVE FIRE PROGRAM

The JLF program was chartered in March 1984 to conduct Live Fire testing of fielded U.S. and foreign air and ground weapons platforms. Programs selected under the original charter that have been tested include the AV-8B, AH-64, UH-60, MIG-23, MI-24 (HIND), T-62, M60A3, T-72, M1, M2/M3, and BMP vehicles.

In 1998 under the JLF Air Systems Program, vulnerability tests were conducted on AH-1S Cobra helicopters and on the F-14 Tomcat. Also during 1998, test plans were prepared for testing the vulnerability of the F-16 to man portable missiles. Under the JLF Ground Systems Program, tests were conducted to determine the lethality of selected U.S. weapons against a classified foreign armored vehicle identified as Spirit. This work is described in the classified annex to this report. Tests were also conducted to determine the lethality of the U.S. HARM missile against ground-based elements of foreign surface-to-air missile systems, including SA-6 and SA-8, also discussed in the classified annex.

• AH-1S Testing: The AH-1S testing began three years ago when 12 retired, flyable aircraft were made available to the JLF program. The first series of tests was dedicated to testing rotor blades, both statically and dynamically. Modeling and simulation were used extensively to predict rotor blade damage and were compared to actual test results. The results of the tests showed, for the first time, the differences in rotor blade damage which occurred between statically and dynamically-tested rotor blades. Comparisons of test results with analytical predictions also indicate that improvements in analysis methods are necessary to increase confidence in accurately predicting blade damage.

• F-14 Testing: The primary objective was to evaluate the vulnerability of the fuel system in relation to various gun and missile threats and assess their impact on mission abort, aircraft kill, and crew injury or death. This includes primary effects such as hydrodynamic ram, fuel leakage and fire. It also includes investigating secondary effects such as structural damage, dry bay fire, external fire, loss of flight control systems, avionics, or ejection system components. Test data will be used to enhance existing computer models in areas where test results significantly differ with expectations. Test results will also be analyzed to develop and propose inexpensive design improvements. The results of the testing conducted to date has shown some interesting effects which could affect how the aircraft is used in battle. These are discussed in the classified annex to this report.

• F-16 Testing: The principal objectives of this ballistic test series are to identify the kill mechanisms (e.g., blast, fragments, and missile body kinetic energy) from a Man-Portable Air-Defense System (MANPADS), which may inflict critical damage to the F-16 aircraft, and determine how the damage affects the flight performance of the aircraft. Most of the testing in the past has been limited to static tests of warheads alone. These tests will provide insights into the damage mechanisms resulting from dynamic impacts of the complete missile (warhead and missile body). The class of MANPADS missiles of interest include SA-7A, 7B, 14, 16, 18, and basic STINGER. Testing is scheduled to be performed during FY99 at Eglin AFB and will utilize four F-16 fuselages.

• SPIRIT Testing: Test firings were conducted against a threat land combat vehicle that was code-named SPIRIT. Most of the firings were of older 25mm Armor-Piercing Discarding Sabot kinetic energy (KE) rounds used by the Army's Bradley Fighting Vehicle. The testing confirmed the general lack of effectiveness of the less capable 25mm rounds against the class of systems represented by the SPIRIT. Also, eight shots were fired against the SPIRIT using two candidate KE rounds for the new 30mm gun, which is to be mounted in the Advanced Amphibious Assault Vehicle.

• Improved HARM Testing: The JLF program contributed funding to a joint United States/German test of the Improved HARM warhead against threat air defense components. In early FY98, a shot was conducted against an operating SA-6 radar vehicle, a non-operational SA-6 Radar, and a non-operational SA-6 Transporter-Erector-Launcher. A former East German officer with extensive SA-6 experience assessed the inflicted damage and estimated the repair time to put the system back in operation. Instrument readings during the shot identified unique battle-damage signatures associated with specific levels of damage to the system. Another benefit of the testing was improved modeling of HARM damage to air defense targets, including better target descriptions and fault trees, higher fidelity in component damage representations, and a detailed validation of the primary analysis tools for HARM.

LIVE FIRE TESTING AND TRAINING INITIATIVE PROGRAM

Congress continues to support the Live Fire Testing and Training (LFT&T) Program, a national military testing and training initiative administered by the Services' simulation and training agencies. The program is overseen by the Deputy Director, Operational Test and Evaluation for Live Fire Test and Evaluation. The primary goal of the LFT&T Program is to foster the exchange of technology development initiatives and uses between the live fire test and training communities in order to better serve the ultimate customer-the warfighter. Another goal of the program involves establishing partnerships between DoD and the civilian sector. The LFT&T program was initially supported with $3 million in FY97, $4 million in FY98, and $5 million in FY99. This technology development initiative drew heavily upon expertise at major U.S. simulation and training centers.

Oversight of the LFT&T Program is provided by a Senior Advisory Group (SAG), which consists of leadership from all four Services' simulation and training commands and is chaired by the Deputy Director, Operational Test and Evaluation for Live Fire Test and Evaluation. The projects begun in FY97 and currently supported through the LFT&T Program are:

• Combat Trauma Patient Simulator: This project addresses one of the highest priorities of the LFT&E Program, that of minimizing combat casualties. It involves joining private sector and military development in ground combat operational assessments and training that simulate emergency medical treatment during combat. The Human Patient Simulator and the Multiple Integrated Laser Engagement System are designed to provide assessment capabilities and training for faster and better treatment to wounded personnel on the battlefield. The project will also enable the evaluation of crew injuries as they effect the performance of weapon systems in battle.



• Synthetic Environment Support for Lethality Live Fire Test and Evaluation of Ground Vehicles: This project is a first attempt to build a bridge between live and synthetic test environments supporting the U.S. Army's Bradley Fighting Vehicle Program. Developing the capability to conduct weapons firing tests in a synthetic environment enables testers to assess side-by-side comparisons with live fire test results. The simulations will assist in determining the value of synthetic environment testing to LFT&E. Additionally, through this effort, ground crews will be provided the opportunity to refine their gunnery skills.



• Target Impact Assessment: LFT&E provides a rich data source of target impact and near-miss signatures from front-line U.S. combat platforms encountering threats. Since most training involves limited actual live firings against realistic threats, there are few opportunities for gunners and their commanders to observe an actual combat hit/kill. This project provides a "proof of concept" to define, document, and demonstrate transforming live fire test photographs and video into high-fidelity training models. It will provide more realistic training and give test evaluators a more tractable method of obtaining improved visual representations of test results. Subsequent integration of these target models into training visual systems will provide enhanced realism/fidelity for combat training scenarios involving the detection, acquisition, and engagement of enemy targets.



• Lethality/Vulnerability Enhancements for Ground Vehicle Direct Fire Simulations: This project seeks to improve the realism of training simulations through the application of LFT&E data and methodologies. The primary thrust addresses how training simulations use metrics involving probability-of-kill-given-a-hit information regarding the mobility of ground vehicles. The project will be executed in three phases: Phase I will examine how target-weapon interactions are scored in current training simulations and determine the level of accuracy needed to support training objectives; Phase II will analyze how these training models and methods can be improved; and Phase III will investigate applying current LFT&E test data and methodologies to enhance the fidelity of training engagement simulations.



• Effectiveness of Small Arms Fire: This project provides a reconfigurable engineering tool, the Small Arms Simulator Testbed (SAST), to the small arms testing community which uses modeling and simulation techniques to design, test, evaluate, and modify new weapon concepts. Initiated as a project to support concept development and evaluation of the U.S. Army's Objective Individual Combat Weapon, the SAST has evolved into a tool that identifies critical technical/engineering issues through metrics associated with live fire test of future small arms. SAST also shows marked potential as a training aid of existing weapons. The testbed should result in more informed acquisition decisions by providing vital lethality metrics into small arms system design, thereby reducing the prototype development cycle time. Efforts to date have yielded more than $600 thousand in direct savings. This project has the potential to greatly enhance the realism of anti-terrorism training simulation in urban settings for both current and future weapon systems.

• Simulation for Producing Realistic Munitions Impact Flash Events: An extension of the FY97 Target Impact Assessment Project, this project will develop synthetic image generations of visual signatures from flashes produced by kinetic energy (or other) munitions impacting targets. These modeled results will be integrated into training simulator visual systems.



• Battle Damage Assessment and Repair (BDAR): A joint U.S. Army and U.S. Air Force effort to develop a portable computer-based BDAR data storage/retrieval and training system to support assessment and repair of battle-damaged ground vehicles/aircraft. This effort also includes the effects of threat warheads to assist in understanding the lethality of threat projectiles/missiles and recognizing threat "signatures" on damaged units.



• Augmented Reality-Based Fire Fighting for Total Ship Survivability: A "proof-of-concept" project in support of Total Ship Survivability Tests, using augmented reality technologies to demonstrate the role of shipboard firefighters in fire damage assessment and fire extinguishing employment.

MODELING AND SIMULATION FOCUS AREAS

• LFT&E Target Interaction Lethality and Vulnerability (TILV): The TILV Master Plan and Investment Strategy is a comprehensive effort to identify the technology investment areas which provide the largest payoff to the Lethality/Vulnerability (L/V) community. This activity provides a forum for L/V experts from across the Services and other DoD elements to identify and prioritize areas where technology advances are needed.

• LFT Safety and Survivability of Aircraft Initiative (SSAI): SSAI is a collaborative effort between DOT&E/LFT&E, Sandia National Laboratories (SNL), and the Air Force Research Laboratory (formerly Wright Labs). The objective of the SSAI is to critically assess our ability to predict the safety of aircraft in fire and blast events under flight conditions. The approach selected involves the use of computational models, well-controlled experiments, and live fire tests. The complexity of fire scenarios, the need for high fidelity solutions, and the requirement to address many scenarios suggests a two-tiered approach: multi-dimensional, CFD-based fire field models and reduced physics, fast-running engineering models.

• Dry Bay Fire Model Assessment and Validation Experiments: Due to a lack of data from well-controlled experiments, the credibility of dry bay fire calculations remains unproven. The objective is to build confidence in the models, identify shortcomings, and define action plans to address these issues. The following accomplishments were achieved in FY98:

• VULCAN (fire code) calculations were performed for the class of problems that will be addressed in this study. Issues such as inlet shape, inlet location, inlet air velocity, fuel release location, and dry bay geometry were investigated.
• Model predictions were used to define test fixture requirements, necessary measurements, diagnostic techniques, measurement locations, and test scenarios.
• The test fixture design has been completed.

• Collaboration between SNL and the Army to assess the capability to model ground vehicle fires in tanks.
• Additional Air Force/SNL collaboration on a series of numerical simulations and experiments to gain confidence in modeling air flow and suppressant transport in an aircraft nacelle (as proposed to JTCG for FY98).

• Hypervelocity Impact Hydrocode Study: The objective of the hypervelocity impact study is to critically assess our ability to predict the lethality of TBM or ICBM intercept events. Missile defense programs rely on two methods of defeating threat warheads: hit-to-kill and active kill enhancement. In a hit-to-kill system, a kill vehicle is guided to an intercept where all or part of the interceptor impacts the payload section of the threat vehicle. This is sometimes called a body-to-body impact. The kinetic energy of the engagement is the primary source of damage to the threat payload. Kill enhancement devices are designed to produce a larger region of damage to the target. This is an important consideration for targets with submunitions that require distributed damage for a "hard kill" of the payload. In general the aim-point accuracy of TBM and NMD systems must be very high, and kill enhancement devices are not intended to enlarge the acceptable aiming error but rather distribute the mass more effectively. An exception is the Navy Area program where a fragmenting warhead provides the capability to defeat targets with blast and fragmentation damage, even when miss distances preclude body-to-body impact.