July 9, 2012
GAO's June 14 F-35 Report: Understates Its Own Findings; Uses Misdirecting DOD Criteria
Not all GAO reports are equal. Some tell the whole story; some entirely miss key elements; many are a mixed bag. When I worked at GAO, we used to joke in the cafeteria that the best GAO reports are never released, but some do escape.
GAO's latest offering on the F-35 strikes me as an example of an evaluation that was badly mauled by management both before and after it was written: a key element of the basic design of the study and its own summary of its own findings are both seriously flawed. I attempt to explain in a new piece at Time's Battleland blog. Buried in this GAO report are some important insights about the cost of the F-35, but the report has to be read carefully, and even then you don't get the full story.
(One of the key elements for understanding the F-35, and other aircraft, is the Air Force's official data on the operating costs of its own aircraft. While the piece that follows addresses just the F-35 and F-22 portions of these data, the entire file on all USAF aircraft for the years 2009-2011 is available. The data in the file are both important and in some cases astonishing.)
July 9, 2012
How the F-35 Nearly Doubled In Price (And Why You Didn't Know)
On June 14 - Flag Day, of all days - the Government Accountability Office released a new oversight report on the F-35: Joint Strike Fighter: DOD Actions Needed to Further Enhance Restructuring and Address Affordability Risks. As usual, it contained some important information on growing costs and other problems. Also as usual, the press covered the new report, albeit a bit sparsely.
Fresh bad news on the F-35 has apparently become so routine that the fundamental problems in the program are plowed right over. One gets the impression, especially from GAO's own title to its report, that we should expect the bad news, make some minor adjustments, and then move on. But a deeper dive into the report offers more profound, and disturbing, bottom line.
Notorious for burying its more important findings in the body of a report - I know; I worked there for nearly a decade - GAO understates its own results on acquisition cost growth in its one-page summary, which-sadly-is probably what most read to get what they think is the bottom line.
In that one-page summary, GAO states the F-35 program now projects "costs of $395.7 billion, an increase of $117.2 billion (42 percent) from the prior 2007 baseline." The much more complete story is in this table from the report:
The summary uses the wrong baseline. As F-35 observers know and as the table shows, the cost documentation of the F-35 program started in 2001, not 2007. There has been a lot more cost growth than the "$117.2 billion (42 percent)" stated.
Set in 2001, the total acquisition cost of the F-35 was to be $233.0 billion. Compare that to the current estimate of $395.7 billion: cost growth has been $162.7 billion, or 70%: a lot more than what GAO stated in its summary.
However, the original $233 billion was supposed to buy 2,866 aircraft, not the 2,457 currently planned: making it $162 billion, or 70%, more for 409, or 14%, fewer aircraft. Adjusting for the shrinkage in the fleet, I calculate the cost growth for a fleet of 2,457 aircraft to be $190.8 billion, or 93%.
The cost of the program has almost doubled over the original baseline; it is not an increase of 42%.
Now, you know why DOD loves the rubber baseline. Reset the baseline, and you can pretend a catastrophe is half its actual size.
When assessing the other, even larger, "sustainability" cost implications of the F-35, GAO makes what I regard as a major methodological error.
On page 11, GAO cites DOD's goal for the additional operating, logistics and support costs ("sustainment") of the F-35. GAO focuses on the Air Force's conventional take-off and landing (CTOL) variant and cites the new, March 2012 goal: $35,200 per flight hour, compared to $22,500 for the F-16. For years, DOD has cited the F-16 as the comparison aircraft for calculating costs to operate the F-35; now it is hoping the F-35 will be only 56% more than the cost to sustain the F-16.
GAO, quite properly, offers some skepticism that this goal can be met. It states that the CTOL version is not achieving its own criteria for meantime between failures, falling 30% short in 2011 (page 30); GAO reports that operational testers said "JSF is not on track to meet .operational suitability requirements" (page 17), and finally, GAO says the program is experiencing "excessive time for low observable repair and restoration, low reliability, and poor maintainability performance" (page 17). After all that, GAO politely calls the sustainability cost goal "a significant challenge" (page 31).
GAO is also correct to point out DOD management's declaration that the current F-35 operating cost estimate, "$1.1 Trillion for all three variants based on a 30-year service life," (page 10) is "unaffordable and simply unacceptable in the current fiscal environment" (page 11).
However, comparing the F-35 to the F-16 is a major error; associating those two aircraft is simply implausible. The two have very, very little in common. While they both are single engine aircraft that were planned to cost less than their contemporary higher cost complements (the F-15 and the F-22 respectively), the basic similarity stops there. The F-16 was conceived as a visual-range air to air fighter in the 1970s; it is a far, far more simple design, and it met its inherent affordability goal. The F-35A is a multi-role, multi-service design with stealth and many other highly complex (so-called "5th Generation") attributes added in. It is a far, far more intricate aircraft and, as a result, failed to meet any affordability goal.
The F-35A has much more in common with its Lockheed stablemate, the F-22. While the F-22 may be more complex in some respects (twin-engine with divertible thrust; earlier generation stealth coatings); in other respects the F-35 is the more complex aircraft of the two (basic multi-role design woven into a STOVL-capable, multi-service airframe, even more complex communications, sensor and display systems, and much more software and complexity of system integration).
The F-35's fundamentally complicated ("5th generation") design makes its comparison to the F-16 inappropriate in any effort to understand F-35 operating costs. It should be compared to the F-22 where the similarities abound, for the most part. To better predict unknown F-35 costs, we should start with known F-22 operating costs.
The Air Force has been recording costs per flying hour for the F-22 since 2003. Six years after 2005 when the Air Force declared "initial operating capability" (IOC or the presumed ability to deploy and fight) for the F-22, the Air Force officially calculated an "ownership" cost per-flying-hour for the F-22 at $128,389. (See attached AFCAP Extract 2011Q4 Spreadsheet). That amount, however, is an outlier: the F-22 was grounded for more than four months that year, thereby distorting upwards the per-flying-hour cost.
There were no F-22 groundings or other significant flight limitations in 2010; the data for that year reflect known sustainment costs, per hour, after five years of deployability, thereby reflecting any learning curve in F-22 maintenance and support. The Air Force's "ownership" cost per flying hour for the F-22 in 2010 was $63,929: half the 2011 cost.
It is that amount that should serve as the starting point for considering plausible F-35 operating costs. Optimistically speaking, a downward adjustment can be made for the F-35: Lockheed is attempting to reduce the cost and maintenance hours needed for the F-35's version of stealth coatings, which comprises a large portion of F-22 operating costs, and an allowance should also be made for the single engine design of the F-35.
However, it is currently unknowable whether the lesser stealth cost goal will be achieved (as noted above, GAO found the F-35 is encountering problems), and it is also unknowable if the single engine design compensates, or not, for the added operating costs for the more complex communications, sensors, displays and software integration. While highly optimistic, perhaps a 20% improvement over the F-22 can be analytically useful.
Assuming that 20% cost per-flying-hour improvement over the F-22, the F-35 would cost $51,143 per hour to fly. Rather than an F-35A operating cost that is 56% more than the non-analogous F-16; it is more plausible, and analytically conservative, to calculate an operating cost that is 80% less than the highly comparable F-22-even if the improvement has not yet been demonstrated. The question should not be whether the F-35 can achieve 156% of the operating cost of the F-16; it should be whether it can achieve 80% of the operating costs of the F-22.
Posing the question in that manner, however, presents a serious dilemma: if the currently projected estimate of operating costs for the complete fleet of all three F-35 variants of $1.1 trillion is "unaffordable and simply unacceptable," what is the meaning of a plausible-even if optimistic-operating cost that is well above that unsustainable $1.1 trillion?
During the nine years I worked in GAO's methodology division, specializing in national-security evaluations, we took very seriously the selection of reasonable criteria for the purposes of comparing DOD systems. When DOD's criteria were biased, we selected more appropriate ones. In this recent report, GAO failed to take that step.
We also used to joke in the cafeteria about the tepid titles senior management would give the reports we wrote. This new GAO report, Joint Strike Fighter: DOD Actions Needed to Further Enhance Restructuring and Address Affordability Risks is a very unfortunate example: it does not simply understate the message the data convey; it misstates what the data say. The cost growth inherent in the F-35 program is huge and still growing: far more than to "enhance restructuring" and "address affordability" is needed.
The F-35 should now be officially called "unaffordable and simply unacceptable." All that is lacking is a management that will accept - and act - on that finding.
Winslow Wheeler is the Director of the Straus Military Reform Project of the Center for Defense Information, a part of the Project on Government Oversight (POGO) in Washington, DC. He has authored two books: The Wastrels of Defense: How Congress Sabotages National Security (US Naval Institute Press) and Military Reform: An Uneven History and an Uncertain Future (Stanford University Press).
Director, Straus Military Reform Project, CDI at POGO, POGO
At the time of publication Mr. Wheeler's was the director of the Straus Military Reform Project of the Center For Defense Information at POGO.
The goal of the Straus Military Reform Project is to secure far more effective military forces and much more ethical and professional military and civilian leadership at significantly lower budget levels.
We would like to thank Philip A. Straus Jr. and family for their generous support.
- August 28, 2015
- August 26, 2015
- August 24, 2015