Lion Air Flight 610, a Boeing 737 MAX 8, crashed into the Java Sea shortly after takeoff, resulting in 189 fatalities. The investigation revealed that the aircraft's Maneuvering Characteristics Augmentation System (MCAS) was triggered by erroneous data from an angle-of-attack sensor. The system repeatedly commanded the aircraft's nose downward, and the flight crew was unable to overcome the automated inputs, leading to the fatal crash.
A Boeing 737 crashed into the sea, killing 189 people, after faulty sensor data caused an automated manuevering system to repeatedly push the plane's nose downward.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The automated system physically overrode the pilots' manual control column inputs, removing their ultimate decision authority to keep the plane level.
The MCAS system lacked robustness by relying on a single sensor input without cross-checking, leading to catastrophic failure when that sensor malfunctioned.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the MCAS software autonomously commanding the aircraft's nose down post-deployment, which was an unintentional failure of the system's safety goal.
Added categories peak at 2: Minor (Psychological Harm, Direct)
The crash of Lion Air Flight 610 was a catastrophic critical infrastructure safety failure caused by the autonomous MCAS software reacting to erroneous sensor data. While resulting in tragic loss of life and massive economic consequences for the aviation industry, the incident was an unintentional technical accident with negligible direct implications for national security.
The MCAS system operated independently in real-time without explicit pilot planning, reacting to sensor inputs to command physical flight controls. As Report 7 states, 'MCAS is activated without pilot input and only operates in manual, flaps up flight.'
High Risk: The system is integrated into critical transport infrastructure. The reports describe an 'automated safety system' (MCAS) that 'repeatedly pushed the plane's nose down' which directly impacts the safety of public transport.
MCAS was designed as an automated flight-control system to automatically handle the risk of aerodynamic stall by adjusting the horizontal stabilizer.
The reports provide highly detailed, consistent, and official preliminary findings from aviation safety boards (NTSC, FAA) regarding the mechanical and software failures of the MCAS system and the AOA sensors.
Some initial statements from Boeing attempted to frame the incident primarily as pilot error or maintenance failure rather than a software design flaw.
Technology
Single Sensor Reliance for MCAS
MCAS triggered by a single faulty AOA sensor without cross-checking backups.
Uncommanded Repeated Nose-Down
MCAS software repeatedly commanded stabilizer trim down, causing a deep dive.
Control Column Override Disabled
Unlike older models, pulling back on the column did not stop MCAS runaway.
Data Inputs
Erroneous AOA Sensor Readings
AOA sensor registered extremely high, incorrect values, triggering MCAS.
AOA Sensor Disagreement
Left and right AOA sensors differed by 20 to 59 degrees during flight.
Human Factors
Cockpit Confusion and Overwhelm
Multiple simultaneous alarms and alerts overwhelmed the flight crew.
Lack of MCAS System Awareness
Pilots were not informed of the existence of the MCAS system in training.
Erosion of Hand-Flying Skills
Over-reliance on autopilot systems reduced basic manual piloting proficiency.
Process and Methods
Inadequate Maintenance Testing
Failed to perform a maintenance test flight to validate the sensor repair.
Omission of MCAS from Manuals
Boeing omitted MCAS details from the flight crew operations manual.
Incomplete Troubleshooting
Maintenance cleared the plane without checking the critical AOA sensor.
Management
Prioritizing Market Competition
Retrofitting old aircraft to compete with Airbus created physical instability.
Withholding Safety Information
Management failed to communicate the new automated system to airlines.
Deficient Safety Culture
The airline failed to ground the plane after persistent sensor issues.
Regulatory Environment
Delayed Safety Directives
Regulators only mandated manual updates and procedures after the crash.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.