This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
An Auckland resident, Buddhika Rajapakse, was repeatedly sent payment demands by BP for fuel theft in Whanganui. The company's license plate recognition system incorrectly linked his plate to a different vehicle, failing to verify the make, model, or color of the car in the photographic evidence. The victim has been forced to repeatedly contest these claims while the actual offender remains unidentified.
BP’s license plate recognition system reportedly misidentified Auckland resident Buddhika Rajapakse as responsible for petrol theft in Whanganui. Despite the suspect vehicle being a different make, model, and color, the system allegedly linked Rajapakse’s plate to the thefts. BP has reportedly acknowledged a possible doctored plate but still sent multiple payment requests. Rajapakse has reportedly been forced to contest the claims multiple times.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
BP relied automatically on the AI system's output to issue debt collection letters without human verification of the vehicle details.
The license plate recognition system failed to accurately read the license plate and did not robustly verify the vehicle make and model, leading to a false accusation.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the BP license plate recognition AI system misidentifying a license plate post-deployment, which was an unintentional failure of the system.
A private company's automated license plate recognition system misidentified a plate, leading to false accusations of petrol theft against an Auckland resident. This is a localized commercial and administrative error with negligible national security implications.
The license plate recognition system operates as a tool that performs the specific, well-defined function of reading license plates from camera inputs and matching them to database records.
Minimal or No Risk: The system is a commercial license plate recognition tool used by a private company for fuel theft prevention, which does not fall under the prohibited or high-risk categories of the EU AI Act.
The system's primary function is to read and recognize vehicle license plates from camera footage.
The report clearly outlines the incident, the AI system involved (BP's license plate recognition), the nature of the error, and the impact on the affected individual. There is little ambiguity regarding the facts of the case.
None
Technology
LPR System Misreading
The license plate recognition system misidentified the plate characters.
Lack of Vehicle Cross-Matching
System fails to verify if vehicle details match the plate registration.
Data Inputs
Doctored License Plate
The perpetrator physically altered the plate, feeding false data to LPR.
Human Factors
Perpetrator Deliberate Fraud
An individual doctored their plate to evade payment and shift blame.
Process and Methods
Automated Letter Dispatch
Letters are sent automatically without manual verification of the match.
Inadequate Feedback Loop
Customer service fixes complaints but does not update the automated system.
Management
Lack of System Quality Assurance
Management deployed automated billing without cross-referencing vehicle data.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
