Amazon modified its product search algorithm to prioritize its own in-house, more profitable products over the most relevant or best-selling items. This change was reported to have been internally criticized by engineers and lawyers as a violation of the company's 'best-for-customer' principle.
Amazon tweaked product-search algorithm to boost and guide customers towards more profitable in-house products instead of showing mainly most-relevant and best-selling listings, which its internal engineers and lawyers alleged to violate company’s best-for-customer principle.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI-driven concentration of power and resources within certain entities or groups, especially those with access to or ownership of powerful AI systems, leading to inequitable distribution of benefits and increased societal inequality.
Also classified as
The algorithm manipulated search results and buy box selections to steer customers toward more expensive products for Amazon's financial gain.
Amazon used its dominant platform and proprietary search algorithm to favor its own products and squeeze out independent merchants, centralizing market power and resources.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk was caused by Amazon executives intentionally directing engineers to modify the deployed search algorithm to prioritize profitability over relevance.
Amazon modified its product search algorithm to prioritize its own profitable products, causing financial harm to independent sellers and consumers. While raising significant antitrust and regulatory concerns, the incident remains a commercial dispute with minor national security implications manageable through standard legal and economic frameworks.
The Amazon search algorithm operates as a tool that performs the specific, well-defined function of ranking product listings based on direct search queries and pre-programmed variables.
Minimal or No Risk: The product search and ranking algorithm is a commercial search tool that does not fall under the prohibited or high-risk categories defined in the EU AI Act.
The AI system's primary function is to search and rank product listings in response to user queries, acting as a product search engine.
The reports from WSJ, ProPublica, and The Verge provide detailed, investigative accounts of Amazon's search algorithm changes, including internal conflicts, specific testing metrics, and empirical data from testing 250 products.
Amazon argues that the algorithm is optimized for customer trust and long-term value, and that considering profitability is standard business practice rather than anti-competitive manipulation.
Technology
Algorithmic self-preferencing
Algorithm modified to favor Amazon own-brand and FBA-partner products.
Profitability proxy variables
Engineers used indirect variables to boost profitability without direct metrics.
Removal of relevance default sort
Default sort changed from relevance to featured to mask profitability bias.
Data Inputs
Omission of shipping cost data
Algorithm omitted shipping costs for Amazon/FBA items in price comparisons.
Integration of profit data
Engineers imported contribution profit data to train and test the algorithm.
Human Factors
Pressure on search engineers
Retail executives pressured A9 engineers to prioritize profit over relevance.
Consumer trust in Buy Box neutrality
Shoppers assumed default recommendations represented the cheapest or best deals.
Process and Methods
Profitability added to dashboard
Inclusion of profit metrics in Weblab incentivized biased algorithm designs.
Biased Buy Box selection logic
Selection criteria favored FBA sellers over cheaper independent merchants.
Lack of algorithmic transparency
Secret algorithms prevented external auditing of self-preferencing behavior.
Management
Prioritization of profit over trust
Executives prioritized retail profitability over customer-centric principles.
Reorganization of search team
A9 search team was moved under retail management, reducing independence.
Bypassing of legal constraints
Management pushed for indirect profit proxies to avoid antitrust fines.
Regulatory Environment
Absence of algorithmic oversight
Lack of regulation allowed hidden manipulation of search results.
Unclear antitrust frameworks
Existing laws struggled to address digital platform self-preferencing.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.