This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Figma temporarily disabled its 'Make Design' AI feature after users discovered it was generating near-replicas of Apple's iOS Weather app. Figma's CEO attributed the issue to a lack of variability in the commissioned design systems used by the underlying third-party models (OpenAI GPT-4o and Amazon Titan). The company pulled the feature to conduct a quality assurance review, citing concerns that designers could face legal trouble if they unknowingly used the generated designs.
Figma has temporarily disabled its AI design feature, "Make Design," after accusations of copying Apple’s Weather app. Andy Allen of NotBoring Software highlighted the issue, prompting Figma CEO Dylan Field to deny claims of training the AI on specific app designs. However, Field acknowledged flaws in the QA process and promised to suspend the feature until it meets quality standards. The incident has implications for designers.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems capable of creating economic or cultural value, including through reproduction of human innovation or creativity (e.g., art, music, writing, coding, invention), destabilizing economic and social systems that rely on human effort. The ubiquity of AI-generated content may lead to reduced appreciation for human skills, disruption of creative and knowledge-based industries, and homogenization of cultural experiences.
Also classified as
The system lacked the capability to generate diverse designs due to low variability in its underlying design system, leading to repetitive and plagiarized outputs.
The AI tool reproduced and imitated Apple's existing, publicly known creative UI design, devaluing human design effort and risking legal issues for users.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The AI system unintentionally generated near-replicas of Apple's Weather app after being deployed to beta users.
Figma temporarily disabled its 'Make Design' AI feature after it generated near-replicas of Apple's Weather app. The incident stems from an unintentional quality assurance failure regarding the diversity of the underlying design systems. It represents a standard commercial intellectual property and product quality issue with negligible national security implications.
The report describes the AI system as a design aid that generates UI layouts from text prompts to help developers get ideas down quickly, requiring them to check and modify the results.
Limited Risk: The system is a generative AI tool ('Make Designs') that generates UI layouts and components from text prompts, which falls under generative AI systems with transparency obligations.
The AI system's primary goal is to generate user interface (UI) designs, layouts, and visual components based on text prompts.
The reports provide clear, consistent accounts of the incident from both the person who discovered the issue (Andy Allen) and Figma's leadership (CEO Dylan Field and CTO Kris Rasmussen). The technical cause (low variability in the commissioned design system used by off-the-shelf models) and the company's response (disabling the feature for QA) are explicitly detailed.
The replication could be interpreted as direct training data plagiarism by the third-party models rather than an issue with Figma's commissioned design system.
Technology
Low Output Variability
Off-the-shelf models combined with design system produced near-replicas.
Reliance on Off-the-Shelf Models
Figma used GPT-4o and Titan instead of custom-trained models.
Data Inputs
Flawed Bespoke Design System
The commissioned design system lacked sufficient variation in its components.
Third-Party Model Training Data
Models used may have been trained on Apple's proprietary app designs.
Process and Methods
Inadequate QA Process
Figma's quality assurance failed to catch similarities to existing apps.
Rushed Beta Release
The feature was released in beta without thorough output verification.
Management
Rushed Deadline for Config
Management pushed the team hard to launch the tool at the annual conference.
Regulatory Environment
IP Infringement Risks
Lack of standard compliance checks for AI-generated design copyright.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
