AI generation organization

Last Updated 6/4/25

Definition: Companies that develop and deploy artificial intelligence systems capable of creating text, images, audio, or video content.

Mitigation Strategies:

Real-time prompts for reconsideration Quarantine borderline content Prioritized reporting Transparent feedback and reporting Update ranking model

Synonyms

Generative AI company, AI developer, Foundation model provider

Examples

Anthropic, Cohere, DeepSeek, Hugging Face, Meta AI, Midjourney, OpenAI, Stability AI

Description

These organizations create the underlying AI models and systems that can generate synthetic content. While their technology has many beneficial uses, it can be misused to create non-consensual intimate images, spread misinformation, or perpetuate harmful biases.

AI image generators exhibit significant gender bias, with professionals represented as men in 76% of generated images versus only 8% as women (UNESCO, 2024). The rapid advancement of generative AI has dramatically lowered the technical barriers for creating realistic deepfakes - one security analysis estimated that explicit deepfakes increased fourfold from 2022 to 2023 (IIA Tools Landscape Analysis, 2025).

References

Humane Intelligence. (2025). Digital violence, real world harm: Evaluating survivor-centric tools for intimate image abuse in the age of gen AI.
UNESCO, & IRCAI. (2024). Challenging systematic prejudices: an investigation into Gender Bias in Large Language Models. United Nations Educational, Scientific and Cultural Organization (UNESCO). https://unesdoc.unesco.org/ark:/48223/pf0000388971

Is something missing, or could it be better?