When AI Removes the Hijab: The Hidden Question of Digital Identity and Consent
Artificial intelligence is rapidly becoming part of everyday digital life, transforming the way people work, communicate, and even present themselves online. But as AI-generated images become increasingly common, a less visible question is emerging: what happens when AI alters a person’s identity without their permission?
Recent research by Pakistani-origin AI scholar Dr. Mahwish Moazzam has shed light on this issue. Her study of over 25 commercially available AI-powered headshot applications revealed a consistent pattern: photographs of women wearing hijabs were transformed into professional headshots with the hijab removed, without users’ consent.
Dr. Moazzam, a Research Scholar at the University of California, Berkeley School of Law, specializes in human rights, gender, and emerging technologies. Her work explores the impact of AI systems on equality, dignity, visibility, and the recognition of diverse forms of identity.
Her research findings suggest that this issue goes beyond mere image inaccuracies. None of the applications tested reproduced the hijab accurately; instead, they converted images with a hijab into professional headshots with the covering removed, denying users the choice to preserve their original identity.
For Dr. Moazzam, this phenomenon represents a critical form of AI-related harm: identity erasure.
"This is not simply a question of whether an AI system generates an inaccurate image. When a technology repeatedly removes a visible expression of identity without the user’s consent, it raises serious concerns about dignity, equality, and who is considered the default person in digital systems."
This observation sparks a growing debate about generative AI. While discussions around algorithmic discrimination often focus on misidentification, biased classifications, and unequal access, generative AI introduces a new concern: the active alteration of a person’s representation.
The hijab serves as a clear example because it can be a significant indicator of religious and personal identity. When an AI application automatically removes it while preparing an image labeled as a "professional headshot," it raises fundamental questions about digital identity and consent.
