Sora 2 Faces Criticism Over Unconsented Fetish Content

The launch of OpenAI’s new video app, Sora 2, has sparked controversy as users discover the platform’s vulnerability to unconsented fetish content. Reports indicate that individuals have been using the app to generate videos featuring the faces of real women, including those resembling pregnancy or other niche fetishes. The situation raises significant ethical questions regarding user consent and the implications of AI-generated content.

Sora 2, which allows users to create videos using the likenesses of others, has gained popularity since its launch in March 2024. Users can opt to make their faces available for “cameos,” a feature intended for creative fun. However, some have reported unsettling experiences, including one user discovering a video depicting her as pregnant. This particular instance was part of a broader trend: out of 25 recent videos using her likeness, ten were identified as fetish content, including themes related to belly inflation and giantess scenarios.

The user, who has experience in internet culture, expressed discomfort at the ease with which individuals can create potentially sexualized content without direct consent. “It’s disturbing to see how easily someone can use my face to generate videos for sexual gratification,” she stated. The issue highlights the challenges that come with granting permissions for likenesses in an increasingly digital world.

Concerns Over Consent and Copyright

OpenAI has faced scrutiny not only for the fetish content but also for its approach to copyright and user consent. The app does not permit videos featuring the likenesses of living celebrities, yet it has allowed the creation of content involving deceased figures like Bob Ross and Martin Luther King Jr.. Following complaints from King’s family, OpenAI paused the use of his likeness, illustrating the complexities of managing intellectual property rights within the app.

Additionally, the app’s initial days were marred by unauthorized content featuring popular characters from shows and games, raising further questions about content moderation. A spokesperson from OpenAI did not respond to multiple requests for comment regarding these issues.

Potential Risks for Minors

The situation becomes more concerning when considering the interactions between minors and adult content on Sora 2. Reports surfaced of young users creating videos with a popular female porn star, prompting discussions about the appropriateness of such content. One video featured a boy, estimated to be around 11 years old, lying next to the adult performer, which further complicates the platform’s safety protocols for younger users.

OpenAI has announced new parental controls aimed at limiting interactions between teens and adults, but the effectiveness of these measures remains unclear. Questions linger about whether it is acceptable for teenage users to interact with adult content creators or if adults can create cameos featuring minors.

The challenges of moderating and controlling the content on Sora 2 underscore a broader conversation about the responsibilities of technology companies in safeguarding user consent and maintaining ethical standards. As the platform evolves, it will be crucial for OpenAI to address these pressing concerns to ensure a safe and respectful environment for all users.

As Sora 2 continues to gain traction, the emergence of fetish content illustrates the unforeseen consequences of allowing users to freely create videos using real people’s likenesses. This raises an important question: how will OpenAI navigate the complexities of consent and content moderation in the age of AI?