X Cracks Down on AI-Generated War Videos to Combat Misinformation
Elon Musk’s social media platform, X, is implementing new policies to penalize users who post AI-generated videos of armed conflicts without disclosing their artificial origin. The move comes after a surge of fake battle scenes flooded the platform following the recent conflict between the U.S. And Israel in Iran.
Revenue Sharing Suspension for Violators
Under the new policy, users found to be posting AI-generated war videos without proper disclosure will be suspended from Creator Revenue Sharing for 90 days. Repeated violations will result in a permanent suspension from the program, according to a recent announcement from X’s head of product, Nikita Bier. The platform will identify these videos through Community Notes and metadata from generative AI tools.
Addressing the Spread of Misinformation
The policy change is a direct response to the proliferation of misleading content during the U.S.-Israel conflict in Iran. Numerous fake videos and images circulated online, including a clip of a U.S. Fighter pilot mistakenly identified as Iranian by a Kuwaiti man, which garnered 70 million views as reported by Times Now. Many of these fakes contained telltale signs of AI generation, such as missing fingers.
Loopholes and Challenges Remain
Despite the new measures, concerns remain about potential loopholes. The effectiveness of the disclosure requirement – whether it needs to be embedded in the video or simply included in the text of a post – is still unclear. Gizmodo points out that X accounts have previously exploited similar loopholes, such as lengthy usernames to obscure disclaimers like “parody.”
Broader Concerns About AI-Generated Misinformation
The issue extends beyond X, with similar fake content appearing on Instagram and Facebook. Full Fact, a UK factchecking organization, notes that AI is “turbocharging the spread of misinformation” according to the Daily Mail, with examples including fabricated images of landmarks like the Burj Khalifa on fire and the body of Ayatollah Khamenei. Researchers have also observed a trend of users attempting to use AI chatbots to verify the authenticity of videos, despite the chatbots’ unreliability in assessing real-time events.
X’s Monetization and the Incentive for Viral Content
X’s Creator Revenue Sharing program incentivizes the creation of engaging, viral content, as users with substantial followings (approaching 100,000 people) can earn hundreds of dollars per month through advertising revenue. This creates a financial motivation to produce shocking posts, even if they are misleading.
Looking Ahead
X’s new policy represents a step towards addressing the growing problem of AI-generated misinformation, particularly during times of conflict. However, the platform will necessitate to continuously adapt its strategies to stay ahead of evolving tactics and ensure the effectiveness of its enforcement efforts. The challenge of balancing free speech with the need to combat harmful disinformation remains a significant one for X and other social media platforms.