A New Front in the Misinformation War
Recent reports have highlighted a troubling trend: AI-generated avatars posing as doctors are racking up millions of views on platforms like TikTok and Meta by peddling dangerous health myths. These synthetic influencers might blend credible wellness
tips with disproven claims, such as certain deodorants causing cancer or unverified supplements offering miracle cures. In response to this growing threat, platforms are publicly stating their commitment to remove such content. A TikTok spokesperson recently affirmed their policy, stating, “we remove harmful health misinformation, including when it's AI-generated.” This isn't just about one platform; it's an industry-wide scramble to address a new, automated form of a very old problem.
The AI-Powered Threat
What makes AI-generated misinformation so much more dangerous? It's a matter of scale, speed, and sophistication. A single company can reportedly produce over a thousand AI-generated ad videos in a single day for a minimal cost. These videos often feature polished, trustworthy-looking avatars delivering advice in a confident tone, making it difficult for viewers to distinguish between a real medical professional and a deepfake. Research from one digital marketing agency found that AI-generated content appeared in 40% of top health-related TikTok videos. For specific searches like “health tips,” that number skyrocketed to 84%. This “industrialised exploitation of trust,” as one researcher called it, means false narratives can reach millions before they are detected.
What Counts as 'Harmful'?
A key part of any platform's policy is defining what crosses the line from benign to harmful. Generally, this includes content that could lead to immediate or long-term physical harm. TikTok's guidelines, for instance, prohibit content that shows fake authoritative sources or crisis events. For its marketplace, it strictly forbids any claims that a product can diagnose, treat, cure, or prevent a medical condition without being a properly regulated Over-the-Counter drug. The primary concern is for content that discourages people from seeking professional medical care or promotes dangerous, unproven remedies over established treatments. Examples found circulating include fake cancer cures and misleading ads for supplements.
The Enforcement Dilemma
Announcing a policy is one thing; enforcing it across billions of posts is another. Platforms use a combination of automated detection systems and human moderators, but the sheer volume of content is a major hurdle. While platforms state they are removing violating content, sometimes only after it's flagged by journalists or researchers, the gap between policy and what users see in their feeds persists. AI-generated content is particularly tricky. Bad actors can quickly create new accounts or slightly alter their content to evade detection. In response, some platforms are shifting their strategy from solely removing content to also labeling it. Both Meta and TikTok have introduced labels to identify content as AI-generated, aiming to give users more context. However, the effectiveness of these labels depends on users noticing them and understanding their implications.
Beyond Takedowns: Promoting Good Information
Fighting misinformation isn't just about playing defense. Platforms are also taking steps to proactively elevate credible information. TikTok, for example, states that it partners with the World Health Organization and the UK's NHS to provide reliable health information directly within the app. This strategy aims to dilute the pool of bad information with good, making it easier for users to find trustworthy advice. However, medical experts remain concerned. The British Medical Association and NHS England have both voiced alarms about the public safety dangers of fake medical advice, noting that real clinicians are seeing an increase in patients who are worried and confused by things they've seen online.
