Connect with us

Hi, what are you looking for?

AI Marketing

TikTok’s AI Symphony Generates Rampant Fake Ads, Misleading Health Products Surge

TikTok’s AI Symphony enables rapid creation of misleading ads, with $12B investment in AI prompting a surge in fraudulent health product promotions.

In a landscape increasingly dominated by digital advertising, TikTok has emerged as a key player, leveraging its vast user base to generate significant revenue through targeted campaigns. According to documents filed with Ireland’s Company Registration Office (CRO) in August, TikTok Technology Ltd, the social media giant’s Irish arm, indicated that its business model heavily depends on a blend of advertising income, value-added services, and merchandise sales. However, this reliance on advertising revenue has raised concerns regarding the integrity of content on the platform.

Reports have surfaced indicating a rise in misleading and harmful advertisements on TikTok, often generated by artificial intelligence (AI). This trend has been exacerbated by the company’s substantial investments in AI technology. Earlier this year, the Financial Times reported that TikTok’s parent company, ByteDance, intended to invest $12 billion in AI chips by 2025. The influx of AI-generated content, including fraudulent advertisements, poses a growing challenge to the platform’s reputation.

Recent advertisements on TikTok have promoted dubious health products, including weight loss supplements claiming efficacy without scientific backing. One notable example includes ads for GLP-1 patches, which are falsely marketed as weight-loss aids, lacking the active ingredient found in legitimate medications like Ozempic and Mounjaro. Many of these ads direct users to cloned websites impersonating established pharmacies, potentially deceiving consumers into trusting illegitimate businesses.

TikTok has established advertising policies aimed at preventing misleading and deceptive content. According to the company, these policies are designed to protect integrity and authenticity for users, declaring that accounts violating these rules may face suspension or bans. Specifically addressing health misinformation, TikTok commits to combating false claims that can influence personal health decisions and public trust in credible health sources.

Despite these assurances, the proliferation of AI-generated ads remains a significant issue. TikTok’s investment in AI tools has allowed for the rapid creation of content within the app itself. The platform’s marketing tool, TikTok for Business, is a resource for businesses to develop advertising campaigns. It features a chatbot assistant that aids users in crafting advertisements, affirming that it can indeed produce AI-generated content that can be promoted on TikTok.

In 2024, TikTok launched TikTok Symphony, a generative AI suite designed to streamline the creation of brand content. The tool offers options for pre-built and custom avatars and includes editing, translation, and dubbing capabilities for video advertisements. The company claims it simplifies the ad creation process, allowing businesses with limited resources to maximize their marketing efforts.

However, the very system designed to assist brands in creating content has also facilitated an increase in misleading advertisements. In an illustrative instance, an individual was able to create an AI-generated ad promoting weight loss supplements in just minutes without any content moderation warnings from the platform. The ad was flagged only post-creation, despite its promotion of unverified health claims.

Although TikTok maintains that content generated using its AI tools undergoes a moderation review, the presence of deceptive ads still permeates the platform. Users are potentially exposed to unsafe products and scams linked to fraudulent third-party websites. TikTok has stated that it actively removes content violating its policies on health-related claims and is committed to restricting misleading advertisements.

In light of the growing concerns surrounding AI-generated content, EU Commissioner for Democracy, Justice, the Rule of Law and Consumer Protection Code, Michael McGrath, emphasized the need for regulatory safeguards. He noted that while the EU aims to foster competitiveness in AI, it must operate within established guardrails. “We have a good regulatory framework in place, but we need to ensure that the rulebook is enforced,” he stated.

As digital advertising continues to evolve, the balance between innovation and consumer protection will be critical. TikTok’s ongoing challenges with misleading content generated by AI underscore the need for robust oversight in the rapidly changing landscape of social media advertising.

See also
Sofía Méndez
Written By

At AIPressa, my work focuses on deciphering how artificial intelligence is transforming digital marketing in ways that seemed like science fiction just a few years ago. I've closely followed the evolution from early automation tools to today's generative AI systems that create complete campaigns. My approach: separating strategies that truly work from marketing noise, always seeking the balance between technological innovation and measurable results. When I'm not analyzing the latest AI marketing trends, I'm probably experimenting with new automation tools or building workflows that promise to revolutionize my creative process.

You May Also Like

Top Stories

DeepSeek launches its mHC architecture, enhancing large-model training efficiency while reducing computational costs, with consistent performance across 3-27 billion parameter models.

AI Technology

ByteDance plans to invest $14 billion in Nvidia AI chips by 2026, aiming to enhance its computing power and solidify its lead in AI...

Top Stories

Offensive AI memes fuel 98% of new crypto rug pulls, raising alarms over Meta's lax content moderation amid escalating scams targeting investors.

Top Stories

Anthropic skyrockets to a $300B valuation in under five years, while Harvey boasts over $100M ARR, signaling a transformative shift in AI-driven business models.

AI Generative

Volcano Engine named exclusive AI cloud partner for the 2026 CCTV Spring Festival Gala, leveraging multimodal models to enhance viewer interaction and engagement.

Top Stories

Italy's AGCM orders Meta to suspend WhatsApp terms amid rising AI investment surging to $202.3B, creating over 50 billionaires in 2025.

AI Finance

Oracle, Meta, xAI, and CoreWeave channel over $120 billion into AI data centers using SPVs, allowing them to offload debt and secure vital computing...

AI Education

Chinese parents increasingly rely on ByteDance's AI Dola, now with 172 million users, to monitor homework amid education cuts and rising economic pressures.

© 2025 AIPressa · Part of Buzzora Media · All rights reserved. This website provides general news and educational content for informational purposes only. While we strive for accuracy, we do not guarantee the completeness or reliability of the information presented. The content should not be considered professional advice of any kind. Readers are encouraged to verify facts and consult appropriate experts when needed. We are not responsible for any loss or inconvenience resulting from the use of information on this site. Some images used on this website are generated with artificial intelligence and are illustrative in nature. They may not accurately represent the products, people, or events described in the articles.