Connect with us

Hi, what are you looking for?

AI Marketing

TikTok’s AI Symphony Generates Rampant Fake Ads, Misleading Health Products Surge

TikTok’s AI Symphony enables rapid creation of misleading ads, with $12B investment in AI prompting a surge in fraudulent health product promotions.

In a landscape increasingly dominated by digital advertising, TikTok has emerged as a key player, leveraging its vast user base to generate significant revenue through targeted campaigns. According to documents filed with Ireland’s Company Registration Office (CRO) in August, TikTok Technology Ltd, the social media giant’s Irish arm, indicated that its business model heavily depends on a blend of advertising income, value-added services, and merchandise sales. However, this reliance on advertising revenue has raised concerns regarding the integrity of content on the platform.

Reports have surfaced indicating a rise in misleading and harmful advertisements on TikTok, often generated by artificial intelligence (AI). This trend has been exacerbated by the company’s substantial investments in AI technology. Earlier this year, the Financial Times reported that TikTok’s parent company, ByteDance, intended to invest $12 billion in AI chips by 2025. The influx of AI-generated content, including fraudulent advertisements, poses a growing challenge to the platform’s reputation.

Recent advertisements on TikTok have promoted dubious health products, including weight loss supplements claiming efficacy without scientific backing. One notable example includes ads for GLP-1 patches, which are falsely marketed as weight-loss aids, lacking the active ingredient found in legitimate medications like Ozempic and Mounjaro. Many of these ads direct users to cloned websites impersonating established pharmacies, potentially deceiving consumers into trusting illegitimate businesses.

TikTok has established advertising policies aimed at preventing misleading and deceptive content. According to the company, these policies are designed to protect integrity and authenticity for users, declaring that accounts violating these rules may face suspension or bans. Specifically addressing health misinformation, TikTok commits to combating false claims that can influence personal health decisions and public trust in credible health sources.

Despite these assurances, the proliferation of AI-generated ads remains a significant issue. TikTok’s investment in AI tools has allowed for the rapid creation of content within the app itself. The platform’s marketing tool, TikTok for Business, is a resource for businesses to develop advertising campaigns. It features a chatbot assistant that aids users in crafting advertisements, affirming that it can indeed produce AI-generated content that can be promoted on TikTok.

In 2024, TikTok launched TikTok Symphony, a generative AI suite designed to streamline the creation of brand content. The tool offers options for pre-built and custom avatars and includes editing, translation, and dubbing capabilities for video advertisements. The company claims it simplifies the ad creation process, allowing businesses with limited resources to maximize their marketing efforts.

However, the very system designed to assist brands in creating content has also facilitated an increase in misleading advertisements. In an illustrative instance, an individual was able to create an AI-generated ad promoting weight loss supplements in just minutes without any content moderation warnings from the platform. The ad was flagged only post-creation, despite its promotion of unverified health claims.

Although TikTok maintains that content generated using its AI tools undergoes a moderation review, the presence of deceptive ads still permeates the platform. Users are potentially exposed to unsafe products and scams linked to fraudulent third-party websites. TikTok has stated that it actively removes content violating its policies on health-related claims and is committed to restricting misleading advertisements.

In light of the growing concerns surrounding AI-generated content, EU Commissioner for Democracy, Justice, the Rule of Law and Consumer Protection Code, Michael McGrath, emphasized the need for regulatory safeguards. He noted that while the EU aims to foster competitiveness in AI, it must operate within established guardrails. “We have a good regulatory framework in place, but we need to ensure that the rulebook is enforced,” he stated.

As digital advertising continues to evolve, the balance between innovation and consumer protection will be critical. TikTok’s ongoing challenges with misleading content generated by AI underscore the need for robust oversight in the rapidly changing landscape of social media advertising.

See also
Sofía Méndez
Written By

At AIPressa, my work focuses on deciphering how artificial intelligence is transforming digital marketing in ways that seemed like science fiction just a few years ago. I've closely followed the evolution from early automation tools to today's generative AI systems that create complete campaigns. My approach: separating strategies that truly work from marketing noise, always seeking the balance between technological innovation and measurable results. When I'm not analyzing the latest AI marketing trends, I'm probably experimenting with new automation tools or building workflows that promise to revolutionize my creative process.

You May Also Like

Top Stories

Alibaba and ByteDance unveil Qwen-Image-2.0 and Seedream 5.0, revolutionizing AI image generation with enhanced controllability and adaptability ahead of the Spring Festival.

Top Stories

KPMG Australia fined a partner A$10,000 for cheating on an AI ethics test by using generative AI, amid 28 reported AI-related cheating incidents since...

Top Stories

ByteDance's Seedance 2.0 generates high-quality videos mimicking Hollywood scenes, raising concerns over copyright and the future of traditional filmmaking.

Top Stories

Microsoft’s AI chief Mustafa Suleyman outlines a bold shift to self-sufficiency by developing proprietary models, aiming for superintelligence and reducing reliance on OpenAI.

Top Stories

China's AI governance model, shaped by state, private sector, and societal influences, sees 23 of the world's top AI products from Chinese firms generating...

AI Generative

Disney and Paramount escalate legal action against ByteDance, issuing cease-and-desist letters over Seedance 2.0's alleged unauthorized use of copyrighted characters.

Top Stories

Disney files a cease-and-desist against ByteDance's Seedance 2.0 for creating AI-generated videos using its characters, escalating the copyright battle in tech.

Top Stories

Disney has issued a cease-and-desist to ByteDance, claiming its Seedance 2.0 AI unlawfully uses copyrighted characters from iconic franchises like Star Wars and Marvel.

© 2025 AIPressa · Part of Buzzora Media · All rights reserved. This website provides general news and educational content for informational purposes only. While we strive for accuracy, we do not guarantee the completeness or reliability of the information presented. The content should not be considered professional advice of any kind. Readers are encouraged to verify facts and consult appropriate experts when needed. We are not responsible for any loss or inconvenience resulting from the use of information on this site. Some images used on this website are generated with artificial intelligence and are illustrative in nature. They may not accurately represent the products, people, or events described in the articles.