Brussels Identifies TikTok Violations Related to Content Recommendation System
The European Commission has preliminarily concluded that TikTok has violated the Digital Services Act by failing to adequately evaluate and mitigate risks associated with its “For You” recommendation feature. Officials have raised concerns that this algorithm disproportionately affects vulnerable users, including minors, by continuously exposing them to content related to mental health issues, body image concerns, and themes of sadness and isolation.
This finding, revealed on November 6, 2023, calls into question a foundational aspect of TikTok’s service—its algorithm-driven video feed, which curates content based on user interactions such as viewing time and likes.
As users show interest in specific topics, the system generates an increasing volume of related content, creating “rabbit holes” that can be difficult for users to escape. Brussels argues that this mechanism may lead to repeated exposure to harmful material that adversely affects users’ well-being.
Examining the Algorithm’s Impact
The case is primarily focused not on the legality of individual videos but rather on how TikTok identifies and addresses systemic risks associated with its platform. While TikTok provides features like a “not interested” button and an option for a non-personalized feed, preliminary findings suggest these measures do not sufficiently alleviate repeated exposure to potentially detrimental content.
Regulatory bodies are advocating for improvements that place a stronger emphasis on user preferences, simplify access to content controls, regularly assess the algorithm’s implications, and diminish reliance on engagement metrics such as viewing time as a recommendation criterion.
Understanding user attention can be complex; a viewer might engage with a video out of curiosity or concern, complicating the assumption that they desire more content in the same vein.
In response, TikTok has labeled the assessment as “fundamentally inaccurate,” claiming it misrepresents both their platform’s functionality and commitment to user safety. The company asserts that users maintain control over their content experience.
Highlighting Risks to At-Risk Audiences
The Commission’s concerns reflect a broader discourse surrounding algorithm-driven recommendation systems and their impact on mental health. While personalized algorithms can help users discover valuable information and supportive communities, they pose significant risks when they repeatedly funnel users towards limited and distressing themes without recognizing individual vulnerabilities.
Research conducted by Amnesty International in France found that accounts flagged as 13 years old quickly encountered escalating amounts of mental health-related content following similar video views. This highlighted a concerning trend, with rapid shifts that led to feeds focusing predominantly on mental health issues within short timeframes.
While the manually operated accounts involved in the study cannot be universally applied to all young users, they nonetheless exemplify the risks of content amplification that the Digital Services Act mandates large platforms to investigate and address.
Effective regulation must differentiate between harmful content and beneficial discourse. Personal testimonials, credible health information, and peer support play invaluable roles, but the chief issue remains the automated system’s tendency to exacerbate exposure to distressing material without implementing adequate protective measures.
Next Steps in the Investigation
The recent announcement serves as an early procedural step, rather than a conclusive ruling. TikTok will have the opportunity to examine the investigatory file and submit a formal response. The European Board for Digital Services will also be consulted prior to any final determination by the Commission.
Should the preliminary findings be upheld, the Commission could issue an official decision of non-compliance, which may lead to fines of up to 6% of TikTok’s global annual revenue. Any penalties would take into account various factors including the severity and frequency of the infringement.
The investigation has received backing from Ireland’s media regulator, Coimisiún na Meán, given TikTok’s European headquarters are located in Dublin.
This finding is part of a broader inquiry initiated in 2024, which included separate preliminary evaluations concerning features contributing to addictive usage patterns and the protection of minors’ accounts.
Assessing User Control and Agency
This case could set a precedent for how European regulators engage with the operational mechanisms of recommendation algorithms, focusing on system-wide issues rather than merely scrutinizing isolated pieces of content.
To establish an effective solution, tangible changes must manifest, allowing users to comprehend the rationale behind content recommendations, correct any misunderstandings, and effectively minimize exposure to content they prefer to avoid. Moreover, independent researchers and regulators should be permitted to verify the functionality of these controls.
Throughout this process, the Commission must substantiate its arguments through a just procedure, while TikTok retains the right to contest both the findings and recommended remedies. Nevertheless, a pressing public interest question remains: a user-oriented feed cannot genuinely serve its purpose when users have minimal control over its direction.
Discussion about this post