New York Attorney General Accuses TikTok of Deceiving Users With Nonfunctional Algorithm Reset Feature
TikTok deployed a placebo algorithm reset feature to select users while running internal tests that manipulated safety controls and measured user engagement impacts, according to a lawsuit filed by New York Attorney General Letitia James. The legal action alleges that the social media platform offered thousands of users—including children and teenagers—a security option named “Algo refresh” that did not actually alter content recommendations. The lawsuit forms part of a broader legal challenge led by more than twenty states targeting TikTok’s business practices. Court filings indicate that the platform sought to foster addictive user behavior while misrepresenting safety measures. Although numerous filings remain sealed at the company’s request to protect commercial practices, public documents reveal details regarding internal company communications about the testing methodology.
Internal Discord Over Placebo Testing
When executives proposed the testing framework in 2023, members of the company’s wellbeing division raised concerns internally. An internal chat message from a wellbeing executive warned that implementing a placebo group directly conflicted with the core principles of control and transparency.
“This function is about the control and transparency of the algorithm. A group of placebo goes completely against of such idea,” the executive stated in the chat.
The company moved forward with the 2023 tests anyway, comparing user retention times and revenue impacts between groups receiving the working reset function and those receiving the placebo. Beyond the algorithm reset tests, the multi-state complaint highlights instances where TikTok randomly deactivated safety controls for specific users. One such case involved a teenager who died by suicide after viewing self-harm and suicide content on the platform.
What was the Algo refresh feature?
What was the purpose of the Algo refresh feature?
The feature was presented to users as a way to zero out data collection used for content recommendations and reduce exposure to harmful content. However, for users placed in the placebo group, activating the feature produced no effect and timelines continued to use accumulated parameters.
Who initiated the legal action against TikTok?
New York Attorney General Letitia James leads the lawsuit against the company, alongside a coalition of more than twenty states focusing on addictive design features and safety misrepresentations.
When did TikTok conduct the placebo experiments?
The company carried out the testing procedures in 2023 to evaluate how modifying algorithm controls affected user retention times and overall revenue generation.
Related reading