Meta must reform its business practices to ensure Facebook’s algorithms do not amplify hatred and fuel ethnic conflict, Amnesty International said today in the wake of a landmark legal action against Meta submitted in Kenya’s High Court.
“The spread of dangerous content on Facebook lies at the heart of Meta’s pursuit of profit
Flavia Mwangovya, Deputy Director, East Africa, Horn and Great Lakes Region
The legal action claims that Meta promoted speech that led to ethnic violence and killings in Ethiopia by utilizing an algorithm that prioritizes and recommends hateful and violent content on Facebook. The petitioners seek to stop Facebook’s algorithms from recommending such content to Facebook users and compel Meta to create a 200 billion ($1.6 billion USD) victims’ fund. Amnesty International joins six other human rights and legal organizations as interested parties in the case.
“The spread of dangerous content on Facebook lies at the heart of Meta’s pursuit of profit, as its systems are designed to keep people engaged. This legal action is a significant step in holding Meta to account for its harmful business model,” said Flavia Mwangovya, Amnesty International’s Deputy Regional Director of East Africa, Horn, and Great Lakes Region.
One of Amnesty’s staff members in the region was targeted as a result of posts on the social media platform.
“In Ethiopia, the people rely on social media for news and information. Because of the hate and disinformation on Facebook, human rights defenders have also become targets of threats and vitriol. I saw first-hand how the dynamics on Facebook harmed my own human rights work and hope this case will redress the imbalance,” said Fisseha Tekle, legal advisor at Amnesty International.
Fisseha Tekle is one of the petitioners bringing the case, after being subjected to a stream of hateful posts on Facebook for his work exposing human rights violations in Ethiopia. An Ethiopian national, he now lives in Kenya, fears for his life and dare not return to Ethiopia to see his family because of the vitriol directed at him on Facebook.
Because of the hate and disinformation on Facebook, human rights defenders have also become targets of threats and vitriol.
Fisseha Tekle, petitioner
Fatal failings
The legal action is also being brought by Abraham Meareg, the son of Meareg Amare, a University Professor at Bahir Dar University in northern Ethiopia, who was hunted down and killed in November 2021, weeks after posts inciting hatred and violence against him spread on Facebook. The case claims that Facebook only removed the hateful posts eight days after Professor Meareg’s killing, more than three weeks after his family had first alerted the company.
The Court has been informed that Abraham Meareg fears for his safety and is seeking asylum in the United States. His mother who fled to Addis Ababa is severely traumatized and screams every night in her sleep after witnessing her husband’s killing. The family had their home in Bahir Dar seized by regional police.
The harmful posts targeting Meareg Amare and Fisseha Tekle were not isolated cases. The legal action alleges Facebook is awash with hateful, inciteful and dangerous posts in the context of the Ethiopia conflict.
Meta uses engagement-based algorithmic systems to power Facebook’s news feed, ranking, recommendations and groups features, shaping what is seen on the platform. Meta profits when Facebook users stay on the platform as long as possible, by selling more targeted advertising.
The display of inflammatory content – including that which advocates hatred, constituting incitement to violence, hostility and discrimination – is an effective way of keeping people on the platform longer. As such, the promotion and amplification of this type of content is key to the surveillance-based business model of Facebook.
Internal studies dating back to 2012 indicated that Meta knew its algorithms could result in serious real-world harms. In 2016, Meta’s own research clearly acknowledged that “our recommendation systems grow the problem” of extremism.
In September 2022, Amnesty International documented how Meta’s algorithms proactively amplified and promoted content which incited violence, hatred, and discrimination against the Rohingya in Myanmar and substantially increasing the risk of an outbreak of mass violence.
“From Ethiopia to Myanmar, Meta knew or should have known that its algorithmic systems were fuelling the spread of harmful content leading to serious real-world harms,” said Flavia Mwangovya.
“Meta has shown itself incapable to act to stem this tsunami of hate. Governments need to step up and enforce effective legislation to rein in the surveillance-based business models of tech companies.”
Deadly double standards
The legal action also claims that there is a disparity in Meta’s approach in crisis situations in Africa compared to elsewhere in the world, particularly North America. The company has the capability to implement special adjustments to its algorithms to quickly remove inflammatory content during a crisis. But despite being deployed elsewhere in the world, according to the petitioners none of these adjustments were made during the conflict in Ethiopia, ensuring harmful content continued to proliferate.
“Meta has failed to adequately invest in content moderation in the Global South
Flavia Mwangovya
Internal Meta documents disclosed by whistle-blower Frances Haugen, known as the Facebook Papers, showed that the US $300 billion company also did not have sufficient content moderators who speak local languages. A report by Meta’s Oversight Board also raised concerns that Meta had not invested sufficient resources in moderating content in languages other than English.
“Meta has failed to adequately invest in content moderation in the Global South, meaning that the spread of hate, violence, and discrimination disproportionally impacts the most marginalized and oppressed communities across the world, and particularly in the Global South.”
Discussion about this post