Insights from Experts

The newsletter for integrity engineering

May 05, 2023

📰 May 5th, 2023. Issue #12

This article from the Yale-Wikimedia Initiative on Intermediaries & Information discusses the concept of "trusted flagging" and its role in platform governance, where third-party entities are enlisted to flag and report content for removal. The article highlights the diverse range of interests served by trusted flagging programs, from law enforcement to NGOs to IP rights-holders, and the disparities between them. While some trusted flagging strategies have proved to be influential, particularly those leveraging automation, conventional flagging by third parties does not scale, and its influence is primarily in service of existing power structures. The article suggests that more regulation and scrutiny of existing structures are necessary to prevent overreach and safeguard user rights.

Think tank

What are the potential benefits and drawbacks of trusted flagging arrangements for platform governance?
- Trusted flagging arrangements can provide a decentralized, inclusive approach to content moderation, but they can also be subject to bias, lack of accountability, and limited effectiveness.
- Automation can significantly increase the impact of trusted flagging by allowing for stay-down mechanisms and automated filtering based on reference files.
In what ways might trusted flagging be seen as a performative gesture by platforms, and how might this impact its legitimacy?
- It offers platforms legitimacy but does not substantially alter their content moderation practices
What are the risks and challenges associated with third-party flagging, and how can they be mitigated?
- The risks and challenges associated with third-party flagging include over-blocking
- There are concerns about the lack of transparency and accountability in trusted flagging arrangements.
  - One way to mitigate these risks and challenges is to introduce new safeguards, such as eligibility criteria for trusted flaggers, performance reviews and oversight, and both public and individual transparency.