jklaiho hit the nail on the head on MetaFiter:

[A] small number of US-based megacorporations unilaterally deciding what is appropriate for a global audience.

Cue again the official art from the family-friendly anime K-On! that got my Tumblr account auto-moderated as violating their company guidelines. These false positives, and the spectacular failure of the system to block legitimately explicit content made headlines back in the day. Unsurprisingly, the filters and those who implemented them also had no issue with gore (an ethical standard my late mum always thought was “ridiculous”).

A picture of Yui and Mio from K-On that was flagged as explicit by Tumblr.

Most online debates of these issues are perenially stuck in the Technicality Tarpit: how such systems are trained and implemented, whether they leak personal data, the legality of such systems, and so on. It’s to be expected in a room full of nerds, but we also need to talk about:

  • Motives, some of which are reasonable, whole others don’t adequately balance the public good.

  • To what extent we’re comfortable letting functional monopolies dictate morality without oversight or input from the public. Assurances thus far here have done little to assuage my concerns.

It sure bolsters the argument for self-hosting too, if you’re able to.