Tech firms adjudicating on what’s appropriate

Thoughts

jklaiho hit the nail on the head on MetaFiter:

[A] small number of US-based megacorporations unilaterally deciding what is appropriate for a global audience.

Cue again the official art from the family-friendly anime K-On! that got my Tumblr account auto-moderated as violating their company guidelines. These false positives, and the spectacular failure of the system to block legitimately explicit content made headlines back in the day. Unsurprisingly, the filters and those who implemented them also had no issue with gore (an ethical standard my late mum always thought was “ridiculous”).

A picture of Yui and Mio from K-On that was flagged as explicit by Tumblr.

Most online debates of these issues are perenially stuck in the Technicality Tarpit: how such systems are trained and implemented, whether they leak personal data, the legality of such systems, and so on. It’s to be expected in a room full of nerds, but we also need to talk about:

  • Motives, some of which are reasonable, whole others don’t adequately balance the public good.

  • To what extent we’re comfortable letting functional monopolies dictate morality without oversight or input from the public. Assurances thus far here have done little to assuage my concerns.

It sure bolsters the argument for self-hosting too, if you’re able to.

Author bio and support

Me!

Ruben Schade is a technical writer and infrastructure architect in Sydney, Australia who refers to himself in the third person. Hi!

The site is powered by Hugo, FreeBSD, and OpenZFS on OrionVM, everyone’s favourite bespoke cloud infrastructure provider.

If you found this post helpful or entertaining, you can shout me a coffee or send a comment. Thanks ☺️.