{"id":268059,"date":"2020-09-08T02:39:34","date_gmt":"2020-09-08T06:39:34","guid":{"rendered":"https:\/\/canadianinquirer.net\/v1\/?p=268059"},"modified":"2020-09-08T06:44:59","modified_gmt":"2020-09-08T10:44:59","slug":"tiktok-suicide-video-its-time-platforms-collaborated-to-limit-disturbing-content","status":"publish","type":"post","link":"https:\/\/canadianinquirer.net\/v1\/2020\/09\/08\/tiktok-suicide-video-its-time-platforms-collaborated-to-limit-disturbing-content\/","title":{"rendered":"TikTok suicide video: it’s time platforms collaborated to limit disturbing content"},"content":{"rendered":"
\"\"<\/a>
TikTok users have warned others to swipe away quickly if they see a video pop up showing a man with long hair and a beard. (File Photo: @konkarampelas\/Unsplash)<\/figcaption><\/figure>\n

A disturbing video purporting to show a man committing suicide is reportedly doing the rounds on the popular short video app TikTok, reigniting debate about what social media platforms are doing to limit circulation of troubling material.<\/p>\n

According to media reports<\/a>, the video first showed up on Facebook in late August but has been re-uploaded and shared across Instagram and TikTok \u2014 reportedly sometimes cut with seemingly harmless content<\/a> such as cat videos.<\/p>\n

TikTok users have warned<\/a> others to swipe away quickly if they see a video pop up showing a man with long hair and a beard.<\/p>\n

A statement by TikTok quoted<\/a> by News.com.au said:<\/p>\n

Our systems have been automatically detecting and flagging these clips for violating our policies against content that displays, praises, glorifies, or promotes suicide.<\/p>\n

We are banning accounts that repeatedly try to upload clips, and we appreciate our community members who\u2019ve reported content and warned others against watching, engaging, or sharing such videos on any platform out of respect for the person and their family.<\/p><\/blockquote>\n

Schools and child safety advocates have warned parents to be alert for the possibility their child may see \u2014 or may have already seen \u2014 the video if they are a TikTok or Instagram user.<\/p>\n

<\/div>\n

The sad reality is users will continue to post disturbing content and it is impossible for platforms to moderate before posting. And once a video is live, it doesn\u2019t take long for the content to migrate across to other platforms.<\/p>\n

Pointing the finger at individual platforms such as TikTok won\u2019t solve the problem. What\u2019s needed is a coordinated approach where the big social media giants work together.<\/p>\n

\n


\n
\nRead more:
\nDon’t just blame YouTube\u2019s algorithms for \u2018radicalisation\u2019. Humans also play a part<\/a>
\n<\/strong>
\n<\/em><\/p>\n

\n

Evading moderation<\/h2>\n

Post-moderation means even the worst content can be published. Either the platforms identify it with machine learning systems, or users report it to be processed by human moderators. But it can be live for five minutes, an hour or longer.<\/p>\n

Once a video is up, it can be downloaded by bad actors, modulated to reduce the chance of detection by content moderation machine learning systems, and shared across multiple platforms \u2014 Reddit, Instagram, Facebook or more.<\/p>\n

These bad actors can cut the video slightly differently, edit it within harmless material, put filters on it or distort the audio to make it difficult for the content moderation programs to automatically identify disturbing videos. Machine learning with visual content is advancing but it\u2019s not perfect.<\/p>\n

This is broadly what happened with video of the Christchurch massacre, where content taken from the gunman\u2019s Facebook livestream of his attack was downloaded and then shared across various platforms.<\/p>\n

By the time Facebook took down the original video, people already had copies of it and were uploading to Facebook, Reddit, YouTube and more. It very quickly became a cross-platform problem. These bad actors can also add hashtags (some very innocent-sounding) to target a particular community.<\/p>\n

One of the key draws of TikTok as a social media platform is its \u201cspreadability\u201d; how easily it facilitates creating and sharing new videos based on the one a user was just watching.<\/p>\n

With just a few taps users can create a \u201cduet\u201d video showing themselves reacting to the disturbing content. Bad actors, too, can easily re-upload videos that have been removed. Now this purported suicide video is out in the wild, it will be difficult for TikTok to control its spread.<\/p>\n

What about copyright takedowns?<\/h2>\n

Some have noted social media platforms appear very adept at quickly removing copyrighted material from their services (and thereby avoiding huge fines), but can seem more tardy when it comes to disturbing content.<\/p>\n

However, copyright videos are, in many ways, easier for machine learning moderation systems to detect. Existing systems used to limit the spread of copyrighted material have been built specifically for copyright enforcement.<\/p>\n

For example, TikTok uses a system for detecting coprighted material (specifically music licensed by major record labels) to automatically identify a song\u2019s fingerprint<\/a>.<\/p>\n

Even so, TikTok has faced a range of issues relating to copyright enforcement<\/a>. Detecting hate speech or graphic videos on the platform is much more difficult.<\/p>\n

Room for improvement<\/h2>\n

Certainly, there\u2019s room for improvement. It\u2019s a platform-wide, society-wide problem \u2014 we can\u2019t just say TikTok is doing a bad job, it\u2019s something all the platforms need to tackle together.<\/p>\n

But asking market competitors to come up with a coordinated approach is not easy; platforms normally don\u2019t share resources and work together globally to handle content moderation. But maybe they should.<\/p>\n

TikTok employs massive teams of human moderators in addition to their algorithmically driven automated content moderation. These human content moderators work in many regions and languages to monitor content that may violate terms of use.<\/p>\n

Recent events show TikTok is aware of growing demand for improved content moderation practices. In March 2020, responding to national security concerns, TikTok\u2019s parent company ByteDance committed to stop using moderation teams based in China<\/a> to moderate international content. It also established a \u201ctransparency centre\u201d in March 2020 to allow outside observers and experts to scrutinise the platform\u2019s moderation practices<\/a>.<\/p>\n

These platforms have enormous power, and with that comes responsibility. We know content moderation is hard and nobody is saying it needs to be fixed overnight. More and more users know how to game the system, and there\u2019s no single solution that will make the problem go away. It\u2019s an evolving problem and the solution will need to constantly evolve too.<\/p>\n

Improving digital citizenship skills<\/h2>\n

There\u2019s a role for citizens, too. Every time these disturbing videos do the rounds, many more people go online to find the video – they talk about it with their friends and contribute to its circulation.<\/p>\n

Complicating matters is the fact reporting videos on TikTok is not as straightforward as it is on other platforms, such as Facebook or Instagram. A recent study<\/a> I (Bondy Kaye) was involved in compared features on TikTok with its Chinese counterpart, Douyin. We found the report function was located in the \u201cshare\u201d menu accessed from the main viewing screen on both platforms \u2014 not a place many would think to look.<\/p>\n

So if you\u2019re a TikTok user and you encounter this video, don\u2019t share it around – even in an effort to condemn it. You can report the video by clicking the share icon and selecting the appropriate reporting option.<\/p>\n

\n


\n
\nRead more:
\nBecoming more like WhatsApp won’t solve Facebook\u2019s woes \u2013 here’s why<\/a>
\n<\/strong>
\n<\/em><\/p>\n

\n

Anyone seeking support and information about suicide can contact Lifeline on 131 114 or Beyond Blue on 1300 224 636.<\/em>\"The<\/p>\n

Ariadna Matamoros-Fern\u00e1ndez<\/a>, Lecturer in Digital Media at the School of Communication, Queensland University of Technology<\/a><\/em> and D. Bondy Valdovinos Kaye<\/a>, PhD Candidate \/ Editorial Assistant, Queensland University of Technology<\/a><\/em><\/p>\n

This article is republished from The Conversation<\/a> under a Creative Commons license. Read the original article<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

A disturbing video purporting to show a man committing suicide is reportedly doing the rounds on the popular short video …<\/p>\n","protected":false},"author":33,"featured_media":265641,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[54365,16,5,17],"tags":[],"class_list":["post-268059","post","type-post","status-publish","format-standard","has-post-thumbnail","category-instagram","category-news","category-technology","category-news-w","mauthors-ariadna-matamoros-fernandez-lecturer-in-digital-media-at-the-school-of-communication-queensland-university-of-technology","mauthors-d-bondy-valdovinos-kaye-phd-candidate-editorial-assistant-queensland-university-of-technology","mauthors-the-conversation"],"_links":{"self":[{"href":"https:\/\/canadianinquirer.net\/v1\/wp-json\/wp\/v2\/posts\/268059","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/canadianinquirer.net\/v1\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/canadianinquirer.net\/v1\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/canadianinquirer.net\/v1\/wp-json\/wp\/v2\/users\/33"}],"replies":[{"embeddable":true,"href":"https:\/\/canadianinquirer.net\/v1\/wp-json\/wp\/v2\/comments?post=268059"}],"version-history":[{"count":1,"href":"https:\/\/canadianinquirer.net\/v1\/wp-json\/wp\/v2\/posts\/268059\/revisions"}],"predecessor-version":[{"id":268060,"href":"https:\/\/canadianinquirer.net\/v1\/wp-json\/wp\/v2\/posts\/268059\/revisions\/268060"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/canadianinquirer.net\/v1\/wp-json\/wp\/v2\/media\/265641"}],"wp:attachment":[{"href":"https:\/\/canadianinquirer.net\/v1\/wp-json\/wp\/v2\/media?parent=268059"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/canadianinquirer.net\/v1\/wp-json\/wp\/v2\/categories?post=268059"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/canadianinquirer.net\/v1\/wp-json\/wp\/v2\/tags?post=268059"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}