internet software social-media censorship digital-content
What Are Repercussion For Making Uncensorable Social Media?
<p>I'm intending to make and publish an experimental platform where user-generated content (UGC) is uncensorable and permanent. Although tech promotes itself as such, like the omnipotence paradox, man cannot create something that man cannot destroy. Caveat being, I technically have no capacity to moderate UGC, rather it's within the jurisdiction of very complex decentralized infrastructures. Content of this immutable nature is virtually unchallenged.</p>
<p>I wish to make this service privacy respecting and transparent. In the hypothetical this is used for illegal activity, what are the repercussions, and what's within authorities' jurisdiction?</p>
<ol>
<li>Can they shut every aspect of it down? If so can I be reimbursed for expenses?</li>
<li>Can they charge me for illegal UGC, if I'm not the creator/host or have an ability to delist it?</li>
<li>Can they demand I modify/redesign my service model? E.g. to collect user data / to create a backdoor to censor UGC?</li>
</ol>
<p>And adding to those questions, if I moderate UGC via the application/interface/frontend level (which is rather evadable) will the project itself be allowed to operate? And could I be prevented from developing/distributing the original source code?</p>

<p>You can design whatever this system is (leaving aside jurisdictions without First Amendment-like law that lets you design to your hearts content), the problem comes in implementing. The main legal question is whether you are operating a website. A website operator has to comply with various laws that require them to remove content. For example, if you operate a website that allows users to distribute content that they upload, they can distribute copyright-protected content, and you can be held liable for copyright infringement. DMCA in the US provides a way for you to not get sued, but you have to be able to remove putatively infringing content, so you could get sued if you can't remove illegal content. This may also include legal troubles over e.g. defamatory content where a plaintiff gets a court order to remove the content – you can't plead &quot;I can't it down&quot; if the court orders you to do so.</p>
<p><a href="https://web.archive.org/web/20030706044926/http://news.findlaw.com/hdocs/docs/napster/napster-md030601ord.pdf" rel="nofollow noreferrer">Napster was sued</a> for copyright infringement and racketeering for facilitating law-breaking by others (&quot;secondary infringement&quot;), and in <a href="https://supreme.justia.com/cases/federal/us/545/913/" rel="nofollow noreferrer">MGM v. Grokster</a> the Supreme Court annonced the general principle that</p>
<blockquote>
<p>One who distributes a device with the object of promoting its use to
infringe copyright, as shown by clear expression or other affirmative
steps taken to foster infringement, going beyond mere distribution
with knowledge of third-party action, is liable for the resulting acts
of infringement by third parties using the device, regardless of the
device’s lawful uses</p>
</blockquote>
<p>Grokster's problems arose because they clearly intended the software to be used to violate copyright law, whereas it is unlikely that Github will get sued because it is <em>possible</em> to use the platform illegally.</p>
<p>So it really matters exactly what this &quot;platform&quot; is and what your relationship to the platform is. Describing a system is generally not illegal, realizing and maintaining one can easily be.</p>
