legal-terms website
Terms and condition for web scraping
<p>I intend to scrape (download all articles) from a newspaper website which has some terms and conditions listed in its footer. The part which seems to be in my interest is as follows:</p>

<blockquote>
  <p>You shall not copy, reproduce, republish, disassemble, decompile, reverse engineer, download, post, broadcast, transmit, make available to the public, or otherwise use the content of this website in any way except for your own personal, non-commercial use. You shall not adapt, alter or create a derivative work from any content of this website except for your own personal, non-commercial use. Any other use of the content of this website requires the prior written permission of XYZ</p>
</blockquote>

<p>So does this also mean that I cannot scrape data from website and perform some analyses (machine learning and stuff) and use it to generate a report for</p>

<ol>
<li>Research purposes</li>
<li>Commercial purposes</li>
</ol>

<p>Yes, it does. Using the downloaded content, whether it was scraped or individually downloaded one file at a time, for research or for commercial purposes would violate that TOS provision (unless some other provision contradicts it, or you obtain specific permission). The site owner could sue you for such a violation, should the owner become aware of it. I do not think it would be likely to be a criminal offense, depending on the jurisdiction.</p>
