{"id":18729,"date":"2017-03-11T06:52:15","date_gmt":"2017-03-11T05:52:15","guid":{"rendered":"https:\/\/jurnsearch.wordpress.com\/?p=18729"},"modified":"2017-03-11T06:52:15","modified_gmt":"2017-03-11T05:52:15","slug":"common-crawl-at-3bn-web-pages","status":"publish","type":"post","link":"https:\/\/jurn.link\/jurnsearch\/index.php\/2017\/03\/11\/common-crawl-at-3bn-web-pages\/","title":{"rendered":"Common Crawl at 3bn Web pages"},"content":{"rendered":"<p>The open source monthly Web crawl <a href=\"http:\/\/index.commoncrawl.org\/\">Common Crawl<\/a> now &#8220;contains 3.08 billion+ web pages&#8221; and 250TB of uncompressed data. <a href=\"https:\/\/jurn.link\/jurnsearch\/2015\/09\/06\/whats-in-common-crawl\/\">Back in September 2015<\/a>, when this blog last took a look at Common Crawl, that was 145TB.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The open source monthly Web crawl Common Crawl now &#8220;contains 3.08 billion+ web pages&#8221; and 250TB of uncompressed data. Back &hellip;<\/p>\n<p><a href=\"https:\/\/jurn.link\/jurnsearch\/index.php\/2017\/03\/11\/common-crawl-at-3bn-web-pages\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16],"tags":[],"class_list":["post-18729","post","type-post","status-publish","format-standard","hentry","category-spotted-in-the-news"],"_links":{"self":[{"href":"https:\/\/jurn.link\/jurnsearch\/index.php\/wp-json\/wp\/v2\/posts\/18729","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jurn.link\/jurnsearch\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jurn.link\/jurnsearch\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jurn.link\/jurnsearch\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/jurn.link\/jurnsearch\/index.php\/wp-json\/wp\/v2\/comments?post=18729"}],"version-history":[{"count":0,"href":"https:\/\/jurn.link\/jurnsearch\/index.php\/wp-json\/wp\/v2\/posts\/18729\/revisions"}],"wp:attachment":[{"href":"https:\/\/jurn.link\/jurnsearch\/index.php\/wp-json\/wp\/v2\/media?parent=18729"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jurn.link\/jurnsearch\/index.php\/wp-json\/wp\/v2\/categories?post=18729"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jurn.link\/jurnsearch\/index.php\/wp-json\/wp\/v2\/tags?post=18729"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}