
7 Jan
2014
7 Jan
'14
11:55 a.m.
*tl;dr you can download the 376 GB compressed (1.6 TB uncompressed) crawl of 115 million websites with this torrent <https://meanpath.com/meanpath-crawl-20140104.torrent> or you can see a 285 MB sample file here <https://meanpath.com/bot9.meanpath.com-crawl20140104-file3.db.gz>.* http://blog.meanpath.com/meanpath-january-2014-index/