Apache Nutch - the Tool that Drives Common Crawl

Apache Nutch is the tool that delivers data for Common Crawl. Its GitHub repository also contains a link to the wiki which tells you the active version.