Alternative search engine blekko announced today that it is “donating” 22 billion pages’ metadata to Common Crawl, a non-profit foundation, which maintains an open crawl of the web for access and analysis by anyone who cares.
“The holiday season is in full swing and blekko is getting into the giving spirit – donating metadata on search engine ranking for 140 million websites and 22 billion webpages to Common Crawl,” a spokesperson for blekko tells WebProNews.
“With this donation of spam-filtered metadata, blekko is helping Common Crawl ensure that their resources and man-hours are spent crawling real, useful webpages,” he adds.
Blekko says that web and search being open and transparent is “number one on the blekko bill of rights.” Yes, blekko has a bill of rights:
Through blekko’s API, blekko says Common Crawl will have access to the metadata from 140 million websites.
More about the initiative on blekko’s blog.