Grub - Open Source Search / Crawler

Narnach posted a link to www.grub.org and tagged it with grub, search, open, source, crawler, distributed

Recently open sourced distributed web crawler. From the linked page: \"Grub started back in 2000 with a simple concept of distributing part of the search process pipeline: crawling. In a way, we were a bit ahead of our time, but our intention then was what it is now. We want to help fix search.\"