100 Open Source Web Crawler Software Projects

Free and open source web crawler code projects including engines, APIs, generators, and tools.