100 Open Source Crawling Software Projects

Free and open source crawling code projects including engines, APIs, generators, and tools.