PyCrawler – Open Source simple web crawler

A while ago I made a post about a Web Crawler in less that 50 lines of python. Well, I took that and made it a little (and really, I mean just a little..) more sophisticated, and stuck it on GitHub. Anyone who wants to can contribute, or use the code however they want.

PyCrawler On GitHub