Created on July 16, 2012, 12:29 p.m. Language: en Category:
Crawler,
Python,
Source,
Web Description:
To test websites and links. It will traverse all links found to any given depth.
A fork of this snippet can be found here: https://github.com/ewa/python-webcrawler/
Comment on This Data Unit