[Israel.pm] Site Crawler

Guy Malachi guy at ucmore.com
Sun Nov 14 09:05:17 PST 2004


Hey,
Anybody have any tips on how I can create a site crawler that will
extract all the links on a remote site and see if the site links to my
site?
Basically I have a list of urls that I want to check for each url if
somewhere on the site (extracting all links and following onsite links
recursively) there is a link to my site.

Oh yea, it must run on Windows.

TIA,
Guy




More information about the Perl mailing list