[Israel.pm] Site Crawler

Guy Malachi guy at ucmore.com
Sun Nov 14 23:12:00 PST 2004

Thanks guys, I ended up using WWW::Mechanize and it worked out great.

Thanks :)

-----Original Message-----
From: perl-bounces at perl.org.il [mailto:perl-bounces at perl.org.il] On
Behalf Of Yuval Yaari
Sent: Sunday, November 14, 2004 7:17 PM
To: Perl in Israel
Subject: Re: [Israel.pm] Site Crawler

Guy Malachi wrote:

>Anybody have any tips on how I can create a site crawler that will
>extract all the links on a remote site and see if the site links to my
>Basically I have a list of urls that I want to check for each url if
>somewhere on the site (extracting all links and following onsite links
>recursively) there is a link to my site.
>Oh yea, it must run on Windows.
Look at WWW::Mechanize (I managed to run it on Windows).
Shouldn't be too difficult. Good luck.

Perl mailing list
Perl at perl.org.il

More information about the Perl mailing list