Results 1 to 2 of 2
  1. #1
    Join Date
    Jan 2003
    Posts
    55

    Unanswered: Web Crawler in perl

    Hi all...

    Does anyone know how to develop a web crawler in perl?

    Please send me any code or snippets if anyone knows how to do it ...i basically need an application to crawl specific sites and extract all the relevant textual data onto an external file on my system. The crawling must be recursive as in all links on the base HTML page must also be parsed in a similar fashion till no more links can be found.

    Really in a desperate position for help......any sort of code would be gr8!!! soo pleezz pleeez help..
    Thanx in advance

    shuchi
    You try and try again..but then give up, there's no sense in being a complete fool about it!!!

  2. #2
    Join Date
    Sep 2002
    Location
    Germany, near Aachen
    Posts
    120
    With libwww from CPAN comes a small program for website mirroring, that you can use for a start.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •