Results 1 to 3 of 3
  1. #1
    Join Date
    Oct 2006
    Posts
    10

    Thumbs up Unanswered: Any correlation between spiders visit & web page rank?

    It is considered a good sign that spiders visiting your site as often as it would. Usually we notice it thru the weblog.

    Are you also concern about it? If so how you counting how often is google visiting your work at home site instead of using the weblog?

    Is there any correlation between how often the spiders visiting our site with the page rank? And where are the spiders coming in from?
    Monty Auto

    Fast.ProBuilderPLUS.com
    One of The Fastest Growing Online Business Available Today.

  2. #2
    Join Date
    Mar 2007
    Location
    636f6d7075746572
    Posts
    770
    Page ranking has nothing to do with spider visits. i.e. they are not directly correlated. spider visit != pageranking++

    The fact that a spider is indexing your website is good. It means that the search engine will be indexing the content available on your website, and hopefully if you are changing it often enough it'll provide some good feedback on ranking relevance.

    All Apache logs (if you're using apache and logging) should show spider results, and they usually identify themselves as robots, which should help you track them down. I will try to find an example and post it here shortly.

  3. #3
    Join Date
    Mar 2007
    Location
    636f6d7075746572
    Posts
    770
    Posted is an example of what you would expect a robot/spider visit to look like in an Apache log :
    61.135.145.222 - - [29/Jul/2007:22:54:18 +0100] "GET /robots.txt HTTP/1.1" 404 - "-" "Baiduspider+(+http://www.baidu.com/search/spider.htm)"

    n.b. the 404 number you see in the middle indicates that it was unable to find the robots.txt file.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •