Jump to content


Register a free account to unlock additional features at BleepingComputer.com
Welcome to BleepingComputer, a free community where people like yourself come together to discuss and learn how to use their computers. Using the site is easy and fun. As a guest, you can browse and view the various discussions in the forums, but can not create a new topic or reply to an existing one unless you are logged in. Other benefits of registering an account are subscribing to topics and forums, creating a blog, and having no ads shown anywhere on the site.

Click here to Register a free account now! or read our Welcome Guide to learn how to use this site.


Search Engine Optimization

  • Please log in to reply
1 reply to this topic

#1 jessicarobin


  • Members
  • 3 posts
  • Local time:01:41 PM

Posted 13 September 2013 - 05:57 AM

Can anyone please tell me, Difference between spider, crawler and robots?

BC AdBot (Login to Remove)


#2 SpywareDoc


  • Members
  • 687 posts
  • Gender:Male
  • Location:Maryland, USA
  • Local time:03:11 AM

Posted 13 September 2013 - 09:41 AM

Microsoft .NET, SQL Server, and Other New Microsoft Technologies Issues

Some people get confused between "crawler", "robot" and "spider":

Robot: Any program that goes out onto the web to do things. This includes search engine crawlers, but also many other programs, like email scrapers, site testers, and so on.

Crawler: This is the term for the special kind of robot that search engines use.

Spider: this is a term that many professional SEO's use - it's synonymous with "crawler", but apparently isn't as non-threatening and marketing -friendly sounding as "crawler". I tend to use this out of habit.

0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users