Jump to content


 


Register a free account to unlock additional features at BleepingComputer.com
Welcome to BleepingComputer, a free community where people like yourself come together to discuss and learn how to use their computers. Using the site is easy and fun. As a guest, you can browse and view the various discussions in the forums, but can not create a new topic or reply to an existing one unless you are logged in. Other benefits of registering an account are subscribing to topics and forums, creating a blog, and having no ads shown anywhere on the site.


Click here to Register a free account now! or read our Welcome Guide to learn how to use this site.

Photo

Bots and Crawlers


  • Please log in to reply
1 reply to this topic

#1 Korin

Korin

  • Members
  • 48 posts
  • OFFLINE
  •  
  • Gender:Male
  • Location:Toronto, ON
  • Local time:10:36 AM

Posted 27 May 2013 - 03:34 PM

What do bots do (Google, Bing, Google Mobile, etc) - I see them a lot as 'guests' - do they save topics to their search engine? What do Crawlers do?



BC AdBot (Login to Remove)

 


#2 Animal

Animal

    Bleepin' Animinion


  • Site Admin
  • 35,905 posts
  • OFFLINE
  •  
  • Gender:Male
  • Location:Where You Least Expect Me To Be
  • Local time:06:36 AM

Posted 27 May 2013 - 03:41 PM

The short answer is yes. One of the more complete answeres is: http://en.wikipedia.org/wiki/Web_crawler

The Internet is so big, so powerful and pointless that for some people it is a complete substitute for life.
Andrew Brown (1938-1994)


A learning experience is one of those things that say, "You know that thing you just did? Don't do that." Douglas Adams (1952-2001)


"Imagination is more important than knowledge. Knowledge is limited. Imagination circles the world." Albert Einstein (1879-1955)


Follow BleepingComputer on: Facebook | Twitter | Google+




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users