Jump to content


 


Register a free account to unlock additional features at BleepingComputer.com
Welcome to BleepingComputer, a free community where people like yourself come together to discuss and learn how to use their computers. Using the site is easy and fun. As a guest, you can browse and view the various discussions in the forums, but can not create a new topic or reply to an existing one unless you are logged in. Other benefits of registering an account are subscribing to topics and forums, creating a blog, and having no ads shown anywhere on the site.


Click here to Register a free account now! or read our Welcome Guide to learn how to use this site.

Photo

How did they index the Internet initially?


  • Please log in to reply
4 replies to this topic

#1 Just_One_Question

Just_One_Question

  • Members
  • 1,400 posts
  • OFFLINE
  •  
  • Gender:Male
  • Location:Bulgaria
  • Local time:04:17 AM

Posted 20 August 2017 - 04:38 PM

Hey, I know that modern web-search engines, such as Google, bump up results mostly based on references on other sites for those results. That doesn't interest me. I would like to know how did companies like 'Jerry and David's guide to the World Wide Web (Yahoo)' or 'Google' managed to index all the thousands of websites around 1998? I mean, I get that you can write a program that could scan web-pages and their metadata, but how do you tell it where to scan if there isn't a service where you can look up all the various url's? I don't understand, can anyone clarify it a little bit. Thank you once more - this is the best Internet Forum I've ever seen!:)



BC AdBot (Login to Remove)

 


#2 Animal

Animal

    Bleepin' Animinion


  • Site Admin
  • 35,117 posts
  • OFFLINE
  •  
  • Gender:Male
  • Location:Where You Least Expect Me To Be
  • Local time:06:17 PM

Posted 27 August 2017 - 07:32 PM

This is what I found.

The first effort, other than library catalogs, to index the Internet was created in 1989, as Peter Deutsch and Alan Emtage, students at McGill University in Montreal, created an archiver for ftp sites, which they named Archie. This software would periodically reach out to all known openly available ftp sites, list their files, and build a searchable index of the software. The commands to search Archie were unix commands, and it took some knowledge of unix to use it to its full capability.


Above quote source: A Brief History of the Internet by Walt Howe

The Internet is so big, so powerful and pointless that for some people it is a complete substitute for life.
Andrew Brown (1938-1994)


A learning experience is one of those things that say, "You know that thing you just did? Don't do that." Douglas Adams (1952-2001)


"Imagination is more important than knowledge. Knowledge is limited. Imagination circles the world." Albert Einstein (1879-1955)


Follow BleepingComputer on: Facebook | Twitter | Google+

#3 PerspectiveObjective

PerspectiveObjective

  • Members
  • 258 posts
  • OFFLINE
  •  
  • Gender:Female
  • Location:This tiny speck in the universe somewhere in the middle of time.
  • Local time:09:17 PM

Posted 01 September 2017 - 09:06 PM

I'm wiped, can't elaborate in this instance

 

eeeh, catching breath, in from HA! some exercise, probably shouldn't even post anything, but I LIKED THE QUESTION, but I'm shot, can't type, tired.

 

 

must be books or a book on it,

 

 

nice bit on the ftp

 

part

 

 

 

Hey, I know that mode

 

 

 

I get that you can write a program that could scan web-pages and their metadata, but how do you tell it where to scan if there isn't a service where you can look up all the various url's? I don't understand, can anyone clarify it a little bit. Thank you once more - this is the best Internet Forum I've ever seen! :)


Oh those are really nice, where`d you get them done at? YOUR NAILS SILLY! Banter/Wit is a primary member requirement to colossal project solution.  Not to toot my horn......          (                (        (       (     :trumpet: but, who else will!? teeehehehehehheeee!~~~8 : P Additionally::: "Do, or do not. There is no try." - Yoga


#4 Just_One_Question

Just_One_Question
  • Topic Starter

  • Members
  • 1,400 posts
  • OFFLINE
  •  
  • Gender:Male
  • Location:Bulgaria
  • Local time:04:17 AM

Posted 06 September 2017 - 08:46 AM

Thanks, it was quite interesting. Sorry, I didn't respond in a while; I had the information that you provided bookmarked until I had time to research it.:)



#5 Animal

Animal

    Bleepin' Animinion


  • Site Admin
  • 35,117 posts
  • OFFLINE
  •  
  • Gender:Male
  • Location:Where You Least Expect Me To Be
  • Local time:06:17 PM

Posted 09 September 2017 - 09:41 PM

You're quite welcome.

The Internet is so big, so powerful and pointless that for some people it is a complete substitute for life.
Andrew Brown (1938-1994)


A learning experience is one of those things that say, "You know that thing you just did? Don't do that." Douglas Adams (1952-2001)


"Imagination is more important than knowledge. Knowledge is limited. Imagination circles the world." Albert Einstein (1879-1955)


Follow BleepingComputer on: Facebook | Twitter | Google+




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users