The Evolution and Revolution of Search Engines - However, shortly after...
(Page 3 of 6 )
However, shortly after, in December 1993, a new robot was born. This was called the “spider.” Spiders added a much further degree of accuracy by indexing the entire text of a webpage. The older robots only indexed the URL and titles of a page, which meant that some pertinent keywords might not be indexed. This greatly improved the relevancy rankings of their results, and thus was the first major step in forming the major search engines that we have all become so used to using today.
Not long after the spider, we saw the emergence of some of the big guns. In 1994, out of Stanford University came the extremely famous Yahoo. The two guys who started Yahoo were students, David Filo and JerryYang. Basically, at first Yahoo was just a list of these guys’ favorite websites. But soon, due to its easy user-friendly interface, became the most popular web directory. Due to the fact that its websites were all human reviewed, Yahoo was only able to index about 1% of the web. At this time, Altavista became the fastest growing search engines using the spider technology and was indexing up to 10 million pages a day.
More Search Engine Tricks Articles
More By Jase Dow