The practical search is Archie, which was developed in 1990 by Alan Embage, a student of Tellier University.Although World Wide Web did not appear at that time, file transmission in the network was quite frequent, and a large number of files were scattered in different FTP servers, forming a huge amount of information sources.Alan's Archie relies on script programs to search for files on the network, and the common denominator indexes them for users to query.Inspired by Archie's popularity among users, the Computing Service Center of Nevada Higher Education System in the United States developed another similar search tool in 1993. However, this search tool can not only index files, but also retrieve web pages.(Beijing website production)
At that time, the term "robot" was very popular. It refers to a program that quickly and uninterruptedly performs a task.Because the "robot" program specially used to retrieve information crawls like a spider across the network, the search engine "robot" program is also called a "spider" program.The world's first "robot" program to monitor the scale of Internet development is the World Wide Web Wander developed by Matthew Gray.At first, it was only used to count the number of servers on the Internet. Later, it was able to retrieve website domain names.Corresponding to Wanderer, Martin Koster created ALIWEB in October 1993, which is the HTTP version of Archie.ALIWEB does not use a "robot" program, but relies on the website to actively submit information to establish its own link index, similar to the Yahoo classified directory.(High end website construction)
With the rapid development of the Internet, it becomes more and more difficult to retrieve new web pages. Therefore, the traditional "spider" program has been improved on the basis of Matthew Gray's Wanderer.The idea is that since all pages may have links to other websites, it is possible to retrieve the entire Internet from tracking the links of one website.By the end of 1993, some search engines based on this principle began to emerge, among which JumpStation, The World Wide Web Worm (the predecessor of Goto, that is, Overture today, has been acquired by Yahoo) and Repository Based Software Engineering (RBSE) spider are the most famous.However, JumpStation and WWW Worm only rank search results in the order in which search tools find matching information in the database, so there is no information relevance.RBSE is the first search engine to introduce the concept of keyword string matching degree into the arrangement of search results.The earliest modern search engine appeared in July 1994.At that time, Michel Mauldin connected John Leavitt's spider program to its indexing program and created Lycos, which is now known to all.In April of the same year, David Filo, two doctoral students from Stanford University, and Jerry Yang, a Chinese American, jointly founded the super directory index Yahoo, and successfully made the concept of search engine popular.Since then, search engines have entered a period of adjustment and development.At present, there are hundreds of search engines with names on the Internet, and the amount of information they retrieve is not what it used to be.For example, Google claims that the number of pages stored in its database has reached 4 billion.