Search engines have a short list of critical operations that allows them to provide relevant web results when searchers use their system to find information.
1) Crawling the web: Search engines run automated programs, called "bots"or "spiders" that use the hyperlink structure of the web to "crawl" the pages and documents that make up the world wide web. Estimates are that of crawled between 8 and 10 billion.
1) Crawling the web: Search engines run automated programs, called "bots"or "spiders" that use the hyperlink structure of the web to "crawl" the pages and documents that make up the world wide web. Estimates are that of crawled between 8 and 10 billion.