Web indexing refers to various methods for indexing the contents of a website to make searching easy and efficient for the internet users.
-
Whenever a spider or crawler crawls a new page, it stores information about the page in a large database.
-
The information stored is different for each search engine, but in general they include the text, links, media and other content found on the page.
-
To save the amount to storage allocated compression and encoding is applied.
-
The search engine uses a specific algorithm to return successful results in response to the user’s queries among millions of web pages containing information.
-
algorithm uses strategies to analyze and find out the relevance and popularity and closeness of the information in a web page to a specific keyword or phrase contained in the search request .
-
The algorithm looks at the number of times the queried keyword phrase appears on the page, as well as its location on the page.
-
The presence of the keyword at locations likes title, body or tags are given importance. But the importance of these parameters varies for each search engine.