12 November, 2015
Posted in : Technology on by : indrani Tags: crawler, Google, indexing, IT, web
Web indexing refers to various methods for indexing the contents of a website to make searching easy and efficient for the internet users.
Whenever a spider or crawler crawls a new page, it stores information about the page in a large database.
The information stored is different for each search engine, but in general they include the text, links, media and other content found on the page.
To save the amount to storage allocated compression and encoding is applied.
The search engine uses a specific algorithm to return successful results in response to the user’s queries among millions of web pages containing information.
algorithm uses strategies to analyze and find out the relevance and popularity and closeness of the information in a web page to a specific keyword or phrase contained in the search request .
The algorithm looks at the number of times the queried keyword phrase appears on the page, as well as its location on the page.
The presence of the keyword at locations likes title, body or tags are given importance. But the importance of these parameters varies for each search engine.
To find out whether your pages are getting indexed or not :-