Difference between revisions of "URL normalization"
From Wiki @ Karl Jones dot com
Karl Jones (Talk | contribs) (Created page with "'''URL normalization''' is the process by which URLs are modified and standardized in a consistent manner. == Description == The goal of the nor...") |
Karl Jones (Talk | contribs) |
||
| Line 5: | Line 5: | ||
The goal of the normalization process is to transform a URL into a normalized URL so it is possible to determine if two syntactically different URLs may be equivalent. | The goal of the normalization process is to transform a URL into a normalized URL so it is possible to determine if two syntactically different URLs may be equivalent. | ||
| − | [[Web search engine|Search engines]] employ URL normalization in order to assign importance to web pages | + | [[Web search engine|Search engines]] employ URL normalization in order to assign importance to web pages and to reduce indexing of duplicate pages. Web crawlers perform URL normalization in order to avoid crawling the same resource more than once. |
| − | [[Web browser|Web browsers]] may perform normalization to determine if a link has been visited or to determine if a page has been cached. | + | [[Web browser|Web browsers]] may perform normalization to determine if a link has been visited or to determine if a [[page has been cached]]. |
== See also == | == See also == | ||
| Line 13: | Line 13: | ||
* [[Uniform Resource Locator]] | * [[Uniform Resource Locator]] | ||
* [[Web browser]] | * [[Web browser]] | ||
| + | * [[Web cache]] | ||
* [[Web search engine]] | * [[Web search engine]] | ||
Revision as of 14:43, 4 November 2016
URL normalization is the process by which URLs are modified and standardized in a consistent manner.
Description
The goal of the normalization process is to transform a URL into a normalized URL so it is possible to determine if two syntactically different URLs may be equivalent.
Search engines employ URL normalization in order to assign importance to web pages and to reduce indexing of duplicate pages. Web crawlers perform URL normalization in order to avoid crawling the same resource more than once.
Web browsers may perform normalization to determine if a link has been visited or to determine if a page has been cached.
See also
External links
- URL normalization @ Wikipedia
