Difference between revisions of "URL normalization"
From Wiki @ Karl Jones dot com
Karl Jones (Talk | contribs) |
Karl Jones (Talk | contribs) |
||
| Line 7: | Line 7: | ||
[[Web search engine|Search engines]] employ URL normalization in order to assign importance to web pages and to reduce indexing of duplicate pages. Web crawlers perform URL normalization in order to avoid crawling the same resource more than once. | [[Web search engine|Search engines]] employ URL normalization in order to assign importance to web pages and to reduce indexing of duplicate pages. Web crawlers perform URL normalization in order to avoid crawling the same resource more than once. | ||
| − | [[Web browser|Web browsers]] may perform normalization to determine if a link has been visited or to determine if a [[page has been cached]]. | + | [[Web browser|Web browsers]] may perform normalization to determine if a link has been visited or to determine if a [[Web cache|page has been cached]]. |
== See also == | == See also == | ||
Latest revision as of 13:43, 4 November 2016
URL normalization is the process by which URLs are modified and standardized in a consistent manner.
Description
The goal of the normalization process is to transform a URL into a normalized URL so it is possible to determine if two syntactically different URLs may be equivalent.
Search engines employ URL normalization in order to assign importance to web pages and to reduce indexing of duplicate pages. Web crawlers perform URL normalization in order to avoid crawling the same resource more than once.
Web browsers may perform normalization to determine if a link has been visited or to determine if a page has been cached.
See also
External links
- URL normalization @ Wikipedia
