SEO Glossary of Terms Part Two
March 5th, 2008 by Dan
Welcome to part two of my SEO glossary of terms, follow on from last week, this article is a guide to client and SEO beginners on the term used in the industry so next time you speak to your SEO, you can talk on the same language.
Spider
Also referred to as a crawler these are an automated program or script used by search engine to browses the web and store relevant information about the site they browse, for processing by the an Indexer.
Indexer
Search engine Indexer processes the data collected by the spiders then stores it so that search engine query can be match against it for relevance.
Robot.txt file
This file report to the search engine as to what pages you want to be excluded from the search engine indexing process. This ensure that the spider don’t waste their limited time look at page on your website that don’t advertise your business. A common file to be excluded by the robot.txt file is the term and condition page, theses page typical don’t tell Google any thing regarding what your web site is about and therefore don’t need to be spidered.
RSS
An RSS feed will create a streamed summary to a RSS reader of any updated content on your site, RSS makes it possible for people to keep up to day with the changes on your web site in an automated manner to do this they need a RSS reader, a popular one is Google reader.
Canonical
One of the major causes of duplicate content is through a canonical URL, this is where there is more than one address pointing to exactly the same content. For instance http://www.yoursite.com And http://yoursite.com both point to the same page search engines consider this duplicate content and will give you a small penalty for it.
Link to us
If you want to link to this blog, copy and paste the following HTML code to your website.









