subject: Search Engine Optimization [print this page] As I said already Crawlers are not human beings, they don't notice flash movies, frames, directories, images, password protected pages and javascript. The index page is saved in a huge database, from where it can be recovered. Basically, the process of indexing is recognizing the expressions and words that best portray the page. It is difficult to obtain the implication of a web page correctly but if you assist them by optimizing it. There are different algorithms to compute relevancy. These algorithms have various weights for common factors like links or metatags and key word density. That's why various search engines give various search results. The fact is all major Search Engines like Google, Yahoo, MSN etc frequently alter their algorithms and to obtain higher ranking you also need to acclimatize your web pages to up to date changes. For various SEO optimizations various factors are important. Some professionals joked that the algorithms of Google are intently prepared just the opposite of those of Yahoo.