subject: Sökmotoroptimering: A Sweden word of SEO [print this page] Few methods of Skmotoroptimering are getting indexed, Preventing Crawling and Increasing prominence. To find pages for algorithmic search results, foremost search engines (say Yahoo!) use crawlers. Pages that are linked from other search engines are found automatically so they are not needed to be submitted. To ensure that all pages are found (especially pages that are not discoverable by automatically following links), search engine (say google) offers Google Webmaster Tools, for which an XML Sitemap feed can be created and submitted for free. Webmasters inculcate spiders not to crawl certain files or directories through the standard robots.txt file in the root directory of the sphere. This is done to avoid undesirable content in the search indexes.