Robots.txt Sitemap

Whenever a person heard about these his/her reaction. What is it? But few people know the name. Originally it is a text file. Basically it is stuffed commands followed by search engines. If you do not want any folder you may use robots txt command “Disallow :/cgi-bin/” and the folder will remove from the search engine’s sight. If you want to avoid creating Yahoo or Google account to submit your sitemap then robots.txt file will help you out from this problem. For using this the command is very easy: “Sitemap: http://www.lovethepoem.com/sitemap.txt” You can use different ways for every search engine bots, just clarifying the rule to which it destined: “User-Agent: Googlebot”. Just to avoid the commanding procedure you use free creating scripts out there. And for this you don’t have to pay anything. Trust me if you want that your visitors will not land in those pages before they pay anything for this mean you use that page as a download pages then robots txt file is really useful in this. When you do not indexed any page then it will help you a lot. I think I can explain in shortly that what is robots .txt file and why you use this technology in your site’s page. If you want these things which I told you before then it will help you out a lot.