Well, if your blog is self-hosted on a shared server or dedicated, you are always need to set up the robots.txt and make sure the search engine is crawling your site without any issues. I am not talking about blog hosted at blogspot.com, wordpress.com or other blogging platform.

Tags: robots.txt