ą¦ą§ą¦¬ ą¦øą¦¹ą¦ą§ Add ą¦ą¦°ą§ą¦Ø Robot .txt
Robots.txt is a text file on the server that you can customize for search engine bots. It tells search engine bots which directories, websites, or links in search results should or should not be indexed. This means that you can prevent search engine bots from crawling certain directories and web pages or links on your website or blog. Custom Robots.txt is now available for Blogspot. In Blogger, search options are linked to tags. Unless you're careful with labels, you should turn off crawling of search results pages. In Blogger, search links are disabled by crawling by default. You can also write the save location of your sitemap file in this robots.txt. A sitemap is a file on the server that contains all the permalinks to posts on your website or blog. Most of the time, sitemaps are in XML format, e.g. Sitemap.xml.
1. Go to Blogger Dashboard and click on the Settings option
2. crawlers and indexing section
3. Enable custom robots. txt by the switch button click now
4. Click on custom robots. txt, a window will open up, paste the robots. txt file, and update you website link
Example table:
User-agent: Googlebot
Disallow: /nogooglebot/
User-agent: *
Allow: /
Sitemap: http://www.example.com/sitemap.xml
Thanks for visiting my blog
0 Comments