BloggerSEO

Best use Robots.txt file in Blogger Blogspot Blog 2021

Blogger Blogspot blog robots.txt file for advanced SEO, How to add pages and posts sitemap in it.

How to setup a Google robots.txt file, for Best Blogger SEO?

Edit robots.txt file in Blogger
Edit robots.txt file in Blogger
  1. Go to Blogger.com
  2. Sign in to your blogger account
  3. Go to Setting
  4. Click on Search Preference.
  5. Click on custom robots.txt and edit it
  6. Input desired robots.txt file.
Blogger SEO settings robots.txt file step 1
Blogger Step to edit robots.txt
  1. Go to blogger dashboard and click on setting tab
Blogger SEO settings robots.txt file step 2, 3
Provide custom robots.txt for blogger

Find the search Crawlers and Indexing, and then click on edit custom robots.txt file.

By default, this file look likes:

User-agent: Mediapartners-Google
Disallow: 

User-agent: *
Disallow: /search
Allow: /

Sitemap: https://site.blogspot.com/sitemap.xml

Replace the above file with the new file that also include pages sitemap in it i.e.

User-agent: Mediapartners-Google
Disallow: 

User-agent: *
Disallow: /search
Allow: /

Sitemap: https://site.blogspot.com/sitemap.xml
Sitemap: https://site.blogspot.com/sitemap-pages.xml

This Blogger robots.txt file allows search engine bot to crawl your whole website, but it denies access pages that start from /search, this is very useful for SEO. This will avoid creating the junk in search results.

Above file, the setting is best robots.txt practice but not the best for SEO. For the best possible robots settings, try advanced configuration of robots meta tag and robots.txt file.

I hope you like this article if any doubt or questions regarding the Blogger or WordPress SEO can comment below.

Ashok Kumar

Ashok Kumar working in the Search Engine Optimization field since 2015. And worked on many successful projects since then. He shares the real-life experience of best SEO practices with his followers on seoneurons.com. You also can learn Advance level SEO for WordPress, Blogger, or any other blogging platform. Stay tuned.

Related Articles

3 Comments

Leave a Reply

Back to top button