Blogger Blogspot blog robots.txt file for advanced SEO, How to add pages and posts sitemap in it.
How to setup a Google robots.txt file, for Best Blogger SEO?
- Go to Blogger.com
- Sign in to your blogger account
- Go to Setting
- Click on Search Preference.
- Click on custom robots.txt and edit it
- Input desired robots.txt file.
- Go to blogger dashboard and click on setting tab
Find the search Crawlers and Indexing, and then click on edit custom robots.txt file.
By default, this file look likes:
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Allow: /
Sitemap: https://site.blogspot.com/sitemap.xmlReplace the above file with the new file that also include pages sitemap in it i.e.
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Allow: /
Sitemap: https://site.blogspot.com/sitemap.xml
Sitemap: https://site.blogspot.com/sitemap-pages.xmlThis Blogger robots.txt file allows search engine bot to crawl your whole website, but it denies access pages that start from /search, this is very useful for SEO. This will avoid creating the junk in search results.
Above file, the setting is best robots.txt practice but not the best for SEO. For the best possible robots settings, try advanced configuration of robots meta tag and robots.txt file.
I hope you like this article if any doubt or questions regarding the Blogger or WordPress SEO can comment below.
Thank you for this awaesome posts or blog i have added this in my 3 blogs.
1. OpenWorld TechInfos
2. Gurutechnical90
AND
3. TechPro MaxInfo
Once again thank you very very much.
I came here through YouTube your video was showing at the top how did you make that can you make the blog of it please.
Is it possible to block links indexed with (/? M = 1), because my site that is indexed by the search engine is the mobile (/?m=1)
That will not be good for the SEO of the Blogger Blog. You must configure your blog in Google Search Console. Read this article for the best practice. https://seoneurons.com/fix-blogger-duplicate-content-m-1/