{"id":1284,"date":"2020-12-25T23:20:00","date_gmt":"2020-12-25T17:50:00","guid":{"rendered":"https:\/\/seoneurons.com\/blog\/?p=1284"},"modified":"2024-03-12T22:33:54","modified_gmt":"2024-03-12T17:03:54","slug":"perfect-robots-txt-file","status":"publish","type":"blogger-seo","link":"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/","title":{"rendered":"Optimized Robots.txt for Blogger to boost Blog SEO in 2024"},"content":{"rendered":"\n<p>Every search engine crawling bot first interacts with a website&#8217;s robots.txt file and its crawling rules. This means that the robots.txt file plays a pivotal role in the Blogger blog&#8217;s search engine optimization (SEO). This article will guide you on how to create a well-optimized custom robots.txt file for Blogger and how to understand the implications of blocked pages reported by Google Search Console.<\/p><div id=\"ez-toc-container\" class=\"ez-toc-v2_0_82_2 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">In this guide, we\u2019ll walk through:<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #494949;color:#494949\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #494949;color:#494949\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/#what-are-the-functions-of-the-robotstxt-file\" >What are the functions of the robots.txt file?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/#default-robotstxt-file-of-the-blogger-blog\" >Default Robots.txt file of the Blogger Blog.<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/#optimizing-robotstxt-file-for-a-blogger-blog\" >Optimizing Robots.txt File for a Blogger Blog<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/#effects-in-search-engine-console-after-implementing-these-rules-in-robotstxt\" >Effects in Search Engine Console after implementing these rules in robots.txt<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/#how-do-you-implement-this-robotstxt-file-to-blogger\" >How do you implement this Robots.txt File to Blogger?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/#conclusion\" >Conclusion.<\/a><\/li><\/ul><\/nav><\/div>\n\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-what-are-the-functions-of-the-robots-txt-file\"><span class=\"ez-toc-section\" id=\"what-are-the-functions-of-the-robotstxt-file\"><\/span>What are the functions of the robots.txt file?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>The robots.txt file tells the search engine which pages should and shouldn&#8217;t be crawled. This allows us to control the crawling of all web spiders. In the robots.txt file, we can control the crawling activity of each user-agent by allowing or disallowing them. We can also declare sitemaps of our website for search engines like Google, Bing, Yandex, etc. So that these search engines can easily find and index our content.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1280\" height=\"720\" src=\"https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-create-custom-robots-txt-file-blogger.jpg\" alt=\"create custom robot.txt Blogger blog\" class=\"wp-image-5155\" srcset=\"https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-create-custom-robots-txt-file-blogger.jpg 1280w, https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-create-custom-robots-txt-file-blogger-300x169.jpg 300w, https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-create-custom-robots-txt-file-blogger-1024x576.jpg 1024w, https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-create-custom-robots-txt-file-blogger-768x432.jpg 768w, https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-create-custom-robots-txt-file-blogger-390x220.jpg 390w\" sizes=\"auto, (max-width: 1280px) 100vw, 1280px\" \/><figcaption class=\"wp-element-caption\">Blogger robots.txt for best SEO<\/figcaption><\/figure>\n<\/div>\n\n\n\t\t<div class=\"stream-item stream-item-in-post stream-item-in-post-1\">\n\t\t<\/div>\n\t\n\n\n\n<p>The function of robots meta tags is to control page level indexation i.e. page should be visible in search result or not.<\/p>\n\n\n\n<p>Usually, we use the robots meta tags to index or noindex blog posts, pages, and other format web content throughout the web. And the <a href=\"https:\/\/seoneurons.com\/blog\/technical-seo\/robots-txt-file\/\">robots.txt<\/a> to control the search engine bots. You can allow the complete website to crawl, but it will exhaust the crawling budget of the website. To save the crawling budget of the website, you have to block the website&#8217;s search, archive, and label sections.<\/p>\n\n\n\n<p>The robots meta tag is page level and used to decide whether a web page should be visible in SERP. Additionally, a file called robots.txt helps control how search engine bots should behave on the website. If we let the bots freely crawl through our entire website, it could use up a lot of resources. To manage this, we can use robots.txt to tell the bots not to crawl certain parts, like search, archive, and label sections. This way, we save resources and ensure the bots focus on the important stuff on our website.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-default-robots-txt-file-of-the-blogger-blog\"><span class=\"ez-toc-section\" id=\"default-robotstxt-file-of-the-blogger-blog\"><\/span>Default Robots.txt file of the Blogger Blog.<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>To optimize the robots.txt file for a Blogger blog, we first need to understand the CMS structure and analyze the default robots.txt file. Default robots.txt file of Blogger-<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>User-agent: Mediapartners-Google\nDisallow: \n\nUser-agent: *\nDisallow: \/search\nAllow: \/\n\nSitemap: https:\/\/www.example.com\/sitemap.xml<\/code><\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>The first line (User-Agent) of this file declares the bot type<\/strong>. Here it&#8217;s Google AdSense, which is disallowed to none(declared in 2nd line). That means the AdSense ads can appear throughout the website.<\/li>\n\n\n\n<li><strong>The following<\/strong> user agent is *, which means all the search engine bots are disallowed to \/search pages. That means disallowing all search and label pages(same URL structure).<\/li>\n\n\n\n<li><strong>And allow tag<\/strong> to define that all pages other than the disallowing section can be crawled.<\/li>\n\n\n\n<li>The <strong>following line contains a post sitemap<\/strong> for the Blogger blog.<\/li>\n<\/ul>\n\n\n\n\t\t<div class=\"stream-item stream-item-in-post stream-item-in-post-2\">\n\t\t<\/div>\n\t\n\n\n\n<p>This is an almost perfect file to control the search engine bots and provide instructions for pages to crawl or not crawl. But this file allows for indexing the archive pages, which can cause a duplicate content issue. That means it will create junk for the Blogger&#8217;s blog.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"optimizing-robotstxt-file-for-a-blogger-blog\"><\/span>Optimizing Robots.txt File for a Blogger Blog<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>We understood how the default robots.txt file performs its function for the Blogger blog. Let&#8217;s optimize it for the best SEO.<\/p>\n\n\n\n<p>The default robots.txt allows the archive to index, which causes the duplicate content issue. We can prevent this issue by stopping the bots from crawling the archive section. For this, <code>\/search*<\/code> will disable crawling of all search and label pages.<\/p>\n\n\n\n<p>Applying a Disallow rule <code>\/20*<\/code> into the robots.txt file will stop the crawling of archive sections. The <code>\/20*<\/code> rule will block the crawling of all posts, so to avoid this, we have to apply a new Allow rule for the <code>\/*.html<\/code> section that allows the bots to crawl posts and pages.<\/p>\n\n\n\n<p>The default sitemap includes posts, not pages. So you have to add a sitemap for pages located under <code>https:\/\/example.blogspot.com\/sitemap-pages.xml<\/code> or <code>https:\/\/www.example.com\/sitemap-pages.xml<\/code> for the custom domain. You can <a href=\"https:\/\/seoneurons.com\/blog\/blogger-seo\/xml-sitemap\/#submit-sitemap-to-other-search-engines-using-robotstxt\">submit Blogger sitemaps to Google Search Console<\/a> for good results.<\/p>\n\n\n\n<p><strong>So, the new perfect custom robots.txt file for the Blogger blog will look like this.<\/strong><\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>User-agent: Mediapartners-Google\nDisallow: \n\nUser-agent: *  <span style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-cyan-bluish-gray-color\"># to select all crawling bots and search engines<\/span>\nDisallow: \/search* <mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-cyan-bluish-gray-color\"># to block all user generated query item within the website.<\/mark>\nDisallow: \/20*  <mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-cyan-bluish-gray-color\"># this line will disallow archieve section of Blogger.<\/mark>\nDisallow: \/feeds*  <mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-cyan-bluish-gray-color\"># this line will disallow feeds. Read instruction below\n<\/mark>Allow: \/*.html  <mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-cyan-bluish-gray-color\"># allow all post and pages of the blog<\/mark>\n\n<span style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-cyan-bluish-gray-color\">#sitemap of the blog\n<\/span>Sitemap: https:\/\/www.example.com\/sitemap.xml\nSitemap: https:\/\/www.example.com\/sitemap-pages.xml<\/code><\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\/search* will disable crawling of all search and label pages.<\/li>\n\n\n\n<li>Apply a Disallow rule \/20* into the robots.txt file to stop the crawling of archive sections.<\/li>\n\n\n\n<li>Disallow: \/feeds* this rule will disallow crawlers to crawl the feed section. But if you are not generated new <a href=\"https:\/\/seoneurons.com\/blog\/blogger-seo\/xml-sitemap\/\">Blogger XML sitemap<\/a> then do not use this line.  <\/li>\n\n\n\n<li>The \/20* rule will block the crawling of all posts, So to avoid this, we&#8217;ve to apply a new Allow rule for the \/*.html section that allows the bots to crawl posts and pages.<\/li>\n<\/ul>\n\n\n\n\t\t<div class=\"box info  \">\n\t\t\t<div class=\"box-inner-block\">\n\t\t\t\t<span class=\"fa tie-shortcode-boxicon\"><\/span>You&#8217;ve to replace www.example.com with your Blogger domain or custom domain name. For example, suppose your custom domain name is www.iashindu.com; then the sitemap will be at https:\/\/www.iashindu.com\/sitemap.xml. In addition, you can check the current robots.txt at https:\/\/www.example.com\/robots.txt.\n\t\t\t<\/div>\n\t\t<\/div>\n\t\n\n\n\t\t<div class=\"stream-item stream-item-in-post stream-item-in-post-3\">\n\t\t<\/div>\n\t\n\n\n\n<p>In the above file, the setting is the best robots.txt practice for SEO. This will save the website&#8217;s crawling budget and help the Blogger blog to appear in the search results. You have to <a href=\"https:\/\/seoneurons.com\/blog\/seo-friendly-content\/\">write SEO-friendly content<\/a> to appear in the search results.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"effects-in-search-engine-console-after-implementing-these-rules-in-robotstxt\"><\/span>Effects in Search Engine Console after implementing these rules in robots.txt<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>It&#8217;s important to <strong>note that Google Search Console may report that some pages are blocked by your robots.txt file<\/strong>. However, it&#8217;s crucial to check which pages are blocked. Are they content pages or search or archive pages? We can&#8217;t display search and archive pages, which is why these pages are blocked.<\/p>\n\n\n\n<p>But if you want to allow bots to crawl the complete website, then you have to configure robots meta tag and robots.txt file in such a way that.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Robots.txt file allows crawlers to crawl the whole website.<\/li>\n\n\n\n<li>Robots Meta tag disallows non-important pages to noindex.<\/li>\n<\/ul>\n\n\n\n<p>The <a href=\"https:\/\/seoneurons.com\/blog\/blogger-seo\/robots-txt-and-robots-meta-tags-for-seo\/\">amalgamation of Blogger robots.txt and robots meta tags<\/a> may exhaust the crawling budget, but the better alternative is to boost the SEO of the Blogger blog.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-how-do-you-implement-this-robots-txt-file-to-blogger\"><span class=\"ez-toc-section\" id=\"how-do-you-implement-this-robotstxt-file-to-blogger\"><\/span>How do you implement this Robots.txt File to Blogger?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>The Robots.txt file is located at the root level of the website. There is no access to the root in Blogger, so how do you edit this robots.txt file? You can access root files like robots.txt under the settings section of Blogger.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-to-edit-blogger-robots-txt-1024x576.png\" alt=\"How to Edit Blogger robots.txt file\" class=\"wp-image-5157\" srcset=\"https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-to-edit-blogger-robots-txt-1024x576.png 1024w, https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-to-edit-blogger-robots-txt-300x169.png 300w, https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-to-edit-blogger-robots-txt-768x432.png 768w, https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-to-edit-blogger-robots-txt-390x220.png 390w, https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-to-edit-blogger-robots-txt.png 1208w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Provide custom robots.txt<\/figcaption><\/figure>\n<\/div>\n\n\n<ol class=\"wp-block-list\">\n<li>Go to Blogger Dashboard and click on the settings option,<\/li>\n\n\n\n<li>Scroll down to the crawlers and indexing section,<\/li>\n\n\n\n<li>Enable custom robots.txt by the switch button.<\/li>\n\n\n\n<li>Click on <strong>custom robots.txt; a<\/strong> window will open. Paste the robots.txt file and update.<\/li>\n<\/ol>\n\n\n\n\t\t<div class=\"stream-item stream-item-in-post stream-item-in-post-5\">\n\t\t<\/div>\n\t\n\n\n\n<p>After updating the custom robots.txt file for the Blogger blog, you can check the changes by visiting your domain like https:\/\/www.example.com\/robots.txt, where www.example.com should be replaced with your domain address.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-conclusion\"><span class=\"ez-toc-section\" id=\"conclusion\"><\/span>Conclusion.<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>We&#8217;ve explored the function of the robots.txt file and created an optimal custom robots.txt file for the Blogger blog. In the default robots.txt file, the archive section is also allowed to crawl, which causes duplicate content issues for the search engine. This confusion can lead to Google not considering any Page for the search results.<\/p>\n\n\n\n<p>Remember, Google Search Console may report blocked pages, but it&#8217;s crucial to understand which pages are blocked and why. This understanding will help you optimize your site for better SEO results.<\/p>\n\n\n\n<p>I hope you found this article helpful. If you have any doubts or questions regarding Blogger or WordPress SEO, feel free to comment below.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Every search engine crawling bot first interacts with a website&#8217;s robots.txt file and its crawling rules. This means that the robots.txt file plays a pivotal role in the Blogger blog&#8217;s search engine optimization (SEO). This article will guide you on how to create a well-optimized custom robots.txt file for Blogger and how to understand the &hellip;<\/p>\n","protected":false},"author":2,"featured_media":5155,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","format":"standard","meta":{"footnotes":""},"parentpage":[959],"class_list":["post-1284","blogger-seo","type-blogger-seo","status-publish","format-standard","has-post-thumbnail","hentry","parentpage-blogger-seo"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.4 (Yoast SEO v27.4) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Highly Optimized Robots.txt for Blogger SEO (2024 Update)<\/title>\n<meta name=\"description\" content=\"This article will explain how to create a perfect custom robots.txt file in the Blogger and optimize the blog for search engines in 2024.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Optimized Robots.txt for Blogger to boost Blog SEO in 2024\" \/>\n<meta property=\"og:description\" content=\"This article will explain how to create a perfect custom robots.txt file in the Blogger and optimize the blog for search engines in 2024.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/\" \/>\n<meta property=\"og:site_name\" content=\"SEO Neurons\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/SEONeuronsAgency\/\" \/>\n<meta property=\"article:modified_time\" content=\"2024-03-12T17:03:54+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-create-custom-robots-txt-file-blogger.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1280\" \/>\n\t<meta property=\"og:image:height\" content=\"720\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@SEONeurons\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/blogger-seo\\\/perfect-robots-txt-file\\\/\",\"url\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/blogger-seo\\\/perfect-robots-txt-file\\\/\",\"name\":\"Highly Optimized Robots.txt for Blogger SEO (2024 Update)\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/blogger-seo\\\/perfect-robots-txt-file\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/blogger-seo\\\/perfect-robots-txt-file\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/wp-content\\\/uploads\\\/2019\\\/12\\\/how-create-custom-robots-txt-file-blogger.jpg\",\"datePublished\":\"2020-12-25T17:50:00+00:00\",\"dateModified\":\"2024-03-12T17:03:54+00:00\",\"description\":\"This article will explain how to create a perfect custom robots.txt file in the Blogger and optimize the blog for search engines in 2024.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/blogger-seo\\\/perfect-robots-txt-file\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/seoneurons.com\\\/blog\\\/blogger-seo\\\/perfect-robots-txt-file\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/blogger-seo\\\/perfect-robots-txt-file\\\/#primaryimage\",\"url\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/wp-content\\\/uploads\\\/2019\\\/12\\\/how-create-custom-robots-txt-file-blogger.jpg\",\"contentUrl\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/wp-content\\\/uploads\\\/2019\\\/12\\\/how-create-custom-robots-txt-file-blogger.jpg\",\"width\":1280,\"height\":720,\"caption\":\"create custom robot.txt Blogger blog\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/blogger-seo\\\/perfect-robots-txt-file\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/seoneurons.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Blog\",\"item\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Optimized Robots.txt for Blogger to boost Blog SEO in 2024\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/\",\"name\":\"SEO Neurons\",\"description\":\"Create, Optimize Website and Drive More Organic Traffic\",\"publisher\":{\"@id\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/#organization\"},\"alternateName\":\"SEO Neurons\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/#organization\",\"name\":\"SEO Neurons\",\"alternateName\":\"SEO Neurons\",\"url\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/wp-content\\\/uploads\\\/2023\\\/06\\\/seoneurons-logo.svg\",\"contentUrl\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/wp-content\\\/uploads\\\/2023\\\/06\\\/seoneurons-logo.svg\",\"width\":1,\"height\":1,\"caption\":\"SEO Neurons\"},\"image\":{\"@id\":\"https:\\\/\\\/seoneurons.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/SEONeuronsAgency\\\/\",\"https:\\\/\\\/x.com\\\/SEONeurons\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/seoneurons\",\"https:\\\/\\\/www.youtube.com\\\/c\\\/SEONeurons\",\"https:\\\/\\\/www.instagram.com\\\/seo_neurons\\\/\",\"https:\\\/\\\/t.me\\\/SEONeurons\"],\"legalName\":\"SEO Neurons\",\"foundingDate\":\"2021-01-21\",\"numberOfEmployees\":{\"@type\":\"QuantitativeValue\",\"minValue\":\"1\",\"maxValue\":\"10\"}}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Highly Optimized Robots.txt for Blogger SEO (2024 Update)","description":"This article will explain how to create a perfect custom robots.txt file in the Blogger and optimize the blog for search engines in 2024.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/","og_locale":"en_US","og_type":"article","og_title":"Optimized Robots.txt for Blogger to boost Blog SEO in 2024","og_description":"This article will explain how to create a perfect custom robots.txt file in the Blogger and optimize the blog for search engines in 2024.","og_url":"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/","og_site_name":"SEO Neurons","article_publisher":"https:\/\/www.facebook.com\/SEONeuronsAgency\/","article_modified_time":"2024-03-12T17:03:54+00:00","og_image":[{"width":1280,"height":720,"url":"https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-create-custom-robots-txt-file-blogger.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_site":"@SEONeurons","twitter_misc":{"Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/","url":"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/","name":"Highly Optimized Robots.txt for Blogger SEO (2024 Update)","isPartOf":{"@id":"https:\/\/seoneurons.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/#primaryimage"},"image":{"@id":"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/#primaryimage"},"thumbnailUrl":"https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-create-custom-robots-txt-file-blogger.jpg","datePublished":"2020-12-25T17:50:00+00:00","dateModified":"2024-03-12T17:03:54+00:00","description":"This article will explain how to create a perfect custom robots.txt file in the Blogger and optimize the blog for search engines in 2024.","breadcrumb":{"@id":"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/#primaryimage","url":"https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-create-custom-robots-txt-file-blogger.jpg","contentUrl":"https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2019\/12\/how-create-custom-robots-txt-file-blogger.jpg","width":1280,"height":720,"caption":"create custom robot.txt Blogger blog"},{"@type":"BreadcrumbList","@id":"https:\/\/seoneurons.com\/blog\/blogger-seo\/perfect-robots-txt-file\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/seoneurons.com\/"},{"@type":"ListItem","position":2,"name":"Blog","item":"https:\/\/seoneurons.com\/blog\/"},{"@type":"ListItem","position":3,"name":"Optimized Robots.txt for Blogger to boost Blog SEO in 2024"}]},{"@type":"WebSite","@id":"https:\/\/seoneurons.com\/blog\/#website","url":"https:\/\/seoneurons.com\/blog\/","name":"SEO Neurons","description":"Create, Optimize Website and Drive More Organic Traffic","publisher":{"@id":"https:\/\/seoneurons.com\/blog\/#organization"},"alternateName":"SEO Neurons","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/seoneurons.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/seoneurons.com\/blog\/#organization","name":"SEO Neurons","alternateName":"SEO Neurons","url":"https:\/\/seoneurons.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/seoneurons.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2023\/06\/seoneurons-logo.svg","contentUrl":"https:\/\/seoneurons.com\/blog\/wp-content\/uploads\/2023\/06\/seoneurons-logo.svg","width":1,"height":1,"caption":"SEO Neurons"},"image":{"@id":"https:\/\/seoneurons.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/SEONeuronsAgency\/","https:\/\/x.com\/SEONeurons","https:\/\/www.linkedin.com\/company\/seoneurons","https:\/\/www.youtube.com\/c\/SEONeurons","https:\/\/www.instagram.com\/seo_neurons\/","https:\/\/t.me\/SEONeurons"],"legalName":"SEO Neurons","foundingDate":"2021-01-21","numberOfEmployees":{"@type":"QuantitativeValue","minValue":"1","maxValue":"10"}}]}},"_links":{"self":[{"href":"https:\/\/seoneurons.com\/blog\/wp-json\/wp\/v2\/blogger-seo\/1284","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/seoneurons.com\/blog\/wp-json\/wp\/v2\/blogger-seo"}],"about":[{"href":"https:\/\/seoneurons.com\/blog\/wp-json\/wp\/v2\/types\/blogger-seo"}],"author":[{"embeddable":true,"href":"https:\/\/seoneurons.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/seoneurons.com\/blog\/wp-json\/wp\/v2\/comments?post=1284"}],"version-history":[{"count":0,"href":"https:\/\/seoneurons.com\/blog\/wp-json\/wp\/v2\/blogger-seo\/1284\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/seoneurons.com\/blog\/wp-json\/wp\/v2\/media\/5155"}],"wp:attachment":[{"href":"https:\/\/seoneurons.com\/blog\/wp-json\/wp\/v2\/media?parent=1284"}],"wp:term":[{"taxonomy":"parentpage","embeddable":true,"href":"https:\/\/seoneurons.com\/blog\/wp-json\/wp\/v2\/parentpage?post=1284"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}