Hitesh Chauhan Hitesh Chauhan - 7 days ago 6
PHP Question

Not able to fix the issue "Url blocked by robots.txt." in google webmaster tool for wordpress website

I am not able to fix the issue "Url blocked by robots.txt." in google webmaster tool for wordpress website .it seems i am doing every thing right in robots.txt .but it still showing warning . check here

User-agent: *
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /archives/
Disallow: /*?*
Disallow: *?replytocom
Disallow: /comments/feed/
User-agent: Mediapartners-Google*
Allow: /
User-agent: Googlebot-Image
Allow: /wp-content/uploads/
User-agent: Adsbot-Google
Allow: /
User-agent: Googlebot-Mobile
Allow: /

Answer
  1. open robots.txt and replace all the code below
    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /search?q=*
    Disallow: *?replytocom
    Disallow: /attachment/
    Sitemap: http://domain.com/sitemap_index.xml

  2. edit http://domain.com/sitemap_index.xml by link your sitemap

Comments