How to test ROBOTS TXT file in NEW Google webmaster tools dashboard?

Google recently change their dashboard, in such a way it confuses webmasters to test their robots.txt. The sad thing about this update is that: You can never check robots.txt unless you have verified it under your account.

This appears to be true. But there is a way:

If you have a existing verified account of any website. You can use it to test for robots.txt in another website. Let say you have this following given:

VERIFIED in your account: http://www.thiswebsiteverified.com
NOT VERIFIED in your account: http://www.notverifiedingwt.com

Step 1: Change the domain name of the URLS not verified to verified, you can easily do a find and replace function in MS Word. For example, you have this following URLs that you would like to test:

http://www.notverifiedingwt.com/url1.php

http://www.notverifiedingwt.com/url2?x=1.php

http://www.notverifiedingwt.com/url3?x=4.php

If you do a find a replace using MS Word, find “notverifiedingwt.com”, then replace all with “thiswebsiteverified.com”, after performing that operation it will become:

http://www.thiswebsiteverified.com/url1.php

http://www.thiswebsiteverified.com/url2?x=1.php

http://www.thiswebsiteverified.com/url3?x=4.php

Step 2.Now go to GWT (under site configuration–> crawler access) account of http://www.thiswebsiteverified.com, go to robots.txt analysis tool. Copy and paste the robots.txt that would like to test for http://www.notverifiedingwt.com, but in the URLS to be tested, copy and paste these URLs( so that you can use the tool):

http://www.thiswebsiteverified.com/url1.php

http://www.thiswebsiteverified.com/url2?x=1.php

http://www.thiswebsiteverified.com/url3?x=4.php

Now you can test your formulated robots.txt in whatever domains even without verification. Just “find and replace” the unverified URLs with verified domain.

Related posts: