An experiment to prove that the search engines crawl links on noindex page


This page will link to this another page. However this exact page you are reading now is using meta robots noindex tag (view the source of this page)

It would be interesting to prove if the target link to another page will be indexed by search engine bots despite this exact page having noindex tag.
If target page has been actually crawled and index by some search engine bots, then this proves that SE bots crawl links on the pages even with meta robots noindex tag.

This can spark some very useful applications that includes preventing duplicate content as part of an existing search engine optimization strategy.


Note: Results of this experiment will be published in www.seochat.com
Update: Results here How Search Engines Handle the Meta Robots Tag and Robots.txt