More and more often recently we are dealing with websites that have their homepages de indexed by Google for no apparent reason. Nothing has changed in their SEO strategy and their link building is ongoing. So what is the first thing you think of in this instance?
Duplicate Content
Duplicate content is the number one reason I have come across for pages being suddenly de indexed. But the content we have was written by us months ago what could be happening?
Domain Tools
domaintools.com seem to have a whois system on their website, that when someone searches for your whois data it scrapes the content from your site and creates a page on its own site with your content! Domain Tools have a domain PageRank of 6, so more often than not Google will filter out your version of the content.
But that’s not fair, how can I stop it? Simple, two lines of code in your robots.txt will sort it out:
# DomainTools
User-agent: SurveyBot
Disallow: /
(Source: http://www.domaintools.com/webmasters/surveybot.php)
If you found this post useful, why not retweet. Sharing is caring!
