Textpattern CMS support forum
You are not logged in. Register | Login | Help
- Topics: Active | Unanswered
#1 2009-02-19 10:35:55
- beechy
- Member
- Registered: 2006-03-02
- Posts: 92
Google is indexing searches people make on my site
Hi,
Google is indexing loads of searches that people make on my site. I have tried adding,
Disallow: /?q=
to my robots.txt file but this is still not removing the searches from google’s index.
Does anybody know how I can stop google from indexing these pages.
Offline
Re: Google is indexing searches people make on my site
beechy wrote:
Does anybody know how I can stop google from indexing these pages.
Untested – maybe this will work in the <head> tag:
<txp:if_search_results>
<meta name="robots" content="noindex,nofollow" />
</txp:if_search_results>Offline
#3 2009-02-19 10:44:24
- beechy
- Member
- Registered: 2006-03-02
- Posts: 92
Re: Google is indexing searches people make on my site
thanks graeme will try that out
Offline
Re: Google is indexing searches people make on my site
Hello beechy,
Look at this google post on their blog : Crawling through HTML forms … and use method="post" in your search form to prevent this.
Last edited by fpradignac (2009-02-19 13:58:14)
françois
Offline
#5 2009-02-19 14:01:21
- Mary
- Sock Enthusiast
- Registered: 2004-06-27
- Posts: 6,236
Re: Google is indexing searches people make on my site
Google can only index stuff that’s being linked to from somewhere. You might want to figure out where that is (try using Google’s link: operator).
Anyhoo, you want your code snippet to look like this:
<txp:if_search_results>
<meta name="robots" content="noindex,noarchive" />
</txp:if_search_results>Info:
Offline
Re: Google is indexing searches people make on my site
Mary a écrit:
Google can only index stuff that’s being linked to from somewhere.
Mary : if you look at the link above, you can read that :
In the past few months we have been exploring some HTML forms to try to discover new web pages and URLs that we otherwise couldn’t find and index for users who search on Google. Specifically, when we encounter a <FORM> element on a high-quality site, we might choose to do a small number of queries using the form. For text boxes, our computers automatically choose words from the site that has the form; for select menus, check boxes, and radio buttons on the form, we choose from among the values of the HTML. Having chosen the values for each input, we generate and then try to crawl URLs that correspond to a possible query a user may have made …//// … Similarly, we only retrieve GET forms and avoid forms that require any kind of user information.
In my case, Googlebot were doing 10 to 20 queries by day on the same search form with the method GET, changing to POST “save” me.
Last edited by fpradignac (2009-02-19 16:26:55)
françois
Offline