Textpattern CMS support forum
You are not logged in. Register | Login | Help
- Topics: Active | Unanswered
Exclude search engines from specific sections?
Hello everyone,
I’ve been looking through previous postings here on info about how to exclude search engines from indexing specific sections of a client’s site but haven’t seen any specific. Is this possible to do through the htaccess file using Disallow? Or, because the section is housed within TextPattern and not an actual physical folder on the server, would it not work?
Regards,
Michael
Offline
#2 2006-03-10 00:08:48
- Neko
- Member
- Registered: 2004-03-18
- Posts: 458
Re: Exclude search engines from specific sections?
Unless I’ve misunderstood your request, all it takes is adding the desired disallow rules to robots.txt file, like
<code>User-agent: *
Disallow: /doh/
Disallow: /work/
Disallow: /mrburns/
</code>
It doesn’t matter if sections are not phisically “there” (on FTP): a spider is more or less like a guy browsing your site, so TXP handles his requests just fine as if it was a regular reader.
Last edited by Neko (2006-03-10 00:13:16)
Offline
Re: Exclude search engines from specific sections?
Awesome! Thanks! Wasn’t sure but wanted to ask before I did anything.
Regards,
Michael
Offline