Textpattern CMS support forum
You are not logged in. Register | Login | Help
- Topics: Active | Unanswered
#1 2006-03-19 23:12:39
- frostymoss
- New Member
- Registered: 2006-03-19
- Posts: 3
Preventing Archiving and Indexing by search engines
Hello,
I have the follow tag between my META tags on the default and archive page, however spiders and robots are
still indexing my weblog, I find they are indexing individual articles, or comment links, am I doing something wrong? Thanks.
<head>
<meta http-equiv="content-type" content="text/html; charset=utf-8" />
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
<META NAME="ROBOTS" CONTENT="NOARCHIVE">
<link rel="stylesheet" href="<txp:css />" type="text/css" />
<title><txp:page_title /></title>
</head>
<body>Thanks.
Taochou
(Edit: updated code to display properly. :) -Mary)
Last edited by Mary (2006-03-20 02:07:13)
Offline
Re: Preventing Archiving and Indexing by search engines
www.robotstxt.org is what you need.
Last edited by Jeremie (2006-03-19 23:50:49)
Offline
#3 2006-03-20 02:10:36
- Mary
- Sock Enthusiast
- Registered: 2004-06-27
- Posts: 6,236
Re: Preventing Archiving and Indexing by search engines
Your last meta tag is “over-writing” the first, and is also an invalid value.
Try just: <meta name="robots" content="noindex,nofollow" />
Offline