Textpattern CMS support forum
You are not logged in. Register | Login | Help
- Topics: Active | Unanswered
#106 2008-03-24 22:03:40
Re: asy_sitemap: Google-Sitemap (as-is/for developers)
Since Dreamhost users have been having problems editing the plugin, here’s a 4.0.6-compatible version:
# Name: asy_sitemap v0.7 (compressed)
# Type: Admin/Client side plugin
# Generates a gz-compressed Google-Sitemap.
# Author: Sencer Yurdaguel
# URL: http://www.sencer.de/
# .....................................................................
# This is a plugin for Textpattern - http://textpattern.com/
# To install: textpattern> admin> plugins
# Paste the following text into the 'Install plugin' box:
# .....................................................................
H4sIAAAAAAAAA707a3PbtrKf3ZnzHza8nlLqSJT8yKPyI3VjO/EcJ/a1nNN2kowHIiGJY4rQ
JUjLyjn573d3AfBhyUna3rkeRxZB7GKx710gYvDz4N96sDvwUjGT3p4ebG0NPKGXNzrO5UzM
aegZjhT5VGX8Hp+GMg1lBn8UWSQmhUx4vO9m3RRZTCPbiGma5/NBr7dYLALNQEEke/Ty+cC7
k5mOVUpPOwOvHzx3y0dSh1k8z+3LXRx6LVOZiVxqEDD53A3VbJ5JrWUEr5WaJLI7NOQGDDDw
QhXxbn7e6iO9G/EYWuMiDQnljbyPda5bXiYn+EVmN6FIkpEIb712G/79jx96vY2N9ykuMZNp
DvlUwlgliVrE6QS24TxOkQpEuFQFLISdYbkFuTLwIwnIDDUTeUzYl5DJMJO4gagDiyluBjfP
GGQU56AymCudg0hBZAiRyOAfPxhEK0S2WDozcSudiG4WmZjPZeZ1wLPg9JUwe+29v4vGkM2I
Nr4QVczMX/L7eZwiwrEIJRwcgC+iWZz6zMCNDRFFN/MsvtMtv6ZLfge2GE9FTi5GLU/e5zIl
VdC8dk358PG1E633ALS5kxpE/bFGdu8nuJ7GGpwewFQlkWbpvVLpOJ4UqGA0fixygfPhJ/hl
IvObuRYAMIpTkS0BfpMIkKGcAd8xcMjAMM7UDC4vhtfdO5HFYpRIzUh6+FkuWSPtxsC1Nt0a
BzAWiZaWg5uK9V/jcDmlTS/w5yXgQ0tkmVi2/HEm/+dGS8bvd8xjJMeiSPLyUSw1frdCNY9t
h2wA6xDBwSH4D9E1BwmLG2mgNoNGWijaTIR5y23HjPZ65hMFIjVaSiaZk1ORRWS4EdgVdQfG
UibIWymJ5WwsOHMWWPhTtByCnEmRknmqsbHXONM0kcA0/tsMpyKdSKabdwsjiQbdIOWX+v6B
flC/P/S7zz8RlfCKMXRPcVKBjmyJPiGDoZmtGygs7d+J4shwTkPLwrWbyJChYH/+DDJUbdJS
nAT3QEhKtHVRObQGP6FNi9kIAZGP/J6QVoSwGbH5+yhkNPrNOs/azUdU3J09wBV3AI0uEnGy
XAvttt18ROhdht4l6IWUt4+B095gA2qPsHEAzxj4GQEvpchWgetsaDcfifI+wfedm4/QInLr
7BUUmtQ1tuwwWowql0gKocyyWkQIIIozetFCjynyaZtIypTKiceIGyffz7txqnN0Z2z4JaaD
h6CB33NY72dJMPns75U0HCt4d3FtLISVm0nEsILibRjbnUgKCqNoc0KToWE8Q3tY2kDKJKyY
y4F1Euwz+mTgnprhStVEr8PvtvidSBbIRzu0zUNT3GqytEM7PMQ6YUd2ecTI2Q495aGZSvNp
OfaMx4xE7dBzHuKA6tFA2/IE5SBFOIXS9dB2N29xrzh/k7nANsHetnS3H2jGJ9zvJn1hZ/XF
RJ28yFLLBTe5s+pYcMjJb03osRG2CkFxeqdupW6kEBOT6tDrRYz5VIGqUuTzIg9MUHqFNo3p
RUHJT5zCajxssw5S+tF1uNA14hJj1tJgfVhalwq0NpGtaY6bwhXmNjKRFYF9g6bkfD+G/h9/
xHGaScMmb/BNmOFXrVAVKYaCG4qS7YODfhv+8x+EuLk6+e/3J8PrD/5dLBf+pycHGD3a0AbD
dBNHMDLSwqsoapMSZMT3CodUejUYmwj8lci1SeI4WGFYq+H6Og1X1qk8U6fhZzolNZ0VUtuV
ZZ/L3NdAq5kgiRl1l72+zl0YfIfupNAk5bGay7SD+hEKclNoc10rS0JBcQ+IXag6ajxmPUGa
MV/Pl4xrkqiRSFDcuC2ENVsezyk30Sq8JeTQ8iibn7C3CDBLxpTrRR9ZK7MsVeavzrMO+tBq
ExcppsBzItDAcQ4MrCI0KCCVizL1tZ4IJdsdyzycPrCPmMwGFR5NGG06RU/TMYuINMJI8dBZ
zzXmaQZjB9/hjJfwVqQFbvOS1kazNO6KUnAdY96GSJdTtQj+grJDzaVMpcAY3PJ+71rKB3Cd
LdkUVZ0XQRDY1JZXQ3ZbQ8OgBpsoBeQ+fmKQx9So5duKyg+ckDAq+MFIaNakVqXhFiciGaPz
0IyZ8umTa+gt5GgmyGtoF1F0j0h6aZ8OvIBWDjx4c3192dsK+h+zjyn98yq0Kxvsbg8Ad7Og
pAu5r9UMk2XEWtshgi2mSCG0noylGvNua9uln818xgqHSa9mmre2X1homkI8Qv3C3xbN7IC/
3e/DxT/JZaxStMMULcn2MVwtVHYroyc1Yr6UPAoTpSXTY15+AfI5j25yVGB5mAVwHEesbojZ
bfILpg4nqIukXlXsWI0GnKk6FxxlYmGGjqiQwqInknDmKix22V8tJ9a66r/vEPOs+Ko/JGk8
IRyuqq7pnwms5mWWoas5qJZDzYoUGnaKnoshA3jFNkRiIkNmf0ciQ99ExRQW9vU48CTWN+7V
n1jTEIn+Eb14bFYvF0Cv8OiS0ETJYWKvSofnuuVF6qZUeM+4hyc1qHYj2fj/CyK43FygKal5
q1ZKox9wRiDDqQKiqEp2aMcVtd8B7u1H8R260XiSHnz0Qklq+9EDnS8TiQMzkU1QpRHJYEfO
PnqHXt3dVSwCRubvzy2kF6pEZYNMRt4h+rtqZuDv9+aHfo0CjGQzk51u5GKCtJoQYgkG2z5S
3NyY7njtwMydZGLc8mwZZ2sqKGuqAXiBlgm+PUvRhT6stdeaU70gCrz9UQa9Q8+utuHZAm1l
JWgd2zJo/ZplQf/omq6M+jNrIv8TjAIwU1E8jqnsJgPEusQqGNSqyBLf2NDl5egQaq0iVkZ8
biqn7UKRvth/20Z5yP6p8npku9ywWO+vyqJvZaeOMl2MZmbRhk1S7FP0qWeYKctspO5LPdiQ
FrbROwq0HbVptPRs06RT6TaxocuaPzB6v/fRs9OaFtJDE7GK/6UeCpqdzRhTtahU21OKlGWV
FjWqNBsP1vctXDn/ra5FCf+gafFV+LUtiwpTs2PxnZjW9isI52Ptiu9oVhiaXDXtfjBxoNzr
azW7BV2pgs0nHCHgvaQQNZ+bnDuzYsE83auVxN8utP7vXb4J/Ovy+DgNkwKTCtNMwKxxXoww
QZj20GEilghNQgfz6dy41c2Z1Bo9P2Axtlf2JTBq/TL5TGVAFXQ7/mKEmS8yoYIBD6tU34RS
7txx4enVQiaD12JirzfMaZOmUrUVbz1aboTTrPWs3w78l/ezBOzhwYGHuSnGdUqOEfbAe399
2n3hvfQDnr7dDlJn4v4+coKKAQRP9UH9aKIqZnoa6w1MjV1a3OsHL3ZJkAw0uNdxA3CxE6hs
0sMMdKv3+9vzIQObbk4aSobT8cDgPFchV/V/ZmVE8P2Tq+aQpoC5Z/lq/5gyEgugcabSnII6
51lW9bTpmQZ1GGZ8cADMOAzAFSdhP1Hh4bpKZL9Hb5pzKx2lKP5QYz9sfaJw3phUk1nPrm1V
Z2Mzo/6cFmOJKWpSzNKWObnqeKjXzpDwie36CRJfNq9VRi4GXSjPd7WpUcZMuyKk1jfKTMtI
lK9wbqv+yM+vzy9+PToffvCxxp4lcXp7g+FU+p/4UIQMYunXIDZsQbe2jHupD/ygKvVwqT0H
Z6uR78PzAAmNVIjcl0elWwnYN0WgXwp1r9o4NF0XHEK/DSXObwq9AbxGAfZWyaxpQn0n5o/5
tKXj5DP7HeNjOoShlPaqOZC3iVMMznFEPQHraHXDECqdy9RC32jyVC3v7LhTpPH9TR6jmHMx
m7cuFRZfUZvUxnztADyYco4J11tl5tjvHReR8Usu8gLTpus4p3YF7hhBcz6I8ynTQM+NKQbm
ni65sxBwiBza9dmizcqwj9XNotWu1N6uBscnw1eNhkNN+bk2b7log5tOcdErxEOTKjW2yuc0
Hp9KmFJlGbUd/ODbxf1P3LNbMw4HtVGzBf+Tw1XTH3hwblBfrtVs47NKcuOR2I+s6K5buI3z
HgD+BC+e7fb70C4PyUq7W0sJwjxQSqO2sNa6HjOu5gwkD/0IjlPKEGv14ll/64by83VMbTOa
EiRtyKBG8Z810mrkKyb6uIV+2xy5V4LRO7JdIW5cm+3ZJox9HY8fN3CzMEb2Q3vouDH57Lo5
sdPIL2XiUSYp1Gau5yw+p9u6CEMcGhd0ak/L5DINbAqUSRbqXyt3GZr5NCJu23WJr/Q8yvC3
Mc87tQkW1UhVEwNWZ/rHapEmSkTszAhsAPsCppkcl8nGt/uFgU9V9toX+z2xlkTaCjdRTfpL
O1ld+UHm8s3Wo28N4S/1PC0sboXOTswZmEXMm2hyuF6U2RMeetdo1Z2qbCZyuhRAcQLOhhdk
iqZEOEOZq8ScBpoLAJZSTKODVOY9Mth6rUaOCBPxHHeHYQHKsGBfWxpcjeIW4+4GeX5ToePk
1aqi6SIIsXHX3FD9HNFhIr3xL/yOebvXeIk1M3VUw2mBCYyeJ3Heojcd2MHIM/DbnX7nWQnC
bQKH8I/urBt9vH4zwDyXanazdMCILYBjLQFY3tprOvlybi4dDbwtOzSVCV862u0/xaf96dbh
8dnw1fnR2duTq/0ePv7ww8b+/PD6zdkQhhen178dXZ0go+Dy6uJfZ8cnx3A0pMejd8dwenEF
p1cnJwFcvzmBo/fXb3DAYaMpf/C0o/NzOD27fncyHDLIEVweXV2fvXp/fnQFl++vLi+GiOLs
Hby7gJN/nby7huEbgqkh/fUEzs+Ofj0/MQgQ8fHR26PXJ0P47c3R9fACwXD46mx49u41YaIZ
vx39ARfvr+HilDG9H56Yr7V9BabD8cPZbK4yLCnyAVxJNPN9OTv8J4Z3VEetC6n3ezgAI0m5
qz0IMqe/SYGeKKBmGXENmffbVHDnU0CzQ/ayxto/VAEhFuJjTIvYo2QykXd0nnKWGk0kpcNf
g+LH/3qxvfV8j07pR2RqA7dckRziZxIf/ip0HNaBHzgJ/X1eIlKh7sm0J0YYQoJpPku8w78F
Th4B42aMZDKdl5nKFVYVf4+8ucXy1ylsYKgRiXEucYJ8oxaUvZ6VtxHgkoVdF+RFkbsbMSN1
X1cJWMRJAgm6QbreMOPjMAx35hjLNqLql+zK623TTBWTKaMsb211czEKAAkqL7WR9ri7OkAu
3JBRLU95atG4YpcvFCR8tS4nFeUUm8+/YR8dk0onhysH3fs9++Yrt/FgzUW8rr2JB0TvkvwV
Q/MNPMw/mPDaTTxoOYMQiVYgoghmZGcr9JgOlOL7YXwYo9sB31AqCSgX52SfFtVTVSSRwWzS
K96Aa8eVV8ko9JTMJAbiZpeWVUWca3OVJJUy0kHJsV/ZIVRsogXRlpdku2tpctpi+depNCOX
2krTTS0PaXTB17fIr5hzMF06nPnhmZFMKWtpPMp3yJSVoePcFLmshhhTlZuedYuVRPCJahuK
uUqhvp3awbJmmp1+ohxjmsTYWiSlhEorBLxDFrWrrc+rBAfEOLcqXqoRLl1Zh7RgJB0MGeUh
Uyopp6QLhKiSpj/9UFHdETUfTTGgzslIM2lYF1E16c71WdvpLV1CHKPUiXck1sXU3k+cSr5z
KnE3kVEO2oe5fGreRjZpdO9LoQvOt8GQSI3aggZya013mPci143iptb552xngI4LlXVmNkE0
mnuutxiqaOJOf6+9Eoz4GLDOi0SpW5T+relPLco5dN1Ipblo+jjq47p2OZbUrlPPvfIVhxen
1AEtA5RyAeqIbvXe0gY53D1yO8u4I2ul47KRTS1FhDSXCOrhpMLq1J0aS5WGq1SWy5RtuBZb
Et1n1Bzm2UeZ+O6OlTqrNOA+Q3eHdUSJ+DoqGFV5tpPbTOAcNYTc3hCHb8mgaFXkvFlzKihX
oHq8y1mfgyKlti5pXOTkAQzh1p+F6s44QVyQ28whGpK4E3Ei+IKF7RUEmGtREQtvGydQLKsR
+TnuWEeBO7uqNhyaS1Bu0zTHeWlzPs2my26V5CMA8Y9lRtFmhXm1otNGn6lAntAWR1KaSGbu
WtF2+cTsdz5xwNDwXkusFGv3BEuD4GBk3QYy/1bKeXmjha+qkttvrFqHNkQG7TLyqzLyNxM/
awhlruVU7ZXxt+aiX65y5gcWrBgQokGlg9d2R93mGSBKWNGVHY5FNOBOSMqgyDcY8LcwDOCb
RHHutsJRZoZaY4INmg9FGjJfkoDQrrA2VsoheqoyZOjZuHJGrHxGZ0PyyuBiSKY7Nm9ZmiP8
Bxcznc0jTbWYyqFThKHKInsJh1eKpI4xywke5lgrHL0UWmN4i4DSRDRF5FV5flVpbN2V1fjs
9lVaH3X1jHCcljtg6q3xLtzCNlej8l6hHmvqbZDF2WDNvcLSkVAWo8t1A7gY48aLTBNRaSgb
VJj1TZiZ29115+XuavJmDz3TMrlzmzVQxkbgLhOLpH4+OWDFMt9HKmdJMmOoK09Kvt3fo+5h
rPnaP49s7bHDN7ew4oSVib1PhsNYWk/oxhvJOPu2rIbkeuiGl5g4gi2pD7m9KipLHoLGKUcS
OiupSMykdX5r8UDLXSZgKN4RvX6jZrLLhy5qTHpPaOZuhTaZEzonVmj2WUioySMNlsaCbGAM
n6m72IyYrNyoPV2apzT2Xszm7GvR39yZxTVJKJQZBVH3wkEBOiZUF2f1Znq5FtmdubBqsnW6
Wt/ly8VAl4wAi6o7uVad3aFUXWb2v/zMoqf8bRur/+fPnz6Nnj/vb0e745/726PnT0dbO9HO
btgfb/dfhN7el/8FdE50Z6s0AAA=Offline
#107 2008-03-25 09:39:26
Re: asy_sitemap: Google-Sitemap (as-is/for developers)
jm – does new version have new features or bug fixes except add_privs()?
Providing help in hacking ATM! Come to courses and don’t forget to bring us notebook and hammer! What for notebook? What a kind of hacker you are without notebok?
Offline
#108 2008-03-28 02:52:23
Re: asy_sitemap: Google-Sitemap (as-is/for developers)
Just add_privs. I don’t actually use it, but “corporal_clegg” on IRC and a few forum members were having problems on Dreamhost. Any specific bugs (too lazy to read the forum thread)?
Offline
#109 2008-04-01 01:17:49
- kevinpotts
- Member
- From: Ghost Coast
- Registered: 2004-12-07
- Posts: 370
Re: asy_sitemap: Google-Sitemap (as-is/for developers)
jm wrote:
Since Dreamhost users have been having problems editing the plugin, here’s a 4.0.6-compatible version:
Thanks for this. Appreciated.
BTW, my offer to pay someone to enhance this plugin stands. Just ping me either here or on my e-mail.
Last edited by kevinpotts (2008-04-01 01:29:25)
Kevin
(graphicpush)
Offline
#110 2008-04-01 02:00:25
Re: asy_sitemap: Google-Sitemap (as-is/for developers)
I’ll give it a shot. What are the current bugs and desired features?
Offline
#111 2008-04-01 02:06:23
- kevinpotts
- Member
- From: Ghost Coast
- Registered: 2004-12-07
- Posts: 370
Re: asy_sitemap: Google-Sitemap (as-is/for developers)
Whatever the community desires, I think. For me personally, there are three essentials:
- 4.0.6 compatible out of the box — no hacks
- Follows Google’s protocol exactly (I don’t want to worry whether it works or not)
- Select which sections are included / excluded from the rendered sitemap
My ideal situation is to produce a new version (jmd_you_r_awesome, or whatever) and kill asy_sitemap since development has obviously ceased.
Last edited by kevinpotts (2008-04-01 02:07:53)
Kevin
(graphicpush)
Offline
#112 2008-04-01 04:35:23
Re: asy_sitemap: Google-Sitemap (as-is/for developers)
- Correct auto-update of sitemap after article update and new article creation
- Ping google not every update, but accumulate all changes and make ping every n-hours, for example every 25 hours (to prevent google think that we are spammers :)
- Show some stat page where the amount of links in sitemap can be seen – would be ideal to show a liitle mention of update on article page, somewhere in the bottom of the page
Last edited by the_ghost (2008-04-01 04:36:41)
Providing help in hacking ATM! Come to courses and don’t forget to bring us notebook and hammer! What for notebook? What a kind of hacker you are without notebok?
Offline
#113 2008-04-01 05:07:34
Re: asy_sitemap: Google-Sitemap (as-is/for developers)
Thanks for the input guys. So we’ve got:
- 4.0.6 compatibility
- Follow sitemaps.org protocol
- Exclude sections
- Update sitemap after each article creation and modification
- Delayed pinging
- Stats page
#2: I think priority shouldn’t be included for individual articles – it’s an optional element that’s prone to overuse. However, priority for each section might be useful. Yay or nay?
#3: How do you want this displayed? The simplest method would be a multiselect, but if we introduce priority, we would need something akin to the presentation>sections tab (hopefully not a giant vertical page).
- & #6: Since cron isn’t a user-friendly option, I’ll create a database table that stores the following info:
- Time since last ping
- Number of links
- Last update/regeneration
So at each generation, a query would run to check the last time, and if it met or exceeded n hours (set in prefs), it would ping google. As the sitemap was being generated, the number of links/@urls@ would be stored alongside the lastmod of the last article.
Offline
#114 2008-04-01 08:45:21
Re: asy_sitemap: Google-Sitemap (as-is/for developers)
jm
Cool that you’re getting things moving on this plugin. Perhaps my post on the subject was too big and people couldn’t be arsed to read it ;-)
I still don’t see how this plugin helps search engines and would love someone to explain whether a sitemap is a statement of intent or fact and give some concrete examples of how it helps Googlebot index a site better; imo it does an admirable job on its own if you get your SEO right.
As for features, would it make sense to get the plugin to learn and adapt the priority/frequency based on frequency of updates in a section? It seems at the moment it just sets the update frequency to a fixed amount, which is surely unwise given the vast array of sites out there. For example: why should a blog post be set to change frequently? Once it’s posted, that’s pretty much it, right? (not counting comments and a couple of edits). And after the comments have expired and the article is no longer modified, why should the sitemap remain set to update the article frequently? It has essentially become a static page.
Also, without setting priority there’s no way for bots to judge the relative importance of pages or sections so people might as well leave the bot alone to do its crawly stuff without trying to give it misguided hints. Or am I wrong? (… probably!)
In terms of plugin usability I still think all XML/robots.txt and config files should be updated automatically by the plugin. There’s too much intervention and messing around with FTP required right now (points 9 and 10 in my original post). This should be fairly easy to achieve.
It’s great that you’re willing to tackle this, jm. I did some preliminary work on updating it a while ago, but since very few said what they wanted it to actually do and whether it was truly useful, I gave up trying to guess! Shoot me a mail if you wanna chat about what I tried (it wasn’t much, but might help).
The smd plugin menagerie — for when you need one more gribble of power from Textpattern. Bleeding-edge code available on GitHub.
Hire Txp Builders – finely-crafted code, design and Txp
Offline
#115 2008-04-01 09:43:15
Re: asy_sitemap: Google-Sitemap (as-is/for developers)
Only one quickie:
A permanently pinging of the sitemap.xml or gz-compressed is not needed. If you have once pinged google and/or have used the webmastertools and/or showed the place of the sitemap in the robots.txt so no further ping is necessary. Google does his job by itself.
And: A sitemap.xml only makes sense, if you have many sites (blog or portal or something else) and these sites are not link anywhere in your website so googlebot can’t follow the link. If you have an archive site or a sitemap site so the googlebot can follow these links and no sitemap.xml is needed.
Last edited by trenc (2008-04-01 09:44:17)
Digital nomad, sailing the world on a sailboat: 32fthome.com
Offline
#116 2008-04-01 10:12:38
Re: asy_sitemap: Google-Sitemap (as-is/for developers)
trenc
That’s how I interpreted the spec too. Once the bot knows of the existence of the sitemap (via robots.txt or a ping) it’ll read it in future. And, iirc, each time it reads it, the frequencies and priorities in the sitemap tell it what has changed and what’s more important to index. Hence, keeping all priorities and frequencies the same adds no value.
A sitemap.xml only makes sense, if you have many sites… and these sites are not link anywhere in your website so googlebot can’t follow the link.
I agree. Maybe I’ve missed something, but I can’t see the need for a sitemap in most ordinary web site situations. I’d love to hear how it helps people with a TXP site because, on the surface, it seems a lot of hassle for minimum return…
The smd plugin menagerie — for when you need one more gribble of power from Textpattern. Bleeding-edge code available on GitHub.
Hire Txp Builders – finely-crafted code, design and Txp
Offline
#117 2008-04-01 11:40:57
Re: asy_sitemap: Google-Sitemap (as-is/for developers)
Bloke schrieb:
And, iirc, each time it reads it, the frequencies and priorities in the sitemap tell it what has changed and what’s more important to index. Hence, keeping all priorities and frequencies the same adds no value.
All the priority and frequency stuff are only a guiding principle not a rule. In the end google mainly decide these by real the posting frequency, last modified header data, similarity with other sites of the website, importance, trust for searchers and other websites etc. pp. So the googlebot can visit a blog 30 times a day another once a week and a normal website once in a month. It’will not really depending on a sitemap – it’s a decision by google.
If I would know the google algorithm… holy moly… I would be a millionaire or even more. :)
But i’ve find out that, at least, the order in the serps of a site:domain.tld query depends a little bit on the given sitemap. But – cui bono?
Digital nomad, sailing the world on a sailboat: 32fthome.com
Offline
#118 2008-04-01 13:49:59
- kevinpotts
- Member
- From: Ghost Coast
- Registered: 2004-12-07
- Posts: 370
Re: asy_sitemap: Google-Sitemap (as-is/for developers)
jm wrote:
Thanks for the input guys. So we’ve got …
Thanks again for taking this on. While I can offer no assistance in the programming, I would be happy to help with any interface design or usability, and of course I would be happy to be a beta tester.
Kevin
(graphicpush)
Offline
#119 2008-04-01 14:12:16
Re: asy_sitemap: Google-Sitemap (as-is/for developers)
(Bloke) …I can’t see the need for a sitemap in most ordinary web site situations. I’d love to hear how it helps people with a TXP site…
- 1 article (updated), one section, five tags, two categories = eight pages = 1 actual article entry on top of the sitemap = fast indexing of the article
Below the line a sitemap adds some priority/recommendation what to index first.
Btw. JM: 5. Delayed pinging
6. Stats page
I would not need that and I would love it only as an optional feature with a switch (On/Off).
Get all online mentions of Textpattern via OPML subscription: TXP Info Sources: Textpattern RSS feeds as dynamic OPML
Offline
#120 2008-04-01 18:25:34
Re: asy_sitemap: Google-Sitemap (as-is/for developers)
Bloke wrote:
I still don’t see how this plugin helps search engines and would love someone to explain whether a sitemap is a statement of intent or fact and give some concrete examples of how it helps Googlebot index a site better; imo it does an admirable job on its own if you get your SEO right.
- Your site has dynamic content.
- Your site has pages that aren’t easily discovered by Googlebot during the crawl process – for example, pages featuring rich AJAX or Flash.
- Your site is new and has few links to it. (Googlebot crawls the web by following links from one page to another, so if your site isn’t well linked, it may be hard for us to discover it.)
- Your site has a large archive of content pages that are not well linked to each other, or are not linked at all.
The last point makes sense to me. On one site I developed, the archive is the only way to find other articles – the authors never link to each other.
As for features, would it make sense to get the plugin to learn and adapt the priority/frequency based on frequency of updates in a section?
That sounds like a good idea for section frequency. I do agree with trenc’s point about lastmod at least for articles. Setting a high changefreq/article is a little reminiscent of the revisit-after meta tag.
Also, without setting priority there’s no way for bots to judge the relative importance of pages or sections so people might as well leave the bot alone to do its crawly stuff without trying to give it misguided hints.
Yeah after a little more reading, it seems the only time it would play a role is for pages of similar content. Even then, I strongly doubt an arbitrary priority is going to affect the crawler. Since it’s optional, I’m not going to include it in the release.
Shoot me a mail if you wanna chat about what I tried (it wasn’t much, but might help).
I probably will soon :). I’m starting from scratch initially (code-onset OCD), then I’ll take a look at the existing asy_sitemap for ideas.
trenc wrote:
A permanently pinging of the sitemap.xml or gz-compressed is not needed.
Hey, that’s good to know. I saw the robots.txt mention in the protocol, so that seems like a good way to go (or w/webmaster tools). I haven’t used webmaster tools in a few years, but doesn’t it let you point to a sitemap? Seems that would eliminate the need for any kind of pinging mechanism.
Offline