Textpattern CMS

#1 2008-06-04 17:16:02

crowleyr

Member

From: Tallinn

Registered: 2006-04-04

Posts: 27

googlebot pain...

oki…

i recently built a site for someone. whilst under development the client requested an “under construction come back in June” holding image on index.htm while i did my txp dev on a sub directory.

problem is that google has not re-crawled the fresh content… i have added robots.txt, re-submitted the url to google for inclusion, applied GoogleAnalytics validation etc… to no avail..

any ideas on how to ‘force’ a re-crawl of the content ??

#2 2008-06-04 17:22:20

maniqui

Member

From: Buenos Aires, Argentina

Registered: 2004-10-10

Posts: 3,070

Website

Re: googlebot pain...

A sitemap may help.

Also, check Google webmaster tools

Last edited by maniqui (2008-06-04 17:23:14)

---

La música ideas portará y siempre continuará

TXP Builders – finely-crafted code, design and txp

#3 2008-06-04 17:25:15

crowleyr

Member

From: Tallinn

Registered: 2006-04-04

Posts: 27

Re: googlebot pain...

added sitemap also.. (using the great jmd_sitemap plugin to generate the xml)

#4 2008-06-04 18:24:12

wet

Developer Emeritus

From: Schoerfling, Austria

Registered: 2005-06-06

Posts: 3,330

Website Mastodon

Re: googlebot pain...

The only thing which really helps is a link from a reputable site. Everything else are just placebos (especially the Google submission form).

#5 2008-06-04 18:24:41

hcgtv

Plugin Author

From: Key Largo, Florida

Registered: 2005-11-29

Posts: 2,722

Website

Re: googlebot pain...

You can put an adsense ad on the page, that will get the bots to notice your page, then you can take it off.

I have adsense on all my sites, not for the money but for how rapidly a post I make makes it to the search farm. I can make a post and in less than a half hour, it comes up on a search.

---

We Love TXP . TXP Themes . TXP Tags . TXP Planet . TXP Make

#6 2008-06-04 19:29:25

masa

Member

From: Asturias, Spain

Registered: 2005-11-25

Posts: 1,091

Re: googlebot pain...

wet wrote:

The only thing which really helps is a link from a reputable site.

I’m not so sure about that anymore.

I have had Txp sites under development repeatedly being visited by the bots practically from day one. These didn’t have more than the site title and a “coming soon” notice on the front page, but preferably I put up a textual summary of what the site will be about.

#7 2008-06-04 19:31:51

crowleyr

Member

From: Tallinn

Registered: 2006-04-04

Posts: 27

Re: googlebot pain...

agree with masa – my previous txp deployments have attracted bots without even submitting url let alone being linked elsewhere.