Go to main content

Textpattern CMS support forum

You are not logged in. Register | Login | Help

#13 2025-09-20 16:28:46

colak
Admin
From: Cyprus
Registered: 2004-11-20
Posts: 9,260
Website GitHub Mastodon Twitter

Re: Referrer spam

skewray wrote #340572:

I suspect these hits are Google Cloud, not fake IPs. FYI, my ham-handed solution :

# Google AS15169 Evil=96.2% 2025-08-27 Warning: May block Google employees....

The ranges are not a complete set, just what I’ve seen on my site. If I get the cookie thing working, I may rip this sort of stuff out. It is a bit labor intensive to create.

Thanks so much. I’ll look into it tomorrow when I’m fresh. Meanwhile, I have halved the speeds and added an apology to all the pages of the website.

I do not think that there are for LLMs as they also list a referrer sites such as techcrunch, sears, etc. I do not think that bonafide LLM bots would do that, although I may be wrong.

<IfModule ratelimit_module>
SetOutputFilter RATE_LIMIT
SetEnv rate-limit 50
SetEnv rate-initial-burst 200
</IfModule>

Yiannis
——————————
NeMe | hblack.art | EMAP | A Sea change | Toolkit of Care
I do my best editing after I click on the submit button.

Offline

#14 2025-09-20 16:45:15

skewray
Member
From: Sunny Southern California
Registered: 2013-04-25
Posts: 259
Website Mastodon

Re: Referrer spam

What I’ve been seeing recently are bursts of hits, but each one is from not only different IPs, but from all over the world. Not referrer spam, though; I haven’t seen any of that in years. Whoever is crawling my site, for whatever reason, is renting a cloud server somewhere, doing a bunch of single-access drive-by hits, and then closing it down. Multiplied by thousands. Very sly.

Sometimes these clusters have a central country of origin. Since I’ve shut down the US, then it was China, then India, then Brazil, then Vietnam. Whoever this is, they use cloud+ISP companies, so just blocking the entire ASN isn’t worth it.

Online

#15 2025-09-20 16:45:30

gaekwad
Server grease monkey
From: People's Republic of Cornwall
Registered: 2005-11-19
Posts: 4,491
Bitbucket GitHub

Re: Referrer spam

colak wrote #340566:

Edited to add that ratelimit_module has reduced the speed of the bots dramatically.

Excellent!

Offline

#16 2025-09-20 17:58:12

vistopher
Plugin Author
Registered: 2025-09-15
Posts: 9
Website GitHub

Re: Referrer spam

colak wrote #340570:

Maybe I should wait until then?

No guarantee I will update it with any speed.. the plugin should still work after the modification so I’m not too concerned about updating it. Although it will be very nice for future plugins

Offline

#17 2025-09-21 04:31:10

colak
Admin
From: Cyprus
Registered: 2004-11-20
Posts: 9,260
Website GitHub Mastodon Twitter

Re: Referrer spam

vistopher wrote #340576:

No guarantee I will update it with any speed.. the plugin should still work after the modification so I’m not too concerned about updating it. Although it will be very nice for future plugins

Hi,

I installed and enabled the plugin, but I cannot see the IPs in admin > Visitor logs, but I do see them after clicking on the relevant table in rss_admin_db_manager.

I’m running the latest txp.


Yiannis
——————————
NeMe | hblack.art | EMAP | A Sea change | Toolkit of Care
I do my best editing after I click on the submit button.

Offline

#18 2025-09-21 05:12:09

colak
Admin
From: Cyprus
Registered: 2004-11-20
Posts: 9,260
Website GitHub Mastodon Twitter

Re: Referrer spam

skewray wrote #340572:

I suspect these hits are Google Cloud, not fake IPs. FYI, my ham-handed solution :

# Google AS15169 Evil=96.2% 2025-08-27 Warning: May block Google employees....

The ranges are not a complete set, just what I’ve seen on my site. If I get the cookie thing working, I may rip this sort of stuff out. It is a bit labor intensive to create.

The RewriteCond %{HTTP_USER_AGENT} directive returns a 500 for me:(


Yiannis
——————————
NeMe | hblack.art | EMAP | A Sea change | Toolkit of Care
I do my best editing after I click on the submit button.

Offline

#19 2025-09-21 05:41:37

colak
Admin
From: Cyprus
Registered: 2004-11-20
Posts: 9,260
Website GitHub Mastodon Twitter

Re: Referrer spam

I’ve been researching if I can apply the ratelimit_module only for specific IPs. At the moment it is a global directive which is not nice for legit visitors. No results were returned.


Yiannis
——————————
NeMe | hblack.art | EMAP | A Sea change | Toolkit of Care
I do my best editing after I click on the submit button.

Offline

#20 2025-09-21 19:07:49

vistopher
Plugin Author
Registered: 2025-09-15
Posts: 9
Website GitHub

Re: Referrer spam

colak wrote #340578:

Hi,

I installed and enabled the plugin, but I cannot see the IPs in admin > Visitor logs, but I do see them after clicking on the relevant table in rss_admin_db_manager.

I’m running the latest txp.

I’ve only tested it on 4.8.8, not the beta versions. I will try to install the latest beta tonight and see if what the issue is.

Offline

#21 Yesterday 03:33:27

colak
Admin
From: Cyprus
Registered: 2004-11-20
Posts: 9,260
Website GitHub Mastodon Twitter

Re: Referrer spam

It appears that all attacks come from ips belonging to google starting with 34.174. I’m very close to apply a Deny from 34.174. directive to up to 1 million users.


Yiannis
——————————
NeMe | hblack.art | EMAP | A Sea change | Toolkit of Care
I do my best editing after I click on the submit button.

Offline

#22 Yesterday 06:01:23

jakob
Admin
From: Germany
Registered: 2005-01-20
Posts: 5,001
Website GitHub

Re: Referrer spam

You are, it seems, not alone as many others are reporting similar activity from those IPs.


TXP Builders – finely-crafted code, design and txp

Offline

#23 Yesterday 08:13:02

colak
Admin
From: Cyprus
Registered: 2004-11-20
Posts: 9,260
Website GitHub Mastodon Twitter

Re: Referrer spam

jakob wrote #340593:

You are, it seems, not alone as many others are reporting similar activity from those IPs.

Thanks so much Julian, I’m glad I’m not the only one. I wrote to google and their form said that they would respond within a week. As others have the problem hopefully Google will take action.
Meanwhile, I’m denying access to every single ip that starts with 34.174.


Yiannis
——————————
NeMe | hblack.art | EMAP | A Sea change | Toolkit of Care
I do my best editing after I click on the submit button.

Offline

#24 Yesterday 13:49:10

vistopher
Plugin Author
Registered: 2025-09-15
Posts: 9
Website GitHub

Re: Referrer spam

colak wrote #340578:

Hi,

I installed and enabled the plugin, but I cannot see the IPs in admin > Visitor logs, but I do see them after clicking on the relevant table in rss_admin_db_manager.

I’m running the latest txp.

Alright, the github is updated and works with the 4.9.0 beta versions.

This is the change I had not accounted for:
  • Developer: ‘Visitor logs’ panel is now bound to the new ‘lore’ event name (was: ‘log’) to prevent conflicts with privacy filters.

Offline

Board footer

Powered by FluxBB