How do I block referrers from domain extensions?

colak · 2017-04-19 15:38:51

I am getting a lot of spam referrers from .porn and .taxi domain extensions. As both of those handles are irrelevant to our sites, I’m trying to figure out how to block all referrers from them.

Can anyone give me some pointers?

philwareham · 2017-04-19 15:44:48

You can do that in the .htaccess file, see here

colak · 2017-04-19 16:23:15

Hi Phil… Thanks for the link. I am currently using another method which does not need all the backslashes but the list is getting very big. As such I am trying to find a way to block all referrers who use .porn and .taxi extensions. Although I am all too aware that this is a losing battle I am not giving up just yet:)

GugUser · 2017-04-19 16:28:32

On this website perishablepress.com you can also find many tips.

colak · 2017-04-19 17:02:25

GugUser wrote #305397:

On this website perishablepress.com you can also find many tips.

That’s for query strings :(

GugUser · 2017-04-19 17:45:13

I know, but on the same site you can find many other tips.

colak · 2017-04-20 05:57:57

GugUser wrote #305401:

I know, but on the same site you can find many other tips.

Thanks… I looked through it and did not find anything. I guess with the proliferation of new domain extensions, it will be just a matter of time before a blocking solution will turn up.

gaekwad · 2017-04-20 11:17:04

Yiannis, are you using purely Textpattern access/referrer stats, or another product/service?

colak · 2017-04-20 11:55:33

Hi Pete,

I’m using slimstat & google analytics. The issue though is not only the stats but also the bandwidth. 3 days ago I got about 1600 ‘page views’ (within 20 minutes) from various .porn and .taxi spam referrers. This is basically the reason I want to block both extensions in the htaccess file.

gaekwad · 2017-04-21 08:41:06

colak wrote #305408:

This is basically the reason I want to block both extensions in the htaccess file.

Forgive me if I’m covering well-trodden ground: have you thought about Cloudflare? Cuts back on the bots significantly and has other benefits, too. The $20/month plan may well save you some hours and pay for itself.

colak · 2017-04-21 09:35:25

gaekwad wrote #305422:

Forgive me if I’m covering well-trodden ground: have you thought about Cloudflare? Cuts back on the bots significantly and has other benefits, too. The $20/month plan may well save you some hours and pay for itself.

It’s a personal dislike

colak · 2017-05-15 16:54:52

Got it! Here is the directives should anybody need it but do use with care. The site I am implementing this on, has low traffic and no known links from these domains.

RewriteEngine on
RewriteCond %{HTTP_REFERER} ^http(s)?://[^/]+\.adult/? [NC,OR]
RewriteCond %{HTTP_REFERER} ^http(s)?://[^/]+\.kz/? [NC,OR]
RewriteCond %{HTTP_REFERER} ^http(s)?://[^/]+\.porn/? [NC,OR]
RewriteCond %{HTTP_REFERER} ^http(s)?://[^/]+\.pro/? [NC,OR]
# RewriteCond %{HTTP_REFERER} ^http(s)?://[^/]+\.ru/? [NC,OR]
# How can I exclude yandex.ru from here?
RewriteCond %{HTTP_REFERER} ^http(s)?://[^/]+\.taxi/? [NC,OR]
RewriteCond %{HTTP_REFERER} ^http(s)?://[^/]+\.top/? [NC,OR]
RewriteCond %{HTTP_REFERER} ^http(s)?://[^/]+\.ua/? [NC,OR]
RewriteCond %{HTTP_REFERER} ^http(s)?://[^/]+\.xyz/? [NC]
RewriteRule .* http://127.0.0.1/ [R,L]

Textpattern CMS

Textpattern CMS support forum

#1 2017-04-19 15:38:51