Accessing TXP website via Proxy doesn't work

Karsten · 2015-10-02 08:39:12

Dear all,

I’m having problems getting my website to be accessible via a proxy. Part of our website is restricted to paying customers only. Visitors from the IP range of the customer network or visitors who access our website via the proxyserver of the customer network (a university library) should have access to our website. As such also students working from home should have access to our site when they visit it via the university proxyserver.

This however does not work.

Our TXP website uses the “permanent link mode” and the customer links to ourdomain.com/library/ this /library/ is a section in TXP and not an actual folder on the server. Apparently this doesn’t work > result a 403 error.

__________________

Forbidden

You don’t have permission to access /library/ on this server.
Apache/2.4.10 (Debian) Server at www.mydomain.com Port 443

__________________

If they link to ourdomain.com/ and subsequently click on a <a href link to ourdomain/library/ it does work. After that the /library/ is in the user’s cache and also the direct link suddenly works.

Doens anyone have a suggestion how the ourdomain.com/library/ link could work for new users via the proxy?

Perhaps it has something to do with the .htaccess that is required in the root of our domain when you use the permament link mode of TXP?

An additional question is if anyone knows why accessing our TXP site via this proxy is going really really slowly. Other sites load with normal speed, but if you access ourdomain.com via this proxy the site is very very slow.

Any suggestions how we could get this to work?

Last edited by Karsten (2015-10-02 09:41:36)

Karsten · 2015-10-02 10:03:33

So when I link to

http://proxy-ub.com/login?url=https://www.mydomain.com/library/

it doesn’t work

however

http://proxy-ub.com/login?url=https://www.mydomain.com/library/index.php

does seem to work, albeit very very very slowly.

perhaps this has something to do, or with not correctly working of, the htaccess script that TXP want me to use:

#DirectoryIndex index.php index.html

#Options +FollowSymLinks
#Options -Indexes
#ErrorDocument 403 default

<IfModule mod_rewrite.c>
	RewriteEngine On
	#RewriteBase /relative/web/path/

	RewriteCond %{REQUEST_FILENAME} -f [OR]
	RewriteCond %{REQUEST_FILENAME} -d
	RewriteRule ^(.+) - [PT,L]

	RewriteCond %{REQUEST_URI} !=/favicon.ico
	RewriteRule ^(.*) index.php

	RewriteCond %{HTTP:Authorization}  !^$
	RewriteRule .* - [E=REMOTE_USER:%{HTTP:Authorization}]
</IfModule>

#php_value register_globals 0

# SVG
AddType image/svg+xml  svg svgz
AddEncoding gzip       svgz

??? anyone?

Destry · 2015-10-02 11:45:36

I can’t give you an answer, because I don’t know, but if someone does know they will certainly chime in. You just have to be patient. People on different sides of the world waking and sleeping, and all that. ;)

colak · 2015-10-02 11:50:29

Is the speed problem with the proxy rather than txp?
What happens if you go to http://proxy-ub.com/login?url=http://wired.com ?

Karsten · 2015-10-02 12:57:16

Hi Yiannis,

proxy should work fine, they use it for all via campus access to third parties, other sites load normal speed, our site is extremely slow and doesn’t automatically pick ip ../library/ but will take /library/index.php which should normally be arranged bu the htaccess file in use for permanent link mode websites.

Karsten · 2015-10-02 12:58:52

Can’t actually test other sites as proxy is set up to only be able to contact sites they green-lighted

colak · 2015-10-02 16:19:10

Hi Karsten,

I am not certain if it will help but could you post the diagnostics of your website here? Hopefully one of our devs or plugin authors might spot something which will be of help.

Karsten · 2015-10-06 15:10:15

Pre-flight check

The following PHP functions (which may be necessary to run Textpattern) are disabled on your server: pcntl_alarm, pcntl_fork, pcntl_waitpid, pcntl_wait, pcntl_wifexited, pcntl_wifstopped, pcntl_wifsignaled, pcntl_wexitstatus, pcntl_wtermsig, pcntl_wstopsig, pcntl_signal, pcntl_signal_dispatch, pcntl_get_last_error, pcntl_strerror, pcntl_sigprocmask, pcntl_sigwaitinfo, pcntl_sigtimedwait, pcntl_exec, pcntl_getpriority, pcntl_setpriority,

Diagnostics:

Textpattern version: 4.5.7 (r5900)
Last update: 2015-08-17 09:46:53/2015-08-17 09:40:38
Document root: /data/web/sidestone/www.sidestone.com/ (/data/web/sidestone/www.sidestone.com)
$path_to_site: /data/web/sidestone/www.sidestone.com
Textpattern path: /data/web/sidestone/www.sidestone.com/textpattern
Permanent link mode: section_title
open_basedir: /data/web/sidestone/www.sidestone.com:/usr/local/lib/php/:/tmp
Temporary directory path: /data/web/sidestone/www.sidestone.com/textpattern/tmp
Site URL: www.sidestone.com
PHP version: 5.6.9-0+deb8u1
GD Graphics Library: 2.1.1-dev; supported formats: GIF, JPG, PNG.
Server TZ: Europe/Berlin
Server local time: 2015-10-06 17:07:39
DST enabled?: 1
Automatically adjust DST setting?: 1
Time zone: Europe/Amsterdam (3600)
MySQL: 5.5.44-0+deb8u1
Locale: C
Server: Apache/2.4.10 (Debian)
Apache version: Apache/2.4.10 (Debian)
PHP server API: apache2handler
RFC 2616 headers: 
Server OS: Linux 3.16.0-4-amd64
Active plugins: rvm_if_this_article-0.1, zem_contact_lang-4.0.3.6m, zem_contact_reborn-4.0.3.20m, pap_contact_cleaner-0.1, rss_auto_excerpt-0.5, wet_if_page-0.1, smd_if-0.91, rah_replace-0.3, rah_metas-1.4, adi_mobile-0.2, etc_pagination-0.4.2, etc_query-1.2.6, rah_ip_range-0.4, ebl-image-edit-1.0, upm_image-0.6.2, soo_page_numbers-0.3.0, upm_insert_tab-0.3, upm_savenew-0.4.2m, soo_txp_obj-1.1.0, smd_where_used-0.30, smd_browse_by-0.10, yab_copy_to_new-0.2, rah_textile_bar-0.7, glz_custom_fields-1.4.0-beta
Admin-side theme: classic 4.5.7

Pre-flight check: 
------------------------
The following PHP functions (which may be necessary to run Textpattern) are disabled on your server: pcntl_alarm, pcntl_fork, pcntl_waitpid, pcntl_wait, pcntl_wifexited, pcntl_wifstopped, pcntl_wifsignaled, pcntl_wexitstatus, pcntl_wtermsig, pcntl_wstopsig, pcntl_signal, pcntl_signal_dispatch, pcntl_get_last_error, pcntl_strerror, pcntl_sigprocmask, pcntl_sigwaitinfo, pcntl_sigtimedwait, pcntl_exec, pcntl_getpriority, pcntl_setpriority, 
------------------------

<code>.htaccess</code> file contents: 
------------------------
#DirectoryIndex index.php index.html

#Options +FollowSymLinks
#Options -Indexes
#ErrorDocument 403 default

<IfModule mod_rewrite.c>
	RewriteEngine On
	#RewriteBase /relative/web/path/

	RewriteCond %{REQUEST_FILENAME} -f [OR]
	RewriteCond %{REQUEST_FILENAME} -d
	RewriteRule ^(.+) - [PT,L]

	RewriteCond %{REQUEST_URI} !=/favicon.ico
	RewriteRule ^(.*) index.php

	RewriteCond %{HTTP:Authorization}  !^$
	RewriteRule .* - [E=REMOTE_USER:%{HTTP:Authorization}]
</IfModule>

#php_value register_globals 0

# SVG
AddType image/svg+xml  svg svgz
AddEncoding gzip       svgz


#above the htaccess lines from textpattern #




#below some URL redirects to correct for broken links/old ulrs #

RedirectMatch 301 ^/books/(.*)$ https://www.sidestone.com/bookshop/$1
RedirectMatch 301 ^/books/(.*)$ https://www.sidestone.com/bookshop/$1
RedirectMatch 301 ^/webshop/(.*)$ https://www.sidestone.com/bookshop/$1
RedirectMatch 301 ^/index_(.*)$ https://www.sidestone.com/bookshop/
RedirectMatch 301 ^/base_(.*)$ https://www.sidestone.com/bookshop/
RedirectMatch 301 ^/graat/(.*)$ https://www.sidestone.com/graat
RedirectMatch 301 ^/barendgraat/(.*)$ https://www.sidestone.com/graat
RedirectMatch 301 ^/schliemann/(.*)$ https://www.sidestone.com/schliemann
Redirect /schliemann https://www.sidestone.com/bookshop/?q=schliemanndiaries
Redirect /graat https://www.sidestone.com/bookshop/?q=barend+graat
Redirect /barendgraat https://www.sidestone.com/bookshop/?q=barend+graat
Redirect /libraryprogram https://www.sidestone.com/toolbox/sidestone-library-program


#below spamvisit blockers #

RewriteEngine on
# Options +FollowSymlinks
RewriteCond %{HTTP_REFERER} (\.ru) [NC,OR]
RewriteCond %{HTTP_REFERER} (prostitutki) [NC,OR]
RewriteCond %{HTTP_REFERER} (abtasty\.com) [NC,OR]
RewriteCond %{HTTP_REFERER} (viagra) [NC,OR]
RewriteCond %{HTTP_REFERER} (avtojur\.ru) [NC,OR]
RewriteCond %{HTTP_REFERER} (spatex\.ru) [NC,OR]
RewriteCond %{HTTP_REFERER} (sitetourism\.com) [NC,OR]
RewriteCond %{HTTP_REFERER} (mobile-phones) [NC,OR]
RewriteCond %{HTTP_REFERER} (nayra\.ru) [NC,OR]
RewriteCond %{HTTP_REFERER} (flash-igry) [NC,OR]
RewriteCond %{HTTP_REFERER} (robot-forex) [NC,OR]
RewriteCond %{HTTP_REFERER} (sportliga) [NC,OR]
RewriteCond %{HTTP_REFERER} (ru-tao) [NC,OR]
RewriteCond %{HTTP_REFERER} (tipkiller) [NC,OR]
RewriteCond %{HTTP_REFERER} (palevertel) [NC,OR]
RewriteCond %{HTTP_REFERER} (infoportnews) [NC,OR]
RewriteCond %{HTTP_REFERER} (xbox) [NC,OR]
RewriteCond %{HTTP_REFERER} (tipsoffice) [NC,OR]
RewriteCond %{HTTP_REFERER} (moesonce) [NC,OR]
RewriteCond %{HTTP_REFERER} (pornuck) [NC,OR]
RewriteCond %{HTTP_REFERER} (porn) [NC,OR]
RewriteCond %{HTTP_REFERER} (vetklinika) [NC,OR]
RewriteCond %{HTTP_REFERER} (zebradudka) [NC,OR]
RewriteCond %{HTTP_REFERER} (pets) [NC,OR]
RewriteCond %{HTTP_REFERER} (ruex) [NC,OR]
RewriteCond %{HTTP_REFERER} (soft-program) [NC,OR]
RewriteCond %{HTTP_REFERER} (game-top) [NC,OR]
RewriteCond %{HTTP_REFERER} (android-store) [NC,OR]
RewriteCond %{HTTP_REFERER} (profx) [NC,OR]
RewriteCond %{HTTP_REFERER} (samo-cvet) [NC,OR]
RewriteCond %{HTTP_REFERER} (atomenergy) [NC,OR]
RewriteCond %{HTTP_REFERER} (rusenvironmental\.net) [NC,OR]
RewriteCond %{HTTP_REFERER} (nalberan) [NC,OR]
RewriteCond %{HTTP_REFERER} (nayra\.ru) [NC,OR]
RewriteCond %{HTTP_REFERER} (banan\.tv) [NC,OR]
RewriteCond %{HTTP_REFERER} (semalt\.com) [NC,OR]
RewriteCond %{HTTP_REFERER} (4fup\.com) [NC,OR]
RewriteCond %{HTTP_REFERER} (houdom\.net) [NC,OR]
RewriteCond %{HTTP_REFERER} (vbabul\.net) [NC,OR]
RewriteCond %{HTTP_REFERER} (stazher\.com) [NC,OR]
RewriteCond %{HTTP_REFERER} (foxoweb\.org) [NC,OR]
RewriteCond %{HTTP_REFERER} (videokrik\.net) [NC,OR]
RewriteCond %{HTTP_REFERER} (pro-land\.su) [NC,OR]
RewriteCond %{HTTP_REFERER} (rangapoker\.com) [NC,OR]
RewriteCond %{HTTP_REFERER} (mirzonru\.net) [NC,OR]
RewriteCond %{HTTP_REFERER} (youdesigner\.kz) [NC,OR]
RewriteCond %{HTTP_REFERER} (anibox\.me) [NC,OR]
RewriteCond %{HTTP_REFERER} (siteexpress\.co.il) [NC,OR]
RewriteCond %{HTTP_REFERER} (world-mmo\.com) [NC,OR]
RewriteCond %{HTTP_REFERER} (chimiver) [NC,OR]
RewriteCond %{HTTP_REFERER} (thewomenlife) [NC,OR]
RewriteCond %{HTTP_REFERER} (minecraft) [NC,OR]
RewriteCond %{HTTP_REFERER} (jointpoint) [NC,OR]
RewriteCond %{HTTP_REFERER} (smart-halyava) [NC,OR]
RewriteCond %{HTTP_REFERER} (vse-v-internet) [NC,OR]
RewriteCond %{HTTP_REFERER} (av-host\net) [NC,OR]
RewriteCond %{HTTP_REFERER} (1kino) [NC,OR]
RewriteCond %{HTTP_REFERER} (eramebel) [NC,OR]
RewriteCond %{HTTP_REFERER} (xn--80ahdks) [NC,OR]
RewriteCond %{HTTP_REFERER} (sapio\by) [NC,OR]
RewriteCond %{HTTP_REFERER} (flowwwers) [NC,OR]
RewriteCond %{HTTP_REFERER} (bookmaker) [NC,OR]
RewriteCond %{HTTP_REFERER} (fairground) [NC,OR]
RewriteCond %{HTTP_REFERER} (xvideos) [NC,OR]
RewriteCond %{HTTP_REFERER} (watches) [NC,OR]
RewriteCond %{HTTP_REFERER} (ogli) [NC,OR]
RewriteCond %{HTTP_REFERER} (erotika) [NC,OR]
RewriteCond %{HTTP_REFERER} (credit-banki) [NC,OR]
RewriteCond %{HTTP_REFERER} (prank) [NC,OR]
RewriteCond %{HTTP_REFERER} (forex) [NC,OR]
RewriteCond %{HTTP_REFERER} (winterior) [NC,OR]
RewriteCond %{HTTP_REFERER} (kiprinform) [NC,OR]
RewriteCond %{HTTP_REFERER} (digitaljournals\.ru) [NC,OR]
RewriteCond %{HTTP_REFERER} (onlinekinovse\.ru) [NC,OR]
RewriteCond %{HTTP_REFERER} (www.plentagos\.com) [NC,OR]
RewriteCond %{HTTP_REFERER} (priora-2\.com) [NC,OR]
RewriteCond %{HTTP_REFERER} (xn--l1aengat.xn--p1ai) [NC,OR]
RewriteCond %{HTTP_REFERER} (getsport\.co.il) [NC,OR]
RewriteCond %{HTTP_REFERER} (buy-tramadolonline\.org) [NC,OR]
RewriteCond %{HTTP_REFERER} (www.avtoarenda\.by) [NC,OR]
RewriteCond %{HTTP_REFERER} (www.spy-sts\.com) [NC,OR]
RewriteCond %{HTTP_REFERER} (selectricscootershq\.org) [NC,OR]
RewriteCond %{HTTP_REFERER} (gametor\.su) [NC,OR]
RewriteCond %{HTTP_REFERER} (invetdollare\.net) [NC,OR]
RewriteCond %{HTTP_REFERER} (xn--80aaaks3bbhabgbigamdr2h.xn--p1ai) [NC,OR]
RewriteCond %{HTTP_REFERER} (oceasiberia\.net) [NC,OR]
RewriteCond %{HTTP_REFERER} (timetorelax\.biz) [NC,OR]
RewriteCond %{HTTP_REFERER} (looking-auto\.com) [NC,OR]
RewriteCond %{HTTP_REFERER} (stop-drugs\.net) [NC,OR]
RewriteCond %{HTTP_REFERER} (x-musics\.com) [NC,OR]
RewriteCond %{HTTP_REFERER} (zakazfutbolki\.com) [NC,OR]
RewriteCond %{HTTP_REFERER} (animebox.com\.ua) [NC,OR]
RewriteCond %{HTTP_REFERER} (beamfall\.info) [NC,OR]
RewriteCond %{HTTP_REFERER} (porno) [NC,OR]
RewriteCond %{HTTP_REFERER} (navro) [NC,OR]
RewriteCond %{HTTP_REFERER} (sexhd) [NC,OR]
RewriteCond %{HTTP_REFERER} (wma\.su) [NC,OR]
RewriteCond %{HTTP_REFERER} (lolitka) [NC,OR]
RewriteCond %{HTTP_REFERER} (prognoz) [NC,OR]
RewriteCond %{HTTP_REFERER} (lochka) [NC,OR]
RewriteCond %{HTTP_REFERER} (orgbase) [NC,OR]
RewriteCond %{HTTP_REFERER} (xxlslots) [NC,OR]
RewriteCond %{HTTP_REFERER} (pornoforadult\.com) [NC,OR]
RewriteCond %{HTTP_REFERER} (master-muznachas\.ru) [NC,OR]
RewriteCond %{HTTP_REFERER} (xn----7sbittjtdqw.xn--p1ai) [NC,OR]
RewriteCond %{HTTP_REFERER} (zl-news\.ru) [NC,OR]
RewriteCond %{HTTP_REFERER} (modamoda) [NC,OR]
RewriteCond %{HTTP_REFERER} (pronekut) [NC,OR]
RewriteCond %{HTTP_REFERER} (gelezki) [NC,OR]
RewriteCond %{HTTP_REFERER} (ublaze) [NC,OR]
RewriteCond %{HTTP_REFERER} (allkomplekt) [NC,OR]
RewriteCond %{HTTP_REFERER} (mirskidok) [NC,OR]
RewriteCond %{HTTP_REFERER} (lampokrat) [NC,OR]
RewriteCond %{HTTP_REFERER} (greenalco) [NC,OR]
RewriteCond %{HTTP_REFERER} (master-remont) [NC,OR]
RewriteCond %{HTTP_REFERER} (gasmin.dp) [NC,OR]
RewriteCond %{HTTP_REFERER} (e1agahwn) [NC,OR]
RewriteCond %{HTTP_REFERER} (les-femmes\.ru) [NC,OR]
RewriteCond %{HTTP_REFERER} (gvoz\.ru) [NC,OR]
RewriteCond %{HTTP_REFERER} (sergeisviridov) [NC,OR]
RewriteCond %{HTTP_REFERER} (komportal) [NC,OR]
RewriteCond %{HTTP_REFERER} (dmdpark) [NC,OR]
RewriteCond %{HTTP_REFERER} (fxclab) [NC,OR]
RewriteCond %{HTTP_REFERER} (matrix-of-money) [NC,OR]
RewriteCond %{HTTP_REFERER} (gryazeboy) [NC,OR]
RewriteCond %{HTTP_REFERER} (casino) [NC,OR]
RewriteCond %{HTTP_REFERER} (low-price-moscow-taxi) [NC,OR]
RewriteCond %{HTTP_REFERER} (cleaning-uborka) [NC,OR]
RewriteCond %{HTTP_REFERER} (ledotape) [NC,OR]
RewriteCond %{HTTP_REFERER} (posevogorod) [NC,OR]
RewriteCond %{HTTP_REFERER} (us-ds) [NC,OR]
RewriteCond %{HTTP_REFERER} (coachtopbags) [NC,OR]
RewriteCond %{HTTP_REFERER} (otoplenia) [NC,OR]
RewriteCond %{HTTP_REFERER} (nardulan) [NC,OR]
RewriteCond %{HTTP_REFERER} (sugarkun) [NC,OR]
RewriteCond %{HTTP_REFERER} (lenoreno) [NC,OR]
RewriteCond %{HTTP_REFERER} (moscow-clining) [NC,OR]
RewriteCond %{HTTP_REFERER} (est-otdyh) [NC,OR]
RewriteCond %{HTTP_REFERER} (best-hoster) [NC,OR]
RewriteCond %{HTTP_REFERER} (forexjobs) [NC,OR]
RewriteCond %{HTTP_REFERER} (lankarns) [NC,OR]
RewriteCond %{HTTP_REFERER} (randecan) [NC,OR]
RewriteCond %{HTTP_REFERER} (ledekole) [NC,OR]
RewriteCond %{HTTP_REFERER} (segway911) [NC,OR]
RewriteCond %{HTTP_REFERER} (lexon\.su) [NC,OR]
RewriteCond %{HTTP_REFERER} (casino) [NC,OR]
RewriteCond %{HTTP_REFERER} (moscow-taxi) [NC,OR]
RewriteCond %{HTTP_REFERER} (magazin-masterov) [NC,OR]
RewriteCond %{HTTP_REFERER} (worldsonew\.biz) [NC,OR]
RewriteCond %{HTTP_REFERER} (saminter.goodboard) [NC,OR]
RewriteCond %{HTTP_REFERER} (fastxak) [NC,OR]
RewriteCond %{HTTP_REFERER} (camcorderservice) [NC,OR]
RewriteCond %{HTTP_REFERER} (dveri-hammer) [NC,OR]
RewriteCond %{HTTP_REFERER} (profile-m) [NC,OR]
RewriteCond %{HTTP_REFERER} (gigtv) [NC,OR]
RewriteCond %{HTTP_REFERER} (assorti) [NC,OR]
RewriteCond %{HTTP_REFERER} (traveluar) [NC,OR]
RewriteCond %{HTTP_REFERER} (overseasfirstfederal) [NC,OR]
RewriteCond %{HTTP_REFERER} (fre4games) [NC,OR]
RewriteCond %{HTTP_REFERER} (free-bet) [NC,OR]
RewriteCond %{HTTP_REFERER} (atkinx) [NC,OR]
RewriteCond %{HTTP_REFERER} (mama-vartovsk) [NC,OR]
RewriteCond %{HTTP_REFERER} (alp100) [NC,OR]
RewriteCond %{HTTP_REFERER} (magazin-masterov) [NC,OR]
RewriteCond %{HTTP_REFERER} (www.biz-uspeh) [NC,OR]
RewriteCond %{HTTP_REFERER} (piratik) [NC,OR]
RewriteCond %{HTTP_REFERER} (saminter.goodboard) [NC,OR]
RewriteCond %{HTTP_REFERER} (vzlom-vk\.ru) [NC]
RewriteRule \.*$ - [F,L]




RewriteEngine On 
RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Bot\ mailto:craftbot@yahoo.com [OR] 
RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Custo [OR] 
RewriteCond %{HTTP_USER_AGENT} ^DISCo [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Download\ Demon [OR] 
RewriteCond %{HTTP_USER_AGENT} ^eCatch [OR] 
RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [OR] 
RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [OR] 
RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Express\ WebPictures [OR] 
RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR] 
RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [OR] 
RewriteCond %{HTTP_USER_AGENT} ^FlashGet [OR] 
RewriteCond %{HTTP_USER_AGENT} ^GetRight [OR] 
RewriteCond %{HTTP_USER_AGENT} ^GetWeb! [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [OR] 
RewriteCond %{HTTP_USER_AGENT} ^GrabNet [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Grafula [OR] 
RewriteCond %{HTTP_USER_AGENT} ^HMView [OR] 
RewriteCond %{HTTP_USER_AGENT} HTTrack [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^Image\ Stripper [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Image\ Sucker [OR] 
RewriteCond %{HTTP_USER_AGENT} Indy\ Library [NC,OR] 
RewriteCond %{HTTP_USER_AGENT} ^InterGET [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja [OR] 
RewriteCond %{HTTP_USER_AGENT} ^JetCar [OR] 
RewriteCond %{HTTP_USER_AGENT} ^JOC\ Web\ Spider [OR] 
RewriteCond %{HTTP_USER_AGENT} ^larbin [OR] 
RewriteCond %{HTTP_USER_AGENT} ^LeechFTP [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader [OR] 
RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Navroad [OR] 
RewriteCond %{HTTP_USER_AGENT} ^NearSite [OR] 
RewriteCond %{HTTP_USER_AGENT} ^NetAnts [OR] 
RewriteCond %{HTTP_USER_AGENT} ^NetSpider [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Net\ Vampire [OR] 
RewriteCond %{HTTP_USER_AGENT} ^NetZIP [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Octopus [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Navigator [OR] 
RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto [OR] 
RewriteCond %{HTTP_USER_AGENT} ^pavuk [OR] 
RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [OR] 
RewriteCond %{HTTP_USER_AGENT} ^RealDownload [OR] 
RewriteCond %{HTTP_USER_AGENT} ^ReGet [OR] 
RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger [OR] 
RewriteCond %{HTTP_USER_AGENT} ^SmartDownload [OR] 
RewriteCond %{HTTP_USER_AGENT} ^SuperBot [OR] 
RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Surfbot [OR] 
RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [OR] 
RewriteCond %{HTTP_USER_AGENT} ^VoidEYE [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebAuto [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebCopier [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebFetch [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebGo\ IS [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebLeacher [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebReaper [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebSauger [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Website\ eXtractor [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Website\ Quester [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebStripper [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WebZIP [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Wget [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Widow [OR] 
RewriteCond %{HTTP_USER_AGENT} ^WWWOFFLE [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Xaldon\ WebSpider [OR] 
RewriteCond %{HTTP_USER_AGENT} ^Zeus 
RewriteRule ^.* - [F,L]

Last edited by Karsten (2015-10-08 10:59:52)

etc · 2015-10-06 16:40:51

Karsten wrote #295326:

An additional question is if anyone knows why accessing our TXP site via this proxy is going really really slowly. Other sites load with normal speed, but if you access ourdomain.com via this proxy the site is very very slow.

Could it be that your spamblock list (in “advanced preferences”) is not empty? Or some plugin (etc_query, I’m looking at you) is trying to establish an outgoing connexion?

ruud · 2015-10-06 16:47:58

Karsten wrote #295326:

I’m having problems getting my website to be accessible via a proxy.

Can you also access the website without going via a proxy? If so, does it work quickly and without any errors?

Our TXP website uses the “permanent link mode” and the customer links to ourdomain.com/library/ this /library/ is a section in TXP and not an actual folder on the server. Apparently this doesn’t work > result a 403 error.
If they link to ourdomain.com/ and subsequently click on a <a href link to ourdomain/library/ it does work. After that the /library/ is in the user’s cache and also the direct link suddenly works.

What happens if you clear the browser cache and then restart the browser?

Check the apache error logs and access logs. Assuming it does work if you visit the site directly, it would be interesting to see what the difference is between with/without proxy in the log files. Perhaps that gives a clue as to what the cause is.

An additional question is if anyone knows why accessing our TXP site via this proxy is going really really slowly. Other sites load with normal speed, but if you access ourdomain.com via this proxy the site is very very slow.

Only via the proxy or also directly? Check the TXP preferences. There should be an option for name lookups. Disable that one. Or disable logging completely and see if that helps.

jakob · 2015-10-06 20:35:49

Not really on topic, but as an aside:

You should be able to simplify some of your redirects. I’ve not tried them in an actual htaccess, but the following patterns should group together what you currently have on several lines.

^/(books|webshop)/?(.*)$  https://www.sidestone.com/bookshop/$2
^/(index_|base_)(.*)$  https://www.sidestone.com/bookshop/
^/(barend)?graat/?(.*)$  https://www.sidestone.com/bookshop/?q=barend+graat
^/schliemann/?(.*)$  https://www.sidestone.com/?q=schliemanndiaries
^/libraryprogram$ https://www.sidestone.com/toolbox/sidestone-library-program

(you should be able to drop the second set of rewrites)

And you might be able to do your ISBN permlinks using txp to make them more maintainable by storing the ISBN with the article in a custom field. A couple of ideas (again without having tried them):

I’ve done something similar using gbp_permanent_links and a myword/custom_5/ rule, where “myword” can be anything (e.g. “permlink” or “isbn”) and custom_5 is the custom field in which the permlink is stored. gbp_permanent_links is a bit of a beast but can work well for such things. With this option you’d drop your permalink htaccess rewrites entirely.
Another option to explore could be rah_pathway (infos here). It’s not properly compiled so you have to install it by putting it in your plugin directory (as set in the advanced prefs). Like the first option, you designate a custom_field (assign it manually in the plugin code) and use that to store a permlink of your choosing with the article. What I don’t know with that plugin is whether the normal article_url_title still works as usual (but I would guess so. Try it first). With this option you’d also drop your permalink htaccess rewrites entirely.
You could use a single htaccess rule in place, e.g. ^/permlink/(.*)$ /index.php?s=permlink&isbn=$1 (before the txp rewrites) and then create a section called permlink that uses adi_gps or another similar plugin (rah_gps / smd_if) to grab the isbn from the url and store it as a variable. You can then use txp:article or txp:article_custom with the attribute customfieldname='<txp:variable name="isbn" />' to either output the article in question or to fashion a php redirect to the correct article. Remember to provide a “not found” option for invalid queries, e.g. as a message or trigger a 404.

Karsten · 2015-10-07 13:37:28

in advanced preferences the spamblocklist was set to “sbl.spamhaus.org” however, clearing this to an empty field had no effect on loading speed via the proxy

i cleared the htaccess of everything apart of bit of code at the top required for txp to work, but this too had no effect on loading speed

i have etc_query plugin but don’t actually use it, so have set it to inactive, but this too had no effect on loading speed

The website on it’s own works fine and quickly. Users visiting the site via this proxy will see additional content (blocked to normal visitors) so that’s why the proxy is needed. Browser cache has no effect on this.

switch of logging and name lookups: this seems to have speed things up a bit, but it is still rather slow

Textpattern CMS

Textpattern CMS support forum

#1 2015-10-02 08:39:12