Textpattern CMS

#1 2021-08-11 07:26:13

peterj

Member

From: Melbourne, Australia

Registered: 2005-06-02

Posts: 99

database body fields and text encoding

I’ve just had to move a big old undermaintained website from one host (Litespeed, txp4.6.2, Alt php7.1 ) to a new host (Litespeed, currently EA php7.2). The Maria database setups look the same, body & body_html are utf8_general_ci. Having issues saving, viewing and editing posts. I am trying to troubleshoot it but not sure which direction to head, wondering if this is a familiar to any one.

New posts (made on new server, textile on)
Single quotes convert to utf-8 in body_html. Paragraphs containing double quotes vanish in body_html field.

Old posts (made on old server, textile on)
Single quotes are curly quotes (not in utf) in the body_html column. Very short posts appear on front end and backend.
For longer posts with lots of punctuation, frontend output contains diamond question marks in place of single and double quotes. On the backend. The Body textarea is completely empty. The body and body_html fields are intact in the database. If I save the article though, as I managed to do, the database fields are wiped.

I will update core TXP and the plugins in coming weeks.

Peter

#2 2021-08-11 07:51:43

Dragondz

Moderator

From: Algérie

Registered: 2005-06-12

Posts: 1,538

Website GitHub Twitter

Re: database body fields and text encoding

Hi Peter,

What was the old DB collation ? (utf8_general_ci or something else ?)

Can you post here the old txp diagnostic and the new one.

Cheers.

---

Conception site web Algerie | Livre Algerie | Construction Piscine Algerie

#3 2021-08-11 08:08:01

peterj

Member

From: Melbourne, Australia

Registered: 2005-06-02

Posts: 99

Re: database body fields and text encoding

Hi Rabah,

The collation for the fields is utf8_general_ci on both sites.
Old site is Mysql (5.6.51-cll-lve), new is Mariadb (10.3.28-MariaDB-cll-lve).

I will be able organise diagnostics tonight.
Thanks.

#4 2021-08-11 13:06:19

peterj

Member

From: Melbourne, Australia

Registered: 2005-06-02

Posts: 99

Re: database body fields and text encoding

Sorry about length – only the high detail version has charset info in it – that varies. Excuse old plugins, this site was built in 2008… still kicking!

OLD Server Diagnostics high detail

Textpattern version: 4.6.2 (8412e32468526e075446b881d13bd9ce)
Last update: 2019-01-08 10:22:19/2019-01-08 10:20:18
Document root: /home/xxxxxx1/public_html
$path_to_site: /home/xxxxxx1/public_html/cms
Textpattern path: /home/xxxxxx1/public_html/cms/textpattern
Article URL pattern: section_id_title
Temporary directory path: /home/xxxxxx1/public_html/cms/textpattern/tmp
Site URL: www.xxxxxxaper.com/cms
PHP version: 7.1.33
GD Graphics Library: bundled (2.1.0 compatible); supported formats: GIF, JPG, PNG.
Server TZ: Australia/Melbourne
Server local time: 2021-08-11 22:59:13
Daylight Saving Time enabled?:
Automatically adjust Daylight Saving Time setting?: 1
Time zone (GMT offset in seconds): Australia/Melbourne (36000)
MySQL: 5.6.51-cll-lve
Database server time: 2021-08-11 22:59:13
Database server time offset: 0 s
Database server timezone: SYSTEM
Database session timezone: SYSTEM
Locale: en_GB.UTF-8
Server: LiteSpeed
PHP server API: litespeed
RFC 2616 headers:
Server OS: Linux 3.10.0-962.3.2.lve1.5.52.el7.x86_64
Active plugins: zem_ir-0.5, asy_wondertag-0.5, smd_calendar-0.52, adi_gps-0.4, htn_antispam-0.2, smd_if-0.91, rss_auto_excerpt-0.5.1m, zem_contact_lang-4.0.3.6, zem_contact_reborn-4.5.0.0, rss_thumbpop-0.7m, mem_randimg-0.3, mem_self_register-0.9.11, adi_cat_menu-0.6, smd_gallery-0.62, adi_calc-1.2, smd_query-0.50, mem_simple_form-0.3, mem_public_article-0.1, adi_contact-0.4, etc_query-1.3.4, cbe_frontauth-0.9.7, adi_globals-0.3, stm_image_uploader-0.4, tru_tags-3.9, mem_article_count-0.2, soo_image-1.0.b.9, aks_cache-0.3d, smd_macro-0.41, mem_form-0.8.4, soo_txp_obj-1.1.2, soo_plugin_pref-0.2.2, smd_lib-0.36, bot_write_tab_customize-0.7.5, smd_where_used-0.30, glz_custom_fields-1.5.0, smd_thumbnail-0.32, ied_plugin_composer-1.2.1
Admin-side theme: classic 4.6.2

Pre-flight check:
————————————
There was a problem trying to connect to the RPC server. Please try again later.
Clean URLs are only supported on Apache, use at your own risk.
The following PHP functions (which may be necessary to run Textpattern) are disabled on your server: show_source, allow_url_fopen, pcntl_exec
————————————

.htaccess file contents: ————————————

1. BEGIN Textpattern
   #DirectoryIndex index.php index.html

#Options +FollowSymLinks
#Options -Indexes
#ErrorDocument 403 default

<IfModule mod_rewrite.c> RewriteEngine On #RewriteBase /relative/web/path/

# 201901 force https PJ RewriteCond %{SERVER_PORT} 80 RewriteCond %{REQUEST_URI} cms RewriteRule ^(.*)$ https://www.xxxxxxaper.com/cms/$1 [R=301,L]

RewriteCond %{REQUEST_FILENAME} -f [OR] RewriteCond %{REQUEST_FILENAME} -d RewriteRule ^(.+) – [PT,L] RewriteCond %{REQUEST_URI} !=/favicon.ico RewriteRule ^(.*) index.php RewriteCond %{HTTP:Authorization} !^$ RewriteRule .* – [E=REMOTE_USER:%{HTTP:Authorization}] </IfModule>

#php_value register_globals 0

<IfModule mod_mime.c> AddType image/svg+xml svg svgz AddEncoding gzip svgz </IfModule>

1. END Textpattern

————————————

Charset (default/config): latin1/utf8
character_set_client: utf8
character_set_connection: utf8
character_set_database: latin1
character_set_filesystem: binary
character_set_results: utf8
character_set_server: latin1
character_set_system: utf8
character_sets_dir: /usr/share/mysql/charsets/
18 Tables: OK

21 Custom fields: custom_1, custom_2, custom_3, custom_4, custom_5, custom_6, custom_7, custom_8, custom_9, custom_10, custom_11, custom_12, custom_13, custom_14, custom_15, custom_16, custom_17, custom_18, custom_19, custom_20, custom_21 (21)

PHP extensions: Core/7.1.33, date/7.1.33, libxml/7.1.33, openssl/7.1.33, pcre/7.1.33, sqlite3/7.1.33, zlib/7.1.33, bz2/7.1.33, calendar/7.1.33, ctype/7.1.33, curl/7.1.33, hash/1.0, filter/7.1.33, ftp/7.1.33, gettext/7.1.33, gmp/7.1.33, SPL/7.1.33, iconv/7.1.33, pcntl/7.1.33, readline/7.1.33, Reflection/7.1.33, session/7.1.33, standard/7.1.33, shmop/7.1.33, SimpleXML/7.1.33, mbstring/7.1.33, tokenizer/7.1.33, xml/7.1.33, litespeed, bcmath/7.1.33, dom/20031129, fileinfo/1.0.5, gd/7.1.33, imagick/3.4.4, imap/7.1.33, intl/1.1.0, json/1.5.0, exif/7.1.33, mcrypt/7.1.33, mysqli/7.1.33, mysqlnd/mysqlnd 5.0.12-dev – 20150407 – $Id: 38fea24f2847fa7519001be390c98ae0acafe387 $, PDO/7.1.33, pdo_mysql/7.1.33, pdo_sqlite/7.1.33, pgsql/7.1.33, Phar/2.0.2, posix/7.1.33, pspell/7.1.33, soap/7.1.33, sockets/7.1.33, tidy/7.1.33, wddx/7.1.33, xmlreader/7.1.33, xmlrpc/7.1.33, xmlwriter/7.1.33, xsl/7.1.33, zip/1.13.5, Zend OPcache/7.1.33

Apache modules: mod_rewrite, mod_mime, mod_headers, mod_expires, mod_auth_basic

/../index.php: 91b2dbb550c73fe2a7f8bad6c0c165b3
/../css.php: 1872823dbb091f1a3e28d37018a25917
/admin-themes/classic/classic.php: d9b7586b795cd0c3cfed0cc3de1a737f
/admin-themes/hive/hive.php: d01bc2e963a848ae28d13df9c0cbfefd
/admin-themes/hiveneutral/hiveneutral.php: 9fe45801d23c69e90b6e771f7d621754
/css.php: 15b5eb655ba4f162361c30ed083502d0
/include/txp_admin.php: 6e1b2ec212f673fae4022da9e1dee03e
/include/txp_article.php: 12a156ffb905daafc55bb76d16f3b3c4
/include/txp_auth.php: 3c53dc12daf2818a58b65d26dc995358
/include/txp_category.php: b82bf6f9668fb3953786cc8ea6c72e26
/include/txp_css.php: 275baaa28814a719d890a895a730e78e
/include/txp_diag.php: 1236dbc50fcd292555e17a5357d257b0
/include/txp_discuss.php: 28d572167f576f7ababc3138a23fc77b
/include/txp_file.php: b24d3c19ed68ab8d0ba9dcfdbf9822bf
/include/txp_form.php: aa456de76a14187399fcf113b6843973
/include/txp_image.php: 43e37f80bce83a3cc8a4b5058328bba2
/include/txp_lang.php: 6e0c06bd366837d4b23bd755f7a54d9b
/include/txp_link.php: 6e8fa57564b1cc72181ee54b3bd9b10f
/include/txp_list.php: e69e39f2dae2f81c814dc88b8a09b8b7
/include/txp_log.php: 6474bae0873b4b66a4ffab7b0fafe86b
/include/txp_page.php: 4f84cb835a5a4c0974b3359ec5ac691d
/include/txp_pane.php: a6fd0eb91f9a9d2454f558ce82dd236c
/include/txp_plugin.php: c10be88d56fe2daa3a297d6a5a4bc7ae
/include/txp_prefs.php: 6951674c8e3267b9171acf90e52a28a4
/include/txp_section.php: 9a9bb075ec2ae48a8898392a28f80c10
/include/txp_tag.php: b06927b4f0304e7ee8a7e88f2615d6d2
/index.php: 73f449df6cee012fcfcdf005a8710a30
/lib/IXRClass.php: a1b525b4a9ed12dcb5677d5232a3d92e
/lib/PasswordHash.php: 40e06a9c70b96309728e0a02822a6722
/lib/admin_config.php: e81e53b7c3083ac599967072df52c49f
/lib/class.thumb.php: 385ecc1a5c59561db667c2490a1d45c8
/lib/class.trace.php: 0ee318488a6f48da87f0c0cf6fe323f9
/lib/classTextile.php: bc332cd871af9aea59d1f0a20e6e47cb
/lib/constants.php: be11b7315b4a9505e2d2ab0ab04c2ab7
/lib/taglib.php: f1b871e7ff90028d3cd12a944b4c2153
/lib/txplib_admin.php: fb66c1420b71d18416181df1f09dfcb3
/lib/txplib_db.php: ffdb7520a8da7d45f244dd6052b22df6
/lib/txplib_forms.php: c61b2af91351854c8df777d2b8097e9f
/lib/txplib_head.php: c74b4a61144f6020fb513fbe2d446ce2
/lib/txplib_html.php: 2a6520ac0de472e03f48963570359ea2
/lib/txplib_misc.php: 44e673f4994eee5a65552e496ae1c578
/lib/txplib_publish.php: b5707fa079d073cb8f2ba138c09c0d70
/lib/txplib_theme.php: 6de524114ee36d72ce424a77b92051ed
/lib/txplib_update.php: 477518d6ecc2ab603ffa9439df4b3720
/lib/txplib_validator.php: 7bf016bf3449424b84c15dfe3544e329
/lib/txplib_wrapper.php: be2a8ee0e5a16a67cfb366802d5d0176
/publish.php: 805fd06782ecd44b3ed42fabc54a954c
/publish/atom.php: 9dffcb3fa3a6c7990f731e8c8073b76c
/publish/comment.php: 49004f3d722f096741eb685fa1817a45
/publish/log.php: d99b408d6bf88b39865dab18cfaf73a2
/publish/rss.php: af420738b7d5c6e1e97fdbcffa527a62
/publish/search.php: 3d7e0fcea6f40d31dae8c7fb208e35e6
/publish/taghandlers.php: 5653e0dcd45db67c5607db6d386738fb
/textpattern.js: d7654c4b09d4b59f08d72a0701e91771
/update/_to_1.0.0.php: 038fee881209aae809666177852f0c64
/update/_to_4.0.2.php: 2fda6b67e48855a503d31b226739c1e8
/update/_to_4.0.3.php: 0ed87e575b17dc7a5c96ae68a3d16397
/update/_to_4.0.4.php: bf3676db9029bcd37c2df43bef3443f0
/update/_to_4.0.5.php: fa4026347c767cfbd6450cd98c9e37f6
/update/_to_4.0.6.php: 6e9a6eb010ba628e77fb00bfb5a0c62a
/update/_to_4.0.7.php: f72fc3ee07beb2a63a56057187daf136
/update/_to_4.0.8.php: 0d96bca3d788b371b54e925bb3b006a0
/update/_to_4.2.0.php: efcc7e8a390968de49fd8e060f5e01a4
/update/_to_4.3.0.php: 6a819428ad8c1952a7ce5e394abe2823
/update/_to_4.5.0.php: 328e41695d6fd6be1c3e18b86e91ab08
/update/_to_4.5.7.php: 12f67c98bc6479b54dc7f02cade86638
/update/_to_4.6.0.php: 993a0ce529653a6cc4de3a4c454514a8
/update/_update.php: a797c3f31953d468747755b1f30a687f
/vendors/dropbox/zxcvbn/zxcvbn.js: 0592f04743d1d2b81b21b6c57c2e9dc7
/vendors/jquery/jquery/jquery.js: 4f252523d4af0b478c810c2547a63e19
/vendors/jquery/jquery-ui/jquery-ui.js: 0a497d4661df7b82feee14332ce0bdaf
/vendors/PrismJS/prism/prism.js: 9987be40687dad6b26f400b8ce7d4a54
/vendors/Netcarver/Textile/DataBag.php: 63e6f6033871535df2494a0253ceb691
/vendors/Netcarver/Textile/Parser.php: f78b64f1082064fa92524e5f8a0682b4
/vendors/Netcarver/Textile/Tag.php: a7f254b354148a092dbb7ae2f91482ee
/vendors/Textpattern/Adaptable/AdapterInterface.php: de8792292a384f8a51f07d8c1e24c1e5
/vendors/Textpattern/Adaptable/Providable.php: db58e36723a5e6169cdab51407ec3e61
/vendors/Textpattern/Adaptable/ProvidableInterface.php: fe415c23619c580543a415c8872d2761
/vendors/Textpattern/Admin/Theme.php: eede702ee31d32d67b9ed3ea58287dd1
/vendors/Textpattern/Container/Container.php: 8aa23f3dd76ae9515e01f92210fca272
/vendors/Textpattern/Container/ContainerInterface.php: 73fdfc8a970ba41953207f18e245436b
/vendors/Textpattern/Container/FactorableInterface.php: 7a5493a74358c0f9cb362119565c0b8a
/vendors/Textpattern/Container/FactoryInterface.php: 231dca8874a1e894afbf57de8b343620
/vendors/Textpattern/Container/ReusableInterface.php: df4edfb5a1ae3d43f0ad257139647dbd
/vendors/Textpattern/Date/Timezone.php: d83b6ea7db588599b81709f85c600b1b
/vendors/Textpattern/Filter/Exception.php: 9dfad03467f770dfe5fea7f4c3886cfb
/vendors/Textpattern/Filter/FilterCallable.php: ff71a066bde804ec70a4ef5a32ed7d79
/vendors/Textpattern/Filter/StringFilter.php: aa39802e3186f455cf46071ea4e21cf9
/vendors/Textpattern/Http/Request.php: eb603f3a3aee03861cf57f59851ff5a6
/vendors/Textpattern/Iterator/FileIterator.php: 0b92ccce27d3dc6684914c14a645bf54
/vendors/Textpattern/L10n/Locale.php: da92218be29aa7573b5768c2f6d4cf7e
/vendors/Textpattern/Loader.php: 5132ee7aec8a6be0e0a19984c5fb68ca
/vendors/Textpattern/Mail/Adapter/Mail.php: 7d09ff9ec0f6c042bc37af0521af255f
/vendors/Textpattern/Mail/AdapterInterface.php: 5c374a13da2b48765337daf6564608c8
/vendors/Textpattern/Mail/Compose.php: c26a947697ba18e05aa6dcab94baee5d
/vendors/Textpattern/Mail/Encode.php: 0dc0530c9033491519a097130402c711
/vendors/Textpattern/Mail/Exception.php: ce0c04106b33126de84b777ba80c9950
/vendors/Textpattern/Mail/Message.php: e35c47b7bf47cbcbd9f96864941b3689
/vendors/Textpattern/Password/Adapter/PasswordHash.php: 53d6862f0d1dada12218ab3aace85162
/vendors/Textpattern/Password/AdapterInterface.php: a23c46382eff2c784f5e549eb17160b4
/vendors/Textpattern/Password/Generator.php: 0b2697558cda93525de4bf4671e49453
/vendors/Textpattern/Password/Hash.php: 7404c7e10f304be5089b6607c235a602
/vendors/Textpattern/Password/Random.php: e2d21125ea9fc2567157080a137c9473
/vendors/Textpattern/Search/Filter.php: 8b4ef3fd8511467ee5f6026c748e259c
/vendors/Textpattern/Search/Method.php: 9de58b5033c9c0b61bef5d5f92bef75a
/vendors/Textpattern/Security/Exception.php: 1271a06d808208d3fc208cbe675555a0
/vendors/Textpattern/Security/Filter.php: 5a15e72dd32ab2f616c219742fbdee7c
/vendors/Textpattern/Server/Config.php: 33ae325df3a4c5788908ad49bab86c04
/vendors/Textpattern/Tag/Registry.php: 9bd60f0c914e97f5ec894f46437adda1
/vendors/Textpattern/Tag/Syntax/Authors.php: c29c9244f8a1009483c634d78df01bf5
/vendors/Textpattern/Tag/Syntax/File.php: 705562c46df238e113a3c29a2f1cb3c1
/vendors/Textpattern/Tag/Syntax/Image.php: d8917b9156ec10930bacdd209ae93bc7
/vendors/Textpattern/Tag/Syntax/Link.php: 80f8b01a48682d20649b739a574ba690
/vendors/Textpattern/Tag/Syntax/Partial.php: 657fa060189b64a08e2cbd241b759b77
/vendors/Textpattern/Textfilter/Base.php: 0496350b655278e555c139d6a00d559d
/vendors/Textpattern/Textfilter/Constraint.php: 03b065d525667b360b31a346e539c926
/vendors/Textpattern/Textfilter/Nl2Br.php: 00c2e5eb5bf332688a9c50f4e5ed73f1
/vendors/Textpattern/Textfilter/Plain.php: e3c7f63b9a1940cc798855b9967f23de
/vendors/Textpattern/Textfilter/Registry.php: 4170a43b7973f1120de914a3fc0576fb
/vendors/Textpattern/Textfilter/TextfilterInterface.php: 30811632e0c2f491726995e95c579087
/vendors/Textpattern/Textfilter/Textile.php: 082ebbdb2f7a49fdb9765c4c6d2f5ef9
/vendors/Textpattern/Textile/Parser.php: 9d949632792c6b4d06989d9e2850744f
/vendors/Textpattern/Textpack/Parser.php: 2a1f718b9b11e97086161060c8e76b17
/vendors/Textpattern/Textpack/String/Iterator.php: 135cf5d86e191bae3139703c51cdc217
/vendors/Textpattern/Textpack/StringInterface.php: b6cc517b7ec5f0e1995916878d5ee358
/vendors/Textpattern/Type/StringType.php: c322366173b359c6d14223eee5b425bc
/vendors/Textpattern/Type/TypeCallable.php: af1e2c7330803292e81aec97a198a373
/vendors/Textpattern/Type/TypeInterface.php: b1b40316a4aaa7fc99f43078f215ab16
/vendors/Textpattern/Validator/BlankConstraint.php: fa03c1d5576cbb03d62113e84617016b
/vendors/Textpattern/Validator/CategoryConstraint.php: 7983c8612d3289f20ee02c07657102e3
/vendors/Textpattern/Validator/ChoiceConstraint.php: 3308767c97cfb14f608a01d7583c79a6
/vendors/Textpattern/Validator/Constraint.php: ac476eae8cd4acbf30b1f1ed80f59240
/vendors/Textpattern/Validator/FalseConstraint.php: fa81622e336dc47e5706c860983fe79a
/vendors/Textpattern/Validator/FormConstraint.php: 8f5c5ececcc8b9b45ab9d237f1d1ba60
/vendors/Textpattern/Validator/SectionConstraint.php: 18a6828594b47798bf7db56f9e01c40c
/vendors/Textpattern/Validator/TrueConstraint.php: 415c2ec0adc2a37b0c9bfb82af66b000
/vendors/Textpattern/Validator/Validator.php: ff06c7f8ccdc75c195c8cc38c624ea0f
/vendors/Txp.php: 3cbca9376577717d0a4cfc80903013ff

————————————

Last edited by peterj (2021-08-11 13:07:12)

#5 2021-08-11 13:08:43

peterj

Member

From: Melbourne, Australia

Registered: 2005-06-02

Posts: 99

Re: database body fields and text encoding

NEW Server High detail Diagnostics

Textpattern version: 4.6.2 (8412e32468526e075446b881d13bd9ce)
Last update: 2019-01-08 10:22:19/2019-01-08 10:20:18
Document root: /home/xxxxxx1/public_html
$path_to_site: /home/xxxxxx1/public_html/cms
Textpattern path: /home/xxxxxx1/public_html/cms/textpattern
Article URL pattern: section_id_title
Temporary directory path: /home/xxxxxx1/public_html/cms/textpattern/tmp
Site URL: www.xxxxxxaper.com/cms
PHP version: 7.2.34
GD Graphics Library: bundled (2.1.0 compatible); supported formats: GIF, JPG, PNG.
Server TZ: UTC
Server local time: 2021-08-11 07:55:29
Daylight Saving Time enabled?: 0
Automatically adjust Daylight Saving Time setting?: 1
Time zone (GMT offset in seconds): Australia/Melbourne (36000)
MySQL: 10.3.28-MariaDB-cll-lve
Database server time: 2021-08-11 17:55:29
Database server time offset: 1 s
Database server timezone: SYSTEM
Database session timezone: SYSTEM
Locale: en_GB.UTF-8
Server: LiteSpeed
PHP server API: litespeed
RFC 2616 headers:
Server OS: Linux 3.10.0-962.3.2.lve1.5.49.el7.x86_64
Active plugins: zem_ir-0.5, asy_wondertag-0.5, smd_calendar-0.52, adi_gps-0.4, htn_antispam-0.2, smd_if-0.91, rss_auto_excerpt-0.5.1m, zem_contact_lang-4.0.3.6, zem_contact_reborn-4.5.0.0, rss_thumbpop-0.7m, mem_randimg-0.3, mem_self_register-0.9.11, adi_cat_menu-0.6, smd_gallery-0.62, adi_calc-1.2, smd_query-0.50, mem_simple_form-0.3, mem_public_article-0.1, adi_contact-0.4, etc_query-1.3.4, cbe_frontauth-0.9.7, adi_globals-0.3, stm_image_uploader-0.4, tru_tags-3.9, mem_article_count-0.2, soo_image-1.0.b.9, aks_cache-0.3d, smd_macro-0.41, mem_form-0.8.4, soo_txp_obj-1.1.2, soo_plugin_pref-0.2.2, smd_lib-0.36, bot_write_tab_customize-0.7.5, smd_where_used-0.30, glz_custom_fields-1.5.0, smd_thumbnail-0.32, ied_plugin_composer-1.2.1
Admin-side theme: classic 4.6.2

Pre-flight check:
————————————
There was a problem trying to connect to the RPC server. Please try again later.
Clean URLs are only supported on Apache, use at your own risk.
The following PHP functions (which may be necessary to run Textpattern) are disabled on your server: show_source, ini_set
————————————

.htaccess file contents: ————————————

1. BEGIN Textpattern
   #DirectoryIndex index.php index.html

#Options +FollowSymLinks
#Options -Indexes
#ErrorDocument 403 default

<IfModule mod_rewrite.c> RewriteEngine On #RewriteBase /relative/web/path/

# 201901 force https PJ RewriteCond %{SERVER_PORT} 80 RewriteCond %{REQUEST_URI} cms RewriteRule ^(.*)$ https://www.xxxxxxaper.com/cms/$1 [R=301,L]

RewriteCond %{REQUEST_FILENAME} -f [OR] RewriteCond %{REQUEST_FILENAME} -d RewriteRule ^(.+) – [PT,L] RewriteCond %{REQUEST_URI} !=/favicon.ico RewriteRule ^(.*) index.php RewriteCond %{HTTP:Authorization} !^$ RewriteRule .* – [E=REMOTE_USER:%{HTTP:Authorization}] </IfModule>

#php_value register_globals 0

<IfModule mod_mime.c> AddType image/svg+xml svg svgz AddEncoding gzip svgz </IfModule>

1. END Textpattern

————————————

Charset (default/config): latin1/utf8
character_set_client: latin1
character_set_connection: latin1
character_set_database: latin1
character_set_filesystem: binary
character_set_results: latin1
character_set_server: latin1
character_set_system: utf8
character_sets_dir: /usr/share/mysql/charsets/
18 Tables: textpattern is utf8, txp_category is utf8, txp_css is utf8, txp_discuss is utf8, txp_discuss_ipban is utf8, txp_discuss_nonce is utf8, txp_file is utf8, txp_form is utf8, txp_image is utf8, txp_lang is utf8, txp_link is utf8, txp_log is utf8, txp_page is utf8, txp_plugin is utf8, txp_prefs is utf8, txp_section is utf8, txp_token is utf8, txp_users is utf8

21 Custom fields: custom_1, custom_2, custom_3, custom_4, custom_5, custom_6, custom_7, custom_8, custom_9, custom_10, custom_11, custom_12, custom_13, custom_14, custom_15, custom_16, custom_17, custom_18, custom_19, custom_20, custom_21 (21)

PHP extensions: Core/7.2.34, date/7.2.34, libxml/7.2.34, openssl/7.2.34, pcre/7.2.34, sqlite3/7.2.34, zlib/7.2.34, bz2/7.2.34, calendar/7.2.34, ctype/7.2.34, curl/7.2.34, hash/1.0, filter/7.2.34, ftp/7.2.34, gettext/7.2.34, gmp/7.2.34, SPL/7.2.34, iconv/7.2.34, pcntl/7.2.34, readline/7.2.34, Reflection/7.2.34, session/7.2.34, standard/7.2.34, shmop/7.2.34, SimpleXML/7.2.34, mbstring/7.2.34, tokenizer/7.2.34, xml/7.2.34, litespeed, bcmath/7.2.34, dba/7.2.34, dom/20031129, enchant/7.2.34, fileinfo/1.0.5, gd/7.2.34, imap/7.2.34, intl/1.1.0, json/1.6.0, ldap/7.2.34, exif/7.2.34, mysqli/7.2.34, mysqlnd/mysqlnd 5.0.12-dev – 20150407 – $Id: 3591daad22de08524295e1bd073aceeff11e6579 $, odbc/7.2.34, PDO/7.2.34, pdo_mysql/7.2.34, PDO_ODBC/7.2.34, pdo_pgsql/7.2.34, pdo_sqlite/7.2.34, pgsql/7.2.34, Phar/2.0.2, posix/7.2.34, pspell/7.2.34, snmp/0.1, soap/7.2.34, sockets/7.2.34, sysvmsg/7.2.34, sysvsem/7.2.34, sysvshm/7.2.34, wddx/7.2.34, xmlreader/7.2.34, xmlrpc/7.2.34, xmlwriter/7.2.34, xsl/7.2.34, zip/1.15.4, ionCube Loader/10.4.3, Zend OPcache/7.2.34, SourceGuardian/11.4.1

Apache modules: mod_rewrite, mod_mime, mod_headers, mod_expires, mod_auth_basic

pretext_data: array ( ‘status’ => ‘200’, ‘id’ => ‘’, ‘s’ => ‘’, ‘c’ => ‘’, ‘context’ => ‘’, ‘q’ => ‘’, ‘m’ => ‘’, ‘pg’ => ‘’, ‘p’ => ‘’, ‘month’ => ‘’, ‘author’ => ‘’, ‘request_uri’ => ‘/cms/43097503a8c1f727f6c4da5a60d5d7ac/?txpcleantest=1’, ‘qs’ => ‘txpcleantest=1’, ‘subpath’ => ‘\\/cms\\/’, ‘req’ => ‘/43097503a8c1f727f6c4da5a60d5d7ac/?txpcleantest=1’,
)

/../index.php: 91b2dbb550c73fe2a7f8bad6c0c165b3
/../css.php: 1872823dbb091f1a3e28d37018a25917
/admin-themes/classic/classic.php: d9b7586b795cd0c3cfed0cc3de1a737f
/admin-themes/hive/hive.php: d01bc2e963a848ae28d13df9c0cbfefd
/admin-themes/hiveneutral/hiveneutral.php: 9fe45801d23c69e90b6e771f7d621754
/css.php: 15b5eb655ba4f162361c30ed083502d0
/include/txp_admin.php: 6e1b2ec212f673fae4022da9e1dee03e
/include/txp_article.php: 12a156ffb905daafc55bb76d16f3b3c4
/include/txp_auth.php: 3c53dc12daf2818a58b65d26dc995358
/include/txp_category.php: b82bf6f9668fb3953786cc8ea6c72e26
/include/txp_css.php: 275baaa28814a719d890a895a730e78e
/include/txp_diag.php: 1236dbc50fcd292555e17a5357d257b0
/include/txp_discuss.php: 28d572167f576f7ababc3138a23fc77b
/include/txp_file.php: b24d3c19ed68ab8d0ba9dcfdbf9822bf
/include/txp_form.php: aa456de76a14187399fcf113b6843973
/include/txp_image.php: 43e37f80bce83a3cc8a4b5058328bba2
/include/txp_lang.php: 6e0c06bd366837d4b23bd755f7a54d9b
/include/txp_link.php: 6e8fa57564b1cc72181ee54b3bd9b10f
/include/txp_list.php: e69e39f2dae2f81c814dc88b8a09b8b7
/include/txp_log.php: 6474bae0873b4b66a4ffab7b0fafe86b
/include/txp_page.php: 4f84cb835a5a4c0974b3359ec5ac691d
/include/txp_pane.php: a6fd0eb91f9a9d2454f558ce82dd236c
/include/txp_plugin.php: c10be88d56fe2daa3a297d6a5a4bc7ae
/include/txp_prefs.php: 6951674c8e3267b9171acf90e52a28a4
/include/txp_section.php: 9a9bb075ec2ae48a8898392a28f80c10
/include/txp_tag.php: b06927b4f0304e7ee8a7e88f2615d6d2
/index.php: 73f449df6cee012fcfcdf005a8710a30
/lib/IXRClass.php: a1b525b4a9ed12dcb5677d5232a3d92e
/lib/PasswordHash.php: 40e06a9c70b96309728e0a02822a6722
/lib/admin_config.php: e81e53b7c3083ac599967072df52c49f
/lib/class.thumb.php: 385ecc1a5c59561db667c2490a1d45c8
/lib/class.trace.php: 0ee318488a6f48da87f0c0cf6fe323f9
/lib/classTextile.php: bc332cd871af9aea59d1f0a20e6e47cb
/lib/constants.php: be11b7315b4a9505e2d2ab0ab04c2ab7
/lib/taglib.php: f1b871e7ff90028d3cd12a944b4c2153
/lib/txplib_admin.php: fb66c1420b71d18416181df1f09dfcb3
/lib/txplib_db.php: ffdb7520a8da7d45f244dd6052b22df6
/lib/txplib_forms.php: c61b2af91351854c8df777d2b8097e9f
/lib/txplib_head.php: c74b4a61144f6020fb513fbe2d446ce2
/lib/txplib_html.php: 2a6520ac0de472e03f48963570359ea2
/lib/txplib_misc.php: 44e673f4994eee5a65552e496ae1c578
/lib/txplib_publish.php: b5707fa079d073cb8f2ba138c09c0d70
/lib/txplib_theme.php: 6de524114ee36d72ce424a77b92051ed
/lib/txplib_update.php: 477518d6ecc2ab603ffa9439df4b3720
/lib/txplib_validator.php: 7bf016bf3449424b84c15dfe3544e329
/lib/txplib_wrapper.php: be2a8ee0e5a16a67cfb366802d5d0176
/publish.php: 805fd06782ecd44b3ed42fabc54a954c
/publish/atom.php: 9dffcb3fa3a6c7990f731e8c8073b76c
/publish/comment.php: 49004f3d722f096741eb685fa1817a45
/publish/log.php: d99b408d6bf88b39865dab18cfaf73a2
/publish/rss.php: af420738b7d5c6e1e97fdbcffa527a62
/publish/search.php: 3d7e0fcea6f40d31dae8c7fb208e35e6
/publish/taghandlers.php: 5653e0dcd45db67c5607db6d386738fb
/textpattern.js: d7654c4b09d4b59f08d72a0701e91771
/update/_to_1.0.0.php: 038fee881209aae809666177852f0c64
/update/_to_4.0.2.php: 2fda6b67e48855a503d31b226739c1e8
/update/_to_4.0.3.php: 0ed87e575b17dc7a5c96ae68a3d16397
/update/_to_4.0.4.php: bf3676db9029bcd37c2df43bef3443f0
/update/_to_4.0.5.php: fa4026347c767cfbd6450cd98c9e37f6
/update/_to_4.0.6.php: 6e9a6eb010ba628e77fb00bfb5a0c62a
/update/_to_4.0.7.php: f72fc3ee07beb2a63a56057187daf136
/update/_to_4.0.8.php: 0d96bca3d788b371b54e925bb3b006a0
/update/_to_4.2.0.php: efcc7e8a390968de49fd8e060f5e01a4
/update/_to_4.3.0.php: 6a819428ad8c1952a7ce5e394abe2823
/update/_to_4.5.0.php: 328e41695d6fd6be1c3e18b86e91ab08
/update/_to_4.5.7.php: 12f67c98bc6479b54dc7f02cade86638
/update/_to_4.6.0.php: 993a0ce529653a6cc4de3a4c454514a8
/update/_update.php: a797c3f31953d468747755b1f30a687f
/vendors/dropbox/zxcvbn/zxcvbn.js: 0592f04743d1d2b81b21b6c57c2e9dc7
/vendors/jquery/jquery/jquery.js: 4f252523d4af0b478c810c2547a63e19
/vendors/jquery/jquery-ui/jquery-ui.js: 0a497d4661df7b82feee14332ce0bdaf
/vendors/PrismJS/prism/prism.js: 9987be40687dad6b26f400b8ce7d4a54
/vendors/Netcarver/Textile/DataBag.php: 63e6f6033871535df2494a0253ceb691
/vendors/Netcarver/Textile/Parser.php: f78b64f1082064fa92524e5f8a0682b4
/vendors/Netcarver/Textile/Tag.php: a7f254b354148a092dbb7ae2f91482ee
/vendors/Textpattern/Adaptable/AdapterInterface.php: de8792292a384f8a51f07d8c1e24c1e5
/vendors/Textpattern/Adaptable/Providable.php: db58e36723a5e6169cdab51407ec3e61
/vendors/Textpattern/Adaptable/ProvidableInterface.php: fe415c23619c580543a415c8872d2761
/vendors/Textpattern/Admin/Theme.php: eede702ee31d32d67b9ed3ea58287dd1
/vendors/Textpattern/Container/Container.php: 8aa23f3dd76ae9515e01f92210fca272
/vendors/Textpattern/Container/ContainerInterface.php: 73fdfc8a970ba41953207f18e245436b
/vendors/Textpattern/Container/FactorableInterface.php: 7a5493a74358c0f9cb362119565c0b8a
/vendors/Textpattern/Container/FactoryInterface.php: 231dca8874a1e894afbf57de8b343620
/vendors/Textpattern/Container/ReusableInterface.php: df4edfb5a1ae3d43f0ad257139647dbd
/vendors/Textpattern/Date/Timezone.php: d83b6ea7db588599b81709f85c600b1b
/vendors/Textpattern/Filter/Exception.php: 9dfad03467f770dfe5fea7f4c3886cfb
/vendors/Textpattern/Filter/FilterCallable.php: ff71a066bde804ec70a4ef5a32ed7d79
/vendors/Textpattern/Filter/StringFilter.php: aa39802e3186f455cf46071ea4e21cf9
/vendors/Textpattern/Http/Request.php: eb603f3a3aee03861cf57f59851ff5a6
/vendors/Textpattern/Iterator/FileIterator.php: 0b92ccce27d3dc6684914c14a645bf54
/vendors/Textpattern/L10n/Locale.php: da92218be29aa7573b5768c2f6d4cf7e
/vendors/Textpattern/Loader.php: 5132ee7aec8a6be0e0a19984c5fb68ca
/vendors/Textpattern/Mail/Adapter/Mail.php: 7d09ff9ec0f6c042bc37af0521af255f
/vendors/Textpattern/Mail/AdapterInterface.php: 5c374a13da2b48765337daf6564608c8
/vendors/Textpattern/Mail/Compose.php: c26a947697ba18e05aa6dcab94baee5d
/vendors/Textpattern/Mail/Encode.php: 0dc0530c9033491519a097130402c711
/vendors/Textpattern/Mail/Exception.php: ce0c04106b33126de84b777ba80c9950
/vendors/Textpattern/Mail/Message.php: e35c47b7bf47cbcbd9f96864941b3689
/vendors/Textpattern/Password/Adapter/PasswordHash.php: 53d6862f0d1dada12218ab3aace85162
/vendors/Textpattern/Password/AdapterInterface.php: a23c46382eff2c784f5e549eb17160b4
/vendors/Textpattern/Password/Generator.php: 0b2697558cda93525de4bf4671e49453
/vendors/Textpattern/Password/Hash.php: 7404c7e10f304be5089b6607c235a602
/vendors/Textpattern/Password/Random.php: e2d21125ea9fc2567157080a137c9473
/vendors/Textpattern/Search/Filter.php: 8b4ef3fd8511467ee5f6026c748e259c
/vendors/Textpattern/Search/Method.php: 9de58b5033c9c0b61bef5d5f92bef75a
/vendors/Textpattern/Security/Exception.php: 1271a06d808208d3fc208cbe675555a0
/vendors/Textpattern/Security/Filter.php: 5a15e72dd32ab2f616c219742fbdee7c
/vendors/Textpattern/Server/Config.php: 33ae325df3a4c5788908ad49bab86c04
/vendors/Textpattern/Tag/Registry.php: 9bd60f0c914e97f5ec894f46437adda1
/vendors/Textpattern/Tag/Syntax/Authors.php: c29c9244f8a1009483c634d78df01bf5
/vendors/Textpattern/Tag/Syntax/File.php: 705562c46df238e113a3c29a2f1cb3c1
/vendors/Textpattern/Tag/Syntax/Image.php: d8917b9156ec10930bacdd209ae93bc7
/vendors/Textpattern/Tag/Syntax/Link.php: 80f8b01a48682d20649b739a574ba690
/vendors/Textpattern/Tag/Syntax/Partial.php: 657fa060189b64a08e2cbd241b759b77
/vendors/Textpattern/Textfilter/Base.php: 0496350b655278e555c139d6a00d559d
/vendors/Textpattern/Textfilter/Constraint.php: 03b065d525667b360b31a346e539c926
/vendors/Textpattern/Textfilter/Nl2Br.php: 00c2e5eb5bf332688a9c50f4e5ed73f1
/vendors/Textpattern/Textfilter/Plain.php: e3c7f63b9a1940cc798855b9967f23de
/vendors/Textpattern/Textfilter/Registry.php: 4170a43b7973f1120de914a3fc0576fb
/vendors/Textpattern/Textfilter/TextfilterInterface.php: 30811632e0c2f491726995e95c579087
/vendors/Textpattern/Textfilter/Textile.php: 082ebbdb2f7a49fdb9765c4c6d2f5ef9
/vendors/Textpattern/Textile/Parser.php: 9d949632792c6b4d06989d9e2850744f
/vendors/Textpattern/Textpack/Parser.php: 2a1f718b9b11e97086161060c8e76b17
/vendors/Textpattern/Textpack/String/Iterator.php: 135cf5d86e191bae3139703c51cdc217
/vendors/Textpattern/Textpack/StringInterface.php: b6cc517b7ec5f0e1995916878d5ee358
/vendors/Textpattern/Type/StringType.php: c322366173b359c6d14223eee5b425bc
/vendors/Textpattern/Type/TypeCallable.php: af1e2c7330803292e81aec97a198a373
/vendors/Textpattern/Type/TypeInterface.php: b1b40316a4aaa7fc99f43078f215ab16
/vendors/Textpattern/Validator/BlankConstraint.php: fa03c1d5576cbb03d62113e84617016b
/vendors/Textpattern/Validator/CategoryConstraint.php: 7983c8612d3289f20ee02c07657102e3
/vendors/Textpattern/Validator/ChoiceConstraint.php: 3308767c97cfb14f608a01d7583c79a6
/vendors/Textpattern/Validator/Constraint.php: ac476eae8cd4acbf30b1f1ed80f59240
/vendors/Textpattern/Validator/FalseConstraint.php: fa81622e336dc47e5706c860983fe79a
/vendors/Textpattern/Validator/FormConstraint.php: 8f5c5ececcc8b9b45ab9d237f1d1ba60
/vendors/Textpattern/Validator/SectionConstraint.php: 18a6828594b47798bf7db56f9e01c40c
/vendors/Textpattern/Validator/TrueConstraint.php: 415c2ec0adc2a37b0c9bfb82af66b000
/vendors/Textpattern/Validator/Validator.php: ff06c7f8ccdc75c195c8cc38c624ea0f
/vendors/Txp.php: 3cbca9376577717d0a4cfc80903013ff

————————————

#6 2021-08-11 13:35:50

Dragondz

Moderator

From: Algérie

Registered: 2005-06-12

Posts: 1,538

Website GitHub Twitter

Re: database body fields and text encoding

Hi,

There those 2 blocks :

old:

Charset (default/config): latin1/utf8
character_set_client: utf8
character_set_connection: utf8
character_set_database: latin1
character_set_filesystem: binary
character_set_results: utf8
character_set_server: latin1
character_set_system: utf8

New:

Charset (default/config): latin1/utf8
character_set_client: latin1
character_set_connection: latin1
character_set_database: latin1
character_set_filesystem: binary
character_set_results: latin1
character_set_server: latin1
character_set_system: utf8

---

Conception site web Algerie | Livre Algerie | Construction Piscine Algerie

#7 2021-08-11 13:46:38

peterj

Member

From: Melbourne, Australia

Registered: 2005-06-02

Posts: 99

Re: database body fields and text encoding

This is from another txp site (4.7.3) we moved manually to the new server. It seems happier. The problematic site was imported by the new host using cpanel transfer.

Charset (default/config): utf8/utf8
character_set_client: utf8
character_set_connection: utf8
character_set_database: latin1
character_set_filesystem: binary
character_set_results: utf8
character_set_server: latin1
character_set_system: utf8
character_sets_dir: /usr/share/mysql/charsets/
collation_connection: utf8_general_ci
collation_database: latin1_swedish_ci
collation_server: latin1_swedish_ci

Is is noted anywhere what the ideal character set settings are for Textpattern as these ones look different again?
I can then try (backing up and) using SQL to ALTER DATABASE as needed.

Last edited by peterj (2021-08-11 13:48:59)

#8 2021-08-11 14:09:34

etc

Developer

Registered: 2010-11-11

Posts: 5,186

Website GitHub

Re: database body fields and text encoding

We have switched to utf8mb4 a while ago:

Charset (default/config): utf8mb4/utf8mb4
character_set_client: utf8mb4
character_set_connection: utf8mb4
character_set_database: utf8mb4
character_set_filesystem: binary
character_set_results: utf8mb4
character_set_server: utf8mb4
character_set_system: utf8
character_sets_dir: ...
collation_connection: utf8mb4_general_ci
collation_database: utf8mb4_general_ci
collation_server: utf8mb4_general_ci

---

bloatware

#9 2021-08-11 14:16:16

Dragondz

Moderator

From: Algérie

Registered: 2005-06-12

Posts: 1,538

Website GitHub Twitter

Re: database body fields and text encoding

Hi,

I presume that you did the transfer like that : backup files and db from the old server, put the new files in the new server and import the db backup to an empty DB in the new server ?

It s allways good to have the same collation for tables but i am not expert in MySql to say whats wrong there. I dont know what to change.

Can you check the config.php file and see if a line like this exist :

$txpcfg[‘dbcharset’] = ‘utf8mb4’;

Try with utf8mb4 and utf8.

---

Conception site web Algerie | Livre Algerie | Construction Piscine Algerie

#10 2021-08-11 14:19:43

Dragondz

Moderator

From: Algérie

Registered: 2005-06-12

Posts: 1,538

Website GitHub Twitter

Re: database body fields and text encoding

etc wrote #331296:

We have switched to utf8mb4 a while ago:

Charset (default/config): utf8mb4/utf8mb4...

Hi Oleg, it s an old txp site 4.6.2, when updating a website is the db charset updated ?

---

Conception site web Algerie | Livre Algerie | Construction Piscine Algerie

#11 2021-08-11 14:31:57

etc

Developer

Registered: 2010-11-11

Posts: 5,186

Website GitHub

Re: database body fields and text encoding

Hi Rabah, that was probably on 4.6 release, I don’t remember exactly. But it only concerns new installs and should not be a problem for older sites. Here I would rather blame the difference in db configs, as you note.

---

bloatware

#12 2021-08-11 14:37:51

peterj

Member

From: Melbourne, Australia

Registered: 2005-06-02

Posts: 99

Re: database body fields and text encoding

Thanks – yikes there are character settings everywhere!

In config.php on this site I have:

$txpcfg[‘dbcharset’] = ‘utf8’;

The host did the transfer of the problem site – and the rest of that cpanel – told me it was a cpanel transfer but maybe they recreated the database otherwise don’t know why it would be different.

I’ll try updating the new database to match the old settings using ALTER DATABASE.

Last edited by peterj (2021-08-11 14:42:32)