Emoji’s not allowed in comments field?

Xavez2 · 2018-01-19 13:19:59

A reader of my blog notified me that it is not possible to post emoji’s in the comment field. I couldn’t find anything about it in the forums either. Is this happening to everyone?

Emoji’s seem to be stripped at the point you click Preview, they never even make it to actually posting :-).

Bloke · 2018-01-19 14:03:06

Xavez2 wrote #308747:

it is not possible to post emoji’s in the comment field… Emoji’s seem to be stripped at the point you click Preview

Hmmm, something’s afoot here:

On Txp 4.6.2:
- Posting Emoji that are entered as character codes (e.g. 🍻) show up in comment preview AND the final post.
- Posting Emoji that are copy and pasted from a set show up in comment preview BUT NOT in the final post.
On Txp 4.7.0-dev:
- Posting Emoji that are entered as character codes (e.g. 🍻) show up in comment preview as raw strings (presumably encoded during transit) BUT NOT in the final post (they are there, but encoded as &#x1F37B; in the comment field and are therefore skipped during display).
- Posting Emoji that are copy and pasted from a set show up in comment preview BUT NOT in the final post: same as on 4.6.2.

If this is indicative of a wider issue and not just my setup, this situation needs fixing somehow. Anybody with some textile / encoding chops want to hazard a guess?

etc · 2018-01-19 14:19:38

Have you set utf8mb4 both in db collation and config.php?

Xavez2 · 2018-01-19 17:47:32

utf8mb4 is set in config.php, but the database is set to utf8_unicode_ci. Since the last debacle, I must say that I am quite hesitant to change anything about that setup :D

Last edited by Xavez2 (2018-01-19 17:47:45)

Xavez2 · 2018-01-19 18:15:13

Update: Okay so it seems that the original issue is not emoji related at all. It was the `wet_commentmagic` plugin that was blocking anything at all from showing up in the preview.

Terribly sorry for putting you on a sidetrack here :-).

That said, the problem Bloke mentioned still exists. I changed the database to `utf8mb4_unicide_ci` just so that we are checking similar setups. I too see emoji showing up as question marks. The preview is fine, but the actual saved thing is a question mark. As in an actual question mark, not the “missing glyph” icon you can see when you paste something in the forum message field ‘?’.

It also shows as a question mark in the database. But not in the e-mail notification about a new comment.

The same problem is true for articles, by the way, so it’s not just related to comments, but it does seem to be related to the database.

philwareham · 2018-01-19 18:15:36

The database tables all need to be uft8mb4 in order for MySQL to store emojis. I think Ruud created a good plugin a few months ago which can do this for you. Sorry I’d post a link to it but I’m on my iPhone at moment. Should be searchable in the forum.

Xavez2 · 2018-01-19 18:21:42

philwareham wrote #308762:

The database tables all need to be uft8mb4 in order for MySQL to store emojis. I think Ruud created a good plugin a few months ago which can do this for you. Sorry I’d post a link to it but I’m on my iPhone at moment. Should be searchable in the forum.

I just checked, and they are.

Update: interestingly, the tables are, but not all the fields are . . . Let’s find that plugin.

Last edited by Xavez2 (2018-01-19 18:31:28)

Xavez2 · 2018-01-19 18:41:43

Excellent, so the problem was indeed that utf8mb4 was not set on all the table columns. I ran ruud’s plugin and that fixed everything. A bit stupid of me to assume that column collations are automatically inherited from tables :-).

Thanks Phil!

Textpattern CMS

Textpattern CMS support forum

#1 2018-01-19 13:19:59