Multi tool use

UTF-8 & IsAlpha() in PHP

I'm working on a application which supports several languages and has a functionality in place which tries to use the language requested by the browser and also allows manual override of this function. This part works fine and picks the correct templates, labels, etc.

User have to enter sometimes text on their own and that's where I run into issues because the application has to accept even "complicated" languages like Chinese and Russian. So far I've taken care of the things mentioned in other posting, i.e.:

mb_internal_encoding( 'UTF-8' )

meta http-equiv=Content-Type content=text/html;charset=UTF-8

mb_detect_encoding() == UTF-8

setLocale(LC_CTYPE, "UTF-8")

setLocale(LC_CTYPE,"zh__CN.utf8")

ctype_alpha()

It seems that even explicit language selection doesn't make ctype_alpha() useful.

ctype_alpha()

Hence the question is: how should I check for alphabetic characters in all languages?

The only idea I had at the moment is to check manually with arrays of "valid" characters - but this seems ugly especially for Chinese.

How would you solve this issue?

4 Answers
4

If you'd like to check only for valid unicode letters regardless of the used language I'd propose to use a regular expression (if your pcre-regex extension is built with unicode support):

// adjust pattern to your needs
// $input needs to be UTF-8 encoded
if (preg_match('/^p{L}+$/u', $input)) {
// OK
} else {
// not OK
}


p{L} checks for unicode characters with the L(etter) property which includes the properties Ll (lower case letter), Lm (modifier letter), Lo (other letter), Lt (title case letter) and Lu (upper case letter) - from: Regular Expression Details).

p{L}

L

Ll

Lm

Lo

Lt

Lu

I wouldn't use an array of characters. That would get impossible to manage.

What I'd suggest is working out a 'default' language from the IP address and using that as the locale for a request. You could also get it from the browser-agent string in some cases. You could provide the user a way to override so that if your default isn't correct they aren't stuck with a strange site. (E.g. provide on the form 'language set to english. If this isn't correct, please change: '. This isn't the nicest thing to provide but you won't get any working validation otherwise as you NEED a language/locale set in order to have a sensible alpha validation (An A isn't a letter in chinese).

You can use the languages from

$_SERVER['HTTP_ACCEPT_LANGUAGE']


It contains something like

de-de,de;q=0.8,en-us;q=0.5,en;q=0.3


so you need to parse this string. Then you can use the preferred language in the setLocale function.

This is rather an encoding issue than a language detection issue. Because UTF-8 can encode any Unicode character.

The best approach is to use UTF-8 throughout your project: in your database, in your output and as expected encoding for the input.

Content-Type

accept-charset

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.