Logo

Programming-Idioms

This language bar is your friend. Select your favorite languages!
  • Perl

Idiom #231 Test if bytes are a valid UTF-8 string

Set b to true if the byte sequence s consists entirely of valid UTF-8 character code points, false otherwise.

# use utf8 is not required
$b = utf8::is_utf8($s);

(Since Perl 5.8.1) Test whether $s is marked internally as encoded in UTF-8.

Use utf8::valid() to check if a string is either valid bytes or well-formed Perl extended UTF-8 (and not a mix).
using System.Text;
var encoding = new UTF8Encoding(false, true);
bool b;
try
{
    encoding.GetCharCount(s);
    b = true;
}
catch (DecoderFallbackException)
{
    b = false;
}

.NET encodings use replacement fallback by default; exception fallback can be specified using the UTF8Encoding constructor.
New implementation...
< > ⌨
programming-idioms.org 
$b = utf8::is_utf8($s);
var encoding = new UTF8Encoding(false, true);
bool b;
try
{
    encoding.GetCharCount(s);
    b = true;
}
catch (DecoderFallbackException)
{
    b = false;
}
b := utf8.Valid(s)
final decoder = UTF_8.newDecoder()
final buffer = ByteBuffer.wrap(s)
try {
    decoder.decode(buffer)
    b = true
} catch (CharacterCodingException e) {
    b = false
}

b := FindInvalidUTF8Codepoint(s) = -1;
try:
    s.decode('utf8')
    b = True
except UnicodeError:
    b = False


b = s.force_encoding("UTF-8").valid_encoding?  
let b = std::str::from_utf8(&bytes).is_ok();