Master programming syntax, solve interactive challenges & run live code in Syntaxis Explore Arena →

menu_book Course Curriculum (Character Encoding & Unicode) expand_more

Unicode Foundations

Code points and scalar values UTF-8 byte sequences UTF-16 surrogate pairs Grapheme clusters Combining marks Normalization NFC Normalization NFD Replacement character U+FFFD

HTML & Web Encoding

HTML meta charset HTTP Content-Type charset URL percent-encoding Form URL encoding JSON Unicode escapes JavaScript Unicode escapes HTML character references Base64 versus text encoding

Strings & Storage

UTF-8 file reading Byte length versus character length Safe string slicing Case folding Locale-sensitive casing Emoji sequences Zero-width joiner BOM handling

Validation & Debugging

Detecting mojibake Invalid UTF-8 handling Round-trip encoding Database utf8mb4 Collation versus encoding Unicode-aware regex Normalization before comparison Security confusables

Character Encoding & Unicode / Validation & Debugging

Invalid UTF-8 handling

Learn Invalid UTF-8 handling in Character Encoding & Unicode with a focused explanation, a topic-specific example, and a mastery check.

12 min read • Intermediate

encoding-026.txt

text

raw=b'abc\xf0\x28\x8c\x28'
for mode in ['replace','ignore']:
    print(mode, raw.decode('utf-8',errors=mode))

What to watch

Content source & attribution

Original Syntaxis Content · Original Syntaxis Content

Lesson quizzes

Invalid UTF-8 handling Mastery Check →

Detecting mojibake

Round-trip encoding