Master programming syntax, solve interactive challenges & run live code in Syntaxis Explore Arena →

menu_book Course Curriculum (Character Encoding & Unicode) expand_more

Unicode Foundations

Code points and scalar values UTF-8 byte sequences UTF-16 surrogate pairs Grapheme clusters Combining marks Normalization NFC Normalization NFD Replacement character U+FFFD

HTML & Web Encoding

HTML meta charset HTTP Content-Type charset URL percent-encoding Form URL encoding JSON Unicode escapes JavaScript Unicode escapes HTML character references Base64 versus text encoding

Strings & Storage

UTF-8 file reading Byte length versus character length Safe string slicing Case folding Locale-sensitive casing Emoji sequences Zero-width joiner BOM handling

Validation & Debugging

Detecting mojibake Invalid UTF-8 handling Round-trip encoding Database utf8mb4 Collation versus encoding Unicode-aware regex Normalization before comparison Security confusables

Character Encoding & Unicode / Validation & Debugging

Unicode-aware regex

Learn Unicode-aware regex in Character Encoding & Unicode with a focused explanation, a topic-specific example, and a mastery check.

12 min read • Intermediate

encoding-030.txt

text

import re
text='naïve café 123'
print(re.findall(r'\w+', text, flags=re.UNICODE))

What to watch

Content source & attribution

Original Syntaxis Content · Original Syntaxis Content

Lesson quizzes

Unicode-aware regex Mastery Check →

Collation versus encoding

Normalization before comparison