UTF8の検索結果1 - 2 件 / 2件

• あとで読む

  You can't just assume UTF-8

  • 4 users
  • csvbase.com
  • テクノロジー
  • 2024/04/30

  Humans speak countless different languages. Not only are these languages incompatible, but runtime transpilation is a real pain. Sadly, every standardisation initiative has failed. At least there is someone to blame for this state-of-affairs: God. It was him, after-all, who cursed humanity to speak different languages, in an early dispute over a controversial property development. However, mankind

  • Programming

  
• あとで読む

  Decoding UTF8 with Parallel Extract

  • 3 users
  • nrk.neocities.org
  • テクノロジー
  • 2024/05/06

  Decoding UTF8 with Parallel Extract 23 Mar 2024 As a side-quest I recently decided to write a branchless utf8 decoder utilizing the pext or "parallel extract" instruction. It's compliant with rfc-3629, meaning that it doesn't just naively decode the code-point but also checks for overlong encoding, surrogate pairs and such. Compiled with gcc -O3 -march=x86-64-v3 the entire decoder results in just