I was trying to find out whether Unicode 18 is changing the sort order of existing characters.
My favorite readable look at the sort order is the "blanked weights" version of FractionalUCA.txt:
https://raw.githubusercontent.com/unicode-org/cldr/refs/heads/main/common/uca/FractionalUCA_blanked.txt
This is easy to compare, but it's hard to distinguish characters that moved in the sort order from new characters.
Idea: I could add the Age value to the inline comments, at least for the blanked file, if not all of the ones with comments. Then I could filter out new characters and compare the rest with the file from the previous version.
@macchiati WDYT?
This file does not easily show changes in the order of Han characters. The implicit-weights order is fixed by allocation, but the radical-stroke order depends on kRSUnicode and on the implemented algorithm (recently upgraded to UAX38). The easiest for that is probably to just compare the kRSUnicode data. New characters come in small numbers of ranges.
I was trying to find out whether Unicode 18 is changing the sort order of existing characters.
My favorite readable look at the sort order is the "blanked weights" version of FractionalUCA.txt:
https://raw.githubusercontent.com/unicode-org/cldr/refs/heads/main/common/uca/FractionalUCA_blanked.txt
This is easy to compare, but it's hard to distinguish characters that moved in the sort order from new characters.
Idea: I could add the Age value to the inline comments, at least for the blanked file, if not all of the ones with comments. Then I could filter out new characters and compare the rest with the file from the previous version.
@macchiati WDYT?
This file does not easily show changes in the order of Han characters. The implicit-weights order is fixed by allocation, but the radical-stroke order depends on kRSUnicode and on the implemented algorithm (recently upgraded to UAX38). The easiest for that is probably to just compare the kRSUnicode data. New characters come in small numbers of ranges.