Skip to content

feat(tokenizers): add experimental Korean tokenizer#1018

Merged
thatjuan merged 2 commits into
oramasearch:mainfrom
dayongkr:add-korean-tokenizer
Jun 27, 2026
Merged

feat(tokenizers): add experimental Korean tokenizer#1018
thatjuan merged 2 commits into
oramasearch:mainfrom
dayongkr:add-korean-tokenizer

test(tokenizers): document Korean compound non-segmentation and add w…

129fd5a
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
Build and Test
succeeded Jun 27, 2026 in 3m 11s