UNICODE_TOKENIZER

val UNICODE_TOKENIZER: String = "UnicodeTokenizer"

The name of PSPDFKit's custom Unicode tokenizer. This tokenizer wraps around SQLite's unicode61 tokenizer to add full case folding to the indexed text.

Warning: This tokenizer is only available when the library supports FTS5, otherwise specifying this as the value for the tokenizer parameter will result in an error when trying to create the library.