Lines Matching refs:to
4 When creating a new full-text table, FTS2 allows the user to select
5 the text tokenizer implementation to be used when indexing text
13 The built-in tokenizers (valid values to pass as <tokenizer name>) are
17 arguments to pass to the selected tokenizer implementation. The
23 FTS2 allows users to provide custom tokenizer implementations. The
24 interface used to create a new tokenizer is defined and described in
27 Registering a new FTS2 tokenizer is similar to registering a new
28 virtual table module with SQLite. The user passes a pointer to a
29 structure containing pointers to various callback functions that
34 FTS2 does not expose a C-function that users call to register new
36 be encoded as an SQL blob value and passed to FTS2 through the SQL
45 <sqlite3_tokenizer_module ptr> is a pointer to an sqlite3_tokenizer_module
48 returned. If only one argument is passed, a pointer to the tokenizer
65 implemented using the ICU library. The first argument passed to the
73 text according to the ICU rules for finding word boundaries and discards
76 processing is required, for example to implement stemming or
80 When using the ICU tokenizer this way, it is safe to overwrite the