7.3.69. tokenizer_list — Groonga v10.1.1-31-g1e46ba6 documentation

# groonga - An open-source fulltext search engine and column store.

- 日本語

# 7.3.69. `tokenizer_list`

## 7.3.69.1. Summary

`tokenizer_list` command lists tokenizers in a database.

## 7.3.69.2. Syntax

This command takes no parameters:

    tokenizer_list

## 7.3.69.3. Usage

Here is a simple example.

Execution example:

    tokenizer_list
    # [
    #   [
    #     0,
    #     1337566253.89858,
    #     0.000355720520019531
    #   ],
    #   [
    #     {
    #       "name": "TokenDelimit"
    #     },
    #     {
    #       "name": "TokenUnigram"
    #     },
    #     {
    #       "name": "TokenBigram"
    #     },
    #     {
    #       "name": "TokenTrigram"
    #     },
    #     {
    #       "name": "TokenBigramSplitSymbol"
    #     },
    #     {
    #       "name": "TokenBigramSplitSymbolAlpha"
    #     },
    #     {
    #       "name": "TokenBigramSplitSymbolAlphaDigit"
    #     },
    #     {
    #       "name": "TokenBigramIgnoreBlank"
    #     },
    #     {
    #       "name": "TokenBigramIgnoreBlankSplitSymbol"
    #     },
    #     {
    #       "name": "TokenBigramIgnoreBlankSplitSymbolAlpha"
    #     },
    #     {
    #       "name": "TokenBigramIgnoreBlankSplitSymbolAlphaDigit"
    #     },
    #     {
    #       "name": "TokenDelimitNull"
    #     },
    #     {
    #       "name": "TokenRegexp"
    #     }
    #   ]
    # ]

It returns tokenizers in a database.

## 7.3.69.4. Return value

`tokenizer_list` command returns tokenizers. Each tokenizers has an attribute that contains the name. The attribute will be increased in the feature:

    [HEADER, tokenizers]

`HEADER`

> See Output format about `HEADER`.

`tokenizers`

> `tokenizers` is an array of tokenizer. Tokenizer is an object that has the following attributes.

> Name | Description
> --- | ---
> `name` | Tokenizer name.

## 7.3.69.5. See also

- Tokenizers

- tokenize