Introduction_analysis_and_query_dsl_for_print.key

Size: px

Start display at page:

Download "Introduction_analysis_and_query_dsl_for_print.key"

えりかままだ
6 years ago
Views:

1 !

2 lucene-gosen elasticsearch-extended-analyze

3 ElasticSearch Server 0.90.x Kibana Kuromoji KindleBOOKWALKER

4 Doorkeeper Doorkeeper Google Groups

5 Analyzer = CharFilter Tokenizer TokenFilter DSL elasticsearch-extended-analyze

7 1 2

9 1 Term Id

11 Term CharFilter Tokenizer TokenFilter

12 Term Id

13 Term Id

14 Analyzer Text char_filter char_filter tokenizer token_ filter token_ filter Tokens

15 { "index":{ analysis":{ "analyzer" : { "my_analyzer" : { "type" : "custom", "tokenizer" : kuromoji_tokenizer, char_filter" : [ char_filter1, char_filter2 ], filter" : [ token_filter1, token_filter2 ] } }

16 Char Filter analysis-charfilters.html html_strip <title>elasticsearch is not a service of AWS</title> Elasticsearch is not a service of AWS

17 Tokenizer analysis-tokenizers.html standard Elasticsearch is not a service of AWS Elasticsearch is not a service of AWS

18 Tokenizer keyword Elasticsearch is not a service of AWS kuromoji_tokenizer

19 TokenFilter Tokenizer Token analysis-tokenfilters.html lowercase Elasticsearch is not a service of AWS elasticsearch is not a service of aws stop Elasticsearch is not a service of AWS Elasticsearch service AWS

20 TokenFilter kuromoji_baseform kuromoji_readingform sushi ga oishika ta

21 html_strip+standard+lowercase+stop html_strip standard lowercase stop <title>elasticsearch is not a service of AWS</title> Elasticsearch is not a service of AWS Elasticsearch is not a service of AWS elasticsearch is not a service of aws elasticsearch service aws!

22 Token position Token start/end offset Tokenizer/TokenFilter kuromoji_tokenizer

24 { "query": { "simple_query_string" : { "query" : " ", "fields" : ["title"] } }, "fields": ["title", "category"] }

25 { "query": { "simple_query_string" : { "query" : " ", "fields" : ["title"] } }, "fields": ["title", "category"], "post_filter": { "term": { "text": "" } } }

26 match query multi match query bool query boosting query common terms query constant score query dis max query filtered query fuzzy like this query fuzzy like this field query function score query fuzzy query geoshape query has child query has parent query ids query indices query match all query more like this query more like this field query nested query prefix query query string query simple query string query range query regexp query span first query span multi term query span near query span not query span or query span term query term query terms query top children query wildcard query template query

27 match query multi match query bool query boosting query common terms query constant score query dis max query filtered query fuzzy like this query fuzzy like this field query function score query fuzzy query geoshape query has child query has parent query ids query indices query match all query more like this query more like this field query nested query prefix query query string query simple query string query range query regexp query span first query span multi term query span near query span not query span or query span term query term query terms query top children query wildcard query template query

28 match query multi match query bool query boosting query common terms query constant score query dis max query filtered query fuzzy like this query fuzzy like this field query function score query fuzzy query geoshape query has child query has parent query ids query indices query match all query more like this query more like this field query nested query prefix query query string query simple query string query range query regexp query span first query span multi term query span near query span not query span or query span term query term query terms query top children query wildcard query template query

30 Term Id

31 <title>elasticsearch is not a service of AWS</title> elasticsearch service aws! AWS aws

32 <title>elasticsearch is not a service of AWS</title> elasticsearch service aws! AWS aws

33 Term Id

34 <title>elasticsearch is not a service of AWS</title> elasticsearch service aws! AWS! AWSaws

35 match query multi match query bool query boosting query common terms query constant score query dis max query filtered query fuzzy like this query fuzzy like this field query function score query fuzzy query geoshape query has child query has parent query ids query indices query match all query more like this query more like this field query nested query prefix query query string query simple query string query range query regexp query span first query span multi term query span near query span not query span or query span term query term query terms query top children query wildcard query template query

37 query_string wildcard wildcard

38 elasticsearch-extended-analyze

39 extended_analyze Solr AnalysisJSON! bin/plugin -i info.johtani/elasticsearch-extended-analyze/1.1.0 curl -XGET " _extended_analyze?tokenizer=kuromoji_tokenizer&filters=kuromoji_basefo rm&attributes=keywordattribute" -d ''

40 demo

lucene-gosen Solr1

ElasticSearch 2013/08/29 @johtani Twitter@johtani lucene-gosen Solr1 http://blog.johtani.info N-gram ElasticSearch ElasticSearch Full text search Wikipedia RDB RDB RDB Term/Token 1 2 1 2 1 2 1 2 1 2 1