Elasticsearch生产实战（ik分词器、拼音分词、自动补全、自动纠错）

我就是我 2023-10-02 22:04 13阅读 0赞

**目录**

一.IK分词器

1.IK分词器介绍

2.安装

3.使用

4.自定义词库

二.拼音分词器

1.拼音分词器介绍

2.安装

三.自动补全

1.效果演示

2.实战

四.自动纠错

1.场景描述

2.DSL实现

3.java实现

五.仿京东实战

--------------------

### 一.IK分词器 ###

#### 1.IK分词器介绍 ####

默认的中文分词是将每个字看成一个词，这显然是不符合要求的，所以我们需要安装中  
文分词器来解决这个问题。

IK分词是一款国人开发的相对简单的中文分词器。虽然开发者自2012年之后就不在维护  
了，但在工程应用中IK算是比较流行的一款！我们今天就介绍一下IK中文分词器的使用。

#### 2.安装 ####

ik分词器下载地址  
https://github.com/medcl/elasticsearch-analysis-ik/releases

链接：https://pan.baidu.com/s/1z49plwtgCzxprTibFviLlw  
提取码：c8xg

（1）先将其解压，将解压后的elasticsearch文件夹重命名文件夹为ik

（2）将ik文件夹拷贝到elasticsearch/plugins 目录下

（3）重新启动es，即可加载IK分词器

#### 3.使用 ####

下面看下效果吧~，如果没有IK分词器会将所有的字都拆分当成词语

postman请求测试【最小切分】：[http://127.0.0.1:9200/testindex/\_analyze][http_127.0.0.1_9200_testindex_analyze]

post请求，参数为：\{"analyzer": "ik\_smart", "text": "北京天安门" \}

![bda40e8478e543b1ad3f5fafd5c99680.png][]

postman请求测试【最小切分】： http://127.0.0.1:9200/testindex/\_analyze

post请求参数为：\{"analyzer": "ik\_max\_word", "text": "北京天安门" \}

![b1944ccd87264039aaf602f4cc99ca7a.png][]

#### 4.自定义词库 ####

现在测试ik分词器中没有配置过的特殊词语时，还是会对所有字分词，这时候需要自定义词库

如下：

http://127.0.0.1:9200/testindex/\_analyze

\{"analyzer": "ik\_max\_word", "text": "你个老6" \}

![60f5cbdf1c9a4f458390b9ba37736f3d.png][]

（1）进入elasticsearch/plugins/ik/config目录

（2）新建一个my.dic文件，编辑内容：你个老6

![81ef1fbec32c482696b0d3d3083d9654.png][]

修改IKAnalyzer.cfg.xml（在ik/config目录下）

![a74bc21895b34526b2a8dc176e81b8d5.png][]

重新启动elasticsearch，测试分词效果

![c8a8261038d945679dd400f78ca895d4.png][]

### 二.拼音分词器 ###

#### 1.拼音分词器介绍 ####

pinyin 分词器可以让用户输入拼音，就能查找到相关的关键词。比如在某个商城搜索中，输入 shuihu，就能匹配到水壶。这样的体验还是非常好的。

#### 2.安装 ####

拼音分词器安装地址：

[Releases · medcl/elasticsearch-analysis-pinyin · GitHub][Releases _ medcl_elasticsearch-analysis-pinyin _ GitHub]

从github上下载对应es版本的拼音分词器，解压到plugins目录下，重命名为pinyin，重启es即可生效

![fc97cb01fdd04371878ae6945abf08e0.png][]

测试

创建索引

#创建索引
    PUT /medcl/
    {
        "settings" : {
            "analysis" : {
                "analyzer" : {
                    "pinyin_analyzer" : {
                        "tokenizer" : "my_pinyin"
                        }
                },
                "tokenizer" : {
                    "my_pinyin" : {
                        "type" : "pinyin",
                        "keep_separate_first_letter" : false,
                        "keep_full_pinyin" : true,
                        "keep_original" : true,
                        "limit_first_letter_length" : 16,
                        "lowercase" : true,
                        "remove_duplicated_term" : true
                    }
                }
            }
        }
    }

#查看分词效果
    GET /medcl/_analyze
    {
      "text": ["汤兵兵"],
      "analyzer": "pinyin_analyzer"
    }

{
      "tokens" : [
        {
          "token" : "tang",
          "start_offset" : 0,
          "end_offset" : 0,
          "type" : "word",
          "position" : 0
        },
        {
          "token" : "汤兵兵",
          "start_offset" : 0,
          "end_offset" : 0,
          "type" : "word",
          "position" : 0
        },
        {
          "token" : "tbb",
          "start_offset" : 0,
          "end_offset" : 0,
          "type" : "word",
          "position" : 0
        },
        {
          "token" : "bing",
          "start_offset" : 0,
          "end_offset" : 0,
          "type" : "word",
          "position" : 1
        }
      ]
    }

创建映射

#创建映射
    POST /medcl/_mapping
    {
      "properties": {
        "name": {
          "type": "keyword",
          "fields": {
            "pinyin": {
              "type": "text",
              "store": false,
              "term_vector": "with_offsets",
              "analyzer": "pinyin_analyzer",
              "boost": 10
            }
          }
        }
      }
    }

批量添加数据

#批量添加数据
    POST /medcl/_bulk
    {"index": {"_index": "medcl","_id": "1"}}
    {"name":"汤兵兵"}
    {"index": {"_index": "medcl","_id": "2"}}
    {"name":"阚阳阳"}
    {"index": {"_index": "medcl","_id": "3"}}
    {"name":"汤一辰"}
    {"index": {"_index": "medcl","_id": "4"}}
    {"name":"汤得明"}
    {"index": {"_index": "medcl","_id": "5"}}
    {"name":"张继琴"}
    {"index": {"_index": "medcl","_id": "6"}}
    {"name":"阚佳武"}
    {"index": {"_index": "medcl","_id": "7"}}
    {"name":"施玉芬"}
    {"index": {"_index": "medcl","_id": "8"}}
    {"name":"陆毅"}
    {"index": {"_index": "medcl","_id": "9"}}
    {"name":"刘德华"}

测试拼音搜索

#拼音分词搜索
    GET /medcl/_search
    {
      "query": {
        "match": {
          "name.pinyin": "tbb"
        }
      }
    }

![6d84a28ccd464cc2a5a1bbdbd50bc428.png][]

拼音分词器可选参数配置

** 可选参数 **
    
    keep_first_letter ： 启用此选项时，例如：刘德华 > ldh，默认值：true
    keep_separate_first_letter ： 启用该选项时，将保留第一个字母分开，例如：刘德华 > l，d，h，默认：假的，注意：查询结果也许是太模糊，由于长期过频
    limit_first_letter_length ： 设置 first_letter 结果的最大长度，默认值：16
    keep_full_pinyin ： 当启用该选项，例如：刘德华 > [liu，de，hua]，默认值：true
    keep_joined_full_pinyin ： 启用此选项时，例如：刘德华 > [liudehua]，默认值：false
    keep_none_chinese ： 在结果中保留非中文字母或数字，默认值：true
    keep_none_chinese_together ： 保持非中国信一起，默认值：true，如：DJ 音乐家 - > DJ，yin，yue，jia，当设置为 false，例如：DJ 音乐家 - > D，J，yin，yue，jia，注意：keep_none_chinese 必须先启动
    keep_none_chinese_in_first_letter ： 第一个字母不能是中文，例如：刘德华 AT2016- > ldhat2016，default：true
    keep_none_chinese_in_joined_full_pinyin ： 保持非中文字母加入完整拼音，例如：刘德华 2016- > liudehua2016，默认：false
    none_chinese_pinyin_tokenize ： 打破非中国信成单独的拼音项，如果他们拼音，默认值：true，如：liudehuaalibaba13zhuanghan- > liu，de，hua，a，li，ba，ba，13，zhuang，han，注意： keep_none_chinese 和 keep_none_chinese_together 应首先启用
    keep_original ： 当启用此选项时，也将保留原始输入，默认值：false
    lowercase ： 小写非中文字母，默认值：true
    trim_whitespace ： 默认值：true
    remove_duplicated_term ： 当启用此选项时，将删除重复项以保存索引，例如：de 的 > de，默认值：false 注意：位置相关查询可能受影响

### 三.自动补全 ###

#### 1.效果演示 ####

汉字自动补全

![5a780b400d7e4ab2a2063e25bea935a6.png][]

拼音自动补全

![b02134ee29084f66864ecc0ae7fa0e56.png][] 拼音首字母自动补全

![bcf102785b6e40309ce8c892f68030ec.png][]

#### 2.实战 ####

（1）数据准备

#创建索引
    PUT /product_completion_index/
    {
      "settings": {
        "number_of_shards": 1,
        "number_of_replicas": 2,
        "analysis": {
          "analyzer": {
            "ik_pinyin_analyzer": {
              "type": "custom",
              "tokenizer": "ik_smart",
              "filter": "pinyin_filter"
            }
          },
          "filter": {
            "pinyin_filter": {
              "type": "pinyin",
              "keep_first_letter": true,
              "keep_separate_first_letter": false,
              "keep_full_pinyin": true,
              "keep_original": true,
              "limit_first_letter_length": 16,
              "lowercase": true,
              "remove_duplicated_term": true
            }
          }
        }
      }
    }
    #创建映射
    POST /product_completion_index/_mapping
    {
      "properties": {
        "name": {
          "type": "keyword"
        },
        "searchkey": {
          "type": "completion",
          "analyzer": "ik_pinyin_analyzer"
        }
      }
    }
    
    #批量新增数据
    POST /product_completion_index/_bulk
    {"index":{"_index":"product_completion_index","_id":"1"}}
    {"name":"小米(MI)","searchkey":"小米手机"}
    {"index":{"_index":"product_completion_index","_id":"2"}}
    {"searchkey":"小米10","name":"小米(MI)"}
    {"index":{"_index":"product_completion_index","_id":"3"}}
    {"searchkey":"小米电视","name":"小米(MI)"}
    {"index":{"_index":"product_completion_index","_id":"4"}}
    {"searchkey":"小米路由器","name":"小米(MI)"}
    {"index":{"_index":"product_completion_index","_id":"5"}}
    {"searchkey":"小米9","name":"小米(MI)"}
    {"index":{"_index":"product_completion_index","_id":"6"}}
    {"searchkey":"小米手机","name":"小米(MI)"}
    {"index":{"_index":"product_completion_index","_id":"7"}}
    {"searchkey":"小米耳环","name":"小米(MI)"}
    {"index":{"_index":"product_completion_index","_id":"8"}}
    {"searchkey":"小米8","name":"小米(MI)"}
    {"index":{"_index":"product_completion_index","_id":"9"}}
    {"searchkey":"小米10Pro","name":"小米(MI)"}
    {"index":{"_index":"product_completion_index","_id":"10"}}
    {"searchkey":"小米笔记本","name":"小米(MI)"}
    {"index":{"_index":"product_completion_index","_id":"11"}}
    {"searchkey":"小米摄像头","name":"小米(MI)"}
    {"index":{"_index":"product_completion_index","_id":"12"}}
    {"searchkey":"小米电饭煲","name":"小米(MI)"}
    {"index":{"_index":"product_completion_index","_id":"13"}}
    {"searchkey":"小米充电宝","name":"小米(MI)"}
    {"index":{"_index":"product_completion_index","_id":"14"}}
    {"searchkey":"adidas男鞋","name":"adidas男鞋"}
    {"index":{"_index":"product_completion_index","_id":"15"}}
    {"searchkey":"adidas女鞋","name":"adidas女鞋"}
    {"index":{"_index":"product_completion_index","_id":"16"}}
    {"searchkey":"adidas外套","name":"adidas外套"}
    {"index":{"_index":"product_completion_index","_id":"17"}}
    {"searchkey":"adidas裤子","name":"adidas裤子"}
    {"index":{"_index":"product_completion_index","_id":"18"}}
    {"searchkey":"adidas官方旗舰店","name":"adidas官方旗舰店"}
    {"index":{"_index":"product_completion_index","_id":"19"}}
    {"searchkey":"阿迪达斯袜子","name":"阿迪达斯袜子"}
    {"index":{"_index":"product_completion_index","_id":"20"}}
    {"searchkey":"阿迪达斯外套","name":"阿迪达斯外套"}
    {"index":{"_index":"product_completion_index","_id":"21"}}
    {"searchkey":"阿迪达斯运动鞋","name":"阿迪达斯运动鞋"}
    {"index":{"_index":"product_completion_index","_id":"22"}}
    {"searchkey":"耐克外套","name":"耐克外套"}
    {"index":{"_index":"product_completion_index","_id":"23"}}
    {"searchkey":"耐克运动鞋","name":"耐克运动鞋"}

（2）测试

#汉字自动补全
    GET product_completion_index/_search
    {
    "from": 0,
    "size": 100,
    "suggest": {
     "czbk-suggest": {
      "prefix": "小米",
      "completion": {
       "field": "searchkey",
       "size": 20,
       "skip_duplicates": true
      }
     }
    }
    }
    // 结果
    {
      "took" : 2,
      "timed_out" : false,
      "_shards" : {
        "total" : 1,
        "successful" : 1,
        "skipped" : 0,
        "failed" : 0
      },
      "hits" : {
        "total" : {
          "value" : 0,
          "relation" : "eq"
        },
        "max_score" : null,
        "hits" : [ ]
      },
      "suggest" : {
        "czbk-suggest" : [
          {
            "text" : "xm",
            "offset" : 0,
            "length" : 2,
            "options" : [
              {
                "text" : "小米10",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "2",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米10",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米10Pro",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "9",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米10Pro",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米8",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "8",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米8",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米9",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "5",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米9",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米充电宝",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "13",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米充电宝",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米手机",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "1",
                "_score" : 1.0,
                "_source" : {
                  "name" : "小米(MI)",
                  "searchkey" : "小米手机"
                }
              },
              {
                "text" : "小米摄像头",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "11",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米摄像头",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米电视",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "3",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米电视",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米电饭煲",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "12",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米电饭煲",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米笔记本",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "10",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米笔记本",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米耳环",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "7",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米耳环",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米路由器",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "4",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米路由器",
                  "name" : "小米(MI)"
                }
              }
            ]
          }
        ]
      }
    }

#拼音自动补全
    GET product_completion_index/_search
    {
    "from": 0,
    "size": 100,
    "suggest": {
     "czbk-suggest": {
      "prefix": "xiaomi",
      "completion": {
       "field": "searchkey",
       "size": 20,
       "skip_duplicates": true
      }
     }
    }
    }
    
    // 结果
    {
      "took" : 1,
      "timed_out" : false,
      "_shards" : {
        "total" : 1,
        "successful" : 1,
        "skipped" : 0,
        "failed" : 0
      },
      "hits" : {
        "total" : {
          "value" : 0,
          "relation" : "eq"
        },
        "max_score" : null,
        "hits" : [ ]
      },
      "suggest" : {
        "czbk-suggest" : [
          {
            "text" : "xiaomi",
            "offset" : 0,
            "length" : 6,
            "options" : [
              {
                "text" : "小米10",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "2",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米10",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米10Pro",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "9",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米10Pro",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米8",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "8",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米8",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米9",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "5",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米9",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米充电宝",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "13",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米充电宝",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米手机",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "1",
                "_score" : 1.0,
                "_source" : {
                  "name" : "小米(MI)",
                  "searchkey" : "小米手机"
                }
              },
              {
                "text" : "小米摄像头",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "11",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米摄像头",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米电视",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "3",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米电视",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米电饭煲",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "12",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米电饭煲",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米笔记本",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "10",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米笔记本",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米耳环",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "7",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米耳环",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米路由器",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "4",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米路由器",
                  "name" : "小米(MI)"
                }
              }
            ]
          }
        ]
      }
    }

#首字母自动补全
    GET product_completion_index/_search
    {
    "from": 0,
    "size": 100,
    "suggest": {
     "czbk-suggest": {
      "prefix": "xm",
      "completion": {
       "field": "searchkey",
       "size": 20,
       "skip_duplicates": true
      }
     }
    }
    }
    
    //结果
    {
      "took" : 1,
      "timed_out" : false,
      "_shards" : {
        "total" : 1,
        "successful" : 1,
        "skipped" : 0,
        "failed" : 0
      },
      "hits" : {
        "total" : {
          "value" : 0,
          "relation" : "eq"
        },
        "max_score" : null,
        "hits" : [ ]
      },
      "suggest" : {
        "czbk-suggest" : [
          {
            "text" : "xm",
            "offset" : 0,
            "length" : 2,
            "options" : [
              {
                "text" : "小米10",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "2",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米10",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米10Pro",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "9",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米10Pro",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米8",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "8",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米8",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米9",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "5",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米9",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米充电宝",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "13",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米充电宝",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米手机",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "1",
                "_score" : 1.0,
                "_source" : {
                  "name" : "小米(MI)",
                  "searchkey" : "小米手机"
                }
              },
              {
                "text" : "小米摄像头",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "11",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米摄像头",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米电视",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "3",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米电视",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米电饭煲",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "12",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米电饭煲",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米笔记本",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "10",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米笔记本",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米耳环",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "7",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米耳环",
                  "name" : "小米(MI)"
                }
              },
              {
                "text" : "小米路由器",
                "_index" : "product_completion_index",
                "_type" : "_doc",
                "_id" : "4",
                "_score" : 1.0,
                "_source" : {
                  "searchkey" : "小米路由器",
                  "name" : "小米(MI)"
                }
              }
            ]
          }
        ]
      }
    }

（3）代码实现

返回数据封装

package com.tangbb.elasticsearch.pojo;
    
    
    //import com.fasterxml.jackson.annotation.JsonInclude;
    
    import com.alibaba.fastjson.annotation.JSONField;
    import com.alibaba.fastjson.serializer.SerializerFeature;
    import com.fasterxml.jackson.annotation.JsonInclude;
    import com.tangbb.elasticsearch.pojo.ResultEnum;
    
    
    import java.io.Serializable;
    
    /**
     * @Class: ResponseData
     * @Package com.itheima.commons.result
     * @Description: 数据返回封装类
     * @Company: http://www.itheima.com/
     */
    //如果加该注解的字段为null,那么就不序列化
    @JsonInclude(JsonInclude.Include.NON_NULL)
    public class ResponseData<T> implements Serializable {
    
        //返回码
        private String code;
        //返回信息
        private String desc;
        //返回的数据
        private T data;
        //返回数据总数
        private Integer count;
    
        public Integer getCount() {
            return count;
        }
    
        public void setCount(Integer count) {
            this.count = count;
        }
    
        public String getCode() {
            return code;
        }
    
        public void setCode(String code) {
            this.code = code;
        }
    
        public String getDesc() {
            return desc;
        }
    
        public T getData() {
            return data;
        }
    
        public ResponseData(T data, ResultEnum resultEnum) {
            this.code = resultEnum.getCode();
            this.desc = resultEnum.getDecs();
            this.data = data;
        }
    
        public ResponseData(ResultEnum resultEnum) {
            this.code = resultEnum.getCode();
            this.desc = resultEnum.getDecs();
        }
    
        public ResponseData(String code, String desc) {
            this.code = code;
            this.desc = desc;
        }
    
        public ResponseData setResultEnum(ResultEnum result) {
            this.code = result.getCode();
            this.desc = result.getDecs();
            return this;
        }
    
        public ResponseData setResultEnum(T data, ResultEnum resultEnum, Integer count) {
            this.code = resultEnum.getCode();
            this.desc = resultEnum.getDecs();
            this.data = data;
            this.count = count;
            return this;
        }
    
        public ResponseData(T data, ResultEnum resultEnum, Integer count) {
            this.code = resultEnum.getCode();
            this.desc = resultEnum.getDecs();
            this.data = data;
            this.count = count;
        }
    
        public ResponseData() {
        }
    
    
        public ResponseData setResultEnum(String code, String desc) {
            this.code = code;
            this.desc = desc;
            return this;
        }
    }

枚举类

package com.tangbb.elasticsearch.pojo;
    
    /**
     * @Class: ResultEnum
     * @Package com.itheima.commons.enums
     * @Description: 操作提示枚举类
     * @Company: http://www.itheima.com/
     */
    public enum ResultEnum {
        success("200", "操作成功！"),
        param_isnull("-400", "参数为空"),
        error("-402", "操作失败！"),
        server_error("-500", "服务异常"),
        data_existent("-504", "数据不存在"),
        result_empty("-000", "查询内容为空"),
    
        NOT_SYSTEM_API("404", "不是系统指定api"),
        REPEAT("666", "数据已存在"),
        HTTP_ERROR("-405", "请求异常");
        private String code;
        private String decs;
    
        public String getCode() {
            return code;
        }
    
        public String getDecs() {
            return decs;
        }
    
        ResultEnum(String code, String decs) {
            this.code = code;
            this.decs = decs;
        }
    
    }

日志类

package com.tangbb.elasticsearch.pojo;
    
    /**
     * @Class: ResultEnum
     * @Package com.itheima.commons.enums
     * @Description: 应用层操作提示
     * @Company: http://www.itheima.com/
     */
    public enum TipsEnum {
        create_index_success("创建索引成功！"),
        create_index_fail("创建索引失败！"),
        delete_index_success("删除索引成功！"),
        delete_index_fail("删除索引失败！"),
        open_index_success("打开索引成功！"),
        open_index_fail("打开索引失败！"),
        close_index_success("关闭索引成功！"),
        close_index_fail("关闭索引失败！"),
        alias_index_success("索引别名设置成功！"),
        alias_index_fail("索引别名设置失败！"),
        exists_index_success("索引是否存在查询成功！"),
        exists_index_fail("引是否存在查询失败！"),
    
    
        create_doc_success("创建文档成功！"),
        create_doc_fail("创建文档失败！"),
        batch_create_doc_success("批量创建文档成功！"),
        batch_create_doc_fail("批量创建文档失败！"),
        update_doc_success("修改文档成功！"),
        update_doc_fail("修改文档失败！"),
        get_doc_success("查询文档成功！"),
        batch_get_doc_fail("批量查询文档失败！"),
        batch_get_doc_success("批量查询文档成功！"),
        get_doc_fail("查询文档失败！"),
        delete_doc_success("删除文档成功！"),
        delete_doc_fail("删除文档失败！"),
        csuggest_get_doc_fail("自动补全获取失败！"),
        csuggest_get_doc_success("自动补全获取成功！"),
    
        psuggest_get_doc_fail("拼写纠错获取失败！"),
        psuggest_get_doc_success("拼写纠错获取成功！"),
    
        tsuggest_get_doc_fail("搜索推荐获取失败！"),
        tsuggest_get_doc_success("搜索推荐获取成功！"),
    
        hotwords_get_doc_fail("搜索热词获取失败！"),
        hotwords_get_doc_success("搜索热词获取成功！"),
        metricagg_get_doc_fail("指标聚合处理失败！"),
        metricagg_get_doc_success("指标聚合处理成功！"),
    
        bucketagg_get_doc_fail("桶聚合处理失败！"),
        bucketagg_get_doc_success("桶聚合处理成功！"),
    
    
        index_default("索引创建失败！");
    
        private String message;
    
        public String getMessage() {
            return message;
        }
    
        TipsEnum(String message) {
            this.message = message;
    
        }
    
    }

实体类

package com.tangbb.elasticsearch.pojo;
    
    import com.fasterxml.jackson.annotation.JsonInclude;
    
    import java.io.Serializable;
    import java.util.List;
    import java.util.Map;
    
    /**
     * @Class: CommonEntity
     * @Package com.itheima.commons.pojo
     * @Description: 公共实体类
     * @Company: http://www.itheima.com/
     */
    //如果加该注解的字段为null,那么就不序列化
    @JsonInclude(JsonInclude.Include.NON_NULL)
    public class CommonEntity implements Serializable {
        //页码
        private int pageNumber;
        //每页数据条数
        private int pageSize;
        //索引名称
        private String indexName;
        //高亮列
        private String highlight;
        //排序 DESC  ASC
        private String sortOrder;
        //排序列
        private String sortField;
        //自动补全建议列
        private String suggestFileld;
        //自动补全建议值
        private String suggestValue;
        //自动补全返回个数
        private Integer suggestCount;
        //动态查询参数封装
        Map<String, Object> map;
        //批量增加list
        private List<Map<String, Object>> list;
    
        public int getPageNumber() {
            return pageNumber;
        }
    
        public void setPageNumber(int pageNumber) {
            this.pageNumber = pageNumber;
        }
    
        public int getPageSize() {
            return pageSize;
        }
    
        public void setPageSize(int pageSize) {
            this.pageSize = pageSize;
        }
    
        public String getIndexName() {
            return indexName;
        }
    
        public void setIndexName(String indexName) {
            this.indexName = indexName;
        }
    
        public String getHighlight() {
            return highlight;
        }
    
        public void setHighlight(String highlight) {
            this.highlight = highlight;
        }
    
        public String getSortOrder() {
            return sortOrder;
        }
    
        public void setSortOrder(String sortOrder) {
            this.sortOrder = sortOrder;
        }
    
        public String getSortField() {
            return sortField;
        }
    
        public void setSortField(String sortField) {
            this.sortField = sortField;
        }
    
        public String getSuggestFileld() {
            return suggestFileld;
        }
    
        public void setSuggestFileld(String suggestFileld) {
            this.suggestFileld = suggestFileld;
        }
    
        public String getSuggestValue() {
            return suggestValue;
        }
    
        public void setSuggestValue(String suggestValue) {
            this.suggestValue = suggestValue;
        }
    
        public Integer getSuggestCount() {
            return suggestCount;
        }
    
        public void setSuggestCount(Integer suggestCount) {
            this.suggestCount = suggestCount;
        }
    
        public Map<String, Object> getMap() {
            return map;
        }
    
        public void setMap(Map<String, Object> map) {
            this.map = map;
        }
    
        public List<Map<String, Object>> getList() {
            return list;
        }
    
        public void setList(List<Map<String, Object>> list) {
            this.list = list;
        }
    }

控制层

/*
         * @Description 自动补全
         * @Method: suggester
         * @Param: [commonEntity]
         * @Update:
         * @since: 1.0.0
         * @Return: com.oldlu.commons.result.ResponseData
         *
         */
        @GetMapping(value = "/csuggest")
        public ResponseData cSuggest(@RequestBody CommonEntity commonEntity) {
            // 构造返回数据
            ResponseData rData = new ResponseData();
            if (StringUtils.isEmpty(commonEntity.getIndexName()) ||
                    StringUtils.isEmpty(commonEntity.getSuggestFileld()) ||
                    StringUtils.isEmpty(commonEntity.getSuggestValue())) {
                rData.setResultEnum(ResultEnum.param_isnull);
                return rData;
            }
            //批量查询返回结果
            List<String> result = null;
            try {
                //通过高阶API调用批量新增操作方法
                result = contentService.cSuggest(commonEntity);
                //通过类型推断自动装箱（多个参数取交集）
                rData.setResultEnum(result, ResultEnum.success, result.size());
                //日志记录
                logger.info(TipsEnum.get_doc_success.getMessage());
            } catch (Exception e) {
                //日志记录
                logger.error(TipsEnum.get_doc_fail.getMessage(), e);
                //构建错误返回信息
                rData.setResultEnum(ResultEnum.error);
            }
            return rData;
        }

服务层

//自动补全
        /*
         * @Description: 自动补全 根据用户的输入联想到可能的词或者短语
         * @Method: suggester
         * @Param: [commonEntity]
         * @Update:
         * @since: 1.0.0
         * @Return: org.elasticsearch.action.search.SearchResponse
         *
         */
        public List<String> cSuggest(CommonEntity commonEntity) throws Exception {
            //定义返回
            List<String> suggestList = new ArrayList<>();
            //构建查询请求
            SearchRequest searchRequest = new
                    SearchRequest(commonEntity.getIndexName());
            //通过查询构建器定义评分排序
            SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
            searchSourceBuilder.sort(new ScoreSortBuilder().order(SortOrder.DESC));
            //构造搜索建议语句,搜索条件字段
            CompletionSuggestionBuilder completionSuggestionBuilder =new
                    CompletionSuggestionBuilder(commonEntity.getSuggestFileld());
            //搜索关键字
            completionSuggestionBuilder.prefix(commonEntity.getSuggestValue());
            //去除重复
            completionSuggestionBuilder.skipDuplicates(true);
            //匹配数量
            completionSuggestionBuilder.size(commonEntity.getSuggestCount());
            searchSourceBuilder.suggest(new SuggestBuilder().addSuggestion("czbk-suggest", completionSuggestionBuilder));
                    //czbk-suggest为返回的字段，所有返回将在czbk-suggest里面，可写死,sort按照评分排序
                    searchRequest.source(searchSourceBuilder);
            //定义查找响应
            SearchResponse suggestResponse = restHighLevelClient.search(searchRequest,
                    RequestOptions.DEFAULT);
            //定义完成建议对象
            CompletionSuggestion completionSuggestion =
                    suggestResponse.getSuggest().getSuggestion("czbk-suggest");
            List<CompletionSuggestion.Entry.Option> optionsList =
                    completionSuggestion.getEntries().get(0).getOptions();
            //从optionsList取出结果
            if (!CollectionUtils.isEmpty(optionsList)) {
                optionsList.forEach(item ->
                        suggestList.add(item.getText().toString()));
            }
            return suggestList;
        }

测试结果

[http://localhost:9090/csuggest][http_localhost_9090_csuggest]

![a6684245458247269f24cddf687b09d9.png][]

![981e4cdb08424102838d2852146a1545.png][]

### 四.自动纠错 ###

#### 1.场景描述 ####

例如：错误输入"【adidaas官方旗舰店】 ”能够纠错为【adidas官方旗舰店】

#### 2.DSL实现 ####

#自动纠错
    GET product_completion_index/_search
    {
    "suggest": {
     "czbk-suggestion": {
      "text": "adidaas官方旗舰店",
      "phrase": {
       "field": "name",
       "size": 13
      }
     }
    }
    }

![de891177b3444b808786d3351ef4ae26.png][]

#### 3.java实现 ####

控制层

/*
         * @Description: 拼写纠错
         * @Method: suggester2
         * @Param: [commonEntity]
         * @Update:
         * @since: 1.0.0
         * @Return: com.oldlu.commons.result.ResponseData
         *
         */
        @GetMapping(value = "/psuggest")
        public ResponseData pSuggest(@RequestBody CommonEntity commonEntity) {
            // 构造返回数据
            ResponseData rData = new ResponseData();
            if (StringUtils.isEmpty(commonEntity.getIndexName()) ||
                    StringUtils.isEmpty(commonEntity.getSuggestFileld()) ||
                    StringUtils.isEmpty(commonEntity.getSuggestValue())) {
                rData.setResultEnum(ResultEnum.param_isnull);
                return rData;
            }
            //批量查询返回结果
            String result = null;
            try {
                //通过高阶API调用批量新增操作方法
                result = contentService.pSuggest(commonEntity);
                //通过类型推断自动装箱（多个参数取交集）
                rData.setResultEnum(result, ResultEnum.success, null);
                //日志记录
                logger.info(TipsEnum.get_doc_success.getMessage());
            } catch (Exception e) {
                //日志记录
                logger.error(TipsEnum.batch_get_doc_fail.getMessage(), e);
                //构建错误返回信息
                rData.setResultEnum(ResultEnum.error);
            }
            return rData;
        }

服务层

/*
         * @Description: 拼写纠错
         * @Method: psuggest
         * @Param: [commonEntity]
         * @Update:
         * @since: 1.0.0
         * @Return: java.util.List<java.lang.String>
         *
         */
        public String pSuggest(CommonEntity commonEntity) throws Exception {
            //定义返回
            String pSuggestString = new String();
            //定义查询请求
            SearchRequest searchRequest = new
                    SearchRequest(commonEntity.getIndexName());
            //定义查询条件构建器
            SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
            //定义排序器
            searchSourceBuilder.sort(new ScoreSortBuilder().order(SortOrder.DESC));
            //构造短语建议器对象（参数为匹配列）
            PhraseSuggestionBuilder pSuggestionBuilder = new
                    PhraseSuggestionBuilder(commonEntity.getSuggestFileld());
            //搜索关键字（被纠错的值）
            pSuggestionBuilder.text(commonEntity.getSuggestValue());
            //匹配数量
            pSuggestionBuilder.size(1);
            searchSourceBuilder.suggest(new SuggestBuilder().addSuggestion("czbk-suggest", pSuggestionBuilder));
                    searchRequest.source(searchSourceBuilder);
            //定义查找响应
            SearchResponse suggestResponse = restHighLevelClient.search(searchRequest,
                    RequestOptions.DEFAULT);
            //定义短语建议对象
            PhraseSuggestion phraseSuggestion =
                    suggestResponse.getSuggest().getSuggestion("czbk-suggest");
            //获取返回数据
            List<PhraseSuggestion.Entry.Option> optionsList =
                    phraseSuggestion.getEntries().get(0).getOptions();
            //从optionsList取出结果
            if (!CollectionUtils.isEmpty(optionsList)
                    &&optionsList.get(0).getText()!=null) {
                pSuggestString = optionsList.get(0).getText().string().replaceAll(" ","");
            }
            return pSuggestString;
        }

测试

[http://localhost:9090/psuggest][http_localhost_9090_psuggest]

![3a3a8522f351464cb81afb63db072b27.png][]

### 五.仿京东实战 ###

仿京东实战完整代码详见我的gitee，代码地址如下

[https://gitee.com/EkkoBoy/elasticsearch.git][https_gitee.com_EkkoBoy_elasticsearch.git]

[http_127.0.0.1_9200_testindex_analyze]: http://127.0.0.1:9200/testindex/_analyze
[bda40e8478e543b1ad3f5fafd5c99680.png]: https://img-blog.csdnimg.cn/bda40e8478e543b1ad3f5fafd5c99680.png
[b1944ccd87264039aaf602f4cc99ca7a.png]: https://img-blog.csdnimg.cn/b1944ccd87264039aaf602f4cc99ca7a.png
[60f5cbdf1c9a4f458390b9ba37736f3d.png]: https://img-blog.csdnimg.cn/60f5cbdf1c9a4f458390b9ba37736f3d.png
[81ef1fbec32c482696b0d3d3083d9654.png]: https://img-blog.csdnimg.cn/81ef1fbec32c482696b0d3d3083d9654.png
[a74bc21895b34526b2a8dc176e81b8d5.png]: https://img-blog.csdnimg.cn/a74bc21895b34526b2a8dc176e81b8d5.png
[c8a8261038d945679dd400f78ca895d4.png]: https://img-blog.csdnimg.cn/c8a8261038d945679dd400f78ca895d4.png
[Releases _ medcl_elasticsearch-analysis-pinyin _ GitHub]: https://github.com/medcl/elasticsearch-analysis-pinyin/releases
[fc97cb01fdd04371878ae6945abf08e0.png]: https://img-blog.csdnimg.cn/fc97cb01fdd04371878ae6945abf08e0.png
[6d84a28ccd464cc2a5a1bbdbd50bc428.png]: https://img-blog.csdnimg.cn/6d84a28ccd464cc2a5a1bbdbd50bc428.png
[5a780b400d7e4ab2a2063e25bea935a6.png]: https://img-blog.csdnimg.cn/5a780b400d7e4ab2a2063e25bea935a6.png
[b02134ee29084f66864ecc0ae7fa0e56.png]: https://img-blog.csdnimg.cn/b02134ee29084f66864ecc0ae7fa0e56.png
[bcf102785b6e40309ce8c892f68030ec.png]: https://img-blog.csdnimg.cn/bcf102785b6e40309ce8c892f68030ec.png
[http_localhost_9090_csuggest]: http://localhost:9090/csuggest
[a6684245458247269f24cddf687b09d9.png]: https://img-blog.csdnimg.cn/a6684245458247269f24cddf687b09d9.png
[981e4cdb08424102838d2852146a1545.png]: https://img-blog.csdnimg.cn/981e4cdb08424102838d2852146a1545.png
[de891177b3444b808786d3351ef4ae26.png]: https://img-blog.csdnimg.cn/de891177b3444b808786d3351ef4ae26.png
[http_localhost_9090_psuggest]: http://localhost:9090/psuggest
[3a3a8522f351464cb81afb63db072b27.png]: https://img-blog.csdnimg.cn/3a3a8522f351464cb81afb63db072b27.png
[https_gitee.com_EkkoBoy_elasticsearch.git]: https://gitee.com/EkkoBoy/elasticsearch.git