Elasticsearch6.2 研究--索引管理

深碍√TFBOYSˉ_ 2022-04-04 15:44 264阅读 0赞

### 目录 ###

*  6Elasticsearch6.2索引管理
 *   *  6.1 搭建工程
     *   *  6.1.1 客户端
         *  6.1.2 创建搜索工程
     *  6.2创建索引库
     *   *  6.2.1 API
         *  6.2.2 Java Client
     *  6.3 添加文档
     *   *  6.3.1 API
         *  6.3.2 Java Client
     *  6.4 查询文档
     *   *  6.4.1 API
         *  6.4.2 Java Client
     *  6.5 更新文档
     *   *  6.5.1 Api
         *  6.5.2 Java Client
     *  6.6 删除文档
     *   *  6.6.1 Api
         *  6.6.2 Java Client

# 6Elasticsearch6.2索引管理 #

## 6.1 搭建工程 ##

### 6.1.1 客户端 ###

ES提供多种不同的客户端：

1、TransportClient

ES提供的传统客户端，官方计划8.0版本删除此客户端。

2、RestClient

RestClient是官方推荐使用的，它包括两种：Java Low Level REST Client和 Java High Level REST Client。

ES在6.0之后提供 Java High Level REST Client， 两种客户端官方更推荐使用 Java High Level REST Client，不过当前它还处于完善中，有些功能还没有。

本教程准备采用 Java High Level REST Client，如果它有不支持的功能，则使用Java Low Level REST Client。

添加依赖：

<dependency>
        <groupId>org.Elasticsearch.client</groupId>
        <artifactId>Elasticsearch-rest-high-level-client</artifactId>
        <version>6.2.1</version>
    </dependency>
    <dependency>
        <groupId>org.Elasticsearch</groupId>
        <artifactId>Elasticsearch</artifactId>
        <version>6.2.1</version>
    </dependency>

### 6.1.2 创建搜索工程 ###

使用SpringBoot创建搜索工程（maven工程）：xc-es-test，添加RestHighLevelClient依赖及junit依赖。

pom.xml

<?xml version="1.0" encoding="UTF-8"?>
    <project xmlns="http://maven.apache.org/POM/4.0.0"
             xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
             xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
        <parent>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-parent</artifactId>
            <version>2.0.1.RELEASE</version>
        </parent>
        <modelVersion>4.0.0</modelVersion>
        <groupId>com.xc</groupId>
        <artifactId>xc-es-test</artifactId>
        <version>1.0-SNAPSHOT</version>
        <dependencies>
            <dependency>
                <groupId>org.springframework.boot</groupId>
                <artifactId>spring-boot-starter-web</artifactId>
            </dependency>
            <dependency>
                <groupId>org.springframework.boot</groupId>
                <artifactId>spring-boot-starter-web</artifactId>
            </dependency>
            <dependency>
                <groupId>org.Elasticsearch.client</groupId>
                <artifactId>Elasticsearch-rest-high-level-client</artifactId>
                <version>6.2.1</version>
            </dependency>
            <dependency>
                <groupId>org.Elasticsearch</groupId>
                <artifactId>Elasticsearch</artifactId>
                <version>6.2.1</version>
            </dependency>
            <dependency>
                <groupId>org.springframework.boot</groupId>
                <artifactId>spring-boot-starter-test</artifactId>
                <scope>test</scope>
            </dependency>
            <dependency>
                <groupId>com.alibaba</groupId>
                <artifactId>fastjson</artifactId>
            </dependency>
            <dependency>
                <groupId>org.apache.commons</groupId>
                <artifactId>commons-io</artifactId>
            </dependency>
            <dependency>
                <groupId>org.apache.commons</groupId>
                <artifactId>commons-lang3</artifactId>
            </dependency>
        </dependencies>
    
    </project>

2、配置文件

application.yml

server:
      port: ${port:40100}
    spring:
      application:
        name: xc-es-test
    xc:
      Elasticsearch:
        hostlist: ${eshostlist:127.0.0.1:9200} #多个结点中间用逗号分隔

3、配置类

创建com.xc.search.config包

在其下创建配置类

package com.xc.search.config;
    
    import org.apache.http.HttpHost;
    import org.Elasticsearch.client.RestClient;
    import org.Elasticsearch.client.RestHighLevelClient;
    import org.springframework.beans.factory.annotation.Value;
    import org.springframework.context.annotation.Bean;
    import org.springframework.context.annotation.Configuration;
    
    
    @Configuration
    public class ElasticsearchConfig {
    
        @Value("${xc.Elasticsearch.hostlist}")
        private String hostlist;
    
        @Bean
        public RestHighLevelClient restHighLevelClient(){
            //解析hostlist配置信息
            String[] split = hostlist.split(",");
            //创建HttpHost数组，其中存放es主机和端口的配置信息
            HttpHost[] httpHostArray = new HttpHost[split.length];
            for(int i=0;i<split.length;i++){
                String item = split[i];
                httpHostArray[i] = new HttpHost(item.split(":")[0], Integer.parseInt(item.split(":")[1]), "http");
            }
            //创建RestHighLevelClient客户端
            return new RestHighLevelClient(RestClient.builder(httpHostArray));
        }
    
    	//项目主要使用RestHighLevelClient，对于低级的客户端暂时不用
        @Bean
        public RestClient restClient(){
            //解析hostlist配置信息
            String[] split = hostlist.split(",");
            //创建HttpHost数组，其中存放es主机和端口的配置信息
            HttpHost[] httpHostArray = new HttpHost[split.length];
            for(int i=0;i<split.length;i++){
                String item = split[i];
                httpHostArray[i] = new HttpHost(item.split(":")[0], Integer.parseInt(item.split(":")[1]), "http");
            }
            return RestClient.builder(httpHostArray).build();
        }
    
    }

3、SpringBoot启动类

@SpringBootApplication
    public class SearchApplication {
    
        public static void main(String[] args) throws Exception {
            SpringApplication.run(SearchApplication.class, args);
        }
    
    }

## 6.2创建索引库 ##

### 6.2.1 API ###

创建索引：

put [http://localhost:9200/索引名称][http_localhost_9200]

{
      "settings":{
      "index":{
          "number_of_shards":1,#分片的数量
          "number_of_replicas":0#副本数量
      	}  
      }
    }

创建映射：

发送：put [http://localhost:9200/索引库名称/类型名称/\_mapping][http_localhost_9200_mapping]

创建类型为xc\_course的映射，共包括三个字段：name、description、studymodel

[http://localhost:9200/xc\_course/doc/\_mapping][http_localhost_9200_xc_course_doc_mapping]

{
     	"properties": {
               "name": {
                  "type": "text",
                  "analyzer":"ik_max_word",
                  "search_analyzer":"ik_smart"
               },
               "description": {
                  "type": "text",
                  "analyzer":"ik_max_word",
                  "search_analyzer":"ik_smart"
               },
               "studymodel": {
                  "type": "keyword"
               },
               "price": {
                  "type": "float"
               },
               "timestamp": {
              		"type":   "date",
              		"format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd||epoch_millis"
            	}
            }
    }

### 6.2.2 Java Client ###

@SpringBootTest
    @RunWith(SpringRunner.class)
    public class TestIndex {
    
        @Autowired
        RestHighLevelClient client;
    
        @Autowired
        RestClient restClient;
    
       //创建索引库
        @Test
        public void testCreateIndex() throws IOException {
            //创建索引请求对象，并设置索引名称
            CreateIndexRequest createIndexRequest = new CreateIndexRequest("xc_course");
            //设置索引参数
            createIndexRequest.settings(Settings.builder().put("number_of_shards",1)
                                                .put("number_of_replicas",0));
    
            //设置映射
            createIndexRequest.mapping("doc"," {\n" +
                    " \t\"properties\": {\n" +
                    "           \"name\": {\n" +
                    "              \"type\": \"text\",\n" +
                    "              \"analyzer\":\"ik_max_word\",\n" +
                    "              \"search_analyzer\":\"ik_smart\"\n" +
                    "           },\n" +
                    "           \"description\": {\n" +
                    "              \"type\": \"text\",\n" +
                    "              \"analyzer\":\"ik_max_word\",\n" +
                    "              \"search_analyzer\":\"ik_smart\"\n" +
                    "           },\n" +
                    "           \"studymodel\": {\n" +
                    "              \"type\": \"keyword\"\n" +
                    "           },\n" +
                    "           \"price\": {\n" +
                    "              \"type\": \"float\"\n" +
                    "           }\n" +
                    "        }\n" +
                    "}", XContentType.JSON);
            //创建索引操作客户端
            IndicesClient indices = client.indices();
    
            //创建响应对象
            CreateIndexResponse createIndexResponse = indices.create(createIndexRequest);
            //得到响应结果
            boolean acknowledged = createIndexResponse.isAcknowledged();
            System.out.println(acknowledged);
        }
        //删除索引库
        @Test
        public void testDeleteIndex() throws IOException {
            //删除索引请求对象
            DeleteIndexRequest deleteIndexRequest = new DeleteIndexRequest("xc_course");
            //删除索引
            DeleteIndexResponse deleteIndexResponse = client.indices().delete(deleteIndexRequest);
            //删除索引响应结果
            boolean acknowledged = deleteIndexResponse.isAcknowledged();
            System.out.println(acknowledged);
        }
    }

## 6.3 添加文档 ##

### 6.3.1 API ###

格式如下：  
PUT /\{index\}/\{type\}/\{id\}  
\{  
“field”: “value”,  
…  
\}

如果不指定id，ES会自动生成。

一个例子：

put [http://localhost:9200/xc\_course/doc/3][http_localhost_9200_xc_course_doc_3]

{
     "name":"spring cloud实战",
     "description":"本课程主要从四个章节进行讲解： 1.微服务架构入门 2.spring cloud 基础入门 3.实战Spring Boot 4.注册中心eureka。",
     "studymodel":"201001"
     "price":5.6
     }

### 6.3.2 Java Client ###

//添加文档
        @Test
        public void testAddDoc() throws IOException {
           //准备json数据
            Map<String, Object> jsonMap = new HashMap<>();
            jsonMap.put("name", "spring cloud实战");
            jsonMap.put("description", "本课程主要从四个章节进行讲解： 1.微服务架构入门 2.spring cloud 基础入门 3.实战Spring Boot 4.注册中心eureka。");
            jsonMap.put("studymodel", "201001");
            SimpleDateFormat dateFormat =new SimpleDateFormat("yyyy-MM-dd HH:mm:ss");
            jsonMap.put("timestamp", dateFormat.format(new Date()));
            jsonMap.put("price", 5.6f);
            //索引请求对象
            IndexRequest indexRequest = new IndexRequest("xc_course","doc");
            //指定索引文档内容
            indexRequest.source(jsonMap);
            //索引响应对象
            IndexResponse indexResponse = client.index(indexRequest);
            //获取响应结果
            DocWriteResponse.Result result = indexResponse.getResult();
            System.out.println(result);
    
        }

## 6.4 查询文档 ##

### 6.4.1 API ###

格式如下：  
GET /\{index\}/\{type\}/\{id\}

### 6.4.2 Java Client ###

//查询文档
    @Test
    public void getDoc() throws IOException {
        GetRequest getRequest = new GetRequest(
                "xc_course",
                "doc",
                "4028e581617f945f01617f9dabc40000");
        GetResponse getResponse = client.get(getRequest);
        boolean exists = getResponse.isExists();
        Map<String, Object> sourceAsMap = getResponse.getSourceAsMap();
        System.out.println(sourceAsMap);
    }

## 6.5 更新文档 ##

### 6.5.1 Api ###

ES更新文档的顺序是：先检索到文档、将原来的文档标记为删除、创建新文档、删除旧文档，创建新文档就会重建索引。

通过请求Url有两种方法：

1、完全替换

Post：[http://localhost:9200/xc\_test/doc/3][http_localhost_9200_xc_test_doc_3]

2、局部更新

下边的例子是只更新price字段。

post: [http://localhost:9200/xc\_test/doc/3/\_update][http_localhost_9200_xc_test_doc_3_update]

{
    	"doc":{"price":66.6}
    }

### 6.5.2 Java Client ###

使用 Client Api更新文档的方法同上边第二种局部更新方法。

可以指定文档的部分字段也可以指定完整的文档内容。

//更新文档
        @Test
        public void updateDoc() throws IOException {
            UpdateRequest updateRequest = new UpdateRequest("xc_course", "doc", "4028e581617f945f01617f9dabc40000");
            Map<String, String> map = new HashMap<>();
            map.put("name", "spring cloud实战");
            updateRequest.doc(map);
            UpdateResponse update = client.update(updateRequest);
            RestStatus status = update.status();
            System.out.println(status);
        }

## 6.6 删除文档 ##

### 6.6.1 Api ###

根据id删除，格式如下：

DELETE /\{index\}/\{type\}/\{id\}

搜索匹配删除，将搜索出来的记录删除，格式如下：

POST /\{index\}/\{type\}/\_delete\_by\_query

下边是搜索条件例子：

{
      "query":{
          "term":{
              "studymodel":"201001"
          }
      }
    }

上边例子的搜索匹配删除会将studymodel为201001的记录全部删除。

### 6.6.2 Java Client ###

搜索匹配删除还没有具体的api，可以采用先搜索出文档id，根据文档id删除。

//根据id删除文档
        @Test
        public void testDelDoc() throws IOException {
            //删除文档id
            String id = "eqP_amQBKsGOdwJ4fHiC";
    
            //删除索引请求对象
            DeleteRequest deleteRequest = new DeleteRequest("xc_course","doc",id);
            //响应对象
            DeleteResponse deleteResponse = client.delete(deleteRequest);
            //获取响应结果
            DocWriteResponse.Result result = deleteResponse.getResult();
           System.out.println(result);
    
        }

[http_localhost_9200]: http://localhost:9200/%E7%B4%A2%E5%BC%95%E5%90%8D%E7%A7%B0
[http_localhost_9200_mapping]: http://localhost:9200/%E7%B4%A2%E5%BC%95%E5%BA%93%E5%90%8D%E7%A7%B0/%E7%B1%BB%E5%9E%8B%E5%90%8D%E7%A7%B0/_mapping
[http_localhost_9200_xc_course_doc_mapping]: http://localhost:9200/xc_course/doc/_mapping
[http_localhost_9200_xc_course_doc_3]: http://localhost:9200/xc_course/doc/3
[http_localhost_9200_xc_test_doc_3]: http://localhost:9200/xc_test/doc/3
[http_localhost_9200_xc_test_doc_3_update]: http://localhost:9200/xc_test/doc/3/_update