es-Java程序中的应用

小咪咪 2022-12-19 06:20 105阅读 0赞

## 关于es 的java 客户端的选择 ##

目前市面上有两类客户端

*  一类是TransportClient 为代表的ES原生客户端，不能执行原生dsl语句必须使用它的Java api方法。
 *  另外一种是以Rest Api为主的missing client，最典型的就是jest。 这种客户端可以直接使用dsl语句拼成的字符串，直接传给服务端，然后返回json字符串再解析。
 *  两种方式各有优劣，但是最近elasticsearch官网，宣布计划在7.0以后的版本中废除TransportClient。以RestClient为主。  
    ![在这里插入图片描述][20201105212732451.png_pic_center]  
    所以在官方的RestClient 基础上，进行了简单包装的Jest客户端，就成了首选，而且该客户端也与springboot完美集成。

## 导入Jest依赖 ##

<dependency>
        <groupId>io.searchbox</groupId>
        <artifactId>jest</artifactId>
        <version>5.3.3</version>
    
    </dependency>
    
    <dependency>
        <groupId>net.java.dev.jna</groupId>
        <artifactId>jna</artifactId>
        <version>4.5.2</version>
    </dependency>
    
    <dependency>
        <groupId>org.codehaus.janino</groupId>
        <artifactId>commons-compiler</artifactId>
        <version>2.7.8</version>
    </dependency>
    
    
    <dependency>
        <groupId>org.elasticsearch</groupId>
        <artifactId>elasticsearch</artifactId>
        <version>2.4.6</version>
    </dependency>

# 在测试类中测试ES #

测试类

*  插入数据

import io.searchbox.client.config.HttpClientConfig
    import io.searchbox.client.{ JestClient, JestClientFactory}
    import io.searchbox.core.Index
    
    
    object MyEsUtil { 
    
      private var factory:JestClientFactory = null;
    
      def getClient:JestClient ={ 
        if(factory==null)build();
        factory.getObject
      }
    
      def  build(): Unit ={ 
        factory=new JestClientFactory
        factory.setHttpClientConfig(new HttpClientConfig.Builder("http://hadoop102:9200" )
          .multiThreaded(true)
          .maxTotalConnection(20)
          .connTimeout(10000).readTimeout(1000).build())
      }
    
      //插入数据
      def addDoc():Unit = { 
        val jest: JestClient = getClient
        //builder 设计模式
        //可转换为json对象 HashMap
        val index = new Index.Builder(Movie1602("1602","龙岭迷窟","鬼吹灯")).index("movie_index1602").`type`("_doc").id("1602")
          .build()
        val message = jest.execute(index).getErrorMessage
        if (message!=null){ 
          println(message)
        }
        jest.close()
      }
    
    
    
      def main(args: Array[String]): Unit = { 
        addDoc()
    
      }
    
      case class Movie1602(id:String,movie_name:String,name:String)
    }

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NTQ4ODU1_size_16_color_FFFFFF_t_70_pic_center]

*  查询表(两种方法)  
    ![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NTQ4ODU1_size_16_color_FFFFFF_t_70_pic_center 1]

import java.util
    
    import io.searchbox.client.config.HttpClientConfig
    import io.searchbox.client.{ JestClient, JestClientFactory}
    import io.searchbox.core.{ Search, SearchResult}
    
    
    object MyEsUtil { 
    
      private var factory: JestClientFactory = null;
    
      def getClient: JestClient = { 
        if (factory == null) build();
        factory.getObject
      }
    
      def build(): Unit = { 
        factory = new JestClientFactory
        factory.setHttpClientConfig(new HttpClientConfig.Builder("http://hadoop102:9200")
          .multiThreaded(true)
          .maxTotalConnection(20)
          .connTimeout(10000).readTimeout(1000).build())
      }
    
    
      //查询数据
      //把结构封装成的Map 必须使用java的，不能使用scala
      def queryDoc(): Unit = { 
        val jest: JestClient = getClient
        val query = "{\n \"from\" : 0,\n \"size\" : 20,\n \"query\" : {\n \"bool\" : {\n \"must\" : {\n " +
          " \"match\" : {\n \"name\" : {\n \"query\" : \"red\"\n }\n }\n },\n " +
          " \"filter\" : {\n \"term\" : {\n \"actorList.name.keyword\" : \"zhang han yu\"\n }\n " +
          " }\n }\n },\n \"sort\" : [ {\n \"doubanScore.keyword\": {\n \"order\" : \"desc\"\n }\n } ],\n " +
          " \"highlight\" : {\n \"fields\" : {\n \"name\" : { }\n }\n }\n}"
        val search = new Search.Builder(query).addIndex("movie_index0105").build()
        val result = jest.execute(search)
        val hits: util.List[SearchResult#Hit[util.Map[String, Any], Void]] = result.getHits(classOf[util.Map[String, Any]])
        import scala.collection.JavaConversions._
        for (hit <- hits) { 
          println(hit.source.mkString("\n"))
        }
        jest.close()
      }
    
      def main(args: Array[String]): Unit = { 
    
        queryDoc()
      }
    }

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NTQ4ODU1_size_16_color_FFFFFF_t_70_pic_center 2]

*  第二种方法  
    ![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NTQ4ODU1_size_16_color_FFFFFF_t_70_pic_center 3]

import java.util
    
    import io.searchbox.client.config.HttpClientConfig
    import io.searchbox.client.{ JestClient, JestClientFactory}
    import io.searchbox.core.{ Index, Search, SearchResult}
    import org.elasticsearch.index.query.{ BoolQueryBuilder, MatchQueryBuilder, TermQueryBuilder}
    import org.elasticsearch.search.builder.SearchSourceBuilder
    import org.elasticsearch.search.highlight.HighlightBuilder
    import org.elasticsearch.search.sort.SortOrder
    
    object MyEsUtil { 
    
      private var factory: JestClientFactory = null;
    
      def getClient: JestClient = { 
        if (factory == null) build();
        factory.getObject
      }
    
      def build(): Unit = { 
        factory = new JestClientFactory
        factory.setHttpClientConfig(new HttpClientConfig.Builder("http://hadoop102:9200")
          .multiThreaded(true)
          .maxTotalConnection(20)
          .connTimeout(10000).readTimeout(1000).build())
      }
    
    
      //查询数据
      //把结构封装成的Map 必须使用java的，不能使用scala
      def queryDoc(): Unit = { 
        val jest: JestClient = getClient
    
    
        val searchSourceBuilder = new SearchSourceBuilder
    
        val boolQueryBuilder = new BoolQueryBuilder
        boolQueryBuilder.must(new MatchQueryBuilder("name", "red"))
        boolQueryBuilder.filter(new TermQueryBuilder("actorList.name.keyword", "zhang han yu"))
        searchSourceBuilder.query(boolQueryBuilder)
        searchSourceBuilder.from(0).size(20)
        searchSourceBuilder.sort("doubanScore", SortOrder.DESC)
        searchSourceBuilder.highlight(new HighlightBuilder().field("name"))
        val query2 = searchSourceBuilder.toString
        print(query2)
        jest.close()
      }
    
      def main(args: Array[String]): Unit = { 
        queryDoc()
      }
    }

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NTQ4ODU1_size_16_color_FFFFFF_t_70_pic_center 4]  
可以到kibana打印看看！

[20201105212732451.png_pic_center]: /images/20221120/7cf26d31874a4fe294f3b7ebe272d859.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NTQ4ODU1_size_16_color_FFFFFF_t_70_pic_center]: /images/20221120/aa9961430f48424490a5e854639a4815.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NTQ4ODU1_size_16_color_FFFFFF_t_70_pic_center 1]: /images/20221120/6cdad4129f854152a9f1f3705c588da3.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NTQ4ODU1_size_16_color_FFFFFF_t_70_pic_center 2]: /images/20221120/3bed00815d934d129f6094e947169c7a.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NTQ4ODU1_size_16_color_FFFFFF_t_70_pic_center 3]: https://img-blog.csdnimg.cn/20201105214347346.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NTQ4ODU1,size_16,color_FFFFFF,t_70#pic_center
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NTQ4ODU1_size_16_color_FFFFFF_t_70_pic_center 4]: https://img-blog.csdnimg.cn/2020110521444092.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NTQ4ODU1,size_16,color_FFFFFF,t_70#pic_center