ES字段数据建模

刺骨的言语ヽ痛彻心扉 2022-11-06 05:53 148阅读 0赞

数据建模是建立数据模型的过程，数据模型是指对现实世界的抽象，其过程包括：概念模型->逻辑模型->数据模型。ES字段数据建模需要考虑以下几个角度：字段类型、是否索引、是否聚合和排序、是否额外存储等。在Mapping中进行设置，index设置是否索引，doc\_values设置是否进行聚合和排序（如果字段只是进行聚合，可以用norms设置节约存储空间），enable设置是否设置字段同时不索引、不聚合和排序，store设置字段是否需要额外存储，对于当source较大时候，需要关闭source则在source上设置enable false,同时对于要存储的字段设置store为true,且在查询时候使用stored\_fields指定查询的字段。

1 Index 一本书的信息
    PUT books/_doc/1
    {
      "title":"Mastering ElasticSearch 5.0",
      "description":"Master the searching, indexing, and aggregation features in ElasticSearch Improve users’ search experience with Elasticsearch’s functionalities and develop your own Elasticsearch plugins",
      "author":"Bharvi Dixit",
      "public_date":"2017",
      "cover_url":"https://images-na.ssl-images-amazon.com/images/I/51OeaMFxcML.jpg"
    }
    
    
    2 查询自动创建的Mapping
    GET books/_mapping
    
    3 删除
    DELETE books
    
    4 优化字段类型 cover_url不被检索
    PUT books
    {
          "mappings" : {
          "properties" : {
            "author" : {"type" : "keyword"},
            "cover_url" : {"type" : "keyword","index": false},
            "description" : {"type" : "text"},
            "public_date" : {"type" : "date"},
            "title" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 100
                }
              }
            }
          }
        }
    }
    
    5 Cover URL index 设置成false，无法对该字段进行搜索
    POST books/_search
    {
      "query": {
        "term": {
          "cover_url": {
            "value": "https://images-na.ssl-images-amazon.com/images/I/51OeaMFxcML.jpg"
          }
        }
      }
    }
    
    
    6 Cover URL index 设置成false，依然支持聚合分析
    POST books/_search
    {
      "aggs": {
        "cover": {
          "terms": {
            "field": "cover_url",
            "size": 10
          }
        }
      }
    }
    
    
    7 删除
    DELETE books
    
    
    8 新增 Content字段。数据量很大。选择将Source 关闭，需要存储的字段store设置true，在查询时候需要设置stored_fields指定查询的字段
    PUT books
    {
          "mappings" : {
          "_source": {"enabled": false},
          "properties" : {
            "author" : {"type" : "keyword","store": true},
            "cover_url" : {"type" : "keyword","index": false,"store": true},
            "description" : {"type" : "text","store": true},
             "content" : {"type" : "text","store": true},
            "public_date" : {"type" : "date","store": true},
            "title" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 100
                }
              },
              "store": true
            }
          }
        }
    }
    
    
    9 Index 一本书的信息,包含Content
    PUT books/_doc/1
    {
      "title":"Mastering ElasticSearch 5.0",
      "description":"Master the searching, indexing, and aggregation features in ElasticSearch Improve users’ search experience with Elasticsearch’s functionalities and develop your own Elasticsearch plugins",
      "content":"The content of the book......Indexing data, aggregation, searching.    something else. something in the way............",
      "author":"Bharvi Dixit",
      "public_date":"2017",
      "cover_url":"https://images-na.ssl-images-amazon.com/images/I/51OeaMFxcML.jpg"
    }
    
    10 查询结果中，Source不包含数据
    POST books/_search
    {}
    
    11 搜索，通过store_fields 字段指定显示数据，同时高亮显示 conent的内容
    POST books/_search
    {
      "stored_fields": ["title","author","public_date"],
      "query": {
        "match": {
          "content": "searching"
        }
      },
    
      "highlight": {
        "fields": {
          "content":{}
        }
      }
    
    }