es 数据类型

谁借莪１个温暖的怀抱￠ 2021-09-02 10:56 448阅读 0赞

官网地址：[https://www.elastic.co/guide/en/elasticsearch/reference/current/mapping-types.html][https_www.elastic.co_guide_en_elasticsearch_reference_current_mapping-types.html]

## 核心数据类型 ##

### 1、字符串类型： ###

es6中，string类型已经被废弃了，需要使用text、keyword类型来代替。

**1）text类型：**

当一个字段需要用于全文搜索(会被分词)，比如产品名称、产品描述信息, 就应该使用text类型。该类型字段会通过分析器转成terms list，然后存入索引。该类型字段不用于排序、聚合操作。

curl -X PUT "localhost:9200/my_index?pretty" -H 'Content-Type: application/json' -d'
    {
      "mappings": {
        "my_type": {
          "properties": {
            "full_name": {
              "type":  "text"
            }
          }
        }
      }
    }
    '

**2）keyword类型：**

当一个字段需要按照精确值进行过滤、排序、聚合等操作时, 就应该使用keyword类型。该类型的字段值不会被分析器处理（分词）

curl -X PUT "localhost:9200/my_index?pretty" -H 'Content-Type: application/json' -d'
    {
      "mappings": {
        "my_type": {
          "properties": {
            "tags": {
              "type":  "keyword"
            }
          }
        }
      }
    }
    '

### 2、数字类型 ###

<table> 
 <thead> 
  <tr> 
   <th>类型</th> 
   <th>说明</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td>byte</td> 
   <td>有符号的8位整数, 范围: [-128 ~ 127]</td> 
  </tr> 
  <tr> 
   <td>short</td> 
   <td>有符号的16位整数, 范围: [-32768 ~ 32767]</td> 
  </tr> 
  <tr> 
   <td>integer</td> 
   <td>有符号的32位整数, 范围: [−231−231&nbsp;~&nbsp;231231-1]</td> 
  </tr> 
  <tr> 
   <td>long</td> 
   <td>有符号的64位整数, 范围: [−263−263&nbsp;~&nbsp;263263-1]</td> 
  </tr> 
  <tr> 
   <td>float</td> 
   <td>32位单精度浮点数</td> 
  </tr> 
  <tr> 
   <td>double</td> 
   <td>64位双精度浮点数</td> 
  </tr> 
  <tr> 
   <td>half_float</td> 
   <td>16位半精度IEEE 754浮点类型</td> 
  </tr> 
  <tr> 
   <td>scaled_float</td> 
   <td>缩放类型的的浮点数, 比如price字段只需精确到分, 57.34缩放因子为100, 存储结果为5734</td> 
  </tr> 
 </tbody> 
</table>

尽可能选择范围小的数据类型, 字段的长度越短, 索引和搜索的效率越高。示例：

curl -X PUT "localhost:9200/my_index?pretty" -H 'Content-Type: application/json' -d'
    {
      "mappings": {
        "my_type": {
          "properties": {
            "number_of_bytes": {
              "type": "integer"
            },
            "time_in_seconds": {
              "type": "float"
            },
            "price": {
              "type": "scaled_float",
              "scaling_factor": 100
            }
          }
        }
      }
    }
    '

### 3、boolean、binary类型 ###

**1）boolean类型：**

可以使用boolean类型的（true、false）也可以使用string类型的（“true”、“false”）。

curl -X PUT "localhost:9200/my_index?pretty" -H 'Content-Type: application/json' -d'
    {
      "mappings": {
        "my_type": {
          "properties": {
            "is_published": {
              "type": "boolean"
            }
          }
        }
      }
    }
    '
    #插入
    curl -X POST "localhost:9200/my_index/my_type/1?pretty" -H 'Content-Type: application/json' -d'
    {
      "is_published": "true" 
    }
    '
    #查询
    curl -X GET "localhost:9200/my_index/_search?pretty" -H 'Content-Type: application/json' -d'
    {
      "query": {
        "term": {
          "is_published": true 
        }
      }
    }
    '

**2）binary类型：**

二进制类型是Base64编码字符串的二进制值，不以默认的方式存储，且不能被搜索。

#添加映射
    PUT website
    {
        "mappings": {
            "blog": {
                "properties": {
                    "blob": {"type": "binary"}   // 二进制
                }
            }
        }
    }
    #添加数据
    PUT website/blog/1
    {
        "title": "Some binary blog",
        "blob": "hED903KSrA084fRiD5JLgY=="
    }

### 4、日期类型： ###

JSON没有日期数据类型, 所以在ES中, 日期可以是：

*  包含格式化日期的字符串, "2018-10-01", 或"2018/10/01 12:10:30".
 *  代表时间毫秒数的长整型数字.
 *  代表时间秒数的整数.

**1）使用format指定格式：**

若未指定格式，则使用默认格式: strict\_date\_optional\_time||epoch\_millis

curl -X PUT "localhost:9200/my_index?pretty" -H 'Content-Type: application/json' -d'
    {
      "mappings": {
        "my_type": {
          "properties": {
            "date": {
              "type": "date" 
            }
          }
        }
      }
    }
    '
    curl -X PUT "localhost:9200/my_index/my_type/1?pretty" -H 'Content-Type: application/json' -d'
    { "date": "2015-01-01" }
    '
    curl -X PUT "localhost:9200/my_index/my_type/2?pretty" -H 'Content-Type: application/json' -d'
    { "date": "2015-01-01T12:10:30Z" }
    '
    curl -X PUT "localhost:9200/my_index/my_type/3?pretty" -H 'Content-Type: application/json' -d'
    { "date": 1420070400001 }
    '
    curl -X GET "localhost:9200/my_index/_search?pretty" -H 'Content-Type: application/json' -d'
    {
      "sort": { "date": "asc"} 
    }
    '

**2）指定多个format：**

使用双竖线||分隔指定多种日期格式，每个格式都会被依次尝试，直到找到匹配的。

curl -X PUT "localhost:9200/my_index?pretty" -H 'Content-Type: application/json' -d'
    {
      "mappings": {
        "my_type": {
          "properties": {
            "date": {
              "type":   "date",
              "format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd||epoch_millis"
            }
          }
        }
      }
    }
    '

### 5、范围类型： ###

<table> 
 <thead> 
  <tr> 
   <th>类型</th> 
   <th>范围</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td>integer_range</td> 
   <td>−231−231&nbsp;~&nbsp;231−1231−1</td> 
  </tr> 
  <tr> 
   <td>long_range</td> 
   <td>−263−263&nbsp;~&nbsp;263−1263−1</td> 
  </tr> 
  <tr> 
   <td>float_range</td> 
   <td>32位单精度浮点型</td> 
  </tr> 
  <tr> 
   <td>double_range</td> 
   <td>64位双精度浮点型</td> 
  </tr> 
  <tr> 
   <td>date_range</td> 
   <td>64位整数, 毫秒计时</td> 
  </tr> 
  <tr> 
   <td>ip_range</td> 
   <td>IP值的范围, 支持IPV4和IPV6, 或者这两种同时存在</td> 
  </tr> 
 </tbody> 
</table>

#添加映射
    PUT company
    {
        "mappings": {
            "department": {
                "properties": {
                    "expected_number": {  // 预期员工数
                        "type": "integer_range"
                    },
                    "time_frame": {       // 发展时间线
                        "type": "date_range", 
                        "format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd||epoch_millis"
                    }
                }
            }
        }
    }
    #插入数据
    PUT company/department/1
    {
        "expected_number" : {
            "gte" : 10,
            "lte" : 20
        },
        "time_frame" : { 
            "gte" : "2018-10-01 12:00:00", 
            "lte" : "2018-11-01"
        }
    }
    #查询
    GET company/department/_search
    {
        "query": {
            "term": {
                "expected_number": {
                    "value": 12
                }
            }
        }
    }
    GET company/department/_search
    {
        "query": {
            "range": {
                "time_frame": {
                    "gte": "208-08-01",
                    "lte": "2018-12-01",
                    "relation": "within" 
                }
            }
        }
    }
    #查询结果
    {
      "took": 26,
      "timed_out": false,
      "_shards": {
        "total": 5,
        "successful": 5,
        "skipped": 0,
        "failed": 0
      },
      "hits": {
        "total": 1,
        "max_score": 1.0,
        "hits": [
          {
            "_index": "company",
            "_type": "department",
            "_id": "1",
            "_score": 1.0,
            "_source": {
              "expected_number": {
                "gte": 10,
                "lte": 20
              },
              "time_frame": {
                "gte": "2018-10-01 12:00:00",
                "lte": "2018-11-01"
              },
              "ip_whitelist" : "192.168.0.0/16"
            }
          }
        ]
      }
    }

## 复杂数据类型 ##

es支持复杂的数据类型，包括：object、array、nested。用的不是很多，举个实例：

#创建mapping
    curl -X PUT "localhost:9200/my_index?pretty" -H 'Content-Type: application/json' -d'
    {
      "mappings": {
        "my_type": { 
          "properties": {
            "region": {
              "type": "keyword"
            },
            "manager": { 
              "properties": {
                "age":  { "type": "integer" },
                "name": { 
                  "properties": {
                    "first": { "type": "text" },
                    "last":  { "type": "text" }
                  }
                }
              }
            }
          }
        }
      }
    }
    '
    #插入数据
    curl -X PUT "localhost:9200/my_index/my_type/1?pretty" -H 'Content-Type: application/json' -d'
    { 
      "region": "US",
      "manager": { 
        "age":     30,
        "name": { 
          "first": "John",
          "last":  "Smith"
        }
      }
    }
    '

存储方式：

{
      "region":             "US",
      "manager.age":        30,
      "manager.name.first": "John",
      "manager.name.last":  "Smith"
    }

## 地理位置数据 ##

### 1、geo point类型： ###

geo point类型用于存储地理位置的经纬度对，可用于：

*  查找一定范围内的地理点；
 *  通过地理位置或相对某个中心点的距离聚合文档；
 *  将距离整合到文档的相关性评分中；
 *  通过距离对文档进行排序。

#mapping
    PUT employee
    {
        "mappings": {
            "developer": {
                "properties": {
                    "location": {"type": "geo_point"}
                }
            }
        }
    }
    # 方式一: 纬度 + 经度键值对
    PUT employee/developer/1
    {
        "text": "小蛮腰-键值对地理点参数", 
        "location": {
            "lat": 23.11, "lon": 113.33		// 纬度: latitude, 经度: longitude
        }
    }
    
    # 方式二: "纬度, 经度"的字符串参数
    PUT employee/developer/2
    {
      "text": "小蛮腰-字符串地理点参数",
      "location": "23.11, 113.33" 			// 纬度, 经度
    }
    
    # 方式三: ["经度, 纬度"] 数组地理点参数
    PUT employee/developer/3
    {
      "text": "小蛮腰-数组参数",
      "location": [ 113.33, 23.11 ] 		// 经度, 纬度
    }
    
    #查询
    GET employee/_search
    {
        "query": { 
            "geo_bounding_box": { 
                "location": {
                    "top_left": { "lat": 24, "lon": 113 },		// 地理盒子模型的上-左边
                    "bottom_right": { "lat": 22, "lon": 114 }	// 地理盒子模型的下-右边
                }
            }
        }
    }

### 2、geo shape类型： ###

使用较少，可参考：[https://blog.csdn.net/u012332735/article/details/54971638][https_blog.csdn.net_u012332735_article_details_54971638]

参考：

[https://www.cnblogs.com/shoufeng/p/10692113.html][https_www.cnblogs.com_shoufeng_p_10692113.html]

[https_www.elastic.co_guide_en_elasticsearch_reference_current_mapping-types.html]: https://www.elastic.co/guide/en/elasticsearch/reference/current/mapping-types.html
[https_blog.csdn.net_u012332735_article_details_54971638]: https://blog.csdn.net/u012332735/article/details/54971638
[https_www.cnblogs.com_shoufeng_p_10692113.html]: https://www.cnblogs.com/shoufeng/p/10692113.html