通过Docker部署Elasticsearch集群

忘是亡心i 2023-03-13 09:16 98阅读 0赞

以7.6.2为例

Elasticsearch

挂载

在宿主机上创建Elasticsearch的数据存储、config配置目录
eg:

  1. 数据存储：
  2. mkdir /data/es/data-b
  3. 配置文件
  4. mkdir /home/es/elasticsearch-7.6.2/config

新建用户 adduser es
数据存储需要赋予权限：sudo chown -R 1000:1000 /data/es/data-b

Elasticsearch配置

在/home/es/elasticsearch-7.6.2/config文件夹下新建elasticsearch.yml、 jvm.options

具体内容可以参考：
elasticsearch.yml

  1. cluster.name: business-log
  2. node.name: es-b-188
  3. http.port: 9201
  4. transport.tcp.port: 9301
  5. discovery.seed_hosts: ["10.133.0.188","10.133.0.190","10.133.0.191"]
  6. cluster.initial_master_nodes: ["10.133.0.188","10.133.0.190","10.133.0.191"]
  7. network.bind_host: 10.133.0.188
  8. network.publish_host: 10.133.0.188

jvm.options

  1. ## JVM configuration
  3. ################################################################
  4. ## IMPORTANT: JVM heap size
  5. ################################################################
  6. ##
  7. ## You should always set the min and max JVM heap
  8. ## size to the same value. For example, to set
  9. ## the heap to 4 GB, set:
  10. ##
  11. ## -Xms4g
  12. ## -Xmx4g
  13. ##
  14. ## See https://www.elastic.co/guide/en/elasticsearch/reference/current/heap-size.html
  15. ## for more information
  16. ##
  17. ################################################################
  19. # Xms represents the initial size of total heap space
  20. # Xmx represents the maximum size of total heap space
  22. -Xms26g
  23. -Xmx26g
  25. ################################################################
  26. ## Expert settings
  27. ################################################################
  28. ##
  29. ## All settings below this section are considered
  30. ## expert settings. Don't tamper with them unless
  31. ## you understand what you are doing
  32. ##
  33. ################################################################
  35. ## GC configuration
  36. #-XX:+UseConcMarkSweepGC
  37. #-XX:CMSInitiatingOccupancyFraction=75
  38. #-XX:+UseCMSInitiatingOccupancyOnly
  40. ## G1GC Configuration
  41. # NOTE: G1GC is only supported on JDK version 10 or later.
  42. # To use G1GC uncomment the lines below.
  43. #-XX:-UseConcMarkSweepGC
  44. #-XX:-UseCMSInitiatingOccupancyOnly
  45. -XX:+UseG1GC
  46. -XX:InitiatingHeapOccupancyPercent=75
  48. ## DNS cache policy
  49. # cache ttl in seconds for positive DNS lookups noting that this overrides the
  50. # JDK security property networkaddress.cache.ttl; set to -1 to cache forever
  51. -Des.networkaddress.cache.ttl=60
  52. # cache ttl in seconds for negative DNS lookups noting that this overrides the
  53. # JDK security property networkaddress.cache.negative ttl; set to -1 to cache
  54. # forever
  55. -Des.networkaddress.cache.negative.ttl=10
  57. ## optimizations
  59. # pre-touch memory pages used by the JVM during initialization
  60. -XX:+AlwaysPreTouch
  62. ## basic
  64. # explicitly set the stack size
  65. -Xss1m
  67. # set to headless, just in case
  68. -Djava.awt.headless=true
  70. # ensure UTF-8 encoding by default (e.g. filenames)
  71. -Dfile.encoding=UTF-8
  73. # use our provided JNA always versus the system one
  74. -Djna.nosys=true
  76. # turn off a JDK optimization that throws away stack traces for common
  77. # exceptions because stack traces are important for debugging
  78. -XX:-OmitStackTraceInFastThrow
  80. # flags to configure Netty
  81. -Dio.netty.noUnsafe=true
  82. -Dio.netty.noKeySetOptimization=true
  83. -Dio.netty.recycler.maxCapacityPerThread=0
  85. # log4j 2
  86. -Dlog4j.shutdownHookEnabled=false
  87. -Dlog4j2.disable.jmx=true
  89. -Djava.io.tmpdir=${ES_TMPDIR}
  91. ## heap dumps
  93. # generate a heap dump when an allocation from the Java heap fails
  94. # heap dumps are created in the working directory of the JVM
  95. -XX:+HeapDumpOnOutOfMemoryError
  97. # specify an alternative path for heap dumps; ensure the directory exists and
  98. # has sufficient space
  99. -XX:HeapDumpPath=data
  101. # specify an alternative path for JVM fatal error logs
  102. -XX:ErrorFile=logs/hs_err_pid%p.log
  104. ## JDK 8 GC logging
  106. 8:-XX:+PrintGCDetails
  107. 8:-XX:+PrintGCDateStamps
  108. 8:-XX:+PrintTenuringDistribution
  109. 8:-XX:+PrintGCApplicationStoppedTime
  110. 8:-Xloggc:logs/gc.log
  111. 8:-XX:+UseGCLogFileRotation
  112. 8:-XX:NumberOfGCLogFiles=32
  113. 8:-XX:GCLogFileSize=64m
  115. # JDK 9+ GC logging
  116. 9-:-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m
  117. # due to internationalization enhancements in JDK 9 Elasticsearch need to set the provider to COMPAT otherwise
  118. # time/date parsing will break in an incompatible way for some date patterns and locals
  119. 9-:-Djava.locale.providers=COMPAT

启动

创建docker-compose.yml文件，内容如下：

  1. version: '2.2'
  2. services:
  3.   elasticsearch:
  4.     image: elasticsearch:7.6.2
  5.     restart: always
  6.     container_name: es-b-188
  7.     network_mode: host
  8.     volumes:
  9.       - /data/es/data-b:/usr/share/elasticsearch/data
  10.       - /home/es/elasticsearch-7.6.2/config/elasticsearch.yml:/usr/share/elasticsearch/config/elasticsearch.yml
  11.       - /home/es/elasticsearch-7.6.2/config/jvm.options:/usr/share/elasticsearch/config/jvm.options
  12.     environment:
  13.       - bootstrap.memory_lock=true
  14.     ulimits:
  15.       memlock:
  16.         soft: -1
  17.         hard: -1

启动：

  1. docker-compose up -d

备注

elasticsearch.yml、jvm.options、docker-compose.yml等每个节点都需要配置，其中elasticsearch.yml、docker-compose.yml具体节点信息需要替换。

Kibana

挂载

在宿主机上创建kibana config配置目录
eg:

  1. 配置文件
  2. mkdir /home/es/kibana-7.6.2

Kibana配置

在/home/es/kibana-7.6.2目录下创建kibana.yml，具体内容如下：

  1. # Kibana is served by a back end server. This setting specifies the port to use.
  2. server.port: 5602
  4. # Specifies the address to which the Kibana server will bind. IP addresses and host names are both valid values.
  5. # The default is 'localhost', which usually means remote machines will not be able to connect.
  6. # To allow connections from remote users, set this parameter to a non-loopback address.
  7. server.host: 0.0.0.0
  9. # Enables you to specify a path to mount Kibana at if you are running behind a proxy.
  10. # Use the `server.rewriteBasePath` setting to tell Kibana if it should remove the basePath
  11. # from requests it receives, and to prevent a deprecation warning at startup.
  12. # This setting cannot end in a slash.
  13. #server.basePath: ""
  15. # Specifies whether Kibana should rewrite requests that are prefixed with
  16. # `server.basePath` or require that they are rewritten by your reverse proxy.
  17. # This setting was effectively always `false` before Kibana 6.3 and will
  18. # default to `true` starting in Kibana 7.0.
  19. #server.rewriteBasePath: false
  21. # The maximum payload size in bytes for incoming server requests.
  22. #server.maxPayloadBytes: 1048576
  24. # The Kibana server's name.  This is used for display purposes.
  25. #server.name: "your-hostname"
  27. # The URLs of the Elasticsearch instances to use for all your queries.
  28. elasticsearch.hosts: ["http://10.133.0.188:9201"]
  30. # When this setting's value is true Kibana uses the hostname specified in the server.host
  31. # setting. When the value of this setting is false, Kibana uses the hostname of the host
  32. # that connects to this Kibana instance.
  33. #elasticsearch.preserveHost: true
  35. # Kibana uses an index in Elasticsearch to store saved searches, visualizations and
  36. # dashboards. Kibana creates a new index if the index doesn't already exist.
  37. #kibana.index: ".kibana"
  39. # The default application to load.
  40. #kibana.defaultAppId: "home"
  42. # If your Elasticsearch is protected with basic authentication, these settings provide
  43. # the username and password that the Kibana server uses to perform maintenance on the Kibana
  44. # index at startup. Your Kibana users still need to authenticate with Elasticsearch, which
  45. # is proxied through the Kibana server.
  46. #elasticsearch.username: "kibana"
  47. #elasticsearch.password: "pass"
  49. # Enables SSL and paths to the PEM-format SSL certificate and SSL key files, respectively.
  50. # These settings enable SSL for outgoing requests from the Kibana server to the browser.
  51. #server.ssl.enabled: false
  52. #server.ssl.certificate: /path/to/your/server.crt
  53. #server.ssl.key: /path/to/your/server.key
  55. # Optional settings that provide the paths to the PEM-format SSL certificate and key files.
  56. # These files are used to verify the identity of Kibana to Elasticsearch and are required when
  57. # xpack.security.http.ssl.client_authentication in Elasticsearch is set to required.
  58. #elasticsearch.ssl.certificate: /path/to/your/client.crt
  59. #elasticsearch.ssl.key: /path/to/your/client.key
  61. # Optional setting that enables you to specify a path to the PEM file for the certificate
  62. # authority for your Elasticsearch instance.
  63. #elasticsearch.ssl.certificateAuthorities: [ "/path/to/your/CA.pem" ]
  65. # To disregard the validity of SSL certificates, change this setting's value to 'none'.
  66. #elasticsearch.ssl.verificationMode: full
  68. # Time in milliseconds to wait for Elasticsearch to respond to pings. Defaults to the value of
  69. # the elasticsearch.requestTimeout setting.
  70. #elasticsearch.pingTimeout: 1500
  72. # Time in milliseconds to wait for responses from the back end or Elasticsearch. This value
  73. # must be a positive integer.
  74. #elasticsearch.requestTimeout: 30000
  76. # List of Kibana client-side headers to send to Elasticsearch. To send *no* client-side
  77. # headers, set this value to [](an empty list).
  78. #elasticsearch.requestHeadersWhitelist: [ authorization ]
  80. # Header names and values that are sent to Elasticsearch. Any custom headers cannot be overwritten
  81. # by client-side headers, regardless of the elasticsearch.requestHeadersWhitelist configuration.
  82. #elasticsearch.customHeaders: {}
  84. # Time in milliseconds for Elasticsearch to wait for responses from shards. Set to 0 to disable.
  85. #elasticsearch.shardTimeout: 30000
  87. # Time in milliseconds to wait for Elasticsearch at Kibana startup before retrying.
  88. #elasticsearch.startupTimeout: 5000
  90. # Logs queries sent to Elasticsearch. Requires logging.verbose set to true.
  91. #elasticsearch.logQueries: false
  93. # Specifies the path where Kibana creates the process ID file.
  94. #pid.file: /var/run/kibana.pid
  96. # Enables you specify a file where Kibana stores log output.
  97. #logging.dest: stdout
  99. # Set the value of this setting to true to suppress all logging output.
  100. #logging.silent: false
  102. # Set the value of this setting to true to suppress all logging output other than error messages.
  103. #logging.quiet: false
  105. # Set the value of this setting to true to log all events, including system usage information
  106. # and all requests.
  107. #logging.verbose: false
  109. # Set the interval in milliseconds to sample system and process performance
  110. # metrics. Minimum is 100ms. Defaults to 5000.
  111. #ops.interval: 5000
  113. # Specifies locale to be used for all localizable strings, dates and number formats.
  114. # Supported languages are the following: English - en , by default , Chinese - zh-CN .
  115. #i18n.locale: "en"

启动

创建docker-compose.yml文件，内容如下：

  1. version: '2'
  2. services:
  3.   kibana:
  4.     image: kibana:7.6.2
  5.     volumes:
  6.       - ./kibana.yml:/usr/share/kibana/config/kibana.yml
  7.     ports:
  8.       - '5602:5602/tcp'

启动：

  1. docker-compose up -d

官方文档

https://www.elastic.co/guide/en/elasticsearch/reference/7.5/docker.html
https://www.elastic.co/guide/en/kibana/current/docker.html

个人微信公众号

在这里插入图片描述

发表评论

表情：
评论列表 （有 0 条评论，98人围观）

还没有评论，来说两句吧...

相关阅读