ELKstack-Elasticsearch各类安装部署方法

iutyhrg

                      手动安装部署Elasticsearch开篇开篇闲话，如果是新人在接触ELKstack什么都不懂的情况下，可以先看看各位前人写的关于ELKstack的博客，如何对ELKstack部署安装及使用，但是别人的东西只能作为借鉴，在自己搭建使用一定要以官方文档为准。
一定要注意软件版本，这里系统集合类软件，如果各软件版本不一致，会造成不可预估的后果！！！
资源列表官方文档： https://www.elastic.co/products/elasticsearch
elasticsearsh权威指南： http://es.xiaoleilu.com/
kibana中文指南:   http://kibana.logstash.es/content/
部署打开官网-->访问docs

我们以最新版本2.3来进行引导


下载方式安装
Installation
设置java环境

1 2	java -version echo $JAVA_HOME

下载elasticsearch压缩包
curl -L -O https://download.elastic.co/elas ... search-2.3.3.tar.gz
解压压缩包，解压后可以直接使用

1 2	tar -xvf elasticsearch-2.3.3.tar.gz cd elasticsearch-2.3.3/bin

启动elasticsearch

1	./elasticsearch

启动信息:

1 2 3 4 5 6 7 8 9 10 11 12

./elasticsearch [2014-03-1313:42:17,218][INFO ][node           ][NewGoblin] version[2.3.3], pid[2085], build[5c03844/2014-02-25T15:52:53Z] [2014-03-1313:42:17,219][INFO ][node           ][NewGoblin] initializing ... [2014-03-1313:42:17,223][INFO ][plugins        ][NewGoblin] loaded [], sites [] [2014-03-1313:42:19,831][INFO ][node           ][NewGoblin] initialized [2014-03-1313:42:19,832][INFO ][node           ][NewGoblin] starting ... [2014-03-1313:42:19,958][INFO ][transport      ][NewGoblin] bound_address {inet[/0:0:0:0:0:0:0:0:9300]}, publish_address {inet[/192.168.8.112:9300]} [2014-03-1313:42:23,030][INFO ][cluster.service][NewGoblin] new_master [NewGoblin][rWMtGj3dQouz2r6ZFL9v4g][mwubuntu1][inet[/192.168.8.112:9300]], reason: zen-disco-join (elected_as_master) [2014-03-1313:42:23,100][INFO ][discovery      ][NewGoblin] elasticsearch/rWMtGj3dQouz2r6ZFL9v4g [2014-03-1313:42:23,125][INFO ][http           ][NewGoblin] bound_address {inet[/0:0:0:0:0:0:0:0:9200]}, publish_address {inet[/192.168.8.112:9200]} [2014-03-1313:42:23,629][INFO ][gateway        ][NewGoblin] recovered [1] indices into cluster_state [2014-03-1313:42:23,630][INFO ][node           ][NewGoblin] started

设置集群名和节点名
./elasticsearch --cluster.name my_cluster_name --node.name my_node_name
yum方式安装
安装GPG验证KEY

rpm --import https://packages.elastic.co/GPG-KEY-elasticsearch

把下面的源配置加入到/etc/yum.repos.d/目录中的 a.repo文件里, 可以起名为：elasticsearch.repo

怎么配elasticsearch的repo源，我想中级以上的小伙伴都会

1 2 3 4 5 6 7 8

[elasticsearch-2.x] name=Elasticsearch repository for2.x packages baseurl=https://packages.elastic.co/elasticsearch/2.x/centos gpgcheck=1 gpgkey=https://packages.elastic.co/GPG-KEY-elasticsearch enabled=1 yum安装即可 yum install elasticsearch

基于salt自动化安装elasticsearch此处只是分享下salt安装elasticsearch的模板，写的比较粗糙，也是刚开始写，很多自定义配置未加入到模板中，后面会逐步改进，内容里不会涉及新手的入门知识，此类入门知识会逐步在salt模块进行分享。
配置state目录

1 2 3

file_roots: base_init: - /etc/salt/states

配置top.sls

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

[iyunv@sz-a-saltstack-xen states]# cat /etc/salt/states/top.sls '*': - init.yum_config - init.selinux_shutdown - init.limit - init.sshd_config - init.clock_config - init.ntp_config - init.user_config - init.salt_minion_config - init.tty_init - init.zabbix_agent 'sz-a-qhfaxes0[1,3]-es-hw': - jdk - elkstack.es

配置elkstack 目录es.sls

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70

elasticsearch-2: pkgrepo.managed: - humanname: Elasticsearch repository for 2.x packages - baseurl: https://packages.elastic.co/elasticsearch/2.x/centos - gpgcheck: 1 - gpgkey: https://packages.elastic.co/GPG-KEY-elasticsearch elasticsearch-server: pkg.installed: - pkgs: - elasticsearch - git - openssl.x86_64 - openssl-devel.x86_64 /etc/elasticsearch/elasticsearch.yml: file.managed: - source: salt://elkstack/files/elasticsearch.yml - template: jinja - user: elasticsearch - group: elasticsearch - require: - pkg: elasticsearch-server /data/qhfax_elckstack: file.directory: - user: elasticsearch - group: elasticsearch - makedirs: True elasticsearch_log_path: file.directory: - name: /var/log/elasticsearch - user: elasticsearch - group: elasticsearch - makedirs: True elasticsearch: service.running: - enable: True - watch: - pkg: elasticsearch-server - file: /etc/elasticsearch/elasticsearch.yml service_plugins_install: file.directory: - name: /root/soft - makedirs: True cmd.run: - cwd: /root/soft - name:  git clone https://github.com/elasticsearch/elasticsearch-servicewrapper.git && ls - unless: test -d /root/soft/elasticsearch-servicewrapper mv_service_es: cmd.run: - cwd: /root/soft - name:  cp -a elasticsearch-servicewrapper/service/  /usr/share/elasticsearch/bin - unless: - test -d /usr/share/elasticsearch/bin/service - test -d elasticsearch-servicewrapper/service ||  echo False head_plugins_install: cmd.run: - cwd: /usr/share/elasticsearch/bin - name:  /usr/share/elasticsearch/bin/plugin install mobz/elasticsearch-head - unless: test -d /usr/share/elasticsearch/plugins/head license_plugins_install: cmd.run: - cwd: /usr/share/elasticsearch/bin - name: /usr/share/elasticsearch/bin/plugin install license - unless: - test -d /usr/share/elasticsearch/plugins/license marvel_plugins_install: cmd.run: - cwd: /usr/share/elasticsearch/bin - name: /usr/share/elasticsearch/bin/plugin install marvel-agent - unless: - test -d /usr/share/elasticsearch/plugins/marvel-agent

上文sls模板存在问题：
1. 没有很好的使用到各类自定义和动态参数
2. 没有进行分层
我考虑应该使用一个应用的生命周期来进行分层，服务器始终保持无状态
安装前预环境 --> 安装 -->  升级