首页 技术 正文
技术 2022年11月15日
0 收藏 966 点赞 3,045 浏览 8982 个字

ElasticSearch 规划-集群规划

ElasticSearch 全文检索— ElasticSearch 安装部署

ElasticSearch 规划-集群规划

ElasticSearch 全文检索— ElasticSearch 安装部署

ElasticSearch 规划-用户规划

ElasticSearch 全文检索— ElasticSearch 安装部署

ElasticSearch 规划-目录规

ElasticSearch 全文检索— ElasticSearch 安装部署

ElasticSearch 集群环境检查-时钟同步

 1.设置本地时间

 cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime

 2.集群时间日期同步NTP

  yum install ntp ntpdate pool.ntp.org

ElasticSearch 集群环境检查-hosts文件检查

 1.配置ElasticSearch集群ip与hostname之间的对应关系

 vi /etc/hosts  192.168.86.135 masternode
  192.168.86.136 slavenode1
  192.168.86.137 slavenode2

 2.ElasticSearch 集群环境检查-禁用防火墙

  查看防火墙状态

 service iptables status

  关闭防火墙

chkconfig iptables off //永久关闭防火墙service iptables stop //临时关闭防火墙

ElasticSearch 集群安装

 1.下载

https://www.elastic.co/

 2.上传并解压

[hadoop@masternode es]$ cd /home/hadoop/app/
[hadoop@masternode app]$ ls
hadoop jdk1..0_60 zookeeper
[hadoop@masternode app]$ rz[hadoop@masternode app]$ rz[hadoop@masternode app]$ ls
elasticsearch-2.4..tar.gz hadoop jdk1..0_60 kibana-4.6.-linux-x86_64.tar.gz zookeeper
[hadoop@masternode app]$ tar -xvf elasticsearch-2.4..tar.gz
[hadoop@masternode app]$ rm -rf elasticsearch-2.4..tar.gz

 3.修改config/elasticsearch.yml配置文件

[hadoop@masternode app]$ cd elasticsearch-2.4./
[hadoop@masternode elasticsearch-2.4.]$ ls
bin config lib LICENSE.txt modules NOTICE.txt README.textile
[hadoop@masternode elasticsearch-2.4.]$ cd config/
[hadoop@masternode config]$ ls
elasticsearch.yml logging.yml
[hadoop@masternode config]$ vim elasticsearch.yml

ElasticSearch 全文检索— ElasticSearch 安装部署

ElasticSearch 全文检索— ElasticSearch 安装部署

ElasticSearch 全文检索— ElasticSearch 安装部署

 4.路径创建

[hadoop@masternode data]$ mkdir es/
[hadoop@masternode data]$ cd es
[hadoop@masternode es]$ mkdir data
[hadoop@masternode es]$ mkdir datalog
[hadoop@masternode es]$ mkdir pid
[hadoop@masternode es]$ ls
data datalog pid

ElasticSearch 全文检索— ElasticSearch 安装部署

 5.分发到其他节点并修改以下配置

[hadoop@masternode app]$ scp -r elasticsearch-2.4./ slavenode1:/home/hadoop/app/
[hadoop@masternode app]$ scp -r elasticsearch-2.4./ slavenode2:/home/hadoop/app/

  Slavenode1:

ElasticSearch 全文检索— ElasticSearch 安装部署

ElasticSearch 全文检索— ElasticSearch 安装部署

  Slavenode2:

ElasticSearch 全文检索— ElasticSearch 安装部署

ElasticSearch 全文检索— ElasticSearch 安装部署

  其它配置不变。

ElasticSearch 插件安装

 1.安装marvel插件(所有节点都需要安装)

[hadoop@masternode app]$ cd elasticsearch-2.4.
[hadoop@masternode elasticsearch-2.4.]$ su
Password:
[root@masternode elasticsearch-2.4.]# bin/plugin install license
-> Installing license...
Plugins directory [/home/hadoop/app/elasticsearch-2.4./plugins] does not exist. Creating...
Trying https://download.elastic.co/elasticsearch/release/org/elasticsearch/plugin/license/2.4.0/license-2.4.0.zip ...
Downloading .......DONE
Verifying https://download.elastic.co/elasticsearch/release/org/elasticsearch/plugin/license/2.4.0/license-2.4.0.zip checksums if available ...
Downloading .DONE
Installed license into /home/hadoop/app/elasticsearch-2.4./plugins/license
[root@masternode elasticsearch-2.4.]# bin/plugin install marvel-agent
-> Installing marvel-agent...
Trying https://download.elastic.co/elasticsearch/release/org/elasticsearch/plugin/marvel-agent/2.4.0/marvel-agent-2.4.0.zip ...
Downloading ..........DONE
Verifying https://download.elastic.co/elasticsearch/release/org/elasticsearch/plugin/marvel-agent/2.4.0/marvel-agent-2.4.0.zip checksums if available ...
Downloading .DONE
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@ WARNING: plugin requires additional permissions @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
* java.lang.RuntimePermission setFactory
* javax.net.ssl.SSLPermission setHostnameVerifier
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html
for descriptions of what these permissions allow and the associated risks.Continue with installation? [y/N]y
Installed marvel-agent into /home/hadoop/app/elasticsearch-2.4./plugins/marvel-agent

 2.安装head插件(选择一个节点安装即可)

[root@masternode elasticsearch-2.4.]# bin/plugin install mobz/elasticsearch-head
-> Installing mobz/elasticsearch-head...
Trying https://github.com/mobz/elasticsearch-head/archive/master.zip ...
Downloading ...................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DONE
Verifying https://github.com/mobz/elasticsearch-head/archive/master.zip checksums if available ...
NOTE: Unable to verify checksum for downloaded plugin (unable to find .sha1 or .md5 file to verify)
Installed head into /home/hadoop/app/elasticsearch-2.4./plugins/head
[root@masternode elasticsearch-2.4.]# ls
bin config lib LICENSE.txt modules NOTICE.txt plugins README.textile
[root@masternode elasticsearch-2.4.]# cd plugins/
[root@masternode plugins]# ls
head license marvel-agent

Kibana 安装

 1.下载

https://www.elastic.co/

 2.解压

[root@masternode plugins]# cd ..
[root@masternode elasticsearch-2.4.]# cd ..
[root@masternode app]# tar –xvf kibana-4.6.-linux-x86_64.tar.gz
[root@masternode app]# rm -rf kibana-4.6.-linux-x86_64.tar.gz
[root@masternode app]# ls
elasticsearch-2.4. hadoop jdk1..0_60 kibana-4.6.-linux-x86_64 zookeeper

 3.修改kibana.yml配置文件

[root@masternode app]# cd kibana-4.6.-linux-x86_64/
[root@masternode kibana-4.6.-linux-x86_64]# ls
bin config data installedPlugins LICENSE.txt node node_modules optimize package.json README.txt src webpackShims
[root@masternode kibana-4.6.-linux-x86_64]# cd config/
[root@masternode config]# ls
kibana.yml
[root@masternode config]# vim kibana.yml 

ElasticSearch 全文检索— ElasticSearch 安装部署

 4.安装marvel插件

[root@masternode config]# cd ..
[root@masternode kibana-4.6.-linux-x86_64]# bin/kibana plugin --install elasticsearch/marvel/latest
Installing marvel
Attempting to transfer from https://download.elastic.co/elasticsearch/marvel/marvel-latest.tar.gz
Transferring bytes....................
Transfer complete
Extracting plugin archive
Extraction complete
Optimizing and caching browser bundles...
Plugin installation complete
[root@masternode kibana-4.6.-linux-x86_64]# ls
bin config data installedPlugins LICENSE.txt node node_modules optimize package.json README.txt src webpackShims
[root@masternode kibana-4.6.-linux-x86_64]# cd installedPlugins/
[root@masternode installedPlugins]# ls
Marvel

ElasticSearch、Kibana 启动

 前台启动

  1.启动ElasticSearch

[root@masternode kibana-4.6.-linux-x86_64]# su Hadoop
[hadoop@masternode elasticsearch-2.4.]$ bin/elasticsearch //在三个节点执行相同的操作
[-- ::,][WARN ][bootstrap ] unable to install syscall filter: seccomp unavailable: requires kernel 3.5+ with CONFIG_SECCOMP and CONFIG_SECCOMP_FILTER compiled in
[-- ::,][INFO ][node ] [node-] version[2.4.], pid[], build[ce9f0c7/--29T09::17Z]
[-- ::,][INFO ][node ] [node-] initializing ...
[-- ::,][INFO ][plugins ] [node-] modules [reindex, lang-expression, lang-groovy], plugins [head, license, marvel-agent], sites [head]
[-- ::,][INFO ][env ] [node-] using [] data paths, mounts [[/home (/dev/sda2)]], net usable_space [.7gb], net total_space [.8gb], spins? [possibly], types [ext4]
[-- ::,][INFO ][env ] [node-] heap size [.6mb], compressed ordinary object pointers [true]
[-- ::,][WARN ][env ] [node-] max file descriptors [] for elasticsearch process likely too low, consider increasing to at least []
[-- ::,][INFO ][node ] [node-] initialized
[-- ::,][INFO ][node ] [node-] starting ...
[-- ::,][INFO ][transport ] [node-] publish_address {192.168.86.135:}, bound_addresses {192.168.86.135:}
[-- ::,][INFO ][discovery ] [node-] escluster/pT7mHJglTw6euS87IbvMGg
[-- ::,][INFO ][marvel.agent.exporter ] [node-] skipping exporter [default_local] as it isn't ready yet
[-- ::,][INFO ][marvel.agent.exporter ] [node-] skipping exporter [default_local] as it isn't ready yet
[-- ::,][INFO ][marvel.agent.exporter ] [node-] skipping exporter [default_local] as it isn't ready yet
[-- ::,][WARN ][discovery ] [node-] waited for 30s and no initial state was set by the discovery
[-- ::,][INFO ][http ] [node-] publish_address {192.168.86.135:}, bound_addresses {192.168.86.135:}
[-- ::,][INFO ][node ] [node-] started

  启动之后打开网页可以查看其状态:

ElasticSearch 全文检索— ElasticSearch 安装部署

  2.启动kibana

[hadoop@masternode kibana-4.6.-linux-x86_64]$ bin/kibana
log [::07.744] [info][status][plugin:kibana@1.0.] Status changed from uninitialized to green - Ready
log [::07.792] [info][status][plugin:elasticsearch@1.0.] Status changed from uninitialized to yellow - Waiting for Elasticsearch
log [::07.816] [info][status][plugin:marvel@2.4.] Status changed from uninitialized to yellow - Waiting for Elasticsearch
log [::07.856] [info][status][plugin:kbn_vislib_vis_types@1.0.] Status changed from uninitialized to green - Ready
log [::09.699] [info][status][plugin:markdown_vis@1.0.] Status changed from uninitialized to green - Ready
log [::09.713] [info][status][plugin:metric_vis@1.0.] Status changed from uninitialized to green - Ready
log [::09.719] [info][status][plugin:spyModes@1.0.] Status changed from uninitialized to green - Ready
log [::09.723] [info][status][plugin:statusPage@1.0.] Status changed from uninitialized to green - Ready
log [::09.727] [info][status][plugin:table_vis@1.0.] Status changed from uninitialized to green - Ready
log [::09.736] [info][listening] Server running at http://0.0.0.0:5601
log [::14.719] [info][status][plugin:elasticsearch@1.0.] Status changed from yellow to yellow - No existing Kibana index found
log [::17.640] [info][status][plugin:marvel@2.4.] Status changed from yellow to green - Marvel ready
log [::17.644] [info][status][plugin:elasticsearch@1.0.] Status changed from yellow to green - Kibana index ready

 ElasticSearch 全文检索— ElasticSearch 安装部署

ElasticSearch 全文检索— ElasticSearch 安装部署

ElasticSearch 全文检索— ElasticSearch 安装部署

ElasticSearch 全文检索— ElasticSearch 安装部署

 后台启动

bin/elasticsearch  -d  -p /home/hadoop/data/es/pid    //三个节点都执行nohup /home/ybxiang/kibana/kibana-4.5.-linux-x64/bin/kibana & exit     //主节点执行

以上就是博主为大家介绍的这一板块的主要内容,这都是博主自己的学习过程,希望能给大家带来一定的指导作用,有用的还望大家点个支持,如果对你没用也望包涵,有错误烦请指出。如有期待可关注博主以第一时间获取更新哦,谢谢!

相关推荐
python开发_常用的python模块及安装方法
adodb:我们领导推荐的数据库连接组件bsddb3:BerkeleyDB的连接组件Cheetah-1.0:我比较喜欢这个版本的cheeta…
日期:2022-11-24 点赞:878 阅读:8,942
Educational Codeforces Round 11 C. Hard Process 二分
C. Hard Process题目连接:http://www.codeforces.com/contest/660/problem/CDes…
日期:2022-11-24 点赞:807 阅读:5,466
下载Ubuntn 17.04 内核源代码
zengkefu@server1:/usr/src$ uname -aLinux server1 4.10.0-19-generic #21…
日期:2022-11-24 点赞:569 阅读:6,281
可用Active Desktop Calendar V7.86 注册码序列号
可用Active Desktop Calendar V7.86 注册码序列号Name: www.greendown.cn Code: &nb…
日期:2022-11-24 点赞:733 阅读:6,095
Android调用系统相机、自定义相机、处理大图片
Android调用系统相机和自定义相机实例本博文主要是介绍了android上使用相机进行拍照并显示的两种方式,并且由于涉及到要把拍到的照片显…
日期:2022-11-24 点赞:512 阅读:7,728
Struts的使用
一、Struts2的获取  Struts的官方网站为:http://struts.apache.org/  下载完Struts2的jar包,…
日期:2022-11-24 点赞:671 阅读:4,765