黑猴子的家：Cloudera Manager 之 Yum私有仓在

1、安装部署httpd服务

[root@hadoop102 ~]# yum install -y httpd

[root@hadoop102 ~]# systemctl start httpd

[root@hadoop102 ~]# cd /var/www/html/
[root@hadoop102 html]# echo "I Love Cloudera Manager" >> index.html
[root@hadoop102 html]# curl http://localhost
I Love Cloudera Manager

[root@hadoop102 ~]# vim /etc/httpd/conf/httpd.conf
AddType application/x-gzip .gz .tgz .parcel

[root@hadoop102 ~]# systemctl restart httpd

2、安装第三方依赖

在三台节点（所有agent的节点）上执行下载第三方依赖

[root@hadoop102 ~]# yum -y install chkconfig python bind-utils psmisc libxslt zlib sqlite cyrus-sasl-plain cyrus-sasl-gssapi fuse fuse-libs redhat-lsb mod_ssl httpd

[root@hadoop103 ~]# yum -y install chkconfig python bind-utils psmisc libxslt zlib sqlite cyrus-sasl-plain cyrus-sasl-gssapi fuse fuse-libs redhat-lsb mod_ssl httpd

[root@hadoop104 ~]# yum -y install chkconfig python bind-utils psmisc libxslt zlib sqlite cyrus-sasl-plain cyrus-sasl-gssapi fuse fuse-libs redhat-lsb mod_ssl httpd

尖叫提示：所有节点都执行

3、部署本地yum仓

1）上传cm5.14.1-centos7.tar.gz安装包

[root@hadoop102 software]# ls -l
-rw-r--r-- 1 root root 984950572 May  5 22:35 cm5.14.1-centos7.tar.gz

2）解压

[root@hadoop102 software]# tar -xzvf cm5.14.1-centos7.tar.gz -C /var/www/html/

3）创建cloudera-repo.repo文件

[root@hadoop102 ~]# vim /etc/yum.repos.d/cloudera-repo.repo
[cloudera-repo]
name=cloudera-repo
baseurl=http://hadoop102/cm/5/
enabled=1
gpgcheck=0

4）访问

http://192.168.2.102/cm/5/

5）分发

[root@hadoop102 yum.repos.d]# xsync.sh cloudera-repo.repo

4、安装Cloudera Manager

1）hadoop102

[root@hadoop102 module]# yum -y install cloudera-manager-daemons cloudera-manager-agent cloudera-manager-server

2）hadoop103 and hadoop104

[root@hadoop103 module]# yum install -y cloudera-manager-daemons cloudera-manager-agent
[root@hadoop104 module]# yum install -y cloudera-manager-daemons cloudera-manager-agent

5、添加驱动包

1）拷贝

[root@hadoop102 /]# cp mysql-connector-java-5.1.27-bin.jar /usr/share/java/mysql-connector-java.jar

尖叫提示: 注意jar包名称要修改为mysql-connector-java.jar
2）分发

[root@hadoop102 ~]# cd /usr/share/java/
[root@hadoop102 java]# xsync mysql-connector-java.jar

6、配置agent

1）hadoop102

[root@hadoop102 ~]# vim /etc/cloudera-scm-agent/config.ini
[General]
# Hostname of the CM server.
server_host=hadoop102

# Port that the CM server is listening on.
server_port=7182

2）hadoop103

[root@hadoop103 ~]# vim /etc/cloudera-scm-agent/config.ini
[General]
# Hostname of the CM server.
server_host=hadoop102

# Port that the CM server is listening on.
server_port=7182

3）hadoop104

[root@hadoop104 ~]# vim /etc/cloudera-scm-agent/config.ini
[General]
# Hostname of the CM server.
server_host=hadoop102

# Port that the CM server is listening on.
server_port=7182

7、在mysql中创建cm库

[root@hadoop102 ~]# cd /usr/share/cmf/schema
[root@hadoop102 schema]# ./scm_prepare_database.sh mysql cm -hhadoop102 -uroot -p000000 --scm-host hadoop102 scm scm scm

参数说明
-h：Database host
-u：Database username
-p：Database Password
--scm-host：SCM server's hostname

8、创建用户cloudera-scm

[root@hadoop102 module]# useradd --system --home=/home/cloudera-scm --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm

[root@hadoop103 module]# useradd --system --home=/home/cloudera-scm --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm

[root@hadoop104 module]# useradd --system --home=/home/cloudera-scm --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm

9、添加CDH安装文件到CM仓目录

1）创建parcels和parcel-repo文件夹

[root@hadoop102 ~]# mkdir -p /opt/cloudera/parcels
[root@hadoop102 ~]# mkdir -p /opt/cloudera/parcel-repo

尖叫提示：parcels文件夹是安装路径, parcel-repo是仓目录
2）上传安装包

[root@hadoop102 ~]# cd /opt/cloudera/parcel-repo/
[root@hadoop102 parcel-repo]# ll
total 2058292
-rw-r--r-- 1 root root 2107526476 May  5 10:14 CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel
-rw-r--r-- 1 root root         41 May  5 10:14 CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel.sha
-rw-r--r-- 1 root root      74072 May  5 11:25 manifest.json

3）修改用户和用户组

[root@hadoop102 opt]# chown -R cloudera-scm:cloudera-scm cloudera/

4）分发cloudera

[root@hadoop102 opt]# xsync.sh cloudera/

5）修改hadoop103和hadoop104的用户组

[root@hadoop103 opt]# chown -R cloudera-scm:cloudera-scm cloudera/
[root@hadoop104 opt]# chown -R cloudera-scm:cloudera-scm cloudera/

10、安装jdk

1）卸载现有jdk
（1）查询是否安装java软件

[root@hadoop102 ~]# rpm -qa | grep java
[root@hadoop102 ~]# rpm -qa | grep jdk

（2）卸载jdk

[root@hadoop102 ~]# rpm -e --nodeps java-1.8

语法：rpm –e --nodeps 软件包名字

2）创建文件夹

[root@hadoop102 ~]# mkdir -p /usr/java/

3）解压jdk
解压jdk到/opt/module目录下

[root@hadoop102 software]$ tar -xzvf jdk-8u144-linux-x64.tar.gz -C /usr/java/

4）配置环境变量

[root@hadoop102 ~]# vim /etc/profile
##JAVA_HOME
export JAVA_HOME=/usr/java/jdk1.8.0_144
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export PATH=$PATH:$JAVA_HOME/bin

[root@hadoop102 ~]# source /etc/profile
[root@hadoop102 ~]# java -version
java version "1.8.0_144"

尖叫提示：环境变量的配置，根据情况在 /etc/profile , /etc/environment, ~/.bashrc 此三个文件中配置,记得分发

11、启动Cloudera Manager

1）hadoop102

[root@hadoop102 ~]# systemctl start cloudera-scm-server
[root@hadoop102 ~]# systemctl start cloudera-scm-agent

2）hadoop103

[root@hadoop103 ~]# systemctl start cloudera-scm-agent

3）hadoop104

[root@hadoop104 ~]# systemctl start cloudera-scm-agent

4）查看log日志

[root@hadoop102 ~]# tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log

数据库与日志相关配置文件在目录 /etc/cloudera-scm-server
日志目录 /var/log/cloudera-scm-server