CDH集群完全卸载过程

大数据评论2,082阅读模式
摘要

CDH(Cloudera Distribution Hadoop)完全卸载删除。

CDH集群卸载过程

1.成功停止集群

CDH集群完全卸载过程

2.解除并移出parcels

(先删除parcels包,再删cluster集群)

(1)成功停止集群后,点击图标

CDH集群完全卸载过程

(2)点击停用

CDH集群完全卸载过程

(3)停用集群上CDH

CDH集群完全卸载过程

(4)移出CDH

CDH集群完全卸载过程

此步骤删除节点上 /opt/cloudera/parcels 目录下的内容

(5)在“已下载”状态下删除本地包

CDH集群完全卸载过程

即删除节点 /opt/cloudera/parcel-repo 下的内容(CDH parcels安装包)

CDH集群完全卸载过程

3.删除集群

CDH集群完全卸载过程

删除成功后

CDH集群完全卸载过程

4.停止Cloudera Manager Server和数据库

systemctl stop cloudera-scm-server

(如果使用db postgresql则需要停止服务:systemctl stop cloudera-scm-server-db-2)

5.卸载Cloudera Manager Server

yum remove cloudera-manager-server

(如果使用db postgresql则需要移出该服务)

6.停止所有节点上Cloudera Manager Agent服务

systemctl stop cloudera-scm-agent

7.卸载所有节点

yum remove 'cloudera-manager-*'

8.在所有节点杀死相关进程

9. 在所有节点移出Cloudera Manager所有用户数据

umount cm_processes

(第一次会正常运行)

10.删除相应数据文件夹

rm -rf

/var/lib/cloudera*

/var/log/cloudera*

/var/run/cloudera*

/etc/cloudera*

/var/cache/yum/x86_64//cloudera (每个节点*路径不同)

(/usr/share/cmf/与/usr/lib64/cmf/若存在也需删除)

(1)公共目录

rm -rf /var/lib/cloudera* /var/log/cloudera* /var/run/cloudera* /etc/cloudera* /usr/share/cmf/ /usr/lib64/cmf/

(2)特别目录

CMserver节点:rm -rf /var/cache/yum/x86_64/$releasever/cloudera-manager/

其他节点:rm -rf /var/cache/yum/x86_64/7Server/cloudera-manager/

11.移出Lock File

rm -rf /tmp/.scm_prepare_node.lock

12.移出用户数据

相应的目录位置

Cloudera Manager安装、配置、数据、日志等目录 /usr/share/cmf /usr/lib64/cmf /var/lib/cloudera* /var/cache/yum/x86_64/6/cloudera* /var/log/cloudera* /var/run/cloudera* /etc/cloudera* /tmp/.scm_prepare_node.lock

用户数据目录 /var/lib/flume-ng /var/lib/hadoop* /var/lib/hue /var/lib/navigator /var/lib/oozie /var/lib/solr /var/lib/sqoop* /var/lib/zookeeper /var/lib/alternatives/avro-tools /var/lib/alternatives/beeline /var/lib/alternatives/catalogd /var/lib/alternatives/cli_* /var/lib/alternatives/flume* /var/lib/alternatives/hadoop* /var/lib/alternatives/hbase* /var/lib/alternatives/hcat /var/lib/alternatives/hdfs /var/lib/alternatives/hive* /var/lib/alternatives/hue* /var/lib/alternatives/impala* /var/lib/alternatives/llama* /var/lib/alternatives/load_gen /var/lib/alternatives/mahout* /var/lib/alternatives/mapred /var/lib/alternatives/oozie* /var/lib/alternatives/pig* /var/lib/alternatives/pyspark /var/lib/alternatives/sentry* /var/lib/alternatives/solr* /var/lib/alternatives/spark* /var/lib/alternatives/sqoop* /var/lib/alternatives/statestored /var/lib/alternatives/whirr /var/lib/alternatives/yarn /var/lib/alternatives/zookeeper*

配置文件目录 /etc/flume-ng /etc/hadoop* /etc/hbase* /etc/hive* /etc/hue /etc/pig /etc/sentry /etc/solr /etc/spark /etc/sqoop* /etc/zookeeper* /etc/alternatives/avro-tools /etc/alternatives/beeline /etc/alternatives/catalogd /etc/alternatives/cli_* /etc/alternatives/flume* /etc/alternatives/hadoop* /etc/alternatives/hbase* /etc/alternatives/hcat /etc/alternatives/hdfs /etc/alternatives/hive* /etc/alternatives/hue* /etc/alternatives/impala* /etc/alternatives/llama* /etc/alternatives/load_gen /etc/alternatives/mahout* /etc/alternatives/mapred /etc/alternatives/oozie* /etc/alternatives/pig* /etc/alternatives/pyspark /etc/alternatives/sentry* /etc/alternatives/solr* /etc/alternatives/spark* /etc/alternatives/sqoop* /etc/alternatives/statestored /etc/alternatives/whirr /etc/alternatives/yarn /etc/alternatives/zookeeper*

Hadoop相关服务安装目录、服务软件包数据,数据格式为parcels、服务软件包缓存数据等 /opt/cloudera/

日志目录 /var/log/hive /var/log/hbase /var/log/hadoop* /var/log/zookeeper

mysql数据目录 /var/lib/mysql

调整每个主机上的数据驱动器的路径,如果主机包含多个驱动路径,则配置多个每个目录占用一行,例如: #/mnt/sdb1/dfs #/mnt/sdb2/dfs /dfs /mapred /yarn

使用下面命令进行一次清除:

rm -rf /usr/share/cmf /usr/lib64/cmf /var/lib/cloudera* /var/cache/yum/x86_64/6/cloudera* /var/log/cloudera* /var/run/cloudera* /etc/cloudera* /tmp/.scm_prepare_node.lock /var/lib/flume-ng /var/lib/hadoop* /var/lib/hue /var/lib/navigator /var/lib/oozie /var/lib/solr /var/lib/sqoop* /var/lib/zookeeper /var/lib/alternatives/avro-tools /var/lib/alternatives/beeline /var/lib/alternatives/catalogd /var/lib/alternatives/cli* /var/lib/alternatives/flume* /var/lib/alternatives/hadoop* /var/lib/alternatives/hbase* /var/lib/alternatives/hcat /var/lib/alternatives/hdfs /var/lib/alternatives/hive* /var/lib/alternatives/hue* /var/lib/alternatives/impala* /var/lib/alternatives/llama* /var/lib/alternatives/load_gen /var/lib/alternatives/mahout* /var/lib/alternatives/mapred /var/lib/alternatives/oozie* /var/lib/alternatives/pig* /var/lib/alternatives/pyspark /var/lib/alternatives/sentry* /var/lib/alternatives/solr* /var/lib/alternatives/spark* /var/lib/alternatives/sqoop* /var/lib/alternatives/statestored /var/lib/alternatives/whirr /var/lib/alternatives/yarn /var/lib/alternatives/zookeeper* /etc/flume-ng /etc/hadoop* /etc/hbase* /etc/hive* /etc/hue /etc/pig /etc/sentry /etc/solr /etc/spark /etc/sqoop* /etc/zookeeper* /etc/alternatives/avro-tools /etc/alternatives/beeline /etc/alternatives/catalogd /etc/alternatives/cli* /etc/alternatives/flume* /etc/alternatives/hadoop* /etc/alternatives/hbase* /etc/alternatives/hcat /etc/alternatives/hdfs /etc/alternatives/hive* /etc/alternatives/hue* /etc/alternatives/impala* /etc/alternatives/llama* /etc/alternatives/load_gen /etc/alternatives/mahout* /etc/alternatives/mapred /etc/alternatives/oozie* /etc/alternatives/pig* /etc/alternatives/pyspark /etc/alternatives/sentry* /etc/alternatives/solr* /etc/alternatives/spark* /etc/alternatives/sqoop* /etc/alternatives/statestored /etc/alternatives/whirr /etc/alternatives/yarn /etc/alternatives/zookeeper* /opt/cloudera/ /var/log/hive /var/log/hbase /var/log/hadoop* /var/log/zookeeper /dfs /mapred /yarn

13.停止数据库

在安装数据库的节点上停掉数据库服务:systemctl stop mariadb

(如果是mysql,则systemctl stop mysql)

14.卸载所有节点上数据库

yum remove -y mariadb mariadb-server

15.删除数据库目录

rm -rf /var/lib/mysql

完毕!可以重新安装了!

Docker容器初学笔记整理 Golang

Docker容器初学笔记整理

“Docker是一个开源的应用容器引擎”,这个概念解释说了等于没说。其实就是个虚拟机,如果我们用过类似VMware这样的虚拟机软件就知道了,在windows上可以跑Linux、mac,反过来也可以。但...