1、集群主机安装包:
集群安装路径:/usr/dif
jdk路径:/usr/java/jdk1.8.0_202-amd64

2、同步数据到安装的客户端主机:
scp -r /usr/dif XXXip:/XXX/
scp -r /usr/java/jdk1.8.0_202-amd64 XXXip:/XXX/

3、在客户端主机上,在/etc/hosts中添加大数据平台的相关主机:
sudo vi /etc/hosts

4、在客户端主机上,把复制过来的hdp和jdk目录,软连接或者直接拷贝到同与集群的相同路径中:
#which java
/usr/bin/java
#ll /usr/bin/java
/usr/bin/java -> /etc/alternatives/java
#ll /etc/alternatives/java
/etc/alternatives/java -> /usr/java/jdk1.8.0_202-amd64/jre/bin/java
配置:
sudo ln -s /XXX/jdk1.8.0_202-amd64/jre/bin/java /etc/alternatives/java
sudo ln -s /etc/alternatives/java /usr/bin/java

#ll /etc/hadoop/conf
conf -> /usr/dif/current/hadoop-client/conf
#ll /usr/dif/current/hadoop-client/conf
/usr/dif/current/hadoop-client/conf -> /etc/hadoop/7.1.0-0/0
配置:
sudo ln -s /XXX/usr/dif /usr/dif
sudo mkdir /etc/hadoop
scp -r /etc/hadoop/7.1.0-0 XXX:/etc/hadoop/
sudo ln -s /etc/hadoop/7.1.0-0/0 /usr/dif/current/hadoop-client/conf
sudo ln -s /usr/dif/current/hadoop-client/conf /etc/hadoop/conf

5、设置环境变量
vi /etc/profile
export JAVA_HOME=/data/dataos/apps/jdk1.8.0_202
export HADOOP_HOME=/usr/dif/7.1.0-0/hadoop
export HADOOP_CONF_DIF=/etc/hadoop/conf
export HIVE_HOME=/usr/dif/7.1.0-0/hive
export SPARK_HOME=/usr/dif/7.1.0-0/spark
export PATH=JAVAHOME/bin:JAVA_HOME/bin:JAVAHOME/bin:HADOOP_HOME/bin:HADOOPHOME/sbin:HADOOP_HOME/sbin:HADOOPHOME/sbin:HIVE_HOME/bin:SPARKHOME/bin:SPARK_HOME/bin:SPARKHOME/bin:PATH
export CLASSPATH=.:JAVAHOME/lib/dt.jar:JAVA_HOME/lib/dt.jar:JAVAHOME/lib/dt.jar:JAVA_HOME/lib/tools.jar
刷新
source /etc/profile

删除软链接
rm /etc/hadoop/conf
通过打包并解压,完美保留软链接和权限。
#打包(显式加 -p 确保保留权限,虽然默认已包含)
tar -cpzf dif.tar.gz /usr/dif
#解包(保留所有属性)
tar -xpzf dif.tar.gz -C /data1/

6、更新kerberos
1)客户端安装
Centos8/euler
yum -y install krb5-client
Centos7/bclinux
yum -y install krb5-workstation
2)更新配置
scp -P9822 XXX:/etc/krb5.conf /etc/krb5.conf
3)更新kertab
scp -r -P9822 XXX:/etc/security/keytabs /etc/security
4)认证
cd /etc/security/keytabs
klist -kt hdfs.headless.keytab
kinit -kt hdfs.headless.keytab XXX

7、验证
hdfs dfs -ls /

报错:hdfs dfs -ls /
ERROR: JAVA_HOME /usr/java/jdk1.8.0_202-amd64/jre does not exist.

mkdir /usr/java
ln -s /data/dataos/apps/jdk1.8.0_202 /usr/java/jdk1.8.0_202-amd64

更多推荐