hadoop安装配置及启动参考文档
·
注意:本章只针对麒麟系统


适配系统版本
适用系统:V10(SP1)
适用架构:X86
安装步骤
hadoop下载链接
解压安装
sudo tar -zxvf hadoop-3.3.0.tar.gz -C /usr/local
cd /usr/local
sudo mv hadoop-3.3.0 hadoop
sudo chmod 777 -R hadoop
配置环境变量
cat >> ~/.bashrc <<EOF
# hadoop
export HADOOP_HOME=/usr/local/hadoop
export HADOOP_CONF_DIR=\$HADOOP_HOME/etc/hadoop
export HADOOP_CLASS_PATH=\$HADOOP_CONF_DIR
export PATH=\$HADOOP_HOME/bin:\$HADOOP_HOME/sbin:\$PATH
EOF
source ~/.bashrc
修改jkd路径并验证
cd /usr/local/hadoop/etc/hadoop
sudo vim hadoop-env.sh
# 修改内容如下
export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
# 执行验证
cd /usr/local/hadoop/bin
./hadoop version
修改配置文件
sudo vim core-site.xml
<configuration>
<property>
<name>hadoop.tmp.dir</name>
<value>file:/usr/local/hadoop/tmp</value>
<description>Abase for other temporary directories.</description>
</property>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>
sudo vim hdfs-site.xml
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>file:/usr/local/hadoop/tmp/dfs/name</value>
</property>
<property>
<name>dfs.datanode.data.dir</name>
<value>file:/usr/local/hadoop/tmp/dfs/data</value>
</property>
</configuration>
配置密钥
ssh-keygen -t rsa
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
chmod 600 ~/.ssh/authorized_keys
chmod 700 ~/.ssh
执行namenode格式化并启动namenode和datanode进程
./bin/hdfs namenode -format
./sbin/start-dfs.sh
./sbin/stop-dfs.sh
查看启动结果及web页面登录
查看节点已启动
jps


更多推荐
所有评论(0)