4

Tuto Install Hadoop by me

 1 year ago
source link: https://gist.github.com/Misash/b4525453ccf4077f12b6de66d76471d9
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client

Tuto Install Hadoop by me

1. Install requirements

sudo apt-get update
sudo apt-get install default-jdk

2. Download Hadoop

wget https://downloads.apache.org/hadoop/common/hadoop-3.3.5/hadoop-3.3.5.tar.gz

3. Extract Hadoop

tar xzf hadoop-3.3.5.tar.gz

4. Get where is java installed

readlink -f $(which java) | sed 's:/bin/java::'
example: /usr/lib/jvm/java-11-openjdk-amd64

5. Edit the file $Hadoop_Home/etc/hadoop/hadoop-env.sh

    export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64

6. Install

    cd ~
    sudo nano hadoop-env.sh

add this lines

export HADOOP_HOME=/home/dark/hadoop-3.3.5            
export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin

apply changes

source ~/.bashrc

7. Check and test

haddop version 

cd hadoop-3.3.5/

bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.5.jar pi 10 100

report

Recommend

About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK