Tuesday, May 26, 2015

Setting up hadoop

1. Extract hadoop tar.gz file
tar zxf hadoop-2.7.0.tar.gz

2. Finding the env.sh file
find hadoop-2.7.0/  -name hadoop-env.sh

3. Changing the JAVA_HOME directory in hadoop-env.sh
% export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64/jre

4. Creating an environment variable that points to the hadoop installation directory
% export HADOOP_HOME=$(pwd)/hadoop-2.7.0
% PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin

5. If everything is done correctly, type
% hadoop version

and you should get the following:

Hadoop 2.7.0
Subversion https://git-wip-us.apache.org/repos/asf/hadoop.git -r d4c8d4d4d203c934e8074b31289a28724c0842cf
Compiled by jenkins on 2015-04-10T18:40Z
Compiled with protoc 2.5.0
From source with checksum a9e90912c37a35c3195d23951fd18f
This command was run using /home/justin/hadoop-2.7.0/share/hadoop/common/hadoop-common-2.7.0.jar

No comments:

Post a Comment