Hadoop : unable to load native hadoop library

2017-06-22T00:33:41

I know that this is a famous question across internet and there are tons of websites showing how to solve this issue and there are hell lots of QA on SO too. BUT NONE of them helped me and I am frustrated now. So I am giving every details I can, if I overlooked anything, I appreciate your help.

**OS** : Ubuntu 16.04 32 bit
**Hadoop version** : Hadoop 3.0.0-alpha3
**bashrc** : 

export HADOOP_HOME=/usr/local/hadoopec/hadoop
export HADOOP_CONF_DIR=/usr/local/hadoopec/hadoop/etc/hadoop
export HADOOP_MAPRED_HOME=/usr/local/hadoopec/hadoop
export HADOOP_COMMON_HOME=/usr/local/hadoopec/hadoop
export HADOOP_HDFS_HOME=/usr/local/hadoopec/hadoop
export PATH=$PATH:/usr/local/hadoopec/hadoop/bin

export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-i386

export LD_LIBRARY_PATH=/usr/local/hadoopec/hadoop/lib/native/:$LD_LIBRARY_PATH
#export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib/native"

export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib"

**core-site.xml** : 

<property>
  <name>hadoop.tmp.dir</name>
  <value>/usr/hadoopec/hadoop/tmp</value>
  <description>Temporary Directory.</description>
</property>

<property>
  <name>fs.default.name</name>
  <value>hdfs://localhost:9000</value>
  <description>Use HDFS as file storage engine</description>
</property>

 **hdfs-env.sh**

export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=$HADOOP_HOME/lib/native"
export HADOOP_OPTS="$HADOOP_OPTS -XX:-PrintWarnings -Djava.net.preferIPv4Stack=true"
export LD_LIBRARY_PATH=/usr/local/hadoopec/hadoop/lib/native/:$LD_LIBRARY_PATH

**hdfs-site.xml**

<property>
<name>dfs.replication</name>
<value>3</value>
</property>

<property>
<name>dfs.permission</name>
<value>false</value>
</property>

 <property>
  <name>dfs.namenode.name.dir</name>
  <value>/usr/local/hadoopec/hadoop/tmp/hdfs/name</value>
  </property>

<property>
  <name>dfs.datanode.data.dir</name>
  <value>/usr/local/hadoopec/hadoop/tmp/hdfs/data</value>
  </property>

If anyone needs some more informations, feel free to ask me.

Copyright License:
Author:「Saurab」,Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.
Link to:https://stackoverflow.com/questions/44681653/hadoop-unable-to-load-native-hadoop-library

About “Hadoop : unable to load native hadoop library” questions

I already saw these kind of problems but it didn't solve anything for me. So I've got Kubuntu 15.04 uname -a Linux laptop 3.19.0-31-generic #36-Ubuntu SMP Wed Oct 7 15:03:41 UTC 2015 i686 i68...
I am using Hadoop in Mac OS X. I think I installed Hadoop properly. When I tried to run an example WordCount problem, I got this error: INFO util.NativeCodeLoader - Unable to load native-hadoop
I know that this is a famous question across internet and there are tons of websites showing how to solve this issue and there are hell lots of QA on SO too. BUT NONE of them helped me and I am
I'm currently configuring hadoop on a server running CentOs. When I run start-dfs.sh or stop-dfs.sh, I get the following error: WARN util.NativeCodeLoader: Unable to load native-hadoop library f...
I'm currently configuring hadoop on a server running CentOs. When I run start-dfs.sh or stop-dfs.sh, I get the following error: WARN util.NativeCodeLoader: Unable to load native-hadoop library f...
I'm currently configuring hadoop on a server running CentOs. When I run start-dfs.sh or stop-dfs.sh, I get the following error: WARN util.NativeCodeLoader: Unable to load native-hadoop library f...
I've installed Hadoop 2.7.2 single node on Ubuntu and I want to run the java wordcount program. The compilation and the creation of the jar file are done succesfully, but when I run the jar file on
I am following this tutorial. start-all.sh output: hduser@ubuntu12:~/hadoop/sbin$ start-dfs.sh 15/07/27 15:24:11 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform...
Without -Djava.library.path=/opt/mapr/hadoop/hadoop-0.20.2/lib/native/Linux-amd64-64/ as an argument to running Java, I get the following error, 2013-11-13 15:23:29,414 WARN pool-3-thread-3 org.
My environment is CentOS 7; Spark 1.6.1; Hadoop 2.6.4; and I have two slave-node in a cluster mode. When I tried hadoop command, I got WARN util.NativeCodeLoader: Unable to load native-hadoop libr...

Copyright License:Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.