Getting error while starting one of nodemanager for kerberos secure hadoop-2.2.0 cluster

2015-05-22T15:26:11

I have enabled kerberos security for hadoop 2.2.0 cluster. But while starting nodemanager i am getting below error: Machine-1 namenode works as datanode at this node nodemanager is running but at machine-2 datanode nodemanager giving below error

 2015-05-29 15:06:00,916 DEBUG    org.apache.hadoop.service.AbstractService: noteFailure org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to initialize container executor
 2015-05-29 15:06:00,925 INFO  org.apache.hadoop.service.AbstractService: Service NodeManager failed in       
 state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to     initialize container executor   
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to   initialize container executor  
        at     org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:148)
    at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
    at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:338)
    at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:386)
    Caused by: java.io.IOException: Cannot run program "/home/hadoopnew/hadoop-2.2.0/bin/container-executor": error=2, No such file or directory
    at java.lang.ProcessBuilder.start(ProcessBuilder.java:1041)
    at org.apache.hadoop.util.Shell.runCommand(Shell.java:407)
    at org.apache.hadoop.util.Shell.run(Shell.java:379)
    at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
    at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.init(LinuxContainerExecutor.java:147)
    at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:146)
    ... 3 more
    Caused by: java.io.IOException: error=2, No such file or directory
    at java.lang.UNIXProcess.forkAndExec(Native Method)
    at java.lang.UNIXProcess.<init>(UNIXProcess.java:135)
    at java.lang.ProcessImpl.start(ProcessImpl.java:130)
    at java.lang.ProcessBuilder.start(ProcessBuilder.java:1022)
    ... 8 more
    2015-05-29 15:06:00,959 DEBUG org.apache.hadoop.service.AbstractService: Service: NodeManager entered state STOPPED
    2015-05-29 15:06:00,959 DEBUG org.apache.hadoop.service.CompositeService: NodeManager: stopping services, size=0
    2015-05-29 15:06:00,959 DEBUG org.apache.hadoop.metrics2.impl.MetricsSystemImpl: refCount=0
    2015-05-29 15:06:00,959 DEBUG org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Redundant shutdown
    java.lang.Throwable
    at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:555)
    at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
    at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
    at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStop(NodeManager.java:208)
    at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
    at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
    at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:80)
    at org.apache.hadoop.service.AbstractService.init(AbstractService.java:171)
    at  org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:338)
    at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:386)
   2015-05-29 15:06:00,960 FATAL   org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager
     org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to initialize container executor
    at   org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:148)
    at    org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
    at   org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:338)
    at    org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:386)
   Caused by: java.io.IOException: Cannot run program "/home/hadoopnew/hadoop-2.2.0/bin/container-executor": error=2, No such file or directory
    at java.lang.ProcessBuilder.start(ProcessBuilder.java:1041)
    at org.apache.hadoop.util.Shell.runCommand(Shell.java:407)
    at org.apache.hadoop.util.Shell.run(Shell.java:379)
    at   org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
    at    org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.init(LinuxContainerExecutor.java:147)
    at    org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:146)
    Caused by: java.io.IOException: error=2, No such file or directory
    at java.lang.UNIXProcess.forkAndExec(Native Method)
    at java.lang.UNIXProcess.<init>(UNIXProcess.java:135)
    at java.lang.ProcessImpl.start(ProcessImpl.java:130)
    at java.lang.ProcessBuilder.start(ProcessBuilder.java:1022)
    ... 8 more
   2015-05-29 15:06:00,976 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: SHUTDOWN_MSG:

How to resolve this error and what exactly it missing ?

Copyright License:
Author:「user07」,Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.
Link to:https://stackoverflow.com/questions/30390742/getting-error-while-starting-one-of-nodemanager-for-kerberos-secure-hadoop-2-2-0

About “Getting error while starting one of nodemanager for kerberos secure hadoop-2.2.0 cluster” questions

I have enabled kerberos security for hadoop 2.2.0 cluster. But while starting nodemanager i am getting below error: Machine-1 namenode works as datanode at this node nodemanager is running but at m...
I am trying to setup the latest Hadoop 2.2 single node cluster on Ubuntu 13.10 64 bit. the OS is a fresh installation, and I have tried using both java-6 64 bit and java-7 64 bit. After following ...
I change some configuration and need to restart nodemanager. I get the following error message: Error starting NodeManager java.lang.UnsatisfiedLinkError: Could not load library. Reasons: [no
We have Dataproc cluster with 4 workers configured. Cluster is up and running and whenever we try to submit the spark-job we are getting this error: YarnRuntimeException: Recieved SHUTDOWN signal ...
In my Windows 10 environment, I installed Hadoop 2.10.1 While starting the nodemanager using .\start-yarn.cmd command, I am getting following error message. The DataNode, ResourceManager and Nam...
I have one master one worker cluster. I am upgrading to YARN from Hadoop classic. resourcemanager and historyserver successfully started, but nodemanager is not starting it is giving error java....
I have prepared a 2 node cluster with plain apache Hadoop. These nodes acts as Kerberos client to another machines which acts as Kerberos Server. The KDC Db, principals of hdfs on each machines are
I'm trying to start a YARN NodeManager on my CDH 5.2.0 cluster using Cloudera Manager. All the other live nodes in the system started fine with the configuration in Cloudera Manager, but one node r...
I have compiled the hadoop binaries on windows x64 machine.. I also built the native source in the path hadoop-2.6.0-src.tar\hadoop-2.6.0-src\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\sr...
NodeManager in my slave node stops after starting. I have 3 node 1 master and 2 slaves when I use command start-yarn.sh my resourcemanager and nodemanagers start correctly but when I query in hive my

Copyright License:Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.