Cannot get tasktracker started on cygwin due to permission failure

2013-01-02T20:03:55

I have setup hadoop 1.1.1 on cygwin under windows 7. The dfs components are starting fine (start-dfs.sh or start-all.sh both) so is jobtracker (start mapred.sh) but the tasktracker fails to start and shuts down with error related to permissions on path to taskTracker (fails to set 0755). I have seen a similar issue reported at Problem starting tasktracker in hadoop under windows but did not find any solution or guidance on how to solve it. Have tried number of websites for solutions too but all in vain.

Here's the log output

     2013-01-02 15:51:31,836 INFO org.apache.hadoop.mapred.TaskTracker: Starting tasktracker with owner as 120173
     2013-01-02 15:51:31,836 INFO org.apache.hadoop.mapred.TaskTracker: Good mapred local directories are: /tmp/hadoop-120173/mapred/local
     2013-01-02 15:51:31,852 ERROR org.apache.hadoop.mapred.TaskTracker: Can not start task tracker because java.io.IOException: Failed to set permissions of path: \tmp\hadoop-120173\mapred\local\taskTracker to 0755
at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
at org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:810)
at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1557)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3893)

    2013-01-02 15:51:31,852 INFO org.apache.hadoop.mapred.TaskTracker: SHUTDOWN_MSG: 

I have even tried to manually set permission on this directory and then run tasktracker but it still fails.

Copyright License:
Author:「Dinkar Gupta」,Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.
Link to:https://stackoverflow.com/questions/14121727/cannot-get-tasktracker-started-on-cygwin-due-to-permission-failure

About “Cannot get tasktracker started on cygwin due to permission failure” questions

I have setup hadoop 1.1.1 on cygwin under windows 7. The dfs components are starting fine (start-dfs.sh or start-all.sh both) so is jobtracker (start mapred.sh) but the tasktracker fails to start and
i am following http://ebiquity.umbc.edu/Tutorials/Hadoop/00%20-%20Intro.html Start the namenode in the first window by executing cd hadoop-0.19.1 bin/hadoop namenode Start the secondary namenode ...
I am running a M/R job on an Hadoop cluster and encounter some failures in a Tasktracker once in a while. I know the nature of these failure and know that when it occurs in a task, this Tasktracker...
I have been able to set up the streaming example with python mapper &amp; reducer. The mapred folder location is /mapred/local/taskTracker both root &amp; mapred users have the ownership to this fo...
I am new to hadoop and only have a Windows machine available. On that, I have created 2 virtual machines in VirtualBox that run CentOS 6.2. I have gone through several problems already with enabli...
I am trying to build and install libYAML as per instructions on their website > http://pyyaml.org/wiki/LibYAML ./configure > successful make > successful make install > failed I ge...
I am new to hadoop and need to setup a sandbox environment in windows to showcase to a client. I have followed below mentioned steps Install cygwin on all machines setup ssh install hadoop 1.0.4
I have a simple setup on EC2 One Master One Slave When I do JPS, I see everything except the tasktracker process. When I execute start-all.sh/stop-all.sh, I see the tasktracker message start,logging,
I have an odd problem with tab completion under cygwin's bash on my Win 7 installation. I get fork failures ('permission denied') under very specific circumstances.. Tab completion works fine for ...
I have a folder /cygwin/d/myfolder/ And everytime I save files there, from cygwin if i do an ls -la I see that the files are given permission 000. That actually causes me quite a bit of problem as I

Copyright License:Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.