File permission issues while running Hadoop 2.7.1

2017-06-09T09:43:45

I am trying to run my 1st Hadoop program & i'm running into file permission issues that I don't know how to resolve. Following is the error code i'm getting. Would appreciate any suggestions on debugging it. Thank you

779 [main] DEBUG org.apache.hadoop.security.UserGroupInformation  - PrivilegedAction as:Zim (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
793 [main] DEBUG org.apache.hadoop.mapreduce.JobSubmitter  - Configuring job job_local1916101729_0001 with file:/tmp/hadoop-Zim/mapred/staging/Zim1916101729/.staging/job_local1916101729_0001 as the submit dir
793 [main] DEBUG org.apache.hadoop.mapreduce.JobSubmitter  - adding the following namenodes' delegation tokens:[file:///]
1325 [main] DEBUG org.apache.hadoop.mapreduce.JobResourceUploader  - default FileSystem: file:///
1359 [main] DEBUG org.apache.hadoop.io.nativeio.NativeIO  - Initialized cache for IDs to User/Group mapping with a  cache timeout of 14400 seconds.
1363 [main] WARN org.apache.hadoop.mapreduce.JobResourceUploader  - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
1368 [main] DEBUG org.apache.hadoop.mapreduce.JobSubmitter  - Creating splits at file:/tmp/hadoop-Zim/mapred/staging/Zim1916101729/.staging/job_local1916101729_0001
1392 [main] INFO org.apache.hadoop.mapreduce.JobSubmitter  - Cleaning up the staging area file:/tmp/hadoop-Zim/mapred/staging/Zim1916101729/.staging/job_local1916101729_0001
Exception in thread "main" java.lang.RuntimeException: Error while running command to get file permissions : java.io.IOException: (null) entry in command string: null ls -F C:\UVic\AdvDB\Assignments\Assgn_3\assign3_hadoop_spark\hadoop_examples_post\input_weather\1901
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:770)
        at org.apache.hadoop.util.Shell.execCommand(Shell.java:866)
        at org.apache.hadoop.util.Shell.execCommand(Shell.java:849)
        at org.apache.hadoop.fs.FileUtil.execCommand(FileUtil.java:1097)
        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:659)
        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:634)
        at org.apache.hadoop.fs.LocatedFileStatus.<init>(LocatedFileStatus.java:49)
        at org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1733)
        at org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1713)

Copyright License:
Author:「Aazim」,Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.
Link to:https://stackoverflow.com/questions/44448026/file-permission-issues-while-running-hadoop-2-7-1

About “File permission issues while running Hadoop 2.7.1” questions

I am trying to run my 1st Hadoop program &amp; i'm running into file permission issues that I don't know how to resolve. Following is the error code i'm getting. Would appreciate any suggestions on
unauthorized: authentication required while pulling sequenceiq/hadoop-docker:2.7.1 sequenceiq/hadoop-docker:2.7.1 is in docker registry. And using registry-mirrors: https://dockerhub.azk8s.cn in l...
Im trying to install Hadoop 2.7.1 on my current laptop running linux mint 17 right now following this guide: http://tecadmin.net/setup-hadoop-single-node-cluster-on-centos-redhat/# However, when I...
I am using Hadoop 2.7.1 and I am trying to get WebDav services from it. I am not finding enough resources for the solution. I am finding an open issue: https://issues.apache.org/jira/browse/HD...
I installed hadoop 2.7.1 and setup the HDFS ..running on JDK 8 . While attempting to run the wordcount job . I get the below exception . Any help appreciated . I drilled down to the logs and foun...
I am working on Stanford's GPS (graph processing system) framework for distributed processing of graphs. The framework uses hadoop. As per GPS documentation, installing GPS requires copying hadoop-...
I was following the instruction on the official website: http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html there are two problems I can't solve: 1. I can't...
After reading almost all the previous posts and web links, I feel to write this post as a need. I am unable to find any directory named ${YOUR_HADOOP_HOME}/src/contrib/eclipse-plugin in my windows ...
I would like to build a hadoop cluster with one master machine and 3 slave machines. I can ssh to any slave machine by code like ssh slave1, but I got error while building cluster, and it kept aski...
I have installed the Hadoop 2.7.1 on Ubuntu 16.04 LTS in pseudo distributed mode. Now I want to connect hadoop with eclipse by using hadoop-eclipse-plugin. But the plugin that I have is version 2.6.0

Copyright License:Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.