Trying to move a csv file from local file system to hadoop file system

2021-05-01T23:03:03

I am trying to copy a csv file from my local file system to hadoop. But I am not able to successfully do it. I am not sure which permissions i need to change. As I understand. hdfs super user does not have access to the /home/naya/dataFiles/BlackFriday.csv

hdfs dfs -put /home/naya/dataFiles/BlackFriday.csv /tmp
# Error: put: Permission denied: user=naya, access=WRITE, inode="/tmp":hdfs:supergroup:drwxr-xr-x
sudo -u hdfs hdfs dfs -put /home/naya/dataFiles/BlackFriday.csv /tmp
# Error: put: `/home/naya/dataFiles/BlackFriday.csv': No such file or directory

Any help is highly appreciated. I want to do it via the command line utility. I can do it via cloudera manager from the hadoop side. But I want to understand whats happening behind the commands

Copyright License:
Author:「jarvis」,Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.
Link to:https://stackoverflow.com/questions/67347668/trying-to-move-a-csv-file-from-local-file-system-to-hadoop-file-system

About “Trying to move a csv file from local file system to hadoop file system” questions

I am trying to copy a csv file from my local file system to hadoop. But I am not able to successfully do it. I am not sure which permissions i need to change. As I understand. hdfs super user does ...
I am trying to read a file from my local EMR file system. It is there as a file under the folder /emr/myFile.csv. However, I keep getting a FileNotFoundException. Here is the line of code that I us...
I have a scenario where I process 1000's of small files using Hadoop. The output of the Hadoop job is then to be used as input for a non-Hadoop algorithm. In the current workflow, data is read, con...
I am running the insert script in hive by load '.csv' file from local file system into hive table as below: load data local inpath 'xxx.csv' into table xxx; I got an error say Failed with exce...
I have installed hadoop. Now i am trying to copy one local file-system to hadoop file-system using below command. hadoop fs -copyFromLocal /mnt/PRO/wvdial.conf hdfs://virus/mydata/hdfs/data...
I am trying to move data from a local file system to the Hadoop distributed file system , but i am not able to move it through oozie Can we move or copy data from a local filesystem to HDFS using o...
I'm trying to read a file via the Hadoop client from a Java program on windows. I have a valid kerberos keytab, but can't seem to read from HDFS. I'm using the example from this page and the hadoop
I have installed hadoop on Ubuntu 14.04. I am getting the following error whenever I copy files from the local file system to HDFS. I am using this command: /usr/local/hadoop$ bin/hadoop dfs -
My hadoop cluster is using HDFS as default fs. But on client side, the input file is located on local file system. (for some reason, I don't want to move that into HDFS). If I give mapreduce job a ...
I am trying to create a CSV file dynamically in the user's system whoever uses my Application so that I can write data into it and then import it to an Excel. Once I am done with my Application, I...

Copyright License:Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.