How to set HADOOP_CLASSPATH for Oozie MapReduce action

2014-11-23T14:27:04

I can run my MapReduce job manually to load data into Hbase without any issue,

HADOOP_CLASSPATH=$HADOOP_CLASSPATH:$HADOOP_MAPRED_HOME/../hbase/*
HADOOP_CLASSPATH=$HADOOP_CLASSPATH:./*
export HADOOP_CLASSPATH=$HADOOP_CLASSPATH

hadoop jar MyLoader-1.0-SNAPSHOT-jar-with-dependencies.jar inputFolder outputFolder

I tried to set this up in a Oozie job as a MapReduce action and it gave me the ClassNotFound error.

I think it's because I didn't export HADOOP_CLASSPATH for the Oozie job. Does anybody know how to set HADOOP_CLASSPATH for Oozie MapReduce action?

Thanks a lot!

Tom

Copyright License:
Author:「Tomx」,Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.
Link to:https://stackoverflow.com/questions/27086251/how-to-set-hadoop-classpath-for-oozie-mapreduce-action

About “How to set HADOOP_CLASSPATH for Oozie MapReduce action” questions

I can run my MapReduce job manually to load data into Hbase without any issue, HADOOP_CLASSPATH=$HADOOP_CLASSPATH:$HADOOP_MAPRED_HOME/../hbase/* HADOOP_CLASSPATH=$HADOOP_CLASSPATH:./* export
I'm using CDH5. I'm hit by a HBase bug while running a MapReduce job through Oozie in a fully distributed environment. This job connects to HBase and adds records programmatically. Requesting to r...
How to configure a custom partitioner on oozie workflow XML for a MapReduce Action? I tried using: <property> <name>mapreduce.job.partitioner.class</name> <value>com.
I want to configure a mapreduce action in oozie workflow for a existing mapreduce jar(with mapper, reducer and sometimes combiner also) file, such that only reducer/combiner is run on the input files.
I have a workflow, in which an oozie mapreduce action is supposed to read data from hive table and give it to appropriate mapper. I have not been able to find corresponding settings/properties for
Hello Pig/Oozie Guru's I have implemented a custom Loader which extends LoadFunc . I am using some external dependencies in the constructor of that Loader. I am able to set the classpath on Pig fr...
From the command line, parameters can be passed to ToolRunner as follows: hadoop jar myJar.jar com.Main -Dprop1=prop1value -Dprop2=prop2value I want to invoke my MapReduce job as part of a MapRed...
Java applications are executed in the Hadoop cluster as map-reduce job with a single Mapper task. If a java mapreduce job(not hive or any other job just a direct mapreduce job) is a part of oozie w...
I installed oozie 4.3.0 in hadoop 2.7.3. oozie and hadoop services are up and running.I tried to execute example map reduce job that comes with oozie distribution, when i check the log of the job, it
I have a mapreduce job packed as a jar file (mymapreduce.jar). When running, it takes a few parameters, e.g. hadoop jar mymapreduce.jar StartClass -i input -p parameter1 -u parameter2. How can I wr...

Copyright License:Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.