How to set HADOOP_CLASSPATH via oozie while running HBase job

2014-10-26T04:40:04

I'm using CDH5. I'm hit by a HBase bug while running a MapReduce job through Oozie in a fully distributed environment. This job connects to HBase and adds records programmatically. Requesting to refer these links to understand the bug I'm hitting. Please note that I cannot modify the map reduce job code. The job runs fine from commandline after setting HADOOP_CLASSPATH env variable. But there seem to be no way to set/override this environment variable from oozie. As a result the job fails when running from oozie. Anybody experienced and found a workaround for this problem?

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.9.1/bk_releasenotes_hdp_2.0/content/ch_relnotes-hdpch_relnotes-hdp-2.0.9.0-knownissues-hbase.html

https://issues.apache.org/jira/browse/HBASE-11118

Copyright License:
Author:「Arijit Banerjee」,Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.
Link to:https://stackoverflow.com/questions/26567033/how-to-set-hadoop-classpath-via-oozie-while-running-hbase-job

About “How to set HADOOP_CLASSPATH via oozie while running HBase job” questions

I'm using CDH5. I'm hit by a HBase bug while running a MapReduce job through Oozie in a fully distributed environment. This job connects to HBase and adds records programmatically. Requesting to r...
I can run my MapReduce job manually to load data into Hbase without any issue, HADOOP_CLASSPATH=$HADOOP_CLASSPATH:$HADOOP_MAPRED_HOME/../hbase/* HADOOP_CLASSPATH=$HADOOP_CLASSPATH:./* export
When I am trying to connect to HBase via oozie, I got the following exception: `Failing Oozie Launcher, Main class [com.sample.util.HBaseBulkLoad], main() threw exception, org.apache.hadoop.hbase.
I want to schedule a Hbase Map-Reduce job by Oozie.I am facing following problem . How/Where to specify these properties in oozie workflow ? ( i> Table name for Mapper/Reducer ii> ...
I have been trying to import data from a mysql table to hbase using oozie via sqoop My sqoop import command: sqoop import --connect jdbc:mysql://some_ip/myDatabase --username User --password-fil...
Hello Pig/Oozie Guru's I have implemented a custom Loader which extends LoadFunc . I am using some external dependencies in the constructor of that Loader. I am able to set the classpath on Pig fr...
I tried running my first oozie job by following a blog post. I used oozie-examples.tar.gz, after extracting, placed examples in hdfs. I tried running map-reduce job in it but unfortunately got an...
I want to run a Hbase TableMapReduce job from oozie scheduler. I have a driver, mapper and no reducer class. What is the best way to run this job from oozie with max-performance of hadoop ecosystem.
I'm getting the below exception while running the sample oozie examples. I've modified the job.properties located at the /examples/apps/map-reduce with the appropriate nameNode and jobTracker detai...
i do have an issue with Kerberos credentials. This work is based on a cluster and the keytabs are provided on each datanode. Basically it is an oozie workflow shell action, and it's purpose is to w...

Copyright License:Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.