hbase - spark-submit no class found - htrace -
i trying run spark example code hbasetest command line using spark-submit instead run-example, in case, can learn more how run spark code in general.
however, told me class_not_found htrace since using cdh5.4. located htrace jar file having hard time adding path.
this final spark-submit command have still have class not found error. can me this?
#!/bin/bash export spark_home=/opt/cloudera/parcels/cdh/lib/spark /bin/bash $spark_home/bin/spark-submit \ --master yarn-client \ --class org.apache.spark.examples.hbasetest \ --driver-class-path /etc/hbase/conf:$spark_home/examples/lib/*.jar:/opt/cloudera/parcels/cdh-5.4.2-1.cdh5.4.2.p0.2/lib/hbase/lib/*.jar \ --jars $spark_home/examples/lib/*.jar:/opt/cloudera/parcels/cdh-5.4.2-1.cdh5.4.2.p0.2/lib/hbase/lib/*.jar \ $spark_home/examples/lib/*.jar \ myhbasetablename
note: htrace-core-3.0.4.jar, htrace-core-3.1.0-incubating.jar, htrace-core.jar located under '/opt/cloudera/parcels/cdh-5.4.2-1.cdh5.4.2.p0.2/lib/hbase/lib/'.
i opened $spark_home/conf/classpath.txt
, added /opt/cloudera/parcels/cdh/lib/hbase/lib/htrace-core-3.1.0-incubating.jar
end of file.
Comments
Post a Comment