hbase - spark-submit no class found - htrace -


i trying run spark example code hbasetest command line using spark-submit instead run-example, in case, can learn more how run spark code in general.

however, told me class_not_found htrace since using cdh5.4. located htrace jar file having hard time adding path.

this final spark-submit command have still have class not found error. can me this?

#!/bin/bash export spark_home=/opt/cloudera/parcels/cdh/lib/spark  /bin/bash $spark_home/bin/spark-submit \ --master yarn-client \ --class org.apache.spark.examples.hbasetest \ --driver-class-path /etc/hbase/conf:$spark_home/examples/lib/*.jar:/opt/cloudera/parcels/cdh-5.4.2-1.cdh5.4.2.p0.2/lib/hbase/lib/*.jar \ --jars $spark_home/examples/lib/*.jar:/opt/cloudera/parcels/cdh-5.4.2-1.cdh5.4.2.p0.2/lib/hbase/lib/*.jar \ $spark_home/examples/lib/*.jar \ myhbasetablename 

note: htrace-core-3.0.4.jar, htrace-core-3.1.0-incubating.jar, htrace-core.jar located under '/opt/cloudera/parcels/cdh-5.4.2-1.cdh5.4.2.p0.2/lib/hbase/lib/'.

i opened $spark_home/conf/classpath.txt , added /opt/cloudera/parcels/cdh/lib/hbase/lib/htrace-core-3.1.0-incubating.jar end of file.

https://community.cloudera.com/t5/advanced-analytics-apache-spark/classnotfoundexception-org-apache-htrace-trace-exception-in/m-p/29253/highlight/true#m915


Comments

Popular posts from this blog

How has firefox/gecko HTML+CSS rendering changed in version 38? -

javascript - Complex json ng-repeat -

jquery - Cloning of rows and columns from the old table into the new with colSpan and rowSpan -