Hello,
I’m trying to get GeoMesa and GeoMesa Tools running on a cloudera installed Accumulo and Hadoop environment. I am running into some issues with a class def not found that I believe are caused by the classpath:
Using GEOMESA_HOME /home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/io/Writable
I think I know the cause of the issue, but not how to resolve it. I think the geomesa command line program is expecting an Apache layout for Hadoop and fails on a Cloudera layout. I think this could be fixed
by setting some environment variables correctly.
Specifically, the GeoMesa program tries to set $HADOOP_SHARE_DIR to ${HADOOP_HOME}/share/hadoop.
However on my cloudera installed environment this path does not exist. This is the setting I have for $HADOOP_HOME. export HADOOP_HOME=/opt/cloudera/parcels/CDH/lib/hadoop
I think the issue gets worse because the GeoMesa program then uses $HADOOP_SHARE_DIR to create several more environment variables. All of them are set to nonexistent directories.
The end result of all of this is that my GeoMesa classpath is missing many things. You can see this here:
$ geomesa classpath
Using GEOMESA_HOME /home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/net.opengis.fes-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/kryo-2.21.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-io-2.4.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-csv-1.0.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/slf4j-api-1.7.5.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-geojson-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/geomesa-utils-accumulo1.6-1.0.0-rc.3-SNAPSHOT.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/scala-library-2.10.4.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/spatial4j-0.4.1.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-metadata-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-xsd-core-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-opengis-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-main-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-graph-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jt-utils-1.3.1.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-xsd-gml2-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-referencing-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/chill_2.10-0.4.0.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/xml-apis-1.0.b2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-cql-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/JavaEWAH-0.6.6.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jgrapht-core-0.9.0.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-xml-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/asm-4.0.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-pool-1.6.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-xsd-gml3-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-codec-1.8.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-compress-1.4.1.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-net-3.3.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jcommander-1.32.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/geomesa-jobs-accumulo1.6-1.0.0-rc.3-SNAPSHOT.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-render-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/maple-0.11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jgrapht-ext-0.9.0.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/scalding-args_2.10-0.11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-process-feature-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jackson-mapper-asl-1.9.3.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-xsd-fes-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-xsd-ows-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/xsd-2.6.0.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/ecore-2.6.1.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/janino-2.6.1.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-lang-2.6.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/scala-reflect-2.10.4.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/net.opengis.ows-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/cascading-local-2.5.5.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jai_core.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/org.w3.xlink-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/avro-1.7.5.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/guava-11.0.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jackson-core-asl-1.9.3.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/reflectasm-1.07-shaded.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/geomesa-feature-accumulo1.6-1.0.0-rc.3-SNAPSHOT.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jsr-275-1.0-beta-2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/riffle-0.1-dev.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/algebird-core_2.10-0.7.0.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/bijection-core_2.10-0.6.3.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-transform-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/chill-hadoop-0.4.0.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/common-2.6.0.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jt-zonalstats-1.3.1.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/mango-core-1.2.0.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/scalding-core_2.10-0.11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jai_codec.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/log4j-1.2.17.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-compiler-2.6.1.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/json-simple-1.1.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/joda-convert-1.6.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/cascading-core-2.5.5.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/paranamer-2.3.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/minlog-1.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-data-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-xsd-wfs-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/xml-commons-resolver-1.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/geomesa-core-accumulo1.6-1.0.0-rc.3-SNAPSHOT.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jdom-1.1.3.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/xz-1.0.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jts-1.13.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-shapefile-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/geomesa-tools-accumulo1.6-1.0.0-rc.3-SNAPSHOT.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-xsd-filter-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/scalding-date_2.10-0.11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/geomesa-filter-accumulo1.6-1.0.0-rc.3-SNAPSHOT.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/joda-time-2.3.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/net.opengis.wfs-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/chill-java-0.4.0.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-api-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-coverage-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/scalalogging-slf4j_2.10-1.1.0.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/cascading-hadoop-2.5.5.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-collections-3.2.1.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/picocontainer-1.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/slf4j-log4j12-1.7.5.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-process-11.2.jar
/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-grid-11.2.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-trace.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-tracer.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-fate.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/guava.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/jetty-util.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/commons-vfs2.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-minicluster.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/ext/geomesa-distributed-runtime-accumulo1.6-1.0.0-rc.3-SNAPSHOT.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/libthrift.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-master.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-gc.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/jcommander.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/servlet-api.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/jline.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-examples-simple.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/gson.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-server-base.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-tserver.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-test.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-start.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/commons-math.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-core.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/jetty.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-proxy.jar
/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-monitor.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jsp-api-2.1.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-cli-1.2.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-httpclient-3.1.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/xmlenc-0.52.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/guava-11.0.2.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/slf4j-api-1.7.5.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/junit-4.11.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-math3-3.1.1.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/log4j-1.2.17.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jackson-xc-1.8.8.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-codec-1.4.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/java-xmlbuilder-0.4.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jackson-core-asl-1.8.8.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/snappy-java-1.0.4.1.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/gson-2.2.4.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-logging-1.1.3.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-net-3.1.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/xz-1.0.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jersey-server-1.9.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-digester-1.8.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-io-2.4.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/asm-3.2.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/paranamer-2.3.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jetty-util-6.1.26.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/apacheds-i18n-2.0.0-M15.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/curator-recipes-2.6.0.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jetty-6.1.26.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/httpcore-4.2.5.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/avro.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/slf4j-log4j12.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/activation-1.1.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/hue-plugins-3.6.0-cdh5.2.0.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/zookeeper.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jettison-1.1.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/curator-framework-2.6.0.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/servlet-api-2.5.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jasper-compiler-5.5.23.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-lang-2.6.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/api-util-1.0.0-M20.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-configuration-1.6.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jsch-0.1.42.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/netty-3.6.2.Final.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/mockito-all-1.8.5.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jersey-core-1.9.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/httpclient-4.2.5.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jsr305-1.3.9.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/hamcrest-core-1.3.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jersey-json-1.9.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-compress-1.4.1.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-collections-3.2.1.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jets3t-0.9.0.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jasper-runtime-5.5.23.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/jaxb-api-2.2.2.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-beanutils-1.7.0.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/protobuf-java-2.5.0.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/curator-client-2.6.0.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-el-1.0.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/stax-api-1.0-2.jar
/opt/cloudera/parcels/CDH/lib/hadoop/lib/api-asn1-api-1.0.0-M20.jar
/etc/accumulo/conf
/etc/hadoop/conf
You can see that this is missing the hadoop-common jar and several other hadoop jars. I think this is why the NoClassDefFoundError is thrown.
I believe I need to figure out the correct settings for the following variables:
HADOOP_SHARE_DIRE
HADOOP_COMMON
HADOOP_HDFS
HADOOP_MAP_REDUCE
HADOOP_YARN
Does anyone know what the correct values would be for a cloudera environment?
Thanks,
Jon Parise
Senior Software Engineer
Viz | General Missons Systems
This message and/or attachments may include information subject to GD Corporate Policies 07-103 and 07-105 and is intended to be accessed only by authorized recipients. Use, storage
and transmission are governed by General Dynamics and its policies. Contractual restrictions apply to third parties. Recipients should refer to the policies or contract to determine proper handling. Unauthorized review, use, disclosure or distribution is
prohibited. If you are not an intended recipient, please contact the sender and destroy all copies of the original message.