Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
[geomesa-users] HADOOP_SHARE_DIR and other variables on Cloudera

Hello,

 

I’m trying to get GeoMesa and GeoMesa Tools running on a cloudera installed Accumulo and Hadoop environment. I am running into some issues with a class def not found that I believe are caused by the classpath:

 

Using GEOMESA_HOME /home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/io/Writable

 

 

I think I know the cause of the issue, but not how to resolve it. I think the geomesa command line program is expecting an Apache layout for Hadoop and fails on a Cloudera layout. I think this could be fixed by setting some environment variables correctly.

 

Specifically, the GeoMesa program tries to set $HADOOP_SHARE_DIR to  ${HADOOP_HOME}/share/hadoop. However on my cloudera installed environment this path does not exist. This is the setting I have for $HADOOP_HOME. export HADOOP_HOME=/opt/cloudera/parcels/CDH/lib/hadoop

 

I think the issue gets worse because the GeoMesa program then uses $HADOOP_SHARE_DIR to create several more environment variables. All of them are set to nonexistent directories.

 

The end result of all of this is that my GeoMesa classpath is missing many things. You can see this here:

 

$ geomesa classpath

Using GEOMESA_HOME /home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/net.opengis.fes-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/kryo-2.21.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-io-2.4.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-csv-1.0.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/slf4j-api-1.7.5.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-geojson-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/geomesa-utils-accumulo1.6-1.0.0-rc.3-SNAPSHOT.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/scala-library-2.10.4.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/spatial4j-0.4.1.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-metadata-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-xsd-core-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-opengis-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-main-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-graph-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jt-utils-1.3.1.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-xsd-gml2-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-referencing-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/chill_2.10-0.4.0.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/xml-apis-1.0.b2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-cql-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/JavaEWAH-0.6.6.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jgrapht-core-0.9.0.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-xml-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/asm-4.0.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-pool-1.6.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-xsd-gml3-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-codec-1.8.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-compress-1.4.1.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-net-3.3.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jcommander-1.32.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/geomesa-jobs-accumulo1.6-1.0.0-rc.3-SNAPSHOT.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-render-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/maple-0.11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jgrapht-ext-0.9.0.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/scalding-args_2.10-0.11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-process-feature-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jackson-mapper-asl-1.9.3.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-xsd-fes-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-xsd-ows-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/xsd-2.6.0.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/ecore-2.6.1.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/janino-2.6.1.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-lang-2.6.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/scala-reflect-2.10.4.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/net.opengis.ows-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/cascading-local-2.5.5.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jai_core.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/org.w3.xlink-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/avro-1.7.5.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/guava-11.0.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jackson-core-asl-1.9.3.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/reflectasm-1.07-shaded.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/geomesa-feature-accumulo1.6-1.0.0-rc.3-SNAPSHOT.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jsr-275-1.0-beta-2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/riffle-0.1-dev.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/algebird-core_2.10-0.7.0.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/bijection-core_2.10-0.6.3.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-transform-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/chill-hadoop-0.4.0.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/common-2.6.0.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jt-zonalstats-1.3.1.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/mango-core-1.2.0.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/scalding-core_2.10-0.11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jai_codec.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/log4j-1.2.17.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-compiler-2.6.1.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/json-simple-1.1.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/joda-convert-1.6.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/cascading-core-2.5.5.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/paranamer-2.3.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/minlog-1.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-data-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-xsd-wfs-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/xml-commons-resolver-1.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/geomesa-core-accumulo1.6-1.0.0-rc.3-SNAPSHOT.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jdom-1.1.3.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/xz-1.0.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/jts-1.13.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-shapefile-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/geomesa-tools-accumulo1.6-1.0.0-rc.3-SNAPSHOT.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-xsd-filter-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/scalding-date_2.10-0.11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/geomesa-filter-accumulo1.6-1.0.0-rc.3-SNAPSHOT.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/joda-time-2.3.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/net.opengis.wfs-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/chill-java-0.4.0.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-api-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-coverage-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/scalalogging-slf4j_2.10-1.1.0.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/cascading-hadoop-2.5.5.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/commons-collections-3.2.1.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/picocontainer-1.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/slf4j-log4j12-1.7.5.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-process-11.2.jar

/home/jonathan.parise/dev/geomesa-accumulo6/geomesa-assemble/target/geomesa-1.0.0-rc.3-SNAPSHOT/lib/gt-grid-11.2.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-trace.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-tracer.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-fate.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/guava.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/jetty-util.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/commons-vfs2.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-minicluster.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/ext/geomesa-distributed-runtime-accumulo1.6-1.0.0-rc.3-SNAPSHOT.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/libthrift.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-master.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-gc.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/jcommander.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/servlet-api.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/jline.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-examples-simple.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/gson.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-server-base.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-tserver.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-test.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-start.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/commons-math.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-core.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/jetty.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-proxy.jar

/opt/cloudera/parcels/ACCUMULO/lib/accumulo/lib/accumulo-monitor.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jsp-api-2.1.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-cli-1.2.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-httpclient-3.1.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/xmlenc-0.52.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/guava-11.0.2.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/slf4j-api-1.7.5.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/junit-4.11.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-math3-3.1.1.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/log4j-1.2.17.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jackson-xc-1.8.8.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-codec-1.4.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/java-xmlbuilder-0.4.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jackson-core-asl-1.8.8.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/snappy-java-1.0.4.1.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/gson-2.2.4.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-logging-1.1.3.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-net-3.1.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/xz-1.0.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jersey-server-1.9.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-digester-1.8.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-io-2.4.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/asm-3.2.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/paranamer-2.3.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jetty-util-6.1.26.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/apacheds-i18n-2.0.0-M15.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/curator-recipes-2.6.0.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jetty-6.1.26.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/httpcore-4.2.5.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/avro.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/slf4j-log4j12.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/activation-1.1.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/hue-plugins-3.6.0-cdh5.2.0.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/zookeeper.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jettison-1.1.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/curator-framework-2.6.0.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/servlet-api-2.5.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jasper-compiler-5.5.23.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-lang-2.6.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/api-util-1.0.0-M20.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-configuration-1.6.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jsch-0.1.42.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/netty-3.6.2.Final.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/mockito-all-1.8.5.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jersey-core-1.9.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/httpclient-4.2.5.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jsr305-1.3.9.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/hamcrest-core-1.3.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jersey-json-1.9.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-compress-1.4.1.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-collections-3.2.1.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jets3t-0.9.0.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jasper-runtime-5.5.23.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/jaxb-api-2.2.2.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-beanutils-1.7.0.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/protobuf-java-2.5.0.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/curator-client-2.6.0.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-el-1.0.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/stax-api-1.0-2.jar

/opt/cloudera/parcels/CDH/lib/hadoop/lib/api-asn1-api-1.0.0-M20.jar

/etc/accumulo/conf

/etc/hadoop/conf

 

 

You can see that this is missing the hadoop-common jar and several other hadoop jars. I think this is why the NoClassDefFoundError is thrown.

 

I believe I need to figure out the correct settings for the following variables:

 

HADOOP_SHARE_DIRE

HADOOP_COMMON

HADOOP_HDFS

HADOOP_MAP_REDUCE

HADOOP_YARN

 

Does anyone know what the correct values would be for a cloudera environment?

 

Thanks,

 

 

Jon Parise

Senior Software Engineer

Viz | General Missons Systems

This message and/or attachments may include information subject to GD Corporate Policies 07-103 and 07-105 and is intended to be accessed only by authorized recipients.  Use, storage and transmission are governed by General Dynamics and its policies. Contractual restrictions apply to third parties.  Recipients should refer to the policies or contract to determine proper handling.  Unauthorized review, use, disclosure or distribution is prohibited.  If you are not an intended recipient, please contact the sender and destroy all copies of the original message.

 


Back to the top