I am trying to build the geomesa-spark module from source
but the build fails when building the GeoMesa Spark Converter
RDD Provider module. Some of the tests fail, giving the next
error:
Tests run: 3, Failures: 0, Errors: 3, Skipped: 0, Time
elapsed: 4.779 sec <<< FAILURE! - in
org.locationtech.geomesa.spark.converter.ConverterSpatialRDDProviderTest
The ConverterSpatialRDDProvider should::read from local
files(org.locationtech.geomesa.spark.converter.ConverterSpatialRDDProviderTest)
Time elapsed: 1.686 sec <<< ERROR!
java.lang.NoClassDefFoundError:
org/apache/commons/io/Charsets
at
org.apache.hadoop.security.Credentials.<clinit>(Credentials.java:222)
at
org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:334)
at
org.apache.hadoop.mapreduce.Job.getInstance(Job.java:184)
at
org.locationtech.geomesa.spark.converter.ConverterSpatialRDDProvider.rdd(ConverterSpatialRDDProvider.scala:64)
at
org.locationtech.geomesa.spark.converter.ConverterSpatialRDDProviderTest$$anonfun$2$$anonfun$apply$7.apply(ConverterSpatialRDDProviderTest.scala:50)
at
org.locationtech.geomesa.spark.converter.ConverterSpatialRDDProviderTest$$anonfun$2$$anonfun$apply$7.apply(ConverterSpatialRDDProviderTest.scala:49)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:283)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:173)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:128)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
Caused by: java.lang.ClassNotFoundException:
org.apache.commons.io.Charsets
at
sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at
org.apache.hadoop.security.Credentials.<clinit>(Credentials.java:222)
at
org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:334)
at
org.apache.hadoop.mapreduce.Job.getInstance(Job.java:184)
at
org.locationtech.geomesa.spark.converter.ConverterSpatialRDDProvider.rdd(ConverterSpatialRDDProvider.scala:64)
at
org.locationtech.geomesa.spark.converter.ConverterSpatialRDDProviderTest$$anonfun$2$$anonfun$apply$7.apply(ConverterSpatialRDDProviderTest.scala:50)
at
org.locationtech.geomesa.spark.converter.ConverterSpatialRDDProviderTest$$anonfun$2$$anonfun$apply$7.apply(ConverterSpatialRDDProviderTest.scala:49)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:283)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:173)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:128)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
The ConverterSpatialRDDProvider should::read from local
files with
filtering(org.locationtech.geomesa.spark.converter.ConverterSpatialRDDProviderTest)
Time elapsed: 0.319 sec <<< ERROR!
java.lang.NoClassDefFoundError: Could not initialize
class org.apache.hadoop.security.Credentials
at
org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:334)
at
org.apache.hadoop.mapreduce.Job.getInstance(Job.java:184)
at
org.locationtech.geomesa.spark.converter.ConverterSpatialRDDProvider.rdd(ConverterSpatialRDDProvider.scala:64)
at
org.locationtech.geomesa.spark.converter.ConverterSpatialRDDProviderTest$$anonfun$2$$anonfun$apply$11.apply(ConverterSpatialRDDProviderTest.scala:58)
at
org.locationtech.geomesa.spark.converter.ConverterSpatialRDDProviderTest$$anonfun$2$$anonfun$apply$11.apply(ConverterSpatialRDDProviderTest.scala:56)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:283)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:173)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:128)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
The ConverterSpatialRDDProvider should::read from a local
file using Converter Name
lookup(org.locationtech.geomesa.spark.converter.ConverterSpatialRDDProviderTest)
Time elapsed: 0.083 sec <<< ERROR!
java.lang.NoClassDefFoundError: Could not initialize
class org.apache.hadoop.security.Credentials
at
org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:334)
at
org.apache.hadoop.mapreduce.Job.getInstance(Job.java:184)
at
org.locationtech.geomesa.spark.converter.ConverterSpatialRDDProvider.rdd(ConverterSpatialRDDProvider.scala:64)
at
org.locationtech.geomesa.spark.converter.ConverterSpatialRDDProviderTest$$anonfun$2$$anonfun$apply$15.apply(ConverterSpatialRDDProviderTest.scala:70)
at
org.locationtech.geomesa.spark.converter.ConverterSpatialRDDProviderTest$$anonfun$2$$anonfun$apply$15.apply(ConverterSpatialRDDProviderTest.scala:64)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:283)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:173)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:128)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
I don't see how can I install the Commons IO library and
let the test access it. Does anybody have succesfully build
Geomesa Spark and have an idea on how to solve this error ?