Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
[geomesa-users] SparkSql for Geomesa Hbase

Hey, 

I got another question on Geomesa Hbase.
Ingesting data works perfectly now, thanks for your help so far.

Now I want to write some queries for Spark (in spark-shell).
Geomesa list lots of SparkSql functions:

I tried this query:
"select * from table where st_contains(st_makeBBOX(0.0, 0.0, 90.0, 90.0), geom)"
And I get this error:
java.lang.NoSuchMethodError: org.apache.spark.sql.execution.datasources.LogicalRelation.copy(Lorg/apache/spark/sql/sources/BaseRelation;Lscala/collection/Seq;Lscala/Option;)Lorg/apache/spark/sql/execution/datasources/LogicalRelation;

I am running spark-shell with these jars:
JARS=file:///opt/geomesa/dist/spark/geomesa-hbase-spark-runtime_2.11-2.0.2.jar,file:///usr/lib/hbase/conf/hbase-site.xml

I also tried to add the jar for spark-sql like this:
JARS=file:///usr/lib/spark/jars/spark-sql_2.11-2.3.1.jar,file:///opt/geomesa/dist/spark/geomesa-hbase-spark-runtime_2.11-2.0.2.jar,file:///usr/lib/hbase/conf/hbase-site.xml  

Unfortunately that did not solve the problem. Do you have any ideas what could cause that error?

Thank you,
Martin




Back to the top