[geomesa-dev] [JIRA] (GEOMESA-2602) Spark - 'cache' option requires extr

["Emilio Lahr-Vivaz (JIRA)" <jira@xxxxxxxxxxxxxxxxxxxxx>]

Title: Message Title

Emilio Lahr-Vivaz created an issue

GeoMesa / GEOMESA-2602

Spark - 'cache' option requires extra classpath dependencies

Issue Type:	Bug
Affects Versions:	2.0.0, 2.1.0, 2.0.1, 2.0.2, 2.2.0, 2.1.1, 2.3.0, 2.1.2, 2.2.1, 2.2.2, 2.1.3
Assignee:	Unassigned
Created:	10/Apr/19 11:08 AM
Priority:	Major
Reporter:	Emilio Lahr-Vivaz

When using: spark.read.option("cache", "true")...
You get: IllegalArgumentException: Cache argument set to true but GeoCQEngineDataStore is not on the classpath

The geomesa-cqengine-datastore_2.11 module needs to be bundled in the various spark-runtime jars for the cache option to work. However, it has always been marked 'provided' - is there a reason for that? Possibly documenting the classpath setup would be sufficient.

Add Comment

Get Jira notifications on your phone! Download the Jira Cloud app for Android or iOS
This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100099-sha1:8dcf83b)