[geomesa-dev] [JIRA] (GEOMESA-2579) Carry Map and List attribute types a

["J G (JIRA)" <jira@xxxxxxxxxxxxxxxxxxxxx>]

Title: Message Title

J G created an issue

GeoMesa / GEOMESA-2579

Carry Map and List attribute types all the way through (for Spark analysis)

Issue Type:	Bug
Assignee:	Unassigned
Created:	06/Mar/19 5:45 PM
Priority:	Critical
Reporter:	J G

jsonList: https://www.geomesa.org/documentation/user/convert/json.html#jsonlist is not supported all the way through to Spark (specifically Pyspark).

I have a schema of a GDELT based data set, which has a schema shown below.. langNames (as a string), keywords (as a ListString), and locTags as a String

....,langNames:String,keywords:ListString,locTags:String

Yet, in Pyspark, when I do a schema check.... the entire keywords field is missing:

df.schema

OUTPUT:

,StructField(langNames,StringType,true),StructField(locTags,StringType,true),

Add Comment

Get Jira notifications on your phone! Download the Jira Cloud app for Android or iOS
This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100099-sha1:d998a3f)