Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
[geomesa-users] Error while parsing action exception when calling store.getFeatureWriter 
All:

   I think I have an ugly edge case here.
I have data that can have 0 or more coordinates in a field.

My featuretype has a multipoint geometry to deal with this.
Since geomesa requires a valid valid geometry in all features if there are no coordinates 
in the record I set a single point of lat: -90 lon: -180 in my geometry.
In this case I have created one record previously in the OSINTRecordset feature type that has the single 
dummy value.
When I go back through my code to see if I have a new record or if I need to update an existing (See code segment below) I get the below parsing error (See stack trace below) on the store.getFeatureWriter call. Since the filter is only for the fid 
I am not certain why geometry coordinates are even playing in the mix.
So I ran a test, and changed the coordinate in the initial record to (50.0, 50.0). And the problem went away.
Now I do something similiar with point geometries and I do not have an issue. 

The error conditions that seem to cause this error are:

1. Multi-point geometry
2. All records with no points other than lat: -90, lon: -180
3. Call to store.getFeatureWriter with a query.

FYI - I have another data type where this also occurs.
private boolean updateFeatureIfExists(String featuresetname, CoalesceRecord record) 
            throws IOException, CQLException, CoalesceDataFormatException
    {
        boolean updated = false;
        DataStore store = connect.getGeoDataStore();
        FilterFactory2 ff = CommonFactoryFinder.getFilterFactory2();

        FeatureId fid =ff.featureId(record.getKey());
// TODO Need to add compare of modified time to see if there was an update 
        Filter filter = ff.id(Collections.singleton(fid));
// Need to escape the fully qualified column in the feature set for filters //Filter filter = CQL.toFilter("\""+featuresetname+".recordKey\" =" + "'" + record.getKey() + "'"); LOGGER.warn("Check if feature for key {} exists in featuresetname: {} , using filter: {}",record.getKey(),featuresetname,filter.toString()); FeatureWriter<SimpleFeatureType, SimpleFeature> writer = store.getFeatureWriter(featuresetname, filter, Transaction.AUTO_COMMIT); 

        if (writer.hasNext() )
        { .....
2017-07-03 15:47:18,171 | WARN | [Thread-12] | (AccumuloPersistor.java:1620) - Check if feature for key 2f9d7f5d-6e85-4897-b418-6e5aebc442ed exists in featuresetname: ReportArtifactRecordset , using filter: [ 2f9d7f5d-6e85-4897-b418-6e5aebc442ed ] 2017-07-03 15:47:25,821 | WARN | [Thread-12] | (AccumuloPersistor.java:1620) - Check if feature for key 3e4707b3-10b8-42dd-b7db-9fc950b9dae8 exists in featuresetname: OERecordset , using filter: [ 3e4707b3-10b8-42dd-b7db-9fc950b9dae8 ] 2017-07-03 15:47:34,886 | WARN | [Thread-12] | (AccumuloPersistor.java:1620) - Check if feature for key c4f1c655-d3f9-42b0-abd3-53c7b9383d25 exists in featuresetname: OSINTRecordset , using filter: [ c4f1c655-d3f9-42b0-abd3-53c7b9383d25 ] 2017-07-03 15:48:03,230 | ERROR | [Thread-12] | (Reports_Consumer.java:122) - Error while parsing action 'stat/OneOrMore/ZeroOrMore/Sequence/org$locationtech$geomesa$utils$stats$StatParser$$singleStat/org$locationtech$geomesa$utils$stats$StatParser$$histogram/org$locationtech$geomesa$utils$stats$StatParser$$histogramAction1' at input position (line 1, pos 159): Count();MinMax("GeoLocation");MinMax("ReportDate");MinMax("recordKey");TopK("recordKey");Histogram("GeoLocation",10000,"POINT (-190 -100)","POINT (-170 -80)");Histogram("ReportDate",1000,"2016-01-19T20:59:00.000Z","2016-01-19T21:01:00.000Z");Histogram("recordKey",1000,"7ef4d1e4-f5c4-4014-8c3c-125b86d3f8860","7ef4d1e4-f5c4-4014-8c3c-125b86d3f886z");Frequency("recordKey","ReportDate",week,20);Frequency("recordKey",20);Z3Histogram("GeoLocation","ReportDate",week,10000) 
^
java.lang.IllegalArgumentException: requirement failed: Value out of bounds ([-180.0 180.0]): -190.0 org.parboiled.errors.ParserRuntimeException: Error while parsing action 'stat/OneOrMore/ZeroOrMore/Sequence/org$locationtech$geomesa$utils$stats$StatParser$$singleStat/org$locationtech$geomesa$utils$stats$StatParser$$histogram/org$locationtech$geomesa$utils$stats$StatParser$$histogramAction1' at input position (line 1, pos 159): Count();MinMax("GeoLocation");MinMax("ReportDate");MinMax("recordKey");TopK("recordKey");Histogram("GeoLocation",10000,"POINT (-190 -100)","POINT (-170 -80)");Histogram("ReportDate",1000,"2016-01-19T20:59:00.000Z","2016-01-19T21:01:00.000Z");Histogram("recordKey",1000,"7ef4d1e4-f5c4-4014-8c3c-125b86d3f8860","7ef4d1e4-f5c4-4014-8c3c-125b86d3f886z");Frequency("recordKey","ReportDate",week,20);Frequency("recordKey",20);Z3Histogram("GeoLocation","ReportDate",week,10000) 
^
java.lang.IllegalArgumentException: requirement failed: Value out of bounds ([-180.0 180.0]): -190.0 
    at org.parboiled.MatcherContext.runMatcher(MatcherContext.java:366)
at org.parboiled.matchers.SequenceMatcher.match(SequenceMatcher.java:46) at org.parboiled.parserunners.BasicParseRunner.match(BasicParseRunner.java:77) 
    at org.parboiled.MatcherContext.runMatcher(MatcherContext.java:351)
    at org.parboiled.matchers.FirstOfMatcher.match(FirstOfMatcher.java:41)
at org.parboiled.parserunners.BasicParseRunner.match(BasicParseRunner.java:77) 
    at org.parboiled.MatcherContext.runMatcher(MatcherContext.java:351)
at org.parboiled.matchers.SequenceMatcher.match(SequenceMatcher.java:46) at org.parboiled.parserunners.BasicParseRunner.match(BasicParseRunner.java:77) 
    at org.parboiled.MatcherContext.runMatcher(MatcherContext.java:351)
at org.parboiled.matchers.ZeroOrMoreMatcher.match(ZeroOrMoreMatcher.java:39) at org.parboiled.parserunners.BasicParseRunner.match(BasicParseRunner.java:77) 
    at org.parboiled.MatcherContext.runMatcher(MatcherContext.java:351)
at org.parboiled.matchers.SequenceMatcher.match(SequenceMatcher.java:46) at org.parboiled.parserunners.BasicParseRunner.match(BasicParseRunner.java:77) 
    at org.parboiled.MatcherContext.runMatcher(MatcherContext.java:351)
at org.parboiled.matchers.SequenceMatcher.match(SequenceMatcher.java:46) at org.parboiled.parserunners.BasicParseRunner.match(BasicParseRunner.java:77) 
    at org.parboiled.MatcherContext.runMatcher(MatcherContext.java:351)
at org.parboiled.parserunners.BasicParseRunner.run(BasicParseRunner.java:72) at org.parboiled.parserunners.ReportingParseRunner.runBasicMatch(ReportingParseRunner.java:86) at org.parboiled.parserunners.ReportingParseRunner.run(ReportingParseRunner.java:66) at org.parboiled.scala.parserunners.ReportingParseRunner.run(ReportingParseRunner.scala:34) at org.locationtech.geomesa.utils.stats.StatParser$.parse(StatParser.scala:36) 
    at org.locationtech.geomesa.utils.stats.Stat$.apply(Stat.scala:115)
at org.locationtech.geomesa.accumulo.data.stats.AccumuloGeoMesaStats$$anonfun$statUpdater$1.apply(AccumuloGeoMesaStats.scala:116) at org.locationtech.geomesa.accumulo.data.stats.AccumuloGeoMesaStats$$anonfun$statUpdater$1.apply(AccumuloGeoMesaStats.scala:116) at org.locationtech.geomesa.index.stats.MetadataStatUpdater.<init>(MetadataBackedStats.scala:323) at org.locationtech.geomesa.accumulo.data.stats.AccumuloGeoMesaStats.statUpdater(AccumuloGeoMesaStats.scala:116) at org.locationtech.geomesa.index.geotools.GeoMesaFeatureWriter.<init>(GeoMesaFeatureWriter.scala:112) at org.locationtech.geomesa.accumulo.data.AccumuloModifyFeatureWriter.<init>(AccumuloFeatureWriter.scala:30) at org.locationtech.geomesa.accumulo.data.AccumuloDataStore.createFeatureWriterModify(AccumuloDataStore.scala:87) at org.locationtech.geomesa.index.geotools.GeoMesaDataStore.getFeatureWriter(GeoMesaDataStore.scala:387) at org.locationtech.geomesa.index.geotools.GeoMesaDataStore.getFeatureWriter(GeoMesaDataStore.scala:49) at com.incadencecorp.coalesce.framework.persistance.accumulo.AccumuloPersistor.updateFeatureIfExists(AccumuloPersistor.java:1621) at com.incadencecorp.coalesce.framework.persistance.accumulo.AccumuloPersistor.addNewFeatureForRecordSet(AccumuloPersistor.java:1499) at com.incadencecorp.coalesce.framework.persistance.accumulo.AccumuloPersistor.persistEntitySearchData(AccumuloPersistor.java:1337) at com.incadencecorp.coalesce.framework.persistance.accumulo.AccumuloPersistor.persistEntityObject(AccumuloPersistor.java:1144) at com.incadencecorp.coalesce.framework.persistance.accumulo.AccumuloPersistor.flattenObject(AccumuloPersistor.java:1057) at com.incadencecorp.coalesce.framework.persistance.CoalescePersistorBase.saveEntity(CoalescePersistorBase.java:99) at com.incadencecorp.coalesce.framework.CoalesceFramework.saveCoalesceEntity(CoalesceFramework.java:451) at com.incadencecorp.oe.ingest.reports.Reports_Consumer.run(Reports_Consumer.java:83) 
    at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException: requirement failed: Value out of bounds ([-180.0 180.0]): -190.0 
    at scala.Predef$.require(Predef.scala:224)
at org.locationtech.geomesa.curve.NormalizedDimension$class.normalize(NormalizedDimension.scala:17) at org.locationtech.geomesa.curve.NormalizedLon.normalize(NormalizedDimension.scala:28) 
    at org.locationtech.geomesa.curve.Z2SFC$.index(Z2SFC.scala:22)
at org.locationtech.geomesa.utils.stats.BinnedGeometryArray.convertToLong(BinnedArray.scala:221) at org.locationtech.geomesa.utils.stats.BinnedGeometryArray.convertToLong(BinnedArray.scala:212) at org.locationtech.geomesa.utils.stats.WholeNumberBinnedArray.<init>(BinnedArray.scala:131) at org.locationtech.geomesa.utils.stats.BinnedGeometryArray.<init>(BinnedArray.scala:213) at org.locationtech.geomesa.utils.stats.BinnedArray$.apply(BinnedArray.scala:121) at org.locationtech.geomesa.utils.stats.Histogram.<init>(Histogram.scala:36) at org.locationtech.geomesa.utils.stats.StatParser$$anonfun$org$locationtech$geomesa$utils$stats$StatParser$$histogram$1$$anonfun$apply$7.apply(StatParser.scala:113) at org.locationtech.geomesa.utils.stats.StatParser$$anonfun$org$locationtech$geomesa$utils$stats$StatParser$$histogram$1$$anonfun$apply$7.apply(StatParser.scala:107) at org.parboiled.scala.rules.Rule$$anonfun$exec$4.apply(Rule.scala:221) at org.parboiled.scala.rules.Rule$$anonfun$exec$4.apply(Rule.scala:217) at org.parboiled.scala.rules.Rule$$anonfun$push$1.apply(Rule.scala:133) at org.parboiled.scala.rules.Rule$$anonfun$push$1.apply(Rule.scala:132) 
    at org.parboiled.scala.rules.Rule$$anon$1.run(Rule.scala:129)
    at org.parboiled.matchers.ActionMatcher.match(ActionMatcher.java:96)
at org.parboiled.parserunners.BasicParseRunner.match(BasicParseRunner.java:77) 
    at org.parboiled.MatcherContext.runMatcher(MatcherContext.java:351)
    ... 42 more


--
========= mailto:dboyd@xxxxxxxxxxxxxxxxx ============
David W. Boyd
VP,  Data Solutions
10432 Balls Ford, Suite 240
Manassas, VA 20109
office:   +1-703-552-2862
cell:     +1-703-402-7908
============== http://www.incadencecorp.com/ ============
ISO/IEC JTC1 WG9, editor ISO/IEC 20547 Big Data Reference Architecture
Chair ANSI/INCITS TC Big Data
Co-chair NIST Big Data Public Working Group Reference Architecture
First Robotic Mentor - FRC, FTC - www.iliterobotics.org
Board Member- USSTEM Foundation - www.usstem.org

The information contained in this message may be privileged
and/or confidential and protected from disclosure.
If the reader of this message is not the intended recipient
or an employee or agent responsible for delivering this message
to the intended recipient, you are hereby notified that any
dissemination, distribution or copying of this communication
is strictly prohibited.  If you have received this communication
in error, please notify the sender immediately by replying to
this message and deleting the material from any computer.

Back to the top