Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [geomesa-users] Getting issues while running GeoMesa tutorial

Thanks for your feedback :)
I have upgraded geomesa and it seems that issue got fixed.

Thanks for your support.

Thanks,
Santanu Sadhu

On Thu, Sep 13, 2018 at 7:43 PM Emilio Lahr-Vivaz <elahrvivaz@xxxxxxxx> wrote:
Hello,

It seems that your hbase cluster is having issues. I would suggest checking the logs for the master and any region servers for more information.

It also appears that you have a mix of geomesa versions - the tutorial and distributed runtime jar are 2.1.0-SNAPSHOT, but you said that you are using 2.0.0. That may be the underlying reason that your cluster is breaking, if things are being configured with different versions. I would suggest using 2.0.2 for everything (you can check out the appropriate git tag for the tutorial before building and running it).

If you find any errors that aren't obvious, write back and we can help point you in the right direction.

Thanks,

Emilio

On 09/13/2018 03:19 AM, Santanu Sadhu wrote:
Hi Team,

We have started evaluating GeoMesa with HBase and while trying to run GeoMesa HBase Quick Start I am getting the following errors. Can you please check what could be the possible error? 
I am not sure whether this is the right location to report any issue or not. If you think you can point to something else. 

[root@d50q-mtr-app22 geomesa-tutorials]#  java -cp geomesa-tutorials-hbase/geomesa-tutorials-hbase-quickstart/target/geomesa-tutorials-hbase-quickstart-2.1.0-SNAPSHOT.jar org.geomesa.example.hbase.HBaseQuickStart --hbase.zookeepers d50q-mtr-app22 --hbase.catalog GeoMesa_tutorial
Picked up JAVA_TOOL_OPTIONS: -Dgeomesa.hbase.coprocessor.path=hdfs://d50q-mtr-app22:8020/user/mapred/geomesa/geomesa-hbase-distributed-runtime_2.11-2.1.0-SNAPSHOT.jar
Loading datastore
Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

Creating schema: GLOBALEVENTID:String,Actor1Name:String,Actor1CountryCode:String,Actor2Name:String,Actor2CountryCode:String,EventCode:String,NumMentions:Integer,NumSources:Integer,NumArticles:Integer,ActionGeo_Type:Integer,ActionGeo_FullName:String,ActionGeo_CountryCode:String,dtg:Date,geom:Point:srid=4326

Generating test data

Writing test data
Cannot get replica 0 location for {"totalColumns":1,"row":"\\x01#Eg\\xCFEg\\xCFE719024875","families":{"d":[{"qualifier":"d","vlen":108,"tag":[],"timestamp":9223372036854775807}]}}
Sep 12, 2018 1:50:04 PM org.geotools.referencing.factory.DeferredAuthorityFactory disposeBackingStore
INFO: Disposing class org.geotools.referencing.factory.epsg.ThreadedHsqlEpsgFactory backing store
Cannot get replica 0 location for {"totalColumns":1,"row":"\\x01\\x1D'B\\xCF\\x8D\\xBDT\\xDE719024879","families":{"d":[{"qualifier":"d","vlen":138,"tag":[],"timestamp":9223372036854775807}]}}
#5, table=GeoMesa_tutorial_gdelt_2dquickstart_z2_v2, attempt=2/35 failed=1162ops, last exception: org.apache.hadoop.hbase.DoNotRetryIOException: Operation Timeout on d50q-mtr-app22,60020,1536751493368, tracking started Wed Sep 12 12:50:17 IDT 2018; not retrying 1162 - final failure
#5, table=GeoMesa_tutorial_gdelt_2dquickstart_z2_v2, attempt=2/35 failed=1192ops, last exception: org.apache.hadoop.hbase.DoNotRetryIOException: Operation Timeout on d50q-mtr-app22,60020,1536740860632, tracking started Wed Sep 12 12:50:17 IDT 2018; not retrying 1192 - final failure
java.lang.RuntimeException: Error running quickstart:
        at org.geomesa.example.quickstart.GeoMesaQuickStart.run(GeoMesaQuickStart.java:92)
        at org.geomesa.example.hbase.HBaseQuickStart.main(HBaseQuickStart.java:25)
Caused by: java.lang.RuntimeException: Error writing features: Failed 2356 actions: RetriesExhaustedException: 2 times, Operation Timeout: 2354 times, servers with issues: null, d50q-mtr-app22,60020,1536751493368, d50q-mtr-app22,60020,1536740860632,
        at org.locationtech.geomesa.index.geotools.GeoMesaFeatureWriter.propagateExceptions(GeoMesaFeatureWriter.scala:186)
        at org.locationtech.geomesa.index.geotools.GeoMesaFeatureWriter.close(GeoMesaFeatureWriter.scala:178)
        at org.geomesa.example.quickstart.GeoMesaQuickStart.writeFeatures(GeoMesaQuickStart.java:171)
        at org.geomesa.example.quickstart.GeoMesaQuickStart.run(GeoMesaQuickStart.java:85)
        ... 1 more
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 2356 actions: RetriesExhaustedException: 2 times, Operation Timeout: 2354 times, servers with issues: null, d50q-mtr-app22,60020,1536751493368, d50q-mtr-app22,60020,1536740860632,
        at org.apache.hadoop.hbase.client.AsyncProcess$BatchErrors.makeException(AsyncProcess.java:260)
        at org.apache.hadoop.hbase.client.AsyncProcess$BatchErrors.access$2400(AsyncProcess.java:240)
        at org.apache.hadoop.hbase.client.AsyncProcess.waitForAllPreviousOpsAndReset(AsyncProcess.java:1889)
        at org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:247)
        at org.apache.hadoop.hbase.client.BufferedMutatorImpl.close(BufferedMutatorImpl.java:170)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.locationtech.geomesa.utils.io.CloseQuietly$.apply(SafeClose.scala:41)
        at org.locationtech.geomesa.index.geotools.GeoMesaFeatureWriter$$anonfun$close$1.apply(GeoMesaFeatureWriter.scala:174)
        at org.locationtech.geomesa.index.geotools.GeoMesaFeatureWriter$$anonfun$close$1.apply(GeoMesaFeatureWriter.scala:173)
        at scala.collection.Iterator$class.foreach(Iterator.scala:742)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1194)
        at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
        at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
        at org.locationtech.geomesa.index.geotools.GeoMesaFeatureWriter.close(GeoMesaFeatureWriter.scala:173)
        ... 3 more


I am using 
HBase version 1.3.1.
Geomesa Version: 2.0.0
Hadoop version: 2.5.2






_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.locationtech.org/mailman/listinfo/geomesa-users

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.locationtech.org/mailman/listinfo/geomesa-users

Back to the top