Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [geomesa-users] geomesa-users Digest, Vol 11, Issue 7
Hi Manas,

Sorry for the delay in responding.  Given the various versions of GeoMesa and the QuickStart code and data, I'm wondering if some combination may not have matched up.  It might be helpful to delete any Accumulo tables which have QuickStart data, delete any GeoMesa artifacts from your ~/.m2/ (say by deleting ~/.m2/repository/org/locationtech), rebuilding GeoMesa and the QuickStart, and finally re-running it.

Anyhow, that's the most thorough approach I can imagine to make sure that the written data corresponds to the version of GeoMesa for reading. 

Thanks,

Jim

On 01/12/2015 03:11 PM, Manas Kar wrote:
Sorry. Clicked the "send button" too soon. 
This stack trace is when I built accumulo6 branch and distributed its run time jar to /ext/ folder and ran the quickstart example.

Thanks
Manas

On Mon, Jan 12, 2015 at 3:06 PM, Manas Kar <manasdebashiskar@xxxxxxxxx> wrote:
Hi Jim, 
 I tried with the accumulo6 branch this time and got the following error.

Failed to get multiscan result
	java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Malformed attribute
		at org.apache.accumulo.tserver.TabletServer$ScanTask.get(TabletServer.java:759)
		at org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.continueMultiScan(TabletServer.java:1422)
		at org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.continueMultiScan(TabletServer.java:1408)
		at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
		at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
		at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
		at java.lang.reflect.Method.invoke(Method.java:606)
		at org.apache.accumulo.trace.instrument.thrift.TraceWrap$1.invoke(TraceWrap.java:63)
		at com.sun.proxy.$Proxy23.continueMultiScan(Unknown Source)
		at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$continueMultiScan.getResult(TabletClientService.java:2276)
		at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$continueMultiScan.getResult(TabletClientService.java:2260)
		at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
		at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
		at org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:171)
		at org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:478)
		at org.apache.accumulo.server.util.TServerUtils$THsHaServer$Invocation.run(TServerUtils.java:231)
		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
		at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
		at java.lang.Thread.run(Thread.java:745)
	Caused by: java.lang.IllegalArgumentException: Malformed attribute
		at org.locationtech.geomesa.utils.geotools.SimpleFeatureTypes$SpecParser.parse(SimpleFeatureTypes.scala:370)
		at org.locationtech.geomesa.utils.geotools.SimpleFeatureTypes$.parse(SimpleFeatureTypes.scala:374)
		at org.locationtech.geomesa.utils.geotools.SimpleFeatureTypes$.createType(SimpleFeatureTypes.scala:44)
		at org.locationtech.geomesa.core.iterators.SpatioTemporalIntersectingIterator.init(SpatioTemporalIntersectingIterator.scala:76)
		at org.apache.accumulo.core.iterators.IteratorUtil.loadIterators(IteratorUtil.java:246)
		at org.apache.accumulo.core.iterators.IteratorUtil.loadIterators(IteratorUtil.java:216)
		at org.apache.accumulo.core.iterators.IteratorUtil.loadIterators(IteratorUtil.java:194)
		at org.apache.accumulo.tserver.Tablet$ScanDataSource.createIterator(Tablet.java:1985)
		at org.apache.accumulo.tserver.Tablet$ScanDataSource.iterator(Tablet.java:1923)
		at org.apache.accumulo.core.iterators.system.SourceSwitchingIterator.seek(SourceSwitchingIterator.java:163)
		at org.apache.accumulo.tserver.Tablet.lookup(Tablet.java:1499)
		at org.apache.accumulo.tserver.Tablet.lookup(Tablet.java:1606)
		at org.apache.accumulo.tserver.TabletServer$ThriftClientHandler$LookupTask.run(TabletServer.java:1119)
		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
		... 5 more




The only change from this branch to what I am compiling is 


@@ -47,7 +47,7 @@
         <!-- environment-dependent versions -->
         <zookeeper.version>3.4.5</zookeeper.version>
         <accumulo.version>1.6.1</accumulo.version>
-        <hadoop.version>2.2.0</hadoop.version>
+        <hadoop.version>2.5.0-cdh5.3.0</hadoop.version>
         <scalding.version>0.11.2</scalding.version>
 
         <!-- logging properties
@@ -958,6 +958,11 @@
             </snapshots>
         </repository>
         <repository>
+           <id>cloudera</id>
+           <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
+        </repository>
+
+        <repository>
             <id>geotools</id>
             <url>http://download.osgeo.org/webdav/geotools</url>
         </repository>
(END)


Thanks
Manas

On Mon, Jan 12, 2015 at 12:00 PM, <geomesa-users-request@xxxxxxxxxxxxxxxx> wrote:
Send geomesa-users mailing list submissions to
        geomesa-users@xxxxxxxxxxxxxxxx

To subscribe or unsubscribe via the World Wide Web, visit
        http://www.locationtech.org/mailman/listinfo/geomesa-users
or, via email, send a message with subject or body 'help' to
        geomesa-users-request@xxxxxxxxxxxxxxxx

You can reach the person managing the list at
        geomesa-users-owner@xxxxxxxxxxxxxxxx

When replying, please edit your Subject line so it is more specific
than "Re: Contents of geomesa-users digest..."


Today's Topics:

   1. Re: Geomesa with Accumulo 1.6 (Manas Kar)
   2. Re: Geomesa with Accumulo 1.6 (Jim Hughes)


----------------------------------------------------------------------

Message: 1
Date: Sun, 11 Jan 2015 20:22:46 -0500
From: Manas Kar <manasdebashiskar@xxxxxxxxx>
To: geomesa-users <geomesa-users@xxxxxxxxxxxxxxxx>
Subject: Re: [geomesa-users] Geomesa with Accumulo 1.6
Message-ID:
        <CAEfGi76aBuy_BCYqE2SGVYqNu8SfpEMKmutw4VL_wAJLmSRaTQ@xxxxxxxxxxxxxx>
Content-Type: text/plain; charset="utf-8"

Hi Jim,
 Can't thank you enough for your help. Here are my steps and results.

I tried running the quickstart tutorial which should create 1000 features
in an empty table.

My tutorial fails with the following error.

Java.util.concurrent.ExecutionException:
java.lang.NoClassDefFoundError: javax/media/jai/util/ImagingListener


Also the acc16_gs26 branch fails to build with
hadoop-version 2.5.0-cdh5.3.0(builds fine with hadoop2.2) with the
following error
[ERROR] import org.glassfish.grizzly.servlet.ServletContextImpl.

Only when I build it with hadoop 2.2 and later don't do a clean build the
build succeeds.
May be this branch is not fully supported but may be I am missing some
thing trivial.

Also the is the geoserver build needs to have the geomesa-assemble jars in
it's lib as well?

..Manas

On Fri, Jan 9, 2015 at 6:50 PM, Manas Kar <manasdebashiskar@xxxxxxxxx>
wrote:

> Hi Jim,
>  Thanks for your elaborate instruction. It definitely took me further then
> where I was before.
>
> Now I can bring up my geosererver. BUT I don't see the "geomesa pannel" on
> the left as described in the document
> http://www.geomesa.org/2014/08/06/geomesa-ui/.
>
> I DO see the Accumulo data store in the stores section but when I apply
> the proper credentials it gets stuck saying
>
> 09 Jan 18:34:54 WARN [org.apache.accumulo.core.client.impl.ServerClient] -
> Failed to find an available server in the list of servers:
> [cloudera2ne:10011 (120000), cloudera3ne:10011 (120000), cloudera1ne:10011
> (120000)]
>
> NB: I tried both IP and FQDN with the same result.
>
> *Am I still missing some jars or any steps? *
>
> *My list is given below*
> #accumulo specific#
>
>    - accumulo-trace.jar
>    - accumulo-fate.jar
>    - accumulo-core.jar
>
> #As per instruction replaced commons lang 2.1 with 2.4 and
> commons-configuration
>
>    - commons-lang-2.4.jar
>    - commons-configuration-1.6.jar
>
>
> #hadoop specific jars from my cloudera servers.
>
>    - hadoop-auth-2.5.0-cdh5.3.0.jar
>    - hadoop-common-2.5.0-cdh5.3.0.jar
>    - hadoop-hdfs-2.5.0-cdh5.3.0.jar
>    - hadoop-mapreduce-client-app-2.5.0-cdh5.3.0.jar
>    - hadoop-mapreduce-client-common-2.5.0-cdh5.3.0.jar
>    - hadoop-yarn-client-2.5.0-cdh5.3.0.jar
>    - hadoop-mapreduce-client-shuffle-2.5.0-cdh5.3.0.jar
>    - hadoop-mapreduce-client-jobclient-2.5.0-cdh5.3.0.jar
>    - hadoop-mapreduce-client-core-2.5.0-cdh5.3.0.jar
>    - hadoop-yarn-client.jar
>    -
>
> *Question: It is the hadoop client for MR2. Do I need to use one for MR1
> instead?*
>
> #Thrift jar
>
>    - libthrift-0.9.0.jar
>
>
> #xookeeper jar
>
>    - zookeeper-3.4.5-cdh5.3.0.jar
>
>
> # plugin(the name says it is 1.5 but it is built with 1.6)
> geomesa-distributed-runtime-accumulo1.5-1.0.0-rc.3-SNAPSHOT.jar
> #wps jars
>
>    - gs-web-wps-2.5.2.jar
>    - gt-xsd-wps-11.2.jar
>    - gt-process-geometry-11.2.jar
>    - gs-wps-core-2.5.2.jar
>    - serializer-2.7.1.jar
>    - net.opengis.wps-11.2.jar
>
>
> Appreciate any help...
> Manas
>
> On Thu, Jan 8, 2015 at 3:53 PM, Manas Kar <manasdebashiskar@xxxxxxxxx>
> wrote:
>
>> Hi Experts,
>>  I built my Geomesa with Accumulo 1.6 and hadoop.version = 2.5.0-cdh5.3.0
>>
>>  It was bit convenient because my Cloudera instance provides Accumulo1.6.
>>  I am now trying to set up Geoserver to show Accumulo Data.
>>
>>  I am using Geoserver 2.5.2 (With WPS)
>>  Accumulo1.6.
>> Geomesa(RC.3)
>>
>> I am seeing the following error after following the document.
>>
>> WARNING: Can't load a service for category "DataStoreFactorySpi". Cause
>> is "ServiceConfigurationError: org.geotools.data.DataStoreFactorySpi:
>> Provider org.locationtech.geomesa.core.data.AccumuloDataStoreFactory could
>> not be instantiated".
>> java.util.ServiceConfigurationError:
>> org.geotools.data.DataStoreFactorySpi: Provider
>> org.locationtech.geomesa.core.data.AccumuloDataStoreFactory could not be
>> instantiated
>> at java.util.ServiceLoader.fail(ServiceLoader.java:224)
>> at java.util.ServiceLoader.access$100(ServiceLoader.java:181)
>> at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:377)
>> at java.util.ServiceLoader$1.next(ServiceLoader.java:445)
>> at org.geotools.factory.FactoryRegistry.register(FactoryRegistry.java:826)
>> at
>> org.geotools.factory.FactoryRegistry.scanForPlugins(FactoryRegistry.java:772)
>> .
>> .
>> .
>> Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/io/Writable
>>
>> What am I missing here? Please help.
>>
>> Thanks
>> Manas
>>
>>
>> On Thu, Jan 8, 2015 at 3:30 PM, Manas Kar <manasdebashiskar@xxxxxxxxx>
>> wrote:
>>
>>> Hi,
>>>  I am trying to make my current Cloudera installation (CDH5.3 with
>>> Accumulo 1.6) work with Geomesa.
>>>
>>> I saw a help in the Archive suggesting not to use Cloudera provided
>>> Accumulo. I was wondering if I can take a different route of compiling
>>> Geomesa with Accumulo 1.6?
>>>
>>> Also Do I have to change the hadoop version to the Cloudera provided
>>> version?
>>>
>>> Than
>>>
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.locationtech.org/mhonarc/lists/geomesa-users/attachments/20150111/cb063f2b/attachment.html>

------------------------------

Message: 2
Date: Mon, 12 Jan 2015 11:46:06 -0500
From: Jim Hughes <jnh5y@xxxxxxxx>
To: geomesa-users@xxxxxxxxxxxxxxxx
Subject: Re: [geomesa-users] Geomesa with Accumulo 1.6
Message-ID: <54B3FA4E.2060504@xxxxxxxx>
Content-Type: text/plain; charset="windows-1252"; Format="flowed"

Hi Manas,

No problem; I'm happy to help.  Once we worked through this, perhaps we
can sort out a branch which supports CDH 5.3.0.

For the issue with the QuickStart, can you send along more of the stack
trace?  Usually, the exception which causes the stack trace is the most
important line.  In this case, we are required by licensing issues to
exclude cerain jai-core which is where this class lives.  In order to
fix things, we'll need to think through the call stack and make a change
so that this class is not used.

 From chatting with some of the other GeoMesa developers, it sounds like
accumulo6 might be a better branch for you to work with.  Can you give
it quick try?  I checked the two branches and 'accumulo6' does not have
any Glassfish dependencies, so that issue should go away.

I don't think that GeoServer needs the geomesa-assemble jars.  The
GeoServer plugin jar contains the jars necessary to run one or two M/R
jobs from the GeoMesa GeoServer panel.  (Again, I'd point out that the
GeoMesa panel is a nice-to-have feature.)

Thanks,

Jim


On 01/11/2015 08:22 PM, Manas Kar wrote:
> Hi Jim,
>  Can't thank you enough for your help. Here are my steps and results.
>
> I tried running the quickstart tutorial which should create 1000
> features in an empty table.
>
> My tutorial fails with the following error.
> Java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: javax/media/jai/util/ImagingListener
>
> Also the acc16_gs26 branch fails to build with
> hadoop-version 2.5.0-cdh5.3.0(builds fine with hadoop2.2) with the
> following error
> [ERROR] import org.glassfish.grizzly.servlet.ServletContextImpl.
>
> Only when I build it with hadoop 2.2 and later don't do a clean build
> the build succeeds.
> May be this branch is not fully supported but may be I am missing some
> thing trivial.
>
> Also the is the geoserver build needs to have the geomesa-assemble
> jars in it's lib as well?
>
> ..Manas
>
> On Fri, Jan 9, 2015 at 6:50 PM, Manas Kar <manasdebashiskar@xxxxxxxxx
> <mailto:manasdebashiskar@xxxxxxxxx>> wrote:
>
>     Hi Jim,
>      Thanks for your elaborate instruction. It definitely took me
>     further then where I was before.
>
>     Now I can bring up my geosererver. BUT I don't see the "geomesa
>     pannel" on the left as described in the document
>     http://www.geomesa.org/2014/08/06/geomesa-ui/.
>
>     I DO see the Accumulo data store in the stores section but when I
>     apply the proper credentials it gets stuck saying
>
>     09 Jan 18:34:54 WARN
>     [org.apache.accumulo.core.client.impl.ServerClient] - Failed to
>     find an available server in the list of servers:
>     [cloudera2ne:10011 (120000), cloudera3ne:10011 (120000),
>     cloudera1ne:10011 (120000)]
>
>     NB: I tried both IP and FQDN with the same result.
>
>     *Am I still missing some jars or any steps? *
>
>     _My list is given below_
>     #accumulo specific#
>
>       * accumulo-trace.jar
>       * accumulo-fate.jar
>       * accumulo-core.jar
>
>     #As per instruction replaced commons lang 2.1 with 2.4 and
>     commons-configuration
>
>       * commons-lang-2.4.jar
>       * commons-configuration-1.6.jar
>
>
>     #hadoop specific jars from my cloudera servers.
>
>       * hadoop-auth-2.5.0-cdh5.3.0.jar
>       * hadoop-common-2.5.0-cdh5.3.0.jar
>       * hadoop-hdfs-2.5.0-cdh5.3.0.jar
>       * hadoop-mapreduce-client-app-2.5.0-cdh5.3.0.jar
>       * hadoop-mapreduce-client-common-2.5.0-cdh5.3.0.jar
>       * hadoop-yarn-client-2.5.0-cdh5.3.0.jar
>       * hadoop-mapreduce-client-shuffle-2.5.0-cdh5.3.0.jar
>       * hadoop-mapreduce-client-jobclient-2.5.0-cdh5.3.0.jar
>       * hadoop-mapreduce-client-core-2.5.0-cdh5.3.0.jar
>       * hadoop-yarn-client.jar
>      *
>
>     *Question: It is the hadoop client for MR2. Do I need to use one
>     for MR1 instead?*
>
>     #Thrift jar
>
>       * libthrift-0.9.0.jar
>
>
>     #xookeeper jar
>
>       * zookeeper-3.4.5-cdh5.3.0.jar
>
>
>     # plugin(the name says it is 1.5 but it is built with 1.6)
>     geomesa-distributed-runtime-accumulo1.5-1.0.0-rc.3-SNAPSHOT.jar
>     #wps jars
>
>       * gs-web-wps-2.5.2.jar
>       * gt-xsd-wps-11.2.jar
>       * gt-process-geometry-11.2.jar
>       * gs-wps-core-2.5.2.jar
>       * serializer-2.7.1.jar
>       * net.opengis.wps-11.2.jar
>
>
>     Appreciate any help...
>     Manas
>
>     On Thu, Jan 8, 2015 at 3:53 PM, Manas Kar
>     <manasdebashiskar@xxxxxxxxx <mailto:manasdebashiskar@xxxxxxxxx>>
>     wrote:
>
>         Hi Experts,
>          I built my Geomesa with Accumulo 1.6 and hadoop.version =
>         2.5.0-cdh5.3.0
>
>          It was bit convenient because my Cloudera instance provides
>         Accumulo1.6.
>          I am now trying to set up Geoserver to show Accumulo Data.
>
>          I am using Geoserver 2.5.2 (With WPS)
>          Accumulo1.6.
>         Geomesa(RC.3)
>
>         I am seeing the following error after following the document.
>
>         WARNING: Can't load a service for category
>         "DataStoreFactorySpi". Cause is "ServiceConfigurationError:
>         org.geotools.data.DataStoreFactorySpi: Provider
>         org.locationtech.geomesa.core.data.AccumuloDataStoreFactory
>         could not be instantiated".
>         java.util.ServiceConfigurationError:
>         org.geotools.data.DataStoreFactorySpi: Provider
>         org.locationtech.geomesa.core.data.AccumuloDataStoreFactory
>         could not be instantiated
>         at java.util.ServiceLoader.fail(ServiceLoader.java:224)
>         at java.util.ServiceLoader.access$100(ServiceLoader.java:181)
>         at
>         java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:377)
>         at java.util.ServiceLoader$1.next(ServiceLoader.java:445)
>         at
>         org.geotools.factory.FactoryRegistry.register(FactoryRegistry.java:826)
>         at
>         org.geotools.factory.FactoryRegistry.scanForPlugins(FactoryRegistry.java:772)
>         .
>         .
>         .
>         Caused by: java.lang.NoClassDefFoundError:
>         org/apache/hadoop/io/Writable
>
>         What am I missing here? Please help.
>
>         Thanks
>         Manas
>
>
>         On Thu, Jan 8, 2015 at 3:30 PM, Manas Kar
>         <manasdebashiskar@xxxxxxxxx
>         <mailto:manasdebashiskar@xxxxxxxxx>> wrote:
>
>             Hi,
>              I am trying to make my current Cloudera installation
>             (CDH5.3 with Accumulo 1.6) work with Geomesa.
>
>             I saw a help in the Archive suggesting not to use Cloudera
>             provided Accumulo. I was wondering if I can take a
>             different route of compiling Geomesa with Accumulo 1.6?
>
>             Also Do I have to change the hadoop version to the
>             Cloudera provided version?
>
>             Than
>
>
>
>
>
>
> _______________________________________________
> geomesa-users mailing list
> geomesa-users@xxxxxxxxxxxxxxxx
> To change your delivery options, retrieve your password, or unsubscribe from this list, visit
> http://www.locationtech.org/mailman/listinfo/geomesa-users

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.locationtech.org/mhonarc/lists/geomesa-users/attachments/20150112/16f9b275/attachment.html>

------------------------------

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
http://www.locationtech.org/mailman/listinfo/geomesa-users

End of geomesa-users Digest, Vol 11, Issue 7
********************************************




_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
http://www.locationtech.org/mailman/listinfo/geomesa-users

Back to the top