Re: [geomesa-users] Tips on ingesting a lot of data into GeoMesa

[Damiano Albani <damiano.albani@xxxxxxxxx>]

Hum, I'm not sure I understand what I precisely need to copy/remove from hbase or hadoop distributions into the lib directory 😕

In fact, the geomesa-bigtable Bash script requires a HADOOP_HOME environment variable to be defined!?

But I have followed your advice and removed lib/guava-17.0.jar -- I suppose that clashes with the repackaged code in lib/bigtable-hbase-1.{1,2}-0.9.4.jar.

Alas, it hasn't completely solved my issue: once started, geomesa-bigtable seems to just sit idle.

Well, in fact, it appears to be doing Zookeeper-related work:

Any idea what's going on?

On Tue, Jan 24, 2017 at 2:50 PM, Emilio Lahr-Vivaz <elahrvivaz@xxxxxxxx> wrote:

The tools don't ship with the hadoop jars - you need to copy them into the lib folder. In general we do that to support different client hadoop installs - for BigTable that might not make sense. Looks like we don't mention that in our docs, though... I will make sure we get that updated. I think the list of jars under geoserver should also work for the tools: http://www.geomesa.org/documentation/user/bigtable/install.html#installing-geomesa-bigtable-in-geoserver

HBase uses a different version of guava, which is why you are getting that second exception. You should remove any jars you copied from the HBase distro.

Thanks,

Emilio

On 01/24/2017 06:10 AM, Damiano Albani wrote:

Hi Emilio,

On Mon, Jan 23, 2017 at 9:26 PM, Emilio Lahr-Vivaz <elahrvivaz@xxxxxxxx> wrote:

Because we're an Eclipse project, anything we host has to be blessed by Eclipse for provenance and license. As we haven't gotten this sign-off on all the BigTable dependencies yet, we unfortunately can't bundle it - we can still use it as a plugin, but you have to build it yourself. Hopefully we will be able to get it approved soon.

OK, I understand the reasoning.

So, I've built the BigTable tools and tried to play with the "geomesa-bigtable ingest" utility.

And I'm probably doing something wrong because I get an ClassNotFoundException for org.apache.hadoop.hbase.client.Connection.

Am I supposed to copy the JARs from the HBase distribution, say version 1.1.2?

Because even if I do that, I get a cryptic error when calling "geomesa-bigtable ingest":

java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.<init>()V from class org.apache.hadoop.hbase.zookeeper.MetaTableLocator

Thanks,

--

Damiano Albani
Geodan

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.locationtech.org/mailman/listinfo/geomesa-users

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.locationtech.org/mailman/listinfo/geomesa-users

--

Damiano Albani
Geodan