Re: [geomesa-users] Tips on ingesting a lot of data into GeoMesa

[Damiano Albani <damiano.albani@xxxxxxxxx>]

On Tue, Jan 24, 2017 at 10:02 PM, Damiano Albani <damiano.albani@xxxxxxxxx> wrote:

Yes, I do have the Cloud SDK installed and configured.

And I have a Maven-based project of mine which can connect just fine to my BigTable instance.

So I don't understand why it doesn't via geomesa-bigtable...

I'll continue investigating.

Further test: calling the BigTableRunner class does also work fine from IntelliJ.

Strange, maybe some kind of wrong JARs in the classpath?!

I've add a look at the content of geomesa.log which is generated by geomesa-bigtable.

I saw things which were not shown on the console, e.g.:

2017-01-24 21:08:27,134 WARN  [org.apache.hadoop.hbase.shaded.org.apache.zookeeper.ClientCnxn] Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect

java.net.ConnectException: Connection refused

        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)

        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)

        at org.apache.hadoop.hbase.shaded.org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)

        at org.apache.hadoop.hbase.shaded.org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)

2017-01-24 21:08:27,243 WARN  [org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper] Possibly transient ZooKeeper, quorum=localhost:2181, exception=org.apache.hadoop.hbase.shaded.org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid

2017-01-24 21:08:28,241 WARN  [org.apache.hadoop.hbase.shaded.org.apache.zookeeper.ClientCnxn] Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect

I don't get why it's trying to connect to localhost?!

By the way, I've solved my Guava related problem by using the shaded version of the HBase client, as proposed in HBASE-14963. This way, I only had to drop a single JAR in lib/.

--

Damiano Albani
Geodan