Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [geomesa-users] Geomesa-HBase and Azure HDInsight
Hi Emilio,

Enabling LOOSE_BBOX did not return the result, but disabling remote.filtering returns the result. Does it confirm the coprocessor is the problem? (It's right from my understanding of your comments, but I just want to make it sure.)

Thank you!


With regards,
Jason Koh

On Wed, Jan 17, 2018 at 3:10 PM, Emilio Lahr-Vivaz <elahrvivaz@xxxxxxxx> wrote:
I'm not really familiar with HDInsight - I assume you read over the various options for adding the jar in the documentation?

http://www.geomesa.org/documentation/user/hbase/install.html#deploying-the-geomesa-hbase-distributed-runtime-jar

Another thing you could try is disabling remote filtering - that will not invoke any coprocessors or hbase filters, so you can determine if there is some other problem. You can disable it by including "remote.filtering" -> false in the data store parameters. You'd want to get it working with remote filtering eventually though - it will be much faster with it turned on.

If you do get it working, let us know what you did and we'll add it to the documentation!

Thanks,

Emilio


On 01/17/2018 05:46 PM, Jason Koh wrote:
Hi Emilio,

Here's the cluster configuration
2 head nodes
2 region nodes
3 zookeeper nodes

I was advised to put the library into the head node in HDInsight where "hbase-regionserver" indicates the same directory.

```
bbbb@aaaaaa:/usr/hdp/current$ ls -l *hbase*
lrwxrwxrwx 1 root root 24 Nov 16 02:42 hbase-client -> /usr/hdp/2.6.2.3-1/hbase
lrwxrwxrwx 1 root root 24 Nov 16 02:42 hbase-master -> /usr/hdp/2.6.2.3-1/hbase
lrwxrwxrwx 1 root root 24 Nov 16 02:42 hbase-regionserver -> /usr/hdp/2.6.2.3-1/hbase
```

So I put the library file under ``/usr/hdp/2.6.2.3-1/hbase/lib`` and updated the hbase-site.xml. Then I have rebooted it and I confirmed if both the primary and secondary head nodes contain the same library file.

Would there be a specific way to manually put the jar file into the region servers? (Is that what I should do?)


Thank you!



With regards,
Jason Koh

On Wed, Jan 17, 2018 at 6:01 AM, Emilio Lahr-Vivaz <elahrvivaz@xxxxxxxx> wrote:
Hello,

Does your HBase instance have multiple region servers? I believe that you need to copy the GeoMesa jar file into the lib folder for each region server.

You can test to see if it's a classpath issue by setting loose_bbox to true - in that case, simple queries (e.g. bbox and/or date without any transformations) won't require any distributed code, and should work regardless of the jar being installed.

Thanks,

Emilio


On 01/16/2018 07:17 PM, Jason Koh wrote:
Hi Geoemsa team,

I am trying to use Geomesa-HBase with Azure HDInsight and get some problem.

Configuration:
- Ubuntu 16.04 (in Azure VM)
- HDInsight 3.6 (HBase 1.1.2), this is the most recent version
- Geomesa 2.11-1.3.4
- Java 8

Geomesa installation: I have put the jar file (coprocessor) into the HDInsight's head node's HBase library folder.

The code is very simple: Just pushing data and query the region.


Symptom: Everything works fine with a standalone HBase. I can push data after defining a schema and I can check it at the HBase command line tool, but CQL does not return anything.
- The version seems not the problem. I have tested on a local standalone HBase 1.1.13, and it worked fine. I have tested a local standalone 1.2.6 and 1.1.13 and they all worked fine.
- The code did not raise any errors, which means that it successfully found the coprocessor. (It raises an error if it is not found.)

I do not know where to look at as I can't see any errors. Any clue on this issue?

Thank you very much.



With regards,
Jason Koh


_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.locationtech.org/mailman/listinfo/geomesa-users


_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.locationtech.org/mailman/listinfo/geomesa-users



_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.locationtech.org/mailman/listinfo/geomesa-users


_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.locationtech.org/mailman/listinfo/geomesa-users

Back to the top