[geomesa-dev] [JIRA] (GEOMESA-2620) Track table splits/ranges and use th

["Emilio Lahr-Vivaz (JIRA)" <jira@xxxxxxxxxxxxxxxxxxxxx>]

Title: Message Title

Emilio Lahr-Vivaz created an issue

GeoMesa / GEOMESA-2620

Track table splits/ranges and use them to inform z-range decomposition

Issue Type:	Improvement
Assignee:	Unassigned
Created:	09/May/19 8:57 AM
Priority:	Major
Reporter:	Emilio Lahr-Vivaz

A potential idea to improve query times: keep metadata about ranges for chunks of data (e.g. track every 100MB chunk). (Determine these with a coprocessor/filter?) Use these metadata to decide how much range decomposition to use for a given query. I.e. if we know that half the range being queried doesn't (likely) have any data, we can not decompose that part very much. If the other half of the range has a lot of data, we can decompose that part extra.

This approach is supposedly used by Apache Phoenix: https://github.com/apache/phoenix

Add Comment

Get Jira notifications on your phone! Download the Jira Cloud app for Android or iOS
This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100100-sha1:5dc2d5e)