Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [geomesa-users] Accumulo Durability
We occasionally disable WALs to speed up ingestion. You can configure the durability on a per-table basis through the shell:

https://accumulo.apache.org/1.7/accumulo_user_manual#_table_durability

Something like:

config -t foo -s table.durability=none

You'd have to do that to each of your geomesa index tables.

I'm not sure exactly what would happen if you deleted the existing WALs - hopefully accumulo would clean those up for you once they aren't needed. But if you're in a bad state you might also need to delete references to them in the metadata table. I believe this comes up from time to time on the accumulo user list.

Thanks,

Emilio

On 04/04/2017 12:27 PM, Jose Bujalance wrote:
Hi,

I am having some problems with my HDFS free disk space, and I think it can be related to the Accumulo durability and the WAL (Write-ahead Log).

When I ingest or delete any feature or catalog in Geomesa, my free disk start decreasing until the disk is full at 100%. I don't fully understand how Acumulo's durability works, but I think this might be because the first time I tried to delete my Geomesa catalog, the deletion didn't fullt suceed because I had a RAM problem, and then I started ingesting new features with the same catalog name, so Accumulo seem to interpret this as an update and starts generating logs in the WAL.

In order to regain some disk space, I would like to clean the WAL logs in the HDFS, and also set the Accumulo's durability to "none" (https://accumulo.apache.org/1.7/accumulo_user_manual#_durability)

However, I don't know what are the consequences of deleting the HDFS folder /apps/accumulo/data/wal, and I haven't found the way to change the durability default.

Has anyone done this before?

Thanks, 
José


_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.locationtech.org/mailman/listinfo/geomesa-users

Back to the top