[rdf4j-dev] ShaclSail performance

[Håvard Ottestad <hmottestad@xxxxxxxxx>]

Hi,

I’m working on performance optimizations for the ShaclSail so that bulk validation of large datasets works as expected. At the moment the bulk validation ends up keeping far too much data in memory and a few of the validation plans are too slow for bulk validation. 

I would like to aim most of these performance fixes for a new bug fix release (3.7.2) since there are no new features or user facing changes. 

For 4.0.0 I am still aiming for even better bulk validation support. The fixes I have at the moment are just stop-gap measures to make bulk validation work again after I broke it with my big ShaclSail rewrite earlier this year. 

4.0.0 will include a more thorough bulk validation support throughout the ShaclSail as well as a “large datasets detection” feature that automatically switches to bulk validation. 

Håvard