Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [rdf4j-dev] Multithreaded access to the MemoryStore
  • From: "Bart Hanssens (BOSA)" <bart.hanssens@xxxxxxxxxxxx>
  • Date: Tue, 9 Nov 2021 11:48:46 +0000
  • Accept-language: en-US
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=bosa.fgov.be; dmarc=pass action=none header.from=bosa.fgov.be; dkim=pass header.d=bosa.fgov.be; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=cSf0qmqqGMP5ZdOD5mhzMuUKxT341Am1rf2G5AmB02A=; b=Hu0XHJ58HlxJjDSwz1ARaTTxm2cGblBIHjSe0Hv2NymWvB/J4OcTERfppCr2f5YSJ6/ei5Qtf5CnLcnIV3gyNohmT5ybxHDUyfIdHs/rWxFi6jJbutE/9JskF83sn7IvHbzl7WjneAmL2oUxH50gTnzcr9DAqsKsz7N3C5XkBl9nWcpv7fQGCwxhu/aH4pVtLbFo0pF3Hc+IWxv2NVoQvHUJSGH1ToBjpEZ3xdiy/oV52DSuOT+ev7VKeQ2enLd8/Gw+SoawHGgzpCtA36k4grfIFuXPZNim/p9m3nrA+snDWzLZUBprQIKH8uxDhdrLCa7iyIwAK1zVWTn1vPhYcQ==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=bAAc3xHl11I9jKf66I8ueJcYQtnpnPve1Qm0Wz0FcTeZvBLupcM6zjwlxIr1beyahTGWzQthm0wKxuk2S08Md7yuqjlveSeyhql1SUplnTXlfF5mX0pmL8wEUIyeiZYAKdyjWOhsfI2dKLIGTL2XfQfX5S5MYit/QbXnERzjzlI7Y+a7DgWchldLK05JCBNaCHB+LqNJtpIqIWRZAFL/vty3hpKjzAqE6bqvbnmfQ6f1lpGk2K+ftso5LrbNX8hVMB9LTcmPyF+sFiHm8cxlktZhahuzDJOCmfiBItfJwCj6dema8BL5w8d63hTcSD/TlYjmMXVb3Uqj2um5QZICmQ==
  • Delivered-to: rdf4j-dev@xxxxxxxxxxx
  • List-archive: <https://www.eclipse.org/mailman/private/rdf4j-dev/>
  • List-help: <mailto:rdf4j-dev-request@eclipse.org?subject=help>
  • List-subscribe: <https://www.eclipse.org/mailman/listinfo/rdf4j-dev>, <mailto:rdf4j-dev-request@eclipse.org?subject=subscribe>
  • List-unsubscribe: <https://www.eclipse.org/mailman/options/rdf4j-dev>, <mailto:rdf4j-dev-request@eclipse.org?subject=unsubscribe>
  • Thread-index: AQHX1TL4gP6h1p8Zl06C8ZHjkMo44Kv7CnrA
  • Thread-topic: [rdf4j-dev] Multithreaded access to the MemoryStore

Hi Håvard,

 

Haven’t used multithread access to the memorystore yet…

I do have access to a cheap “server” (consumer grade AMD Ryzen 5 3600 with 6c/12t) and JDK 17, so I’ll give that a spin.

 

Best regards

 

Bart

 

From: rdf4j-dev <rdf4j-dev-bounces@xxxxxxxxxxx> On Behalf Of Håvard Ottestad
Sent: dinsdag 9 november 2021 7:23
To: rdf4j developer discussions <rdf4j-dev@xxxxxxxxxxx>
Subject: [rdf4j-dev] Multithreaded access to the MemoryStore

 

Hi,

 

I’ve upgraded my laptop just a few days ago to a shiny new MacBook with 8+2 ARM cores. It’s a nice upgrade to my 9 year old MacBook with a quad core Intel processor. 

 

Things are definitely snappier, but I’m struggling to get much performance improvement when comparing single threaded SHACL validation to parallel validation. 

 

Profiler says that there are three major issues of overhead and contention are:

 - creating read locks

 - retrieving the mem-versions of values from the mem value store

 - keeping track of active iterators


Might be that the arm version of jdk 17 still needs optimizations to make locks faster, or maybe it’s due to the arm memory model being more relaxed than the Intel one. 

 

Anyone else run into the same issues?

 

Or someone with an 8+ core Intel/amd machine who would like to test it out? I’m using the benchmark linked below and not seeing much difference when enabling/disabling parallel validation. 

 

 

Cheers,

Håvard

Back to the top