Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [chemclipse-dev] What is the suitable file format for spectrum data store?
There are two Java libraries to manipulate HDF5 file. One is from HDF Group and the other one (JHDF5,  created by Rinn Bernd,ID SIS) is from https://wiki-bsse.ethz.ch/display/JHDF5. The former one is formal but awesome to use. The later one is more Java style and easy to use.
I've made a preliminary try on HDF5.  It would need more addition effort to make an encryption, checksum or compression.
By the way,both libraries are a little big (~10MB for Windows/Linux/OSX).

I found the MVStore from H2 Database attractive. Simple API, small footprint of library (~200KB).


Best regards,

Trig

2016-08-31 14:58 GMT+08:00 Philip Wenig <philip.wenig@xxxxxxxxxxxxx>:
I wouldn't recommend using a database. Rather try to use HDF5. We recently had some discussion in our Science Working Group how to best utilize HDF5. Some projects like DAWNSci use HDF5 already. Please ask at the science mailing list to get best practice infos. If you'd like to use HDF5, we could try to add the third party dependencies.

https://dev.eclipse.org/mailman/listinfo/science-iwg
science-iwg@xxxxxxxxxxx


Best,
Philip


Am 30.08.2016 um 18:18 schrieb Trig Chen:
Hi all,

When I implemented the function of acquiring data from spectrometer, I found that the zip file format  currently used in OpenChrom was not suitable for random and parallel writing data. The zip format is just suitable for one-time writing in end.

What file format do you use in the case of parallel writing and reading big data? 
Database such as H2, SQLite?  or HDF?

Best regards,

Trig


_______________________________________________
chemclipse-dev mailing list
chemclipse-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/chemclipse-dev


-- 
~~~~~~~~~~~~~~~~~~~~~~~~
OpenChrom - the open source alternative for chromatography / mass spectrometry
Dr. Philip Wenig » Founder » philip.wenig@xxxxxxxxxxxxx » http://www.openchrom.net
~~~~~~~~~~~~~~~~~~~~~~~~

_______________________________________________
chemclipse-dev mailing list
chemclipse-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/chemclipse-dev


Back to the top