Hi Philip,
Yes scisoft-core and dawn-ui repos contain the processing. There is a service for pipeline validation and execution,
IOperationService, and
views for editing pipelines and configuring models. The operations are added by extension point and the models use annotations to describe the model properties for editing in the eclipse properties view. The interface of the service will be part of the
dawnsci eclipse project eventually. The implementation will be available via the DAWN p2 site.
Matt
PS Pipelines are linear with slugs optionally being run in parallel. We are not reinventing Ptolemy 2 but making an interactive plotting
which runs live as you make changes. Jacob and I will post a video on what we have so far sometime in the coming weeksJ
From: Philip Wenig [mailto:philip.wenig@xxxxxxxxxxxxxx]
Sent: 18 August 2014 10:25
To: science-iwg@xxxxxxxxxxx
Subject: Re: [science-iwg] EclipseCon Unconference
Hi Matt,
that are good news. Is it already available as a GitHub project?
Best,
Philip
Philip,
There has been some prospecting work at our end on the pipelining stuff. This might be a starting point for a future design. The live pipeline approach seems
to be useful for tomography and diffraction images, so we have gone quite far with the implementation but it is not a fete-a-complis.
Sincerely,
Matt
From: Jay Jay Billings [mailto:jayjaybillings@xxxxxxxxx]
Sent: 16 August 2014 18:34
To: Science Industry Working Group
Subject: Re: [science-iwg] EclipseCon Unconference
It is only version 4. A lot of projects still use other versions and even in version 4 you can pass a flag to disable all version 4 features, so it is an interesting challenge.
Jay
On Aug 16, 2014 1:00 PM, "Philip Wenig" <philip.wenig@xxxxxxxxxxxxxx> wrote:
Hi Jay,
that's funny to know. I didn't realized before that NetCDF is build on top of HDF5. The better for us :-).
Is it only NetCDF version 4 and higher or do the old libraries NetCDF 2.2.22 also rely on HDF5?
Cheers,
Philip
Am 16.08.2014 um 18:45 schrieb Jay Jay Billings:
Philip,
Yes, NetCDF 4 is built on top of HDF5. The projects are contemporaries. NetCDF was started in 1989 at UCAR and HDF was started around the same time at NCSA.
I don't have any contacts on the NetCDF team, but Andrew might know someone. Andrew?
I agree that we should get people to make projects at and join the Foundation as well as the working group. However, in the science world very few people are going to do that without a tangible demonstration of the benefits and I think
that in general the bigger the project the more time it will take for that to happen. So, while we are working on that lofty goal, we should look into getting these things into Orbit.
On Sat, Aug 16, 2014 at 11:45 AM, Philip Wenig <philip.wenig@xxxxxxxxxxxxxx> wrote:
Hi Jay, hi Torkild, all,
yep, it would be great having more plugins available in the Eclipse Orbit universe :-). I gave a short overview at the last EclipseCon in France how to use/include 3rd party libraries (but most of the people know how to do this):
http://de.slideshare.net/PhilipWenig/eclipsecon-france-2014
>From my opinion, we should find a way/strategy how to contact projects and how to convince them to join the Eclipse Foundation except of those who are already part of another Foundation, e.g. Apache Foundation.
@Jay
Are the NetCDF libraries build on top of HDF5? As far as I know, NetCDF is the predecessor of HDF. Anyhow, it was a good step that they switched to a MIT-style license:
http://www.unidata.ucar.edu/blogs/developer/en/entry/new_license_for_netcdf_java
The better it would be if they would join the Science Working Group and switch to EPL. Do you have contact to people from the NetCDF team?
Cheers,
Philip
Am 16.08.2014 um 17:12 schrieb Jay Jay Billings:
Torkild,
I think it would be very cool for those to go into Eclipse Orbit.
More generally, and this is a technical discussion that made me think of getting a forum, we should think about a larger, cross-platform set of universal binary builds of common scientific libraries that we could get approved through Orbit. For example,
in addition to HDF5 we probably need to pick up other I/O libraries like netcdf and exodus II. Both of these are built on top of HDF5 and have BSD licenses, so why not just make it very convenient and build them all together? Other libraries, like math libraries
could be added too. An integrated software stack like this is a highly coveted thing in many M&S circles because it would greatly simplify deployment of M&S codes for commercial customers.
Of course this is a technically difficult thing to do and comes with legal questions, so an extended discussion would be best in a forum or bug ticket. But... it would be really cool to just pull down the org.eclipse.science.native bundle(s) from Orbit in
a target!
Jay
On Aug 16, 2014 10:09 AM, "Torkild Ulvøy Resheim" <torkildr@xxxxxxxxx> wrote:
Hi Philip,
This is a great idea! I'd like to contribute if I can. It's up to my client whether or not I can go to the unconference. I've not heard with them yet so I don't know.
One thing we've been working on that we would like to contribute, if we can - are neatly bundled HDF5 binaries for supported platforms. Maybe this can go into Eclipse Orbit. I suspect we're not alone in packaging HDF5 so it would be great to get some input
on that. In any case I'll start the CQ process very soon, so maybe we can get a go-ahead before EclipseCon.
Best regards,
Torkild
> 16. aug. 2014 kl. 14.50 skrev Philip Wenig <philip.wenig@xxxxxxxxxxxxxx>:
>
> Hi folks,
>
> how about making a code session at the upcoming EclipseCon unconference?
>
> I could set up a separate GitHub project to start quickly within the next weeks. The topic is the n-dimensional editing pipeline we discussed in June, see attached PDF files. We could then prepare and commit ideas/implementations until the unconference starts
and go deeper in a face-to-face meeting.
>
>
> Best,
> Philip
>
> --
> ~~~~~~~~~~~~~~~~~~~~~~~~
> Dr. Philip Wenig
>
> http://www.openchrom.net
>
> https://www.xing.com/profile/Philip_Wenig
> http://de.linkedin.com/pub/philip-wenig/2a/4a8/877
> ~~~~~~~~~~~~~~~~~~~~~~~~
>
> <Draft-1d-Editing-Plotting.pdf><Draft-Editing-Pipeline.pdf>_______________________________________________
> science-iwg mailing list
> science-iwg@xxxxxxxxxxx
> To change your delivery options, retrieve your password, or unsubscribe from this list, visit
>
https://dev.eclipse.org/mailman/listinfo/science-iwg
--
Torkild Ulvøy Resheim
Consultant / Eclipse Committer / Senior Software Developer
Itema AS - http://itema.no
_______________________________________________
science-iwg mailing list
science-iwg@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/science-iwg
_______________________________________________
science-iwg mailing list
science-iwg@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/science-iwg
--
~~~~~~~~~~~~~~~~~~~~~~~~
Dr. Philip Wenig
http://www.openchrom.net
https://www.xing.com/profile/Philip_Wenig
http://de.linkedin.com/pub/philip-wenig/2a/4a8/877
~~~~~~~~~~~~~~~~~~~~~~~~
_______________________________________________
science-iwg mailing list
science-iwg@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/science-iwg
--
Jay Jay Billings
Oak Ridge National Laboratory
Twitter Handle: @jayjaybillings
_______________________________________________
science-iwg mailing list
science-iwg@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/science-iwg
--
~~~~~~~~~~~~~~~~~~~~~~~~
Dr. Philip Wenig
http://www.openchrom.net
https://www.xing.com/profile/Philip_Wenig
http://de.linkedin.com/pub/philip-wenig/2a/4a8/877
~~~~~~~~~~~~~~~~~~~~~~~~
_______________________________________________
science-iwg mailing list
science-iwg@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/science-iwg
_______________________________________________
science-iwg mailing list
science-iwg@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/science-iwg
--
~~~~~~~~~~~~~~~~~~~~~~~~
Dr. Philip Wenig
http://www.openchrom.net
https://www.xing.com/profile/Philip_Wenig
http://de.linkedin.com/pub/philip-wenig/2a/4a8/877
~~~~~~~~~~~~~~~~~~~~~~~~
--
This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail. Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd. Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message. Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom
|