Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [ptp-dev] Remote Enabling GEM Plugin

>After looking at the PTP Wiki...
For reference, it's here: http://wiki.eclipse.org/PTP/designs/remote/using
I've updated it a bit .. including posting a reference (at the bottom) to information about EFS (the Eclipse File System) which abstracts away details in the implementation about
what file system is used to store any files/resources: http://wiki.eclipse.org/index.php/EFS

>the lighter weight approach taken by PLDT (using IResource and getResourceURI(),
>pulling remote files back to the local machine
That may not be the long-term solution but it's what I'm doing at first - and to make sure things at least function,
albeit less efficiently and possibly less correctly than if everything was processed AT the remote host with the "proper"
header files.

>GEM appears to silently fail with remote projects. No NPEs, nothing.
Maybe you're catching NullPointerExceptions? Run it in the debugger, and set the exception breakpoints ("!")
to catch them. If that doesn't point out anything, put a few breakpoints at strategic locations (only the
author knows for sure) and make sure it's getting there. Step if you need to. May require a few restarts
to drill down to a problem area.




...Beth

Beth Tibbitts
Eclipse Parallel Tools Platform http://eclipse.org/ptp
IBM STG Communications Protocols and Tools
Mailing Address: IBM Corp., Coldstream Research Campus, 745 West New Circle Road, Lexington, KY 40511

Inactive hide details for Alan Humphrey ---08/31/2010 02:01:46 PM---Hi all, We're looking at remote-enabling the GEM plugin andAlan Humphrey ---08/31/2010 02:01:46 PM---Hi all, We're looking at remote-enabling the GEM plugin and wanted to ask a few


From:

Alan Humphrey <ahumphre@xxxxxxxxxxx>

To:

Parallel Tools Platform general developers <ptp-dev@xxxxxxxxxxx>

Date:

08/31/2010 02:01 PM

Subject:

[ptp-dev] Remote Enabling GEM Plugin

Sent by:

ptp-dev-bounces@xxxxxxxxxxx




Hi all,

We're looking at remote-enabling the GEM plugin and wanted to ask a few questions & get some input before we dig in. Any input would be gratefully accepted. After looking at the PTP Wiki, it appears the way PLDT is doing things is closer to the approach we need. Not sure how much work remote-enabling GEM would take at this point, but we'd like to get started.

Currently, the general chain of events GEM goes through is outlined in the steps below:


Notes:

* Anything we "run" is via a java.lang.Process object and Runtime.exec() to create a native process.
* We've been mostly using java.IO.File objects and relevant API calls.
* [Recap] ISP (In-situ Partial Order) is the underlying verification tool for GEM. It requires no code instrumentation.
* We've created remote projects and tried running things knowing it wouldn't work, but to see what did actually happen. GEM appears to silently fail with remote projects. No NPEs, nothing.


Basic GEM chain of events
---------------------------------

1.) We run a script (a wrapper for mpicc) that compiles the project, linking in MPI libs (e.g. libmpich, etc) and the interposition layer library for ISP ( The Profiler - libispprof). This interposition layer is needed to intercept MPI calls via the PMPI mechanism and subsequently generate and force relevant schedules.

2.) Next we run ISP itself on the profiled executable. This does all the dynamic verification for the profiled executable and generates a log file (our own format currently).

3.) The log file generated by ISP is then parsed by GEM, allowing GEM to display post verification results and source code stepping. GEM relies on knowing the path to all the relevant source files for the source code stepping we do in the Analyzer View.

Lots is happening under the hood with regard to organization, data structures, etc, but in the context of remote-enabling GEM, it seems like the relevant info is in the steps above. Once the log file is generated, GEM simply needs access to it as well as the source files.

Should we consider the lighter weight approach taken by PLDT (using IResource and getResourceURI(), pulling remote files back to the local machine - we're not relying on any headers, etc at this point), or is another approach to our problem more obvious to any who are more adept at RDT and its inner workings than we are. I think we simply don't understand the entire model very well at this point.

Thanks in advance for your time. I'll be joining the next PTP conference call.

-Alan




_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/ptp-dev


GIF image

GIF image


Back to the top