Re: [ptp-dev] indigo & ptp 5 testing, pbs rm

["Jay Alameda" <jalameda@xxxxxxxxxxxxxxxxx>]

I'm not sure what to suggest, Al.
At the least, we would need to indicate in release notes for 5.0 that the
PBS proxy only works against versions of PBS that support qstat -X (which
neither torque on abe nor pbspro on ember support, did a quick check).  
We could bank on the new generic resource manager, but there is no
fallback of the "old" components.  My preference would be to make sure the
new one worked, I suppose, and make sure it ships with configurations for
PBS as part of the examples.  If that is true, I'd be less inclined to
include the legacy pbs support, as I believe that would be confusing...
My 2 cents (barely).

Jay


-----Original Message-----
From: ptp-dev-bounces@xxxxxxxxxxx [mailto:ptp-dev-bounces@xxxxxxxxxxx] On
Behalf Of Albert L. Rossi
Sent: Wednesday, April 13, 2011 5:22 PM
To: Parallel Tools Platform general developers
Subject: Re: [ptp-dev] indigo & ptp 5 testing, pbs rm

P.S.  I only saw this on ember recently.  The code has not been touched
(as far as I know) since SC10, and it was running against abe then.  But
then abe is moribund anyway ...

----- Albert L. Rossi <arossi@xxxxxxxxxxxxx> wrote:
> Jay, Galen,
> 
> I am not currently master of the PBS proxy code ... I'd have to look,
but my guess is that 5.0 proxy does not start because the first thing it
tries to do is populate the queue information so it can send back the
"model" information to the client.  If it is trying to do this using qstat
-X it is probably failing.  I think in fact that when running it from the
workspace this is what I saw on the error stream.
> 
> This is not an easy fix, as I believe the proxy was built to parse XML.
So ...
> 
> Is this worth investing the time to fix, given what is on the horizon
for Indigo?
> 
> Of course, I may be wrong in my back of the envelope diagnosis here, but
I don't think this is a front-end issue, and it will not make any
difference which template (torque or pro) you choose, as those only have
to do with the way the Launch Tab is configured, not with anything having
to do with the proxy.
> 
> Al
> ----- Jay Alameda <jalameda@xxxxxxxxxxxxxxxxx> wrote:
> > Galen, Al,
> > 
> > I'm having version-confusion-issues: this is what I have verified:
> > 
> > PTP 4.0.6/Eclipse 3.6.2:
> > PBS RM to Abe (torque) and Ember (pbs-pro) both start fine, both using
> > Remote tools with tunneling (on a lousy hotel network).
> > 
> > PTP 5.0/Eclipse 3.7M6plus:
> > PBS RM to Abe (PBS_Torque_Standard, ssh port forwarding, remote
tools):
> > never starts (though the PBS Proxy Server indicates 100%, lower RH
corner
> > of the screen).  Perma-blue-icon.  Killing it seems OK, but PBS Proxy
> > server seems to still be running???
> > PBS RM to Ember (PBS_Pro, ssh port forwarding remote tools - never
starts,
> > same deal as Abe.
> > PBS RM to Abe (PBS_Torque_SMP, not sure what means, ssh port
forwarding,
> > remote tool - never starts, same as before.
> > 
> > I'll try the PE and LL on 4.0.6/3.6.2 to diagnose the other issue,
which
> > now appears to be not related to this problem (thankfully).
> > 
> > Jay
> > 
> > 
> > -----Original Message-----
> > From: ptp-dev-bounces@xxxxxxxxxxx [mailto:ptp-dev-bounces@xxxxxxxxxxx]
On
> > Behalf Of Jay Alameda
> > Sent: Wednesday, April 13, 2011 3:59 PM
> > To: 'Parallel Tools Platform general developers'
> > Subject: Re: [ptp-dev] indigo & ptp 5 testing, pbs rm
> > 
> > Galen, Al,
> > 
> > I'm not sure, I did try to use this resource manager as well, without
luck
> > (it was stuck in the perma-blue-condition).  I'll try to repeat as
well -
> > this was for PTP 4.0.6, Eclipse 3.6.2.  I have to look into an issue
too
> > whereby another user is reporting that the PE resource manager is
doing
> > the same, need to see if this is reproducible.  I believe this was for
the
> > same version of Eclipse and PTP.
> > 
> > Jay
> > 
> > 
> > -----Original Message-----
> > From: ptp-dev-bounces@xxxxxxxxxxx [mailto:ptp-dev-bounces@xxxxxxxxxxx]
On
> > Behalf Of Albert L. Rossi
> > Sent: Wednesday, April 13, 2011 3:12 PM
> > To: Parallel Tools Platform general developers
> > Subject: Re: [ptp-dev] indigo & ptp 5 testing, pbs rm
> > 
> > Galen,
> > 
> > I believe the proxy has issues.  It may be hardcoded to issue qstat -X
> > commands, and they aren't supported (ember for sure).
> > 
> > But this version, if all goes as planned, will be deprecated shortly
> > anyway.  The configurable resource mananger won't have these problems
> > because you can just change the configuration to issue the commands
that
> > every system seems to require differently from the next (standards?
what
> > standards? is the motto of HPC sysadmins).
> > 
> > Al
> > ----- Galen Arnold <arnoldg@xxxxxxxxxxxxx> wrote:
> > > 
> > > Somebody else should make an attempt at setting up a PBS Resource
> > Manager in the Parallel Runtime.  I could not get it setup trying with
3
> > different PBS installations here at NCSA.  The same setup works fine
with
> > helios/ptp4.
> > > 
> > > add resource mgr ...
> > >    remote service provider: remote tools
> > >    tunneling opts: ssh port forwarding
> > >    proxy config: (tried them all )
> > > 
> > > 
> > > ...the proxy server starts but never shows green status for the
resource
> > manager.  I can see java running on the remote machine:
> > > 
> > > [arnoldg@honest3 ~]$ ps auxw|grep java
> > > arnoldg   3254  0.3  0.0  7044 1588 ?        Ss   12:07   0:00 tcsh
-c
> > /bin/sh -c 'echo "PID=$$ PIID=4" > /dev/pts/17; cd
> > /u/ncsa/arnoldg/.eclipsesettings; java -Xms64m -Xmx128m -Xss2m
${javaargs}
> > -jar pbs_proxy.jar --host=localhost --port=60255; '
> > > arnoldg   3369  0.0  0.0  5404 1108 ?        S    12:07   0:00
/bin/sh
> > -c echo "PID=$$ PIID=4" > /dev/pts/17; cd
> > /u/ncsa/arnoldg/.eclipsesettings; java -Xms64m -Xmx128m -Xss2m
${javaargs}
> > -jar pbs_proxy.jar --host=localhost --port=60255; 
> > > arnoldg   3370 18.0  0.2 383368 40276 ?      Sl   12:07   0:00 java
> > -Xms64m -Xmx128m -Xss2m -jar pbs_proxy.jar --host=localhost
--port=60255
> > > 
> > > 
> > > 
> > > Version: 3.7.0
> > > Build id: I20110310-1119
> > > Parallel Tools Platform (PTP) End-User Runtime	5.0.0.201103170933
> > org.eclipse.ptp.feature.group
> > > java version "1.6.0_24"
> > > Java(TM) SE Runtime Environment (build 1.6.0_24-b07)
> > > Java HotSpot(TM) 64-Bit Server VM (build 19.1-b02, mixed mode)
> > > 
> > > Galen Arnold
> > > system engineer
> > > NCSA
> > > 
> > > _______________________________________________
> > > ptp-dev mailing list
> > > ptp-dev@xxxxxxxxxxx
> > > https://dev.eclipse.org/mailman/listinfo/ptp-dev
> > > 
> > 
> > _______________________________________________
> > ptp-dev mailing list
> > ptp-dev@xxxxxxxxxxx
> > https://dev.eclipse.org/mailman/listinfo/ptp-dev
> > 
> > _______________________________________________
> > ptp-dev mailing list
> > ptp-dev@xxxxxxxxxxx
> > https://dev.eclipse.org/mailman/listinfo/ptp-dev
> > 
> > _______________________________________________
> > ptp-dev mailing list
> > ptp-dev@xxxxxxxxxxx
> > https://dev.eclipse.org/mailman/listinfo/ptp-dev
> > 
> 
> _______________________________________________
> ptp-dev mailing list
> ptp-dev@xxxxxxxxxxx
> https://dev.eclipse.org/mailman/listinfo/ptp-dev
> 

_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/ptp-dev