Re: [ptp-dev] Problem with invoking SDM debugger on pSeries Linux

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]

Re: [ptp-dev] Problem with invoking SDM debugger on pSeries Linux

From: Dave Wootton <dwootton@xxxxxxxxxx>
Date: Fri, 17 Oct 2008 19:19:22 -0400
Delivered-to: ptp-dev@xxxxxxxxxxx
List-archive: <https://dev.eclipse.org/mailman/private/ptp-dev>
List-help: <mailto:ptp-dev-request@eclipse.org?subject=help>
List-subscribe: <https://dev.eclipse.org/mailman/listinfo/ptp-dev>, <mailto:ptp-dev-request@eclipse.org?subject=subscribe>
List-unsubscribe: <https://dev.eclipse.org/mailman/listinfo/ptp-dev>, <mailto:ptp-dev-request@eclipse.org?subject=unsubscribe>

Greg
It occurred to me that my problem might be due to my test program not 
being compiled with -g. I recompiled and it seemed like I got a bit 
farther along. The GUI got so far as to try to display a stack trace for 
task 0 (of a 2 tasks on the same node application) suspended at main() and 
showing the line # for main(), trying to open an editor window, and then 
crashing with a subscript out of range exception. Unfortunately I did not 
capture the stack trace since I thought I could recreate it and get a 
better trace, then couldn't get the debugger to run any more. The editor 
window failed to open the source file (maybe since I am running remote on 
a Windows XP system)

My network connection seems exceptionally sluggish for some reason, which 
seems to have caused a second problem, where I was getting a segmentation 
violation at line 324 of src/impl/sdm_routing_table_file.c. This was a 
call to fclose(*routing_file). I'm not sure what should be happening here. 
I commented out the fclose() and that got me past the sigsegv, but with an 
intermittent message about too many open files. If I got bast the 'too 
many open files' message then I got to the point where the debugger tried 
to show a stack trace.

I'll look at this more next week.
Dave



Dave Wootton/Poughkeepsie/IBM@IBMUS 
Sent by: ptp-dev-bounces@xxxxxxxxxxx
10/17/2008 01:25 PM
Please respond to
Parallel Tools Platform general developers <ptp-dev@xxxxxxxxxxx>


To
<ptp-dev@xxxxxxxxxxx>
cc

Subject
[ptp-dev] Problem with invoking SDM debugger on pSeries Linux






Greg
I tried invoking the SDM debugger non my RedHat 5 system (the k17sf2p03 
system you have access to, and which is up now), and had two problems

The first is that the code which waits for the routing file has a timeout 
of 10 seconds, which is apparently too quick, since I get a message that 
SDM timed out waiting for the routing file. I changed both calls that 
waited for the routing file to wait for 1000 seconds which fixed that 
problem.

The second problem is that I get some sort of error message that I think 
is goming from gdb. I'm attaching the logs for both the child SDMs and the 

master SDMs.

The good news is that I'm making it much farther in SDM than I was a month 

ago when I last looked at this.


Dave

_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/ptp-dev

10/17 13:12:07 T(256) Trace: <<< setup_child_stdio exited. (Line 3253)
10/17 13:12:07 T(256) Trace: >>> setup_child_stdio entered. (Line 3238)
10/17 13:12:07 T(256) Trace: <<< setup_child_stdio exited. (Line 3253)
10/17 13:12:07 T(256) Trace: Target env[0]: MP_HOSTFILE=/home/wootton/hostfile.rh
10/17 13:12:07 T(256) Trace: Target env[1]: MP_PROCS=2
10/17 13:12:07 T(256) Trace: Target env[2]: MP_BUFFER_MEM=64M
10/17 13:12:07 T(256) Trace: Target env[3]: MP_RESD=no
10/17 13:12:07 T(256) Trace: Target arg[0]: poe
10/17 13:12:07 T(256) Trace: Target arg[1]: /home/wootton/ptp_proxy/linux/ganymede_rc1/org.eclipse.ptp.debug.sdm_2.1.0.200810101902/sdm
10/17 13:12:07 T(256) Trace: Target arg[2]: --debug
10/17 13:12:07 T(256) Trace: Target arg[3]: --debugger=gdb-mi
10/17 13:12:07 T(256) Trace: +++ Ready to invoke child process
effsize: 3, size: 2, rv: 0
SDM[2]: Looking for env: 'OMPI_MCA_orte_ess_vpid', value: 'NULL'
SDM[2]: Looking for env: 'OMPI_MCA_ns_nds_vpid', value: 'NULL'
SDM[2]: Looking for env: 'PMI_RANK', value: 'NULL'
SDM[2]: Looking for env: 'MP_CHILD', value: '0'
SDM[2]: Found nSDM[2]: [0] size 3
SDM[2]: [0] in sdm_create_sockd_map
SDM[2]: [0] sdm_route_get_route dest {0-1}, parent 2
SDM[2]: [0] adjacent nodes: {}
effsize: 3, size: 2, rv: 0
SDM[2]: [0] nodeID: 0, hostname: k17sf2p03, port: 16378
SDM[2]: [0] found entry for node 0
SDM[2]: [0] found my entry
SDM[2]: [0] bound to port 16378
effsize: 3, size: 2, rv: 0
SDM[2]: Looking for env: 'OMPI_MCA_orte_ess_vpid', value: 'NULL'
SDM[2]: Looking for env: 'OMPI_MCA_ns_nds_vpid', value: 'NULL'
SDM[2]: Looking for env: 'PMI_RANK', value: 'NULL'
SDM[2]: Looking for env: 'MP_CHILD', value: '1'
SDM[2]: Found nSDM[2]: [1] size 3
SDM[2]: [1] in sdm_create_sockd_map
SDM[2]: [1] sdm_route_get_route dest {0-1}, parent 2
SDM[2]: [1] adjacent nodes: {}
effsize: 3, size: 2, rv: 0
SDM[2]: [1] nodeID: 0, hostname: k17sf2p03, port: 16378
SDM[2]: [1] found entry for node 0
SDM[2]: [1] nodeID: 1, hostname: k17sf2p03, port: 16441
SDM[2]: [1] found entry for node 1
SDM[2]: [1] found my entry
SDM[2]: [1] bound to port 16441
SDM[2]: [0] Initialization successful
SDM[1]: starting task 0
SDM[4]: starting server on 0, size=3
SDM[2]: [1] Initialization successful
SDM[1]: starting task 1
SDM[4]: starting server on 1, size=3
SDM[2]: [1] receiving header
SDM[2]: [0] receiving header
SDM[2]: [0] sdm_message_progress received len 174 from 2
SDM[2]: [0] sdm_message_progress agg=00000000 src={2} dest={0-1}
SDM[2]: [1] sdm_message_progress received len 174 from 2
SDM[2]: [0] About to call recv_callback
SDM[2]: [1] sdm_message_progress agg=00000000 src={2} dest={0-1}
SDM[2]: [1] About to call recv_callback
SDM[2]: [0] Enter recv_callback
SDM[2]: [0] got downstream message src={2}, dest={0-1}
SDM[2]: [1] Enter recv_callback
SDM[2]: [1] got downstream message src={2}, dest={0-1}
SDM[2]: [0] Creating new request #0 expected replies {0}
SDM[2]: [1] Creating new request #0 expected replies {1}
SDM[2]: [0] sdm_message_deliver 
SDM[2]: [1] sdm_message_deliver 
SDM[4]: [1] Enter deliver_callback
SDM[4]: [0] Enter deliver_callback
MI: SEND -exec-arguments 40
MI: SEND -exec-arguments 40
MI: RECV ~"Using host libthread_db library \"/lib64/libthread_db.so.1\".\n"
MI: RECV ~"Using host libthread_db library \"/lib64/libthread_db.so.1\".\n"
MI: RECV (gdb) 
MI: RECV (gdb) 
MI: RECV ^done
(gdb) 
MI: RECV ^done
(gdb) 
MI: SEND -gdb-set confirm off
MI: SEND -gdb-set confirm off
MI: RECV ^done
(gdb) 
MI: RECV ^done
(gdb) 
MI: SEND -gdb-version
MI: RECV ~"GNU gdb Red Hat Linux (6.5-25.el5rh)\n"
MI: RECV ~"Copyright (C) 2006 Free Software Foundation, Inc.\n"
MI: SEND -gdb-version
MI: RECV ~"GDB is free software, covered by the GNU General Public License, and you are\n"
MI: RECV ~"GNU gdb Red Hat Linux (6.5-25.el5rh)\n"
MI: RECV ~"welcome to change it and/or distribute copies of it under certain conditions.\n"
MI: RECV ~"Type \"show copying\" to see the conditions.\n"
MI: RECV ~"Copyright (C) 2006 Free Software Foundation, Inc.\n"
MI: RECV ~"There is absolutely no warranty for GDB.  Type \"show warranty\" for details.\n"
MI: RECV ~"GDB is free software, covered by the GNU General Public License, and you are\n"
MI: RECV ~"This GDB was configured as \"ppc64-redhat-linux-gnu\".\n"
MI: RECV ~"welcome to change it and/or distribute copies of it under certain conditions.\n"
MI: RECV ~"Type \"show copying\" to see the conditions.\n"
MI: RECV ^done
(gdb) 
SDM[8]: ------------------- gdb version: 6.500000
SDM[4]: [1] Leaving deliver_callback
SDM[2]: [1] sdm_message_send removing me from dest
SDM[2]: [1] sdm_route_get_route dest {0}, parent 2
SDM[2]: [1] sdm_message_send src {2} dest {0} route {}
SDM[2]: [1] About to call send_complete
SDM[2]: [1] Leaving sdm_message_send
SDM[2]: [1] Leaving recv_callback
SDM[2]: [1] Finished recv_callback
SDM[4]: [1] server event_callback ' 006f:00000001:00000000'
SDM[2]: [1] sdm_aggregate_message: upstream message #0 from {1}
SDM[2]: [1] reply updated: src={1} replies outstanding: {}
SDM[2]: [1] creating new reply #8f34b277 for request 0
SDM[2]: [1] request 0 completed for #8f34b277
SDM[4]: [1] Enter aggregate_callback
SDM[2]: [1] sdm_route_get_route dest {2}, parent 2
SDM[2]: [1] sdm_message_send src {1} dest {2} route {2}
SDM[2]: [1] Sending len 55 to 2
SDM[2]: [1] About to call send_complete
SDM[2]: [1] Leaving sdm_message_send
SDM[4]: [1] Leaving aggregate_callback
SDM[2]: [1] Enter free_request
SDM[2]: [1] Leaving free_request
MI: RECV ~"There is absolutely no warranty for GDB.  Type \"show warranty\" for details.\n"
MI: RECV ~"This GDB was configured as \"ppc64-redhat-linux-gnu\".\n"
^done
(gdb) 
SDM[8]: ------------------- gdb version: 6.500000
SDM[4]: [0] Leaving deliver_callback
SDM[2]: [0] sdm_message_send removing me from dest
SDM[2]: [0] sdm_route_get_route dest {1}, parent 2
SDM[2]: [0] sdm_message_send src {2} dest {1} route {}
SDM[2]: [0] About to call send_complete
SDM[2]: [0] Leaving sdm_message_send
SDM[2]: [0] Leaving recv_callback
SDM[2]: [0] Finished recv_callback
SDM[4]: [0] server event_callback ' 006f:00000001:00000000'
SDM[2]: [0] sdm_aggregate_message: upstream message #0 from {0}
SDM[2]: [0] reply updated: src={0} replies outstanding: {}
SDM[2]: [0] creating new reply #8f34b277 for request 0
SDM[2]: [0] request 0 completed for #8f34b277
SDM[4]: [0] Enter aggregate_callback
SDM[2]: [0] sdm_route_get_route dest {2}, parent 2
SDM[2]: [0] sdm_message_send src {0} dest {2} route {2}
SDM[2]: [0] Sending len 55 to 2
SDM[2]: [0] About to call send_complete
SDM[2]: [0] Leaving sdm_message_send
SDM[4]: [0] Leaving aggregate_callback
SDM[2]: [0] Enter free_request
SDM[2]: [0] Leaving free_request
SDM[2]: [1] receiving header
SDM[2]: [1] sdm_message_progress received len 136 from 2
SDM[2]: [1] sdm_message_progress agg=00000000 src={2} dest={0-1}
SDM[2]: [1] About to call recv_callback
SDM[2]: [1] Enter recv_callback
SDM[2]: [1] got downstream message src={2}, dest={0-1}
SDM[2]: [1] Creating new request #3 expected replies {1}
SDM[2]: [1] sdm_message_deliver 
SDM[4]: [1] Enter deliver_callback
SDM[2]: [0] receiving header
SDM[2]: [0] sdm_message_progress received len 136 from 2
SDM[2]: [0] sdm_message_progress agg=00000000 src={2} dest={0-1}
SDM[2]: [0] About to call recv_callback
SDM[2]: [0] Enter recv_callback
SDM[2]: [0] got downstream message src={2}, dest={0-1}
SDM[2]: [0] Creating new request #3 expected replies {0}
SDM[2]: [0] sdm_message_deliver 
SDM[4]: [0] Enter deliver_callback
MI: SEND -break-insert -t main
MI: RECV ^done,bkpt={number="1",type="breakpoint",disp="del",enabled="y",addr="0x10000970",at="<main+16>",times="0"}
(gdb) 
SDM[4]: [1] Leaving deliver_callback
SDM[2]: [1] sdm_message_send removing me from dest
SDM[2]: [1] sdm_route_get_route dest {0}, parent 2
SDM[2]: [1] sdm_message_send src {2} dest {0} route {}
SDM[2]: [1] About to call send_complete
SDM[2]: [1] Leaving sdm_message_send
SDM[2]: [1] Leaving recv_callback
SDM[2]: [1] Finished recv_callback
SDM[4]: [1] server event_callback ' 006f:00000001:00000000'
SDM[2]: [1] sdm_aggregate_message: upstream message #3 from {1}
SDM[2]: [1] reply updated: src={1} replies outstanding: {}
SDM[2]: [1] creating new reply #8f34b277 for request 3
SDM[2]: [1] request 3 completed for #8f34b277
SDM[4]: [1] Enter aggregate_callback
SDM[2]: [1] sdm_route_get_route dest {2}, parent 2
SDM[2]: [1] sdm_message_send src {1} dest {2} route {2}
SDM[2]: [1] Sending len 55 to 2
SDM[2]: [1] About to call send_complete
SDM[2]: [1] Leaving sdm_message_send
SDM[4]: [1] Leaving aggregate_callback
SDM[2]: [1] Enter free_request
SDM[2]: [1] Leaving free_request
MI: SEND -break-insert -t main
MI: RECV ^done,bkpt={number="1",type="breakpoint",disp="del",enabled="y",addr="0x10000970",at="<main+16>",times="0"}
(gdb) 
SDM[4]: [0] Leaving deliver_callback
SDM[2]: [0] sdm_message_send removing me from dest
SDM[2]: [0] sdm_route_get_route dest {1}, parent 2
SDM[2]: [0] sdm_message_send src {2} dest {1} route {}
SDM[2]: [0] About to call send_complete
SDM[2]: [0] Leaving sdm_message_send
SDM[2]: [0] Leaving recv_callback
SDM[2]: [0] Finished recv_callback
SDM[4]: [0] server event_callback ' 006f:00000001:00000000'
SDM[2]: [0] sdm_aggregate_message: upstream message #3 from {0}
SDM[2]: [0] reply updated: src={0} replies outstanding: {}
SDM[2]: [0] creating new reply #8f34b277 for request 3
SDM[2]: [0] request 3 completed for #8f34b277
SDM[4]: [0] Enter aggregate_callback
SDM[2]: [0] sdm_route_get_route dest {2}, parent 2
SDM[2]: [0] sdm_message_send src {0} dest {2} route {2}
SDM[2]: [0] Sending len 55 to 2
SDM[2]: [0] About to call send_complete
SDM[2]: [0] Leaving sdm_message_send
SDM[4]: [0] Leaving aggregate_callback
SDM[2]: [0] Enter free_request
SDM[2]: [0] Leaving free_request
SDM[2]: [1] receiving header
SDM[2]: [1] sdm_message_progress received len 47 from 2
SDM[2]: [1] sdm_message_progress agg=000186a0 src={2} dest={0-1}
SDM[2]: [1] About to call recv_callback
SDM[2]: [1] Enter recv_callback
SDM[2]: [1] got downstream message src={2}, dest={0-1}
SDM[2]: [1] Creating new request #6 expected replies {1}
SDM[2]: [1] sdm_message_deliver 
SDM[4]: [1] Enter deliver_callback
SDM[2]: [0] receiving header
SDM[2]: [0] sdm_message_progress received len 47 from 2
SDM[2]: [0] sdm_message_progress agg=000186a0 src={2} dest={0-1}
SDM[2]: [0] About to call recv_callback
SDM[2]: [0] Enter recv_callback
SDM[2]: [0] got downstream message src={2}, dest={0-1}
SDM[2]: [0] Creating new request #6 expected replies {0}
SDM[2]: [0] sdm_message_deliver 
SDM[4]: [0] Enter deliver_callback
MI: SEND -exec-run
MI: RECV ^running
(gdb) 
SDM[4]: [1] Leaving deliver_callback
SDM[2]: [1] sdm_message_send removing me from dest
SDM[2]: [1] sdm_route_get_route dest {0}, parent 2
SDM[2]: [1] sdm_message_send src {2} dest {0} route {}
SDM[2]: [1] About to call send_complete
SDM[2]: [1] Leaving sdm_message_send
SDM[2]: [1] Leaving recv_callback
SDM[2]: [1] Finished recv_callback
SDM[4]: [1] server event_callback ' 006f:00000001:00000000'
SDM[2]: [1] sdm_aggregate_message: upstream message #6 from {1}
SDM[2]: [1] reply updated: src={1} replies outstanding: {}
SDM[2]: [1] creating new reply #8f34b277 for request 6
SDM[2]: [1] request 6 completed for #8f34b277
SDM[4]: [1] Enter aggregate_callback
SDM[2]: [1] sdm_route_get_route dest {2}, parent 2
SDM[2]: [1] sdm_message_send src {1} dest {2} route {2}
SDM[2]: [1] Sending len 55 to 2
SDM[2]: [1] About to call send_complete
SDM[2]: [1] Leaving sdm_message_send
SDM[4]: [1] Leaving aggregate_callback
SDM[2]: [1] Enter free_request
SDM[2]: [1] Leaving free_request
MI: SEND -exec-run
MI: RECV ^running
(gdb) 
SDM[4]: [0] Leaving deliver_callback
SDM[2]: [0] sdm_message_send removing me from dest
SDM[2]: [0] sdm_route_get_route dest {1}, parent 2
SDM[2]: [0] sdm_message_send src {2} dest {1} route {}
SDM[2]: [0] About to call send_complete
SDM[2]: [0] Leaving sdm_message_send
SDM[2]: [0] Leaving recv_callback
SDM[2]: [0] Finished recv_callback
SDM[4]: [0] server event_callback ' 006f:00000001:00000000'
SDM[2]: [0] sdm_aggregate_message: upstream message #6 from {0}
SDM[2]: [0] reply updated: src={0} replies outstanding: {}
SDM[2]: [0] creating new reply #8f34b277 for request 6
SDM[2]: [0] request 6 completed for #8f34b277
SDM[4]: [0] Enter aggregate_callback
SDM[2]: [0] sdm_route_get_route dest {2}, parent 2
SDM[2]: [0] sdm_message_send src {0} dest {2} route {2}
SDM[2]: [0] Sending len 55 to 2
SDM[2]: [0] About to call send_complete
SDM[2]: [0] Leaving sdm_message_send
SDM[4]: [0] Leaving aggregate_callback
SDM[2]: [0] Enter free_request
SDM[2]: [0] Leaving free_request
MI: RECV ~"[Thread debugging using libthread_db enabled]\n"
MI: RECV ~"[Thread debugging using libthread_db enabled]\n"
MI: RECV ~"[New Thread 268383472 (LWP 2753)]\n"
MI: RECV ~"[New Thread 268383472 (LWP 2752)]\n"
MI: RECV ~"[New Thread 1081144496 (LWP 2759)]\n"
MI: RECV ~"[New Thread 1081144496 (LWP 2758)]\n"
MI: RECV ~"[Switching to Thread 268383472 (LWP 2753)]\n"
*stopped,thread-id="1",frame={addr="0x10000970",func="main",args=[]}
(gdb) 
MI: RECV ~"[Switching to Thread 268383472 (LWP 2752)]\n"
MI: RECV *stopped,thread-id="1",frame={addr="0x10000970",func="main",args=[]}
(gdb) 
MI: SEND -stack-info-depth
MI: SEND -stack-info-depth
MI: RECV ^done,depth="1"
(gdb) 
MI: RECV ^done,depth="1"
(gdb) 
MI: SEND -var-update *
MI: SEND -var-update *
MI: RECV ^done,changelist=[]
(gdb) 
SDM[4]: [0] server event_callback ' 0071:00000001:00000009 00000001:3 00000001:0 00000000: 00000004:main 0000000a:0x10000970 00000001:0 00000001:1 00000001:1 00000001:0'
SDM[2]: [0] sdm_aggregate_message: upstream message #6 from {0}
SDM[2]: [0] sdm_aggregate_message: message is unsolicited
SDM[2]: [0] Creating new request #6 expected replies {0}
SDM[2]: [0] reply updated: src={0} replies outstanding: {}
SDM[2]: [0] creating new reply #3ff3722 for request 6
SDM[2]: [0] request 6 completed for #3ff3722
SDM[4]: [0] Enter aggregate_callback
SDM[2]: [0] sdm_route_get_route dest {2}, parent 2
SDM[2]: [0] sdm_message_send src {0} dest {2} route {2}
SDM[2]: [0] Sending len 165 to 2
SDM[2]: [0] About to call send_complete
SDM[2]: [0] Leaving sdm_message_send
SDM[4]: [0] Leaving aggregate_callback
SDM[2]: [0] Enter free_request
MI: RECV ^done,changelist=[]
(gdb) 
SDM[4]: [1] server event_callback ' 0071:00000001:00000009 00000001:3 00000001:0 00000000: 00000004:main 0000000a:0x10000970 00000001:0 00000001:1 00000001:1 00000001:0'
SDM[2]: [1] sdm_aggregate_message: upstream message #6 from {1}
SDM[2]: [1] sdm_aggregate_message: message is unsolicited
SDM[2]: [1] Creating new request #6 expected replies {1}
SDM[2]: [1] reply updated: src={1} replies outstanding: {}
SDM[2]: [1] creating new reply #3ff3722 for request 6
SDM[2]: [1] request 6 completed for #3ff3722
SDM[4]: [1] Enter aggregate_callback
SDM[2]: [1] sdm_route_get_route dest {2}, parent 2
SDM[2]: [1] sdm_message_send src {1} dest {2} route {2}
SDM[2]: [1] Sending len 165 to 2
SDM[2]: [1] About to call send_complete
SDM[2]: [1] Leaving sdm_message_send
SDM[4]: [1] Leaving aggregate_callback
SDM[2]: [1] Enter free_request
SDM[2]: [1] Leaving free_request
SDM[2]: [0] Leaving free_request
SDM[2]: [0] receiving header
SDM[2]: [0] sdm_message_progress received len 47 from 2
SDM[2]: [0] sdm_message_progress agg=00000000 src={2} dest={0}
SDM[2]: [0] About to call recv_callback
SDM[2]: [0] Enter recv_callback
SDM[2]: [0] got downstream message src={2}, dest={0}
SDM[2]: [0] Creating new request #11 expected replies {0}
SDM[2]: [0] sdm_message_deliver 
SDM[4]: [0] Enter deliver_callback
MI: SEND info threads
MI: RECV &"info threads\n"
MI: RECV ~"  2 Thread 1081144496 (LWP 2759)  0x4004082c in do_sigwait ()\n"
MI: RECV ~"   from /lib/libpthread.so.0\n"
MI: RECV ~"* 1 Thread 268383472 (LWP 2753)  0x10000970 in main ()\n"
MI: RECV ^done
(gdb) 
SDM[4]: [0] Leaving deliver_callback
SDM[2]: [0] sdm_message_send removing me from dest
SDM[2]: [0] sdm_route_get_route dest {}, parent 2
SDM[2]: [0] sdm_message_send src {2} dest {} route {}
SDM[2]: [0] About to call send_complete
SDM[2]: [0] Leaving sdm_message_send
SDM[2]: [0] Leaving recv_callback
SDM[2]: [0] Finished recv_callback
SDM[4]: [0] server event_callback ' 0072:00000001:00000003 00000001:1 00000001:1 00000001:2'
SDM[2]: [0] sdm_aggregate_message: upstream message #11 from {0}
SDM[2]: [0] reply updated: src={0} replies outstanding: {}
SDM[2]: [0] creating new reply #b329560a for request 11
SDM[2]: [0] request 11 completed for #b329560a
SDM[4]: [0] Enter aggregate_callback
SDM[2]: [0] sdm_route_get_route dest {2}, parent 2
SDM[2]: [0] sdm_message_send src {0} dest {2} route {2}
SDM[2]: [0] Sending len 88 to 2
SDM[2]: [0] About to call send_complete
SDM[2]: [0] Leaving sdm_message_send
SDM[4]: [0] Leaving aggregate_callback
SDM[2]: [0] Enter free_request
SDM[2]: [0] Leaving free_request
SDM[2]: [0] receiving header
SDM[2]: [0] sdm_message_progress received len 47 from 2
SDM[2]: [0] sdm_message_progress agg=00000000 src={2} dest={0}
SDM[2]: [0] About to call recv_callback
SDM[2]: [0] Enter recv_callback
SDM[2]: [0] got downstream message src={2}, dest={0}
SDM[2]: [0] Creating new request #13 expected replies {0}
SDM[2]: [0] sdm_message_deliver 
SDM[4]: [0] Enter deliver_callback
MI: SEND -stack-info-depth
MI: RECV ^done,depth="1"
(gdb) 
SDM[4]: [0] Leaving deliver_callback
SDM[2]: [0] sdm_message_send removing me from dest
SDM[2]: [0] sdm_route_get_route dest {}, parent 2
SDM[2]: [0] sdm_message_send src {2} dest {} route {}
SDM[2]: [0] About to call send_complete
SDM[2]: [0] Leaving sdm_message_send
SDM[2]: [0] Leaving recv_callback
SDM[2]: [0] Finished recv_callback
SDM[4]: [0] server event_callback ' 0074:00000001:00000001 00000001:1'
SDM[2]: [0] sdm_aggregate_message: upstream message #13 from {0}
SDM[2]: [0] reply updated: src={0} replies outstanding: {}
SDM[2]: [0] creating new reply #3928f9a1 for request 13
SDM[2]: [0] request 13 completed for #3928f9a1
SDM[4]: [0] Enter aggregate_callback
SDM[2]: [0] sdm_route_get_route dest {2}, parent 2
SDM[2]: [0] sdm_message_send src {0} dest {2} route {2}
SDM[2]: [0] Sending len 66 to 2
SDM[2]: [0] About to call send_complete
SDM[2]: [0] Leaving sdm_message_send
SDM[4]: [0] Leaving aggregate_callback
SDM[2]: [0] Enter free_request
SDM[2]: [0] Leaving free_request
SDM[2]: [0] receiving header
SDM[2]: [0] sdm_message_progress received len 69 from 2
SDM[2]: [0] sdm_message_progress agg=00000000 src={2} dest={0}
SDM[2]: [0] About to call recv_callback
SDM[2]: [0] Enter recv_callback
SDM[2]: [0] got downstream message src={2}, dest={0}
SDM[2]: [0] Creating new request #15 expected replies {0}
SDM[2]: [0] sdm_message_deliver 
SDM[4]: [0] Enter deliver_callback
MI: SEND -stack-list-frames 0 1
MI: RECV ^done,stack=[frame={level="0",addr="0x10000970",func="main"}]
(gdb) 
SDM[4]: [0] Leaving deliver_callback
SDM[2]: [0] sdm_message_send removing me from dest
SDM[2]: [0] sdm_route_get_route dest {}, parent 2
SDM[2]: [0] sdm_message_send src {2} dest {} route {}
SDM[2]: [0] About to call send_complete
SDM[2]: [0] Leaving sdm_message_send
SDM[2]: [0] Leaving recv_callback
SDM[2]: [0] Finished recv_callback
SDM[4]: [0] server event_callback ' 0069:00000001:00000006 00000001:1 00000001:0 00000000: 00000004:main 0000000a:0x10000970 00000001:0'
SDM[2]: [0] sdm_aggregate_message: upstream message #15 from {0}
SDM[2]: [0] reply updated: src={0} replies outstanding: {}
SDM[2]: [0] creating new reply #affecc0a for request 15
SDM[2]: [0] request 15 completed for #affecc0a
SDM[4]: [0] Enter aggregate_callback
SDM[2]: [0] sdm_route_get_route dest {2}, parent 2
SDM[2]: [0] sdm_message_send src {0} dest {2} route {2}
SDM[2]: [0] Sending len 132 to 2
SDM[2]: [0] About to call send_complete
SDM[2]: [0] Leaving sdm_message_send
SDM[4]: [0] Leaving aggregate_callback
SDM[2]: [0] Enter free_request
SDM[2]: [0] Leaving free_request
SDM[2]: [1] receiving header
SDM[2]: [1] sdm_message_progress received len 69 from 2
SDM[2]: [1] sdm_message_progress agg=00000000 src={2} dest={1}
SDM[2]: [1] About to call recv_callback
SDM[2]: [1] Enter recv_callback
SDM[2]: [1] got downstream message src={2}, dest={1}
SDM[2]: [1] Creating new request #17 expected replies {1}
SDM[2]: [1] sdm_message_deliver 
SDM[4]: [1] Enter deliver_callback
MI: SEND -stack-list-frames 1 1
MI: RECV &"mi_cmd_stack_list_frames: Not enough frames in stack.\n"
MI: RECV ^error,msg="mi_cmd_stack_list_frames: Not enough frames in stack."
(gdb) 
SDM[8]: ------------------- GetStackframes error
SDM[4]: [1] Leaving deliver_callback
SDM[2]: [1] sdm_message_send removing me from dest
SDM[2]: [1] sdm_route_get_route dest {}, parent 2
SDM[2]: [1] sdm_message_send src {2} dest {} route {}
SDM[2]: [1] About to call send_complete
SDM[2]: [1] Leaving sdm_message_send
SDM[2]: [1] Leaving recv_callback
SDM[2]: [1] Finished recv_callback
SDM[4]: [1] server event_callback ' 0070:00000001:00000002 00000001:4 00000045:Debugger error: mi_cmd_stack_list_frames: Not enough frames in stack.'
SDM[2]: [1] sdm_aggregate_message: upstream message #17 from {1}
SDM[2]: [1] reply updated: src={1} replies outstanding: {}
SDM[2]: [1] creating new reply #12bded8d for request 17
SDM[2]: [1] request 17 completed for #12bded8d
SDM[4]: [1] Enter aggregate_callback
SDM[2]: [1] sdm_route_get_route dest {2}, parent 2
SDM[2]: [1] sdm_message_send src {1} dest {2} route {2}
SDM[2]: [1] Sending len 145 to 2
SDM[2]: [1] About to call send_complete
SDM[2]: [1] Leaving sdm_message_send
SDM[4]: [1] Leaving aggregate_callback
SDM[2]: [1] Enter free_request
SDM[2]: [1] Leaving free_request
SDM[2]: [1] receiving header
SDM[2]: [1] sdm_message_progress received len 47 from 2
SDM[2]: [1] sdm_message_progress agg=00000000 src={2} dest={0-1}
SDM[2]: [1] About to call recv_callback
SDM[2]: [1] Enter recv_callback
SDM[2]: [1] got downstream message src={2}, dest={0-1}
SDM[2]: [1] Creating new request #19 expected replies {1}
SDM[2]: [1] sdm_message_deliver 
SDM[4]: [1] Enter deliver_callback
SDM[2]: [0] receiving header
SDM[2]: [0] sdm_message_progress received len 47 from 2
SDM[2]: [0] sdm_message_progress agg=00000000 src={2} dest={0-1}
SDM[2]: [0] About to call recv_callback
SDM[2]: [0] Enter recv_callback
SDM[2]: [0] got downstream message src={2}, dest={0-1}
SDM[2]: [0] Creating new request #19 expected replies {0}
SDM[2]: [0] sdm_message_deliver 
SDM[4]: [0] Enter deliver_callback
MI: SEND -gdb-exit
MI: RECV ^exit
SDM[4]: [1] Leaving deliver_callback
SDM[2]: [1] sdm_message_send removing me from dest
SDM[2]: [1] sdm_route_get_route dest {0}, parent 2
SDM[2]: [1] sdm_message_send src {2} dest {0} route {}
SDM[2]: [1] About to call send_complete
SDM[2]: [1] Leaving sdm_message_send
SDM[2]: [1] Leaving recv_callback
SDM[2]: [1] Finished recv_callback
SDM[4]: [1] server event_callback ' 006f:00000002:00000000'
SDM[2]: [1] sdm_aggregate_message: upstream message #19 from {1}
SDM[2]: [1] reply updated: src={1} replies outstanding: {}
SDM[2]: [1] creating new reply #bca69848 for request 19
SDM[2]: [1] request 19 completed for #bca69848
SDM[4]: [1] Enter aggregate_callback
SDM[2]: [1] sdm_route_get_route dest {2}, parent 2
SDM[2]: [1] sdm_message_send src {1} dest {2} route {2}
SDM[2]: [1] Sending len 55 to 2
SDM[2]: [1] About to call send_complete
SDM[2]: [1] Leaving sdm_message_send
SDM[4]: [1] Leaving aggregate_callback
SDM[2]: [1] Enter free_request
SDM[2]: [1] Leaving free_request
SDM[1]: all finished
MI: SEND -gdb-exit
MI: RECV ^exit
SDM[4]: [0] Leaving deliver_callback
SDM[2]: [0] sdm_message_send removing me from dest
SDM[2]: [0] sdm_route_get_route dest {1}, parent 2
SDM[2]: [0] sdm_message_send src {2} dest {1} route {}
SDM[2]: [0] About to call send_complete
SDM[2]: [0] Leaving sdm_message_send
SDM[2]: [0] Leaving recv_callback
SDM[2]: [0] Finished recv_callback
SDM[4]: [0] server event_callback ' 006f:00000002:00000000'
SDM[2]: [0] sdm_aggregate_message: upstream message #19 from {0}
SDM[2]: [0] reply updated: src={0} replies outstanding: {}
SDM[2]: [0] creating new reply #bca69848 for request 19
SDM[2]: [0] receiving header
SDM[2]: [0] Error retrieving message size!
SDM[2]: [0] request 19 completed for #bca69848
SDM[4]: [0] Enter aggregate_callback
SDM[2]: [0] sdm_route_get_route dest {2}, parent 2
SDM[2]: [0] sdm_message_send src {0} dest {2} route {2}
SDM[2]: [0] Sending len 55 to 2
SDM[2]: [0] About to call send_complete
SDM[2]: [0] Leaving sdm_message_send
SDM[4]: [0] Leaving aggregate_callback
SDM[2]: [0] Enter free_request
SDM[2]: [0] Leaving free_request
SDM[1]: all finished

Configuration location:
    file:/C:/Eclipse_ganymede_workspace/.metadata/.plugins/org.eclipse.pde.core/New_configuration/
Configuration file:
    file:/C:/Eclipse_ganymede_workspace/.metadata/.plugins/org.eclipse.pde.core/New_configuration/config.ini loaded
Install location:
    file:/C:/Program Files/eclipse-3.4-ganymede/
Framework located:
    file:/C:/Program Files/eclipse-3.4-ganymede/plugins/org.eclipse.osgi_3.4.0.v20080605-1900.jar
Framework classpath:
    file:/C:/Program Files/eclipse-3.4-ganymede/plugins/org.eclipse.osgi_3.4.0.v20080605-1900.jar
Splash location:
    C:\Program Files\eclipse-3.4-ganymede\plugins\org.eclipse.platform_3.3.100.v200806172000\splash.bmp
Debug options:
    file:/C:/Eclipse_ganymede_workspace/.metadata/.plugins/org.eclipse.pde.core/New_configuration/.options loaded
Time to load bundles: 40
Starting application: 7106
Application Started: 12932
In saveResourceManagers to file, C:\runtime-New_configuration3\.metadata\.plugins\org.eclipse.ptp.core\resourceManagers.xml
Leaving saveResourceManagers
PE@xxxxxxxxxxxxxxxxxxxxx.comProxyRuntimeClient - firing up proxy, waiting for connection.  Please wait!  This can take a minute . . .
PROXY_SERVER path = 'PE@xxxxxxxxxxxxxxxxxxxxxxxxx'
sessionCreate(0,0)
bind(0.0.0.0/0.0.0.0:0)
port=1309
Launch command: [/home/wootton/ptp_proxy/linux/ganymede_rc1/org.eclipse.ptp.rm.ibm.pe.proxy_2.0.1.200810101902/ptp_ibmpe_proxy, --proxy=tcp, --host=9.65.128.101, --port=1309, --debug=1, --trace=Detail]
accept thread starting...
PE@xxxxxxxxxxxxxxxxxxxxx.comProxyRuntimeClient: Waiting on accept.
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: Last login: Fri Oct 17 13:00:56 2008 from sig-9-65-179-54.mts.ibm.com
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 07/09/2008 install rhya0828a build of hpct
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 07/15/2008 install rhya0829a build of hpct
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 08/07/2008 install rhya0832a  ppe.hpct, ppe.hpct.rte
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 09/10/2008 install rhya0837a  ppe.hpct, ppe.hpct.rte
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 09/11/2008 install rhya0837c  ppe.hpct, ppe.hpct.rte
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/02/2008 install Ellicks GA c121xs11:/tmp/pe510.test/HPCT ppe.hpct, ppe.hpct.rte
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: /home/wootton/ptp_proxy/linux/ganymede_rc1/org.eclipse.ptp.rm.ibm.pe.proxy_2.0.1.200810101902/ptp_ibmpe_proxy --proxy=tcp --host=9.65.128.101 --port=1309 --debug=1 --trace=Detail;exit
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: -bash-3.1$ /home/wootton/ptp_proxy/linux/ganymede_rc1/org.eclipse.ptp.rm.ibm.pe. proxy_2.0.1.200810101902/ptp_ibmpe_proxy --proxy=tcp --host=9.65.128.101 --port= 1309 --debug=1 --trace=Detail;exit
accept thread exiting...
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:00 T(256) Info: Running IBMPE proxy on port 1309
event thread starting...
RECEIVE:[00000017 0000:00000000:00000000]
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:00 T(256) Trace: >>> start_daemon entered. (Line 783)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:00 T(256) Trace:  'version=2.0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:11:00 T(256) Trace:  'baseId=67108864
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:11:00 T(256) Trace: <<< start_daemon exited. (Line 801)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:00 T(256) Trace: >>> zombie_reaper entered. (Line 1812)
RECEIVE:[000000acPE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:01 T(256) Trace: >>> define_model entered. (Line 814)
 00fb:00000000:00000008 00000001:1 00000001:5 0000000d:PE_STDIN_PATH 00000006:STRING 0000000a:Stdin Path 00000021:Specify path for stdin input file 00000005:false 00000000:]
RECEIVE:[000000b0 00fb:00000000:00000008 00000001:1 00000001:5 0000000e:PE_STDOUT_PATH 00000006:STRING 0000000b:Stdout Path 00000023:Specify path for stdout output file 00000005:false 00000000:]
RECEIVE:[000000b0 00fb:00000000:00000008 00000001:1 00000001:5 0000000e:PE_STDERR_PATH 00000006:STRING 0000000b:Stderr Path 00000023:Specify path for stderr output file 00000005:false 00000000:]
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:01 T(256) Trace: >>> send_string_attrs entered. (Line 4518)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:01 T(256) Trace: <<< send_string_attrs exited. (Line 4530)
RECEIVE:[000000d4 00fb:00000000:00000008 00000001:1 00000001:5 0000000d:MP_IONODEFILE 00000006:STRING 00000011:MPI I/O Node List 00000042:Specify file listing nodes performing parallel I/O (MP_IONODEFILE) 00000005:false 00000000:]
RECEIVE:[000000ce 00fb:00000000:00000008 00000001:1 00000001:5 0000000d:MP_PMDLOG_DIR 00000006:STRING 00000011:PMD Log Directory 0000003c:Specify directory where PMD log is generated (MP_PMDLOG_DIR) 00000005:false 00000000:]
RECEIVE:[000000cb 00fb:00000000:00000008 00000001:1 00000001:5 0000000a:MP_COREDIR 00000006:STRING 00000012:Corefile Directory 0000003b:Specify directory for application's core files (MP_COREDIR) 00000005:false 00000000:]
RECEIVE:[000000c9 00fb:00000000:00000008 00000001:1 00000001:5 0000000a:MP_PROFDIR 00000006:STRING 0000000e:GMON Directory 0000003d:Directory containing GMON profiling data files (GMON_PROFDIR) 00000005:false 00000000:]
RECEIVE:[000000c0 00fb:00000000:00000008 00000001:1 00000001:5 0000000a:MP_CMDFILE 00000006:STRING 0000000c:Command File 00000036:Specify script to load nodes in partition (MP_CMDFILE) 00000005:false 00000000:]
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:01 T(256) Trace: >>> send_int_attrs entered. (Line 4542)
RECEIVE:[000000cd 00fb:00000000:00000008 00000001:1 00000001:5 0000000b:MP_HOSTFILE 00000006:STRING 0000000e:Host List File 00000040:Specify name of host list file for node allocation (MP_HOSTFILE) 00000005:false 00000000:]
RECEIVE:[000000d9 00fb:00000000:00000008 00000001:1 00000001:5 0000000d:MP_EUILIBPATH 00000006:STRING 0000000c:Library Path 0000004c:Specify path to message passing and communications libraries (MP_EUILIBPATH) 00000005:false 00000000:]
RECEIVE:[000000be 00fb:00000000:00000008 00000001:1 00000001:5 00000008:MP_RMLIB 00000006:STRING 00000018:Resource Manager Library 0000002a:Specify alternate resource manager library 00000005:false 00000000:]
RECEIVE:[000000c0 00fb:00000000:00000008 00000001:1 00000001:5 0000000d:PE_ENV_SCRIPT 00000006:STRING 00000018:Environment Setup Script 00000027:Specify if using basic or advanced mode 00000005:false 00000000:]
RECEIVE:[000000c7 00fb:00000000:00000008 00000001:1 00000001:5 00000010:PE_ADVANCED_MODE 00000006:STRING 0000000d:Advanced Mode 00000034:Specify name of PE environment variable setup script 00000005:false 00000002:no]
RECEIVE:[000000f2 00fb:00000000:0000000a 00000001:1 00000001:8 00000011:MP_IO_BUFFER_SIZE 00000007:INTEGER 00000013:MPI I/O Buffer Size 0000003b:Specify default buffer size for MPI-IO (MPI_IO_BUFFER_SIZE) 00000001:0 00000004:8192 00000001:1 00000009:134217728]
RECEIVE:[000000d2 00fb:00000000:0000000a 00000001:1 00000001:8 00000008:MP_PROCS 00000007:INTEGER 0000000f:Number of Tasks 0000002a:Specify number of program tasks (MP_PROCS) 00000001:0 00000001:1 00000001:1 0000000a:2147483647]
RECEIVE:[000000e7 00fb:00000000:0000000a 00000001:1 00000001:8 0000000d:MP_ACK_THRESH 00000007:INTEGER 00000018:Acknowledgment Threshold 00000038:Specify packet acknowledgment threshhold (MP_ACK_THRESH) 00000001:0 00000002:30 00000001:1 00000002:31]
RECEIVE:[000000f2 00fb:00000000:0000000a 00000001:1 00000001:8 0000000e:MP_EAGER_LIMIT 00000007:INTEGER 0000000b:Eager Limit 00000044:Specify rondezvous protocol message size threshhold (MP_EAGER_LIMIT) 00000001:0 00000005:65536 00000001:1 0000000a:2147483647]
RECEIVE:[00000101 00fb:00000000:0000000a 00000001:1 00000001:8 00000013:MP_MSG_ENVELOPE_BUF 00000007:INTEGER 00000014:Envelope Buffer Size 0000003d:Specify size of message envelope buffer (MP_MSG_ENVELOPE_BUF) 00000001:0 00000007:8388608 00000007:1000001 0000000a:2147483647]
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:01 T(256) Trace: <<< send_int_attrs exited. (Line 4553)
RECEIVE:[000000eePE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:01 T(256) Trace: >>> send_long_int_attrs entered. (Line 4565)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:01 T(256) Trace: <<< send_long_int_attrs exited. (Line 4577)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:01 T(256) Trace: >>> send_enum_attrs entered. (Line 4589)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:01 T(256) Trace: <<< send_enum_attrs exited. (Line 4642)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:01 T(256) Trace: >>> send_local_default_attrs entered. (Line 4658)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:01 T(256) Trace: <<< send_local_default_attrs exited. (Line 4684)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:01 T(256) Trace: <<< define_model exited. (Line 835)
 00fb:00000000:0000000a 00000001:1 00000001:8 00000013:MP_POLLING_INTERVAL 00000007:INTEGER 00000014:MPI Polling Interval 00000031:Specify PE polling interval (MP_POLLING_INTERVAL) 00000001:0 00000006:400000 00000001:1 0000000a:2147483647]
RECEIVE:[000000e0 00fb:00000000:0000000a 00000001:1 00000001:8 0000000d:PE_RDMA_COUNT 00000007:INTEGER 00000015:Number of rCtx Blocks 0000002d:Specify number of rCxt blocks (MP_RDMA_COUNT) 00000001:0 00000001:0 00000001:0 0000000a:2147483647]
RECEIVE:[000000e2 00fb:00000000:0000000a 00000001:1 00000001:8 0000000f:PE_RDMA_COUNT_2 00000007:INTEGER 00000015:Number of rCtx Blocks 0000002d:Specify number of rCxt blocks (MP_RDMA_COUNT) 00000001:0 00000001:0 00000001:0 0000000a:2147483647]
RECEIVE:[0000010d 00fb:00000000:0000000a 00000001:1 00000001:8 00000016:MP_RETRANSMIT_INTERVAL 00000007:INTEGER 00000017:MPI Retransmit Interval 00000048:Specify interval to check if retransmit neeeded (MP_RETRANSMIT_INTERVAL) 00000001:0 00000005:10000 00000004:1000 0000000a:2147483647]
RECEIVE:[000000f7 00fb:00000000:0000000a 00000001:1 00000001:8 00000011:MP_REXMIT_BUF_CNT 00000007:INTEGER 00000012:Retransmit Buffers 00000041:Specify number of retransmit buffers per task (MP_REXMIT_BUF_CNT) 00000001:0 00000003:128 00000001:1 0000000a:2147483647]
RECEIVE:[000000f9 00fb:00000000:0000000a 00000001:1 00000001:8 00000012:MP_REXMIT_BUF_SIZE 00000007:INTEGER 0000001d:Maximum LAPI Buffered Message 00000035:Specify maximum LAPI buffer size (MP_REXMIT_BUF_SIZE) 00000001:0 00000005:65568 00000001:1 0000000a:2147483647]
RECEIVE:[000000de 00fb:00000000:0000000a 00000001:1 00000001:8 00000012:MP_UDP_PACKET_SIZE 00000007:INTEGER 0000000f:UDP Packet Size 0000002c:Specify UDP packet size (MP_UDP_PACKET_SIZE) 00000001:0 00000001:1 00000001:1 0000000a:2147483647]
RECEIVE:[000000f3 00fb:00000000:0000000a 00000001:1 00000001:8 0000000d:PE_BUFFER_MEM 00000007:INTEGER 0000000d:Buffer Memory 00000041:Specify size of preallocated early arrival buffer (MP_BUFFER_MEM) 00000001:0 00000008:67108864 00000001:0 0000000a:2147483647]
RECEIVE:[0000010e 00fb:00000000:0000000a 00000001:1 00000001:8 00000013:MP_THREAD_STACKSIZE 00000007:INTEGER 00000020:Additional MPI Thread Stack Size 0000004a:Specify additional stack size for MPI service thread (MP_THREAD_STACKSIZE) 00000001:0 00000001:0 00000001:0 0000000a:2147483647]
RECEIVE:[000000db 00fb:00000000:0000000a 00000001:1 00000001:8 00000008:MP_PULSE 00000007:INTEGER 0000000e:Pulse Interval 00000032:Specify interval PE checks remote modes (MP_PULSE) 00000001:0 00000003:600 00000001:0 0000000a:2147483647]
RECEIVE:[000000f0 00fb:00000000:0000000a 00000001:1 00000001:8 0000000a:MP_TIMEOUT 00000007:INTEGER 00000012:Connection Timeout 00000041:Specify timeout limit for connecting to remote nodes (MP_TIMEOUT) 00000001:0 00000003:150 00000001:1 0000000a:2147483647]
RECEIVE:[000000a7 00fb:00000000:0000000a 00000001:1 00000001:8 00000010:MP_INSTANCES_INT 00000007:INTEGER 00000003:??? 00000003:??? 00000001:0 00000001:0 00000001:0 0000000a:2147483647]
RECEIVE:[000000ed 00fb:00000000:0000000a 00000001:1 00000001:8 00000011:PE_BUFFER_MEM_MAX 0000000a:BIGINTEGER 00000003:??? 0000003c:Specify maximum size of early arrival buffer (MP_BUFFER_MEM) 00000001:0 00000001:0 00000001:0 00000013:9223372036854775807]
RECEIVE:[000000e4 00fb:00000000:0000000a 00000001:1 00000001:8 0000000a:MP_DEVTYPE 0000000a:ENUMERATED 00000011:Device Type Class 0000003f:Specify that Infiniband interconnect is to be used (MP_DEVTYPE) 00000001:0 00000000: 00000000: 00000002:ib]
RECEIVE:[000000e2 00fb:00000000:0000000a 00000001:1 00000001:8 0000000a:MP_LABELIO 0000000a:ENUMERATED 00000009:Label I/O 00000040:Specify if application output is labeled by task id (MP_LABELIO) 00000001:0 00000002:no 00000003:yes 00000002:no]
RECEIVE:[000000e5 00fb:00000000:0000000a 00000001:1 00000001:8 0000000c:MP_IO_ERRLOG 0000000a:ENUMERATED 00000014:Create I/O Error Log 00000036:Specify if I/O error logging is enabled (MP_IO_ERRLOG) 00000001:0 00000002:no 00000003:yes 00000002:no]
RECEIVE:[000000da 00fb:00000000:0000000a 00000001:1 00000001:8 0000000f:PE_SPLIT_STDOUT 0000000a:ENUMERATED 00000014:Split STDOUT by Task 00000028:Specify if stdio output is split by task 00000001:0 00000002:no 00000003:yes 00000002:no]
RECEIVE:[000000e1 00fb:00000000:0000000a 00000001:1 00000001:8 0000000c:MP_STDINMODE 0000000a:ENUMERATED 0000000a:STDIN Mode 00000039:Specify how application's stdin is managed (MP_STDINMODE) 00000001:0 00000003:all 00000003:all 00000004:none]
RECEIVE:[000000fa 00fb:00000000:0000000a 00000001:1 00000001:8 0000000d:MP_STDOUTMODE 0000000a:ENUMERATED 0000000b:STDOUT Mode 00000041:Specify how application's stdio output is handled (MP_STDOUTMODE) 00000001:0 00000009:unordered 00000007:ordered 00000009:unordered]
RECEIVE:[000000d2 00fb:00000000:0000000a 00000001:1 00000001:8 00000009:MP_PMDLOG 0000000a:ENUMERATED 0000000e:Create PMD Log 0000002c:Specify if PE diagnostic messages are logged 00000001:0 00000002:no 00000003:yes 00000002:no]
RECEIVE:[000000e8 00fb:00000000:0000000a 00000001:1 00000001:8 0000000b:MP_PRINTENV 0000000a:ENUMERATED 00000011:Print Environment 0000003d:Specify if PE environment variables are printed (MP_PRINTENV) 00000001:0 00000002:no 00000003:yes 00000002:no]
RECEIVE:[00000168 00fb:00000000:0000000f 00000001:1 00000002:13 0000000c:MP_INFOLEVEL 0000000a:ENUMERATED 0000000d:Message Level 00000034:Specify level of PE message reporting (MP_INFOLEVEL) 00000001:0 00000007:Warning 00000005:Error 00000007:Warning 0000000d:Informational 0000000a:Diagnostic 00000012:Diagnostic level 4 00000012:Diagnostic level 5 00000012:Diagnostic level 6]
RECEIVE:[0000010c 00fb:00000000:0000000e 00000001:1 00000002:12 00000013:MP_LAPI_TRACE_LEVEL 0000000a:ENUMERATED 00000010:LAPI Trace Level 00000031:Specify level of LAPI trace (MP_LAPI_TRACE_LEVEL) 00000001:0 00000001:0 00000001:0 00000001:1 00000001:2 00000001:3 00000001:4 00000001:5]
RECEIVE:[000000fc 00fb:00000000:0000000b 00000001:1 00000001:9 0000000d:MP_STATISTICS 0000000a:ENUMERATED 0000000e:MPI Statistics 00000043:Obtain communication statistics for user space jobs (MP_STATISTICS) 00000001:0 00000002:no 00000003:yes 00000002:no 00000005:print]
RECEIVE:[00000108 00fb:00000000:0000000a 00000001:1 00000001:8 00000012:MP_DEBUG_NOTIMEOUT 0000000a:ENUMERATED 00000010:Suppress Timeout 00000057:Specify if debugger can attach without causing application timeout (MP_DEBUG_NOTIMEOUT) 00000001:0 00000002:no 00000003:yes 00000002:no]
RECEIVE:[0000010a 00fb:00000000:0000000c 00000001:1 00000002:10 0000000d:MP_EUIDEVELOP 0000000a:ENUMERATED 00000016:MPI Parameter Checking 00000037:Specify level of MPI parameter checking (MP_EUIDEVELOP) 00000001:0 00000002:no 00000003:yes 00000002:no 00000005:debug 00000007:minimum]
RECEIVE:[000000fa 00fb:00000000:0000000a 00000001:1 00000001:8 0000000e:MP_ADAPTER_USE 0000000a:ENUMERATED 00000015:Exclusive Adapter Use 0000003a:Specify how node's adapter should be used (MP_ADAPTER_USE) 00000001:0 00000006:shared 00000009:dedicated 00000006:shared]
RECEIVE:[000000eb 00fb:00000000:0000000a 00000001:1 00000001:8 0000000a:MP_CPU_USE 0000000a:ENUMERATED 00000011:Exclusive CPU Use 00000032:Specify how node's CPU should be used (MP_CPU_USE) 00000001:0 00000008:multiple 00000008:multiple 00000006:unique]
RECEIVE:[000000f1 00fb:00000000:0000000b 00000001:1 00000001:9 0000000c:MP_EUIDEVICE 0000000a:ENUMERATED 00000007:Adapter 00000039:Specify adapter to use for message passing (MP_EUIDEVICE) 00000001:0 00000000: 00000004:ethx 00000006:sn_all 00000009:sn_single]
RECEIVE:[000000df 00fb:00000000:0000000a 00000001:1 00000001:8 00000009:MP_EUILIB 0000000a:ENUMERATED 00000018:Communications Subsystem 00000030:Communications susbsystem to be used (MP_EUILIB) 00000001:0 00000002:ip 00000002:ip 00000002:us]
RECEIVE:[000000d7 00fb:00000000:0000000a 00000001:1 00000001:8 0000000b:MP_PGMMODEL 0000000a:ENUMERATED 00000011:Programming Model 00000027:Specify programming model (MP_PGMMODEL) 00000001:0 00000004:spmd 00000004:spmd 00000004:mpmd]
RECEIVE:[000000f7 00fb:00000000:0000000a 00000001:1 00000001:8 00000011:MP_CC_SCRATCH_BUF 0000000a:ENUMERATED 00000013:Fastest Collectives 00000043:Specify if fastest collective algorithm is used (MP_CC_SCRATCH_BUF) 00000001:0 00000003:yes 00000003:yes 00000002:no]
RECEIVE:[000000fc 00fb:00000000:0000000a 00000001:1 00000001:8 00000010:MP_CSS_INTERRUPT 0000000a:ENUMERATED 0000001b:Packets Generate Interrupts 00000042:Specify if arriving packets generate interrupts (MP_CSS_INTERRUPT) 00000001:0 00000002:no 00000003:yes 00000002:no]
RECEIVE:[000000f3 00fb:00000000:0000000a 00000001:1 00000001:8 00000010:MP_SHARED_MEMORY 0000000a:ENUMERATED 00000011:Use Shared Memory 00000042:Specify is shared memory used for communication (MP_SHARED_MEMORY) 00000001:0 00000003:yes 00000003:yes 00000002:no]
RECEIVE:[000000fa 00fb:00000000:0000000a 00000001:1 00000001:8 00000010:MP_SINGLE_THREAD 0000000a:ENUMERATED 00000011:Single MPI Thread 0000004a:Specify if application has single thread with MPI calls (MP_SINGLE_THREAD) 00000001:0 00000002:no 00000003:yes 00000002:no]
RECEIVE:[0000010a 00fb:00000000:0000000c 00000001:1 00000002:10 0000000c:MP_WAIT_MODE 0000000a:ENUMERATED 00000009:Wait Mode 00000040:Specify thread behavior when waiting for messages (MP_WAIT_MODE) 00000001:0 00000004:poll 00000006:nopoll 00000004:poll 00000005:sleep 00000005:yield]
RECEIVE:[000000eb 00fb:00000000:0000000a 00000001:1 00000001:8 00000011:MP_HINTS_FILTERED 0000000a:ENUMERATED 0000000e:Hints Filtered 0000003c:Specify if MPI info objects reject hints (MP_HINTS_FILTERED) 00000001:0 00000003:yes 00000003:yes 00000002:no]
RECEIVE:[000000ee 00fb:00000000:0000000a 00000001:1 00000001:8 0000000f:MP_CLOCK_SOURCE 0000000a:ENUMERATED 0000000c:Clock Source 00000049:Specify if high performance switch clock is time source (MP_CLOCK_SOURCE) 00000001:0 00000000: 00000000: 00000002:OS]
RECEIVE:[00000110 00fb:00000000:0000000c 00000001:1 00000002:10 0000000a:MP_MSG_API 0000000a:ENUMERATED 00000013:Message Passing API 0000003c:Specify message passing API used by application (MP_MSG_API) 00000001:0 00000003:MPI 00000003:MPI 00000004:LAPI 00000008:MPI_LAPI 00000008:MPI,LAPI]
RECEIVE:[00000017 0000:00000000:00000000]
RECEIVE:[00000072PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:01 T(256) Trace: >>> start_events entered. (Line 851)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:01 T(256) Trace: >>> discover_jobs entered. (Line 4706)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:01 T(256) Trace: <<< discover_jobs exited. (Line 4764)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:11:01 T(256) Trace: <<< start_events exited. (Line 902)
 00dd:00000000:00000006 00000001:0 00000001:1 00000001:1 00000001:2 0000000c:name=default 0000000f:machineState=UP]
RECEIVE:[00000074 00e0:00000000:00000006 00000001:0 00000001:1 00000001:2 00000001:2 0000000c:name=default 00000011:queueState=NORMAL]
sessionCreate(0,0)
bind(0.0.0.0/0.0.0.0:0)
port=1310
accept thread starting...
RECEIVE:[00000071PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> run entered. (Line 957)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace:  'debugArgs=--port=1310
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'debugArgs=--host=9.65.128.101
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'debugArgs=--debugger=gdb-mi
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'MP_HOSTFILE=/home/wootton/hostfile.rh
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'jobSubId=JOB_12242635236360
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'PE_STDOUT_PATH=/tmp/stdout
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'execName=ring
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'execPath=/home/wootton/ptp_demo/linux/ring
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'PE_STDERR_PATH=/tmp/stderr
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'launchedByPTP=true
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'MP_PROCS=2
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'PE_BUFFER_MEM=64M
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'progArgs=40
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'debug=true
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'debugStopInMain=true
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'debugExecName=sdm
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'workingDir=/home/wootton/ptp_demo/linux/ring
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'queueId=2
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace:  'debugExecPath=/home/wootton/ptp_proxy/linux/ganymede_rc1/org.eclipse.ptp.debug.sdm_2.1.0.200810101902
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: '10/17 13:12:07 T(256) Trace: +++ Parsing arguments
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> update_nodes entered. (Line 3278)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> find_node entered. (Line 3321)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Looking for node 'k17sf2p03'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< find_node exited. (Line 3326)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> add_node entered. (Line 3370)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< add_node exited. (Line 3394)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> find_node entered. (Line 3321)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Looking for node 'k17sf2p03'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< find_node exited. (Line 3349)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> find_node entered. (Line 3321)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Looking for node 'k17sf2p03'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< find_node exited. (Line 3349)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> find_node entered. (Line 3321)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Looking for node 'k17sf2p03'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< find_node exited. (Line 3349)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> find_node entered. (Line 3321)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Looking for node 'k17sf2p03'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< find_node exited. (Line 3349)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> find_node entered. (Line 3321)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Looking for node 'k17sf2p03'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< find_node exited. (Line 3349)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> find_node entered. (Line 3321)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Looking for node 'k17sf2p03'
 00de:00000000:00000006 00000001:1 00000001:1 00000001:3 00000001:2 0000000e:name=k17sf2p03 0000000c:nodeState=UP]
RECEIVE:[000000ab 00dc:00000000:00000007 00000001:2 00000001:1 00000001:4 00000001:3 0000001b:jobSubId=JOB_12242635236360 0000001f:name=wootton.JOB_12242635236360 00000010:jobState=STARTED]
RECEIVE:[00000017 0000:00000001:00000000]
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< find_node exited. (Line 3349)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> find_node entered. (Line 3321)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Looking for node 'k17sf2p03'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< find_node exited. (Line 3349)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> find_node entered. (Line 3321)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Looking for node 'k17sf2p03'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< find_node exited. (Line 3349)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> find_node entered. (Line 3321)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Looking for node 'k17sf2p03'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< find_node exited. (Line 3349)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> find_node entered. (Line 3321)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Looking for node 'k17sf2p03'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< find_node exited. (Line 3349)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> find_node entered. (Line 3321)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Looking for node 'k17sf2p03'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< find_node exited. (Line 3349)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< update_nodes exited. (Line 3305)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Setting up stdio pipe descriptors
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ stdout path: /tmp/stdout
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ stderr path: /tmp/stderr
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> setup_stdio_fd entered. (Line 3191)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< setup_stdio_fd exited. (Line 3226)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: stdout FD 0 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> setup_stdio_fd entered. (Line 3191)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< setup_stdio_fd exited. (Line 3226)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: stderr FD 0 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Forking child process
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Creating poe exec() parameter list
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> create_env_array entered. (Line 3133)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< create_env_array exited. (Line 3164)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Setting up poe stdio file descriptors
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> setup_child_stdio entered. (Line 3238)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Ready to invoke top level SDM
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: +++ Created poe process pid 2714 for jobid 4
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: <<< run exited. (Line 1383)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: >>> startup_monitor entered. (Line 1503)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:07 T(256) Trace: Waiting for task config file /tmp/.ppe.2714.attach.cfg
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:09 T(256) Trace: +++ Have task config file
RECEIVE:[00000052PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:09 T(256) Trace: +++ Application has 2 tasks
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:09 T(256) Trace: Processing 
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 0 1 9.114.21.227 k17sf2p03.ppd.pok.ibm.com 2718 2717 /home/wootton/ptp_proxy/linux/ganymede_rc1/org.eclipse.ptp.debug.sdm_2.1.0.200810101902/sdm --debug --debugger=gdb-mi  10/17 13:12:09 T(256) Trace: Processing 
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 1 1 9.114.21.227 k17sf2p03.ppd.pok.ibm.com 2719 2717 /home/wootton/ptp_proxy/linux/ganymede_rc1/org.eclipse.ptp.debug.sdm_2.1.0.200810101902/sdm --debug --debugger=gdb-mi  10/17 13:12:09 T(256) Trace: 
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: Creating routing file
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:09 T(256) Trace: 
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: Error writing routing file: No such file or directory
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:09 T(256) Trace: >>> find_node entered. (Line 3321)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:09 T(256) Trace: +++ Looking for node 'k17sf2p03'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:09 T(256) Trace: <<< find_node exited. (Line 3349)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:09 T(256) Trace: >>> find_node entered. (Line 3321)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:09 T(256) Trace: +++ Looking for node 'k17sf2p03'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:09 T(256) Trace: <<< find_node exited. (Line 3349)
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: 10/17 13:12:09 T(256) Trace: <<< startup_monitor exited. (Line 1793)
 00e6:00000000:00000004 00000001:1 00000001:4 00000001:1 00000010:jobState=RUNNING]
RECEIVE:[00000153 00df:00000000:00000010 00000001:4 00000001:2 00000001:5 00000001:5 0000000b:name=task_0 00000014:processState=RUNNING 0000000f:processNodeId=3 0000000e:processIndex=0 0000000f:processPID=2718 00000001:6 00000001:5 0000000b:name=task_1 00000014:processState=RUNNING 0000000f:processNodeId=3 0000000e:processIndex=1 0000000f:processPID=2719]
Write
debug: waiting for connect
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: effsize: 3, size: 2, rv: 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: Looking for env: 'OMPI_MCA_orte_ess_vpid', value: 'NULL'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: Looking for env: 'OMPI_MCA_ns_nds_vpid', value: 'NULL'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: Looking for env: 'PMI_RANK', value: 'NULL'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: Looking for env: 'MP_CHILD', value: 'NULL'
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] size 3
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] route for 0 is {} 
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] route for 1 is {} 
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] in sdm_create_sockd_map
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_route_get_route dest {0-2}, parent 2
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] adjacent nodes: {0-1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] adding 0 to my map
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] adding 1 to my map
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: effsize: 3, size: 2, rv: 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] nodeID: 0, hostname: k17sf2p03, port: 16378
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] nodeID: 1, hostname: k17sf2p03, port: 16441
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] nodeID: 1, hostname: k17sf2p03, port: 16441
debug: received connected event
accept thread exiting...
event thread starting...
Msg: EventRequestManager - addEventRequest(): Request: Start debugger request in status [UNKNOWN] for {0-1}.
**** Msg: AbstractEventManager - registerEventRequest(): Request: Start debugger request in status [UNKNOWN] for {0-1}.
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Initialization successful
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[1]: starting client
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] DbgClntInit num_svrs=2
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] send_command dest={0-1} cmd= 0001:00000001:00000005 00000005:10000 00000004:ring 00000021:/home/wootton/ptp_demo/linux/ring 00000021:/home/wootton/ptp_demo/linux/ring 00000002:40
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Creating new request #0 expected replies {0-1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_route_get_route dest {0-1}, parent 2
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_send src {2} dest {0-1} route {0-1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Sending len 182 to 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Sending len 182 to 1
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call send_complete
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving sdm_message_send
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] receiving header
RECEIVE:[00000025PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress received len 47 from 1
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress agg=8f34b277 src={1} dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] got upstream message src={1}, dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_aggregate_message: upstream message #0 from {1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] reply updated: src={1} replies outstanding: {0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] creating new reply #8f34b277 for request 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Finished recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] receiving header
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress received len 47 from 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress agg=8f34b277 src={0} dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] got upstream message src={0}, dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_aggregate_message: upstream message #0 from {0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] reply updated: src={0} replies outstanding: {}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] updating reply #8f34b277 with src {0} for request 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Finished recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] request 0 completed for #8f34b277
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] dbg_clnt_cmd_completed src={0-1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter free_request
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving free_request
 006f:00000001:00000001 00000004:2:03]
Msg: SDMEventManager - update(): Event: EVENT_DBG_OK transid=1 2:03
Msg: SDMEventManager - fireEvent(): event EVENT_DBG_OK transid=1 2:03
Msg: SDMEventManager - fireEvent(): added PDIEvent: org.eclipse.ptp.debug.internal.core.pdi.event.ConnectedEvent@269101
Msg: NotifyJob - size of runnables: 1
Msg: NotifyJob - size of runnables: 1
Msg: NotifyJob - size of runnables: 1
**** Msg: AbstractEventManager - notifyEventRequest(): Request: Start debugger request in status [DONE] for {}.
Msg: NotifyJob - size of runnables: 1
Msg: NotifyJob - size of runnables: 1
Msg: NotifyJob - size of runnables: 1
Msg: EventRequestManager - addEventRequest(): Request: Set Function Breakpoint Request in status [UNKNOWN] for {0-1}.
**** Msg: AbstractEventManager - registerEventRequest(): Request: Set Function Breakpoint Request in status [UNKNOWN] for {0-1}.
Msg: EventRequestManager - addEventRequest(): Request: Resume request in status [UNKNOWN] for {0-1}.
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] send_command dest={0-1} cmd= 0003:00000001:00000008 00000001:0 00000001:1 00000001:0 00000000: 00000004:main 00000000: 00000001:0 00000001:0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Creating new request #3 expected replies {0-1}
RECEIVE:[00000025PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_route_get_route dest {0-1}, parent 2
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_send src {2} dest {0-1} route {0-1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Sending len 144 to 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Sending len 144 to 1
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call send_complete
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving sdm_message_send
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] receiving header
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress received len 47 from 1
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress agg=8f34b277 src={1} dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] got upstream message src={1}, dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_aggregate_message: upstream message #3 from {1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] reply updated: src={1} replies outstanding: {0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] creating new reply #8f34b277 for request 3
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Finished recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] receiving header
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress received len 47 from 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress agg=8f34b277 src={0} dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] got upstream message src={0}, dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_aggregate_message: upstream message #3 from {0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] reply updated: src={0} replies outstanding: {}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] updating reply #8f34b277 with src {0} for request 3
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Finished recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] request 3 completed for #8f34b277
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] dbg_clnt_cmd_completed src={0-1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter free_request
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving free_request
 006f:00000001:00000001 00000004:2:03]
Msg: SDMEventManager - update(): Event: EVENT_DBG_OK transid=1 2:03
Msg: SDMEventManager - fireEvent(): event EVENT_DBG_OK transid=1 2:03
**** Msg: AbstractEventManager - notifyEventRequest(): Request: Set Function Breakpoint Request in status [DONE] for {}.
**** Msg: AbstractEventManager - registerEventRequest(): Request: Resume request in status [UNKNOWN] for {0-1}.
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] send_command dest={0-1} cmd= 000a:00000001:00000000
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Creating new request #6 expected replies {0-1}
RECEIVE:[00000025PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_route_get_route dest {0-1}, parent 2
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_send src {2} dest {0-1} route {0-1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Sending len 55 to 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Sending len 55 to 1
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call send_complete
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving sdm_message_send
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] receiving header
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress received len 47 from 1
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress agg=8f34b277 src={1} dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] got upstream message src={1}, dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_aggregate_message: upstream message #6 from {1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] reply updated: src={1} replies outstanding: {0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] creating new reply #8f34b277 for request 6
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Finished recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] receiving header
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress received len 47 from 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress agg=8f34b277 src={0} dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] got upstream message src={0}, dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_aggregate_message: upstream message #6 from {0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] reply updated: src={0} replies outstanding: {}
 006f:00000001:00000001 00000004:2:03]
Msg: SDMEventManager - update(): Event: EVENT_DBG_OK transid=1 2:03
Msg: SDMEventManager - fireEvent(): event EVENT_DBG_OK transid=1 2:03
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] updating reply #8f34b277 with src {0} for request 6
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Finished recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] request 6 completed for #8f34b277
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] dbg_clnt_cmd_completed src={0-1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter free_request
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving free_request
Msg: NotifyJob - size of runnables: 1
Msg: SDMEventManager - fireEvent(): added PDIEvent: org.eclipse.ptp.debug.internal.core.pdi.event.ResumedEvent@843edc
Msg: NotifyJob - size of runnables: 1
Msg: NotifyJob - size of runnables: 1
Msg: NotifyJob - size of runnables: 1
**** Msg: AbstractEventManager - notifyEventRequest(): Request: Resume request in status [DONE] for {}.
Msg: NotifyJob - size of runnables: 1
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] receiving header
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress received len 157 from 1
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress agg=03ff3722 src={1} dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] got upstream message src={1}, dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_aggregate_message: upstream message #6 from {1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_aggregate_message: message is unsolicited
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Creating new request #6 expected replies {0-1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] reply updated: src={1} replies outstanding: {0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] creating new reply #3ff3722 for request 6
RECEIVE:[00000093 0071:00000001:0000000a 00000004:2:03 00000001:3 00000001:0 00000000: 00000004:main 0000000a:0x10000970 00000001:0 00000001:1 00000001:1 00000001:0]
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Finished recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] receiving header
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress received len 157 from 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress agg=03ff3722 src={0} dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] got upstream message src={0}, dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_aggregate_message: upstream message #6 from {0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] reply updated: src={0} replies outstanding: {}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] updating reply #3ff3722 with src {0} for request 6
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving recv_callback
Msg: SDMEventManager - update(): Event: EVENT_DBG_SUSPEND transid=113 2:03 0 :main:0:268437872
Msg: SDMEventManager - fireEvent(): event EVENT_DBG_SUSPEND transid=113 2:03 0 :main:0:268437872
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Finished recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] request 6 completed for #3ff3722
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] dbg_clnt_cmd_completed src={0-1}
Msg: NotifyJob - size of runnables: 1
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter free_request
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving free_request
================= TIME RESUME: 1224263532581
Msg: SDMEventManager - fireEvent(): added PDIEvent: org.eclipse.ptp.debug.internal.core.pdi.event.SuspendedEvent@e33b57
Msg: EventRequestManager - addEventRequest(): Request: Get info thread request in status [UNKNOWN] for {0}.
**** Msg: AbstractEventManager - registerEventRequest(): Request: Get info thread request in status [UNKNOWN] for {0}.
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] send_command dest={0} cmd= 0015:00000001:00000000
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Creating new request #11 expected replies {0}
RECEIVE:[00000046PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_route_get_route dest {0}, parent 2
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_send src {2} dest {0} route {0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Sending len 55 to 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call send_complete
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving sdm_message_send
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] receiving header
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress received len 80 from 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress agg=b329560a src={0} dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] got upstream message src={0}, dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_aggregate_message: upstream message #11 from {0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] reply updated: src={0} replies outstanding: {}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] creating new reply #b329560a for request 11
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Finished recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] request 11 completed for #b329560a
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] dbg_clnt_cmd_completed src={0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter free_request
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving free_request
 0072:00000001:00000004 00000004:2:01 00000001:1 00000001:1 00000001:2]
Msg: SDMEventManager - update(): Event: EVENT_DBG_THREADS: transid=1 2:01 {1, 2}
Msg: SDMEventManager - fireEvent(): event EVENT_DBG_THREADS: transid=1 2:01 {1, 2}
**** Msg: AbstractEventManager - notifyEventRequest(): Request: Get info thread request in status [DONE] for {}.
Msg: EventRequestManager - addEventRequest(): Request: Retrieve stack info depth request in status [UNKNOWN] for {0}.
**** Msg: AbstractEventManager - registerEventRequest(): Request: Retrieve stack info depth request in status [UNKNOWN] for {0}.
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] send_command dest={0} cmd= 0017:00000001:00000000 0000
RECEIVE:[00000030 0074:00000001:00000002 00000004:2:01 00000001:1]
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Creating new request #13 expected replies {0}
Msg: SDMEventManager - update(): Event: EVENT_DBG_STACK_INFO_DEPTH transid=1 2:01
Msg: SDMEventManager - fireEvent(): event EVENT_DBG_STACK_INFO_DEPTH transid=1 2:01
**** Msg: AbstractEventManager - notifyEventRequest(): Request: Retrieve stack info depth request in status [DONE] for {}.
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_route_get_route dest {0}, parent 2
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_send src {2} dest {0} route {0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Sending len 55 to 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call send_complete
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving sdm_message_send
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] receiving header
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress received len 58 from 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress agg=3928f9a1 src={0} dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] got upstream message src={0}, dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_aggregate_message: upstream message #13 from {0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] reply updated: src={0} replies outstanding: {}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] creating new reply #3928f9a1 for request 13
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving recv_callback
Msg: EventRequestManager - addEventRequest(): Request: List stack frames request in status [UNKNOWN] for {0}.
**** Msg: AbstractEventManager - registerEventRequest(): Request: List stack frames request in status [UNKNOWN] for {0}.
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Finished recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] request 13 completed for #3928f9a1
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] dbg_clnt_cmd_completed src={0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter free_request
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving free_request
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] send_command dest={0} cmd= 000e:00000001:00000002 00000001:0 00000001:11:00000
RECEIVE:[00000072 0069:00000001:00000007 00000004:2:01 00000001:1 00000001:0 00000000: 00000004:main 0000000a:0x10000970 00000001:0]
Msg: SDMEventManager - update(): Event: EVENT_DBG_FRAMES transid=1 2:01
 0 :main:0:268437872
Msg: SDMEventManager - fireEvent(): event EVENT_DBG_FRAMES transid=1 2:01
 0 :main:0:268437872
**** Msg: AbstractEventManager - notifyEventRequest(): Request: List stack frames request in status [DONE] for {}.
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Creating new request #15 expected replies {0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_route_get_route dest {0}, parent 2
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_send src {2} dest {0} route {0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Sending len 77 to 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call send_complete
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving sdm_message_send
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] receiving header
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress received len 124 from 0
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress agg=affecc0a src={0} dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] got upstream message src={0}, dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_aggregate_message: upstream message #15 from {0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] reply updated: src={0} replies outstanding: {}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] creating new reply #affecc0a for request 15
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Finished recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] request 15 completed for #affecc0a
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] dbg_clnt_cmd_completed src={0}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter free_request
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving free_request
Msg: NotifyJob - size of runnables: 8
Msg: EventRequestManager - addEventRequest(): Request: List stack frames request in status [UNKNOWN] for {1}.
**** Msg: AbstractEventManager - registerEventRequest(): Request: List stack frames request in status [UNKNOWN] for {1}.
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] send_command dest={1} cmd= 000e:00000001:00000002 00000001:1 00000001:11:00000
RECEIVE:[0000007fPE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Creating new request #17 expected replies {1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_route_get_route dest {1}, parent 2
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_send src {2} dest {1} route {1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Sending len 77 to 1
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call send_complete
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving sdm_message_send
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] receiving header
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress received len 137 from 1
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_message_progress agg=12bded8d src={1} dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] About to call recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] got upstream message src={1}, dest={2}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] sdm_aggregate_message: upstream message #17 from {1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] reply updated: src={1} replies outstanding: {}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] creating new reply #12bded8d for request 17
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Finished recv_callback
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] request 17 completed for #12bded8d
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] dbg_clnt_cmd_completed src={1}
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Enter free_request
PE@xxxxxxxxxxxxxxxxxxxxxxxxx: SDM[2]: [2] Leaving free_request
 0070:00000001:00000003 00000004:2:02 00000001:4 00000045:Debugger error: mi_cmd_stack_list_frames: Not enough frames in stack.]
Msg: SDMEventManager - update(): Event: EVENT_DBG_ERROR transid=1 2:02 4 Debugger error: mi_cmd_stack_list_frames: Not enough frames in stack.
Msg: SDMEventManager - fireEvent(): event EVENT_DBG_ERROR transid=1 2:02 4 Debugger error: mi_cmd_stack_list_frames: Not enough frames in stack.
Msg: SDMEventManager - fireEvent(): added PDIEvent: org.eclipse.ptp.debug.internal.core.pdi.event.ErrorEvent@fa5e8f
Msg: NotifyJob - size of runnables: 1
Msg: NotifyJob - size of runnables: 5
**** Msg: AbstractEventManager - notifyEventRequest(): Request: List stack frames request in status [DONE] for {}.

Follow-Ups:
- Re: [ptp-dev] Problem with invoking SDM debugger on pSeries Linux
  - From: Dave Wootton

References:
- [ptp-dev] Problem with invoking SDM debugger on pSeries Linux
  - From: Dave Wootton

Prev by Date: Re: [ptp-dev] Long delays opening resource manager wizard
Next by Date: [ptp-dev] Hello every dev.
Previous by thread: [ptp-dev] Problem with invoking SDM debugger on pSeries Linux
Next by thread: Re: [ptp-dev] Problem with invoking SDM debugger on pSeries Linux
Index(es):
- Date
- Thread

Breadcrumbs