| TPTP test automation [message #15106] |
Mon, 11 April 2005 17:35  |
Eclipse User |
|
|
|
Looks like TPTP provides a platform for our performance profiling and
testing needs... is there anyway/API to automate the configuration, app
launching, and data exporting in TPTP? Any ideas or pointers would be great.
Thanks!
-yu
|
|
|
| Re: TPTP test automation [message #15120 is a reply to message #15106] |
Mon, 11 April 2005 18:49  |
| Eclipse User |
|
|
|
Yu Chen wrote:
> Looks like TPTP provides a platform for our performance profiling and
> testing needs... is there anyway/API to automate the configuration, app
> launching, and data exporting in TPTP? Any ideas or pointers would be great.
>
> Thanks!
> -yu
>
>
Hello Yu,
I'm currently working on a new feature (enhancement request
bugzilla_74805) in TPTP for release 3.3 and 4.0 -- it provides a new
TPTP public automation framework/API. For 3.3 and 4.0 only test
execution automatable services will be provided.
For example, and end-user of TPTP can execute a test defined by TPTP
(such as a JUnit or URL test, or other TPTP adopting product downstream
test type) headlessly from outside of Eclipse/TPTP [or programmatically
from within Eclipse]. The command and request of automatable services
will be supported in base TPTP via any of the following use-cases:
1. A simple Java API
2. A command file, shell script helper (for Windows and Unix/Linux)
3. A human-readable XML document specification via the launch
command-line (through an embedded XML document or external XML
document file, both conforming to the defined and provided XML
schema)
4. Through an ant script using a small set of ant tasks
provided via a TPTP antlib (for example, an ant script could be
written that executes tests in a fashion similar to the ant JUnit
test task)
The automation framework is a general framework and will allow any
Eclipse automatable service (a simple Java class that conforms to a
given service interface) to be executed programmatically via a service
identifier, an automation command and a set of name/value pairs. This
framework will be in its first release in 3.3 and 4.0 but hopefully it
will be made increasingly more robust in future releases.
Please e-mail me directly if you would like more information and/or
details (or have comments or suggestions for future versions of this
feature), thanks!
-Scott E. Schneider
IBM Rational, Raleigh, NC
scott.schneider@us.ibm.com
|
|
|
| Re: TPTP test automation [message #15302 is a reply to message #15120] |
Tue, 12 April 2005 13:47 |
| Eclipse User |
|
|
|
I am currently trying to figure out.
- Any web tools integrated with eclipse platform for
web-based reporting?
- Can we have views of data from multiple runs?
For example, if I want to run the same program 100 times with a steady
increment of one profiling param, how would I use TPTP to view the result,
in a tabular or graphical view? Can this be done in TPTP?
Any info would be greatly appreciated.
-Yu
"Scott E. Schneider" <scott.schneider@us.ibm.com> wrote in message
news:425AFF13.4060000@us.ibm.com...
> Yu Chen wrote:
>> Looks like TPTP provides a platform for our performance profiling and
>> testing needs... is there anyway/API to automate the configuration, app
>> launching, and data exporting in TPTP? Any ideas or pointers would be
>> great.
>>
>> Thanks!
>> -yu
>
>
> Hello Yu,
>
> I'm currently working on a new feature (enhancement request
> bugzilla_74805) in TPTP for release 3.3 and 4.0 -- it provides a new TPTP
> public automation framework/API. For 3.3 and 4.0 only test execution
> automatable services will be provided.
>
> For example, and end-user of TPTP can execute a test defined by TPTP (such
> as a JUnit or URL test, or other TPTP adopting product downstream test
> type) headlessly from outside of Eclipse/TPTP [or programmatically from
> within Eclipse]. The command and request of automatable services will be
> supported in base TPTP via any of the following use-cases:
>
> 1. A simple Java API
>
> 2. A command file, shell script helper (for Windows and Unix/Linux)
>
> 3. A human-readable XML document specification via the launch
> command-line (through an embedded XML document or external XML
> document file, both conforming to the defined and provided XML
> schema)
>
> 4. Through an ant script using a small set of ant tasks
> provided via a TPTP antlib (for example, an ant script could be
> written that executes tests in a fashion similar to the ant JUnit
> test task)
>
> The automation framework is a general framework and will allow any Eclipse
> automatable service (a simple Java class that conforms to a given service
> interface) to be executed programmatically via a service identifier, an
> automation command and a set of name/value pairs. This framework will be
> in its first release in 3.3 and 4.0 but hopefully it will be made
> increasingly more robust in future releases.
>
> Please e-mail me directly if you would like more information and/or
> details (or have comments or suggestions for future versions of this
> feature), thanks!
>
> -Scott E. Schneider
> IBM Rational, Raleigh, NC
> scott.schneider@us.ibm.com
|
|
|
| Re: TPTP test automation [message #15368 is a reply to message #15302] |
Tue, 12 April 2005 16:19 |
| Eclipse User |
|
|
|
Hi Yu,
In TPTP we don't have yet any capability (view or report generator) to
merge/diff several trace agents (the resources where we capture the
profiling data).
There is some reporting capability in the Test arena (for execution results
resources) and Scott mentioned that he would provide an automated way to run
testcases.
To profile the same application for 100 times and also change a profiling
param (can you be more specific about this one) you could run the
application in profile mode (by passing -XrunPiAgent argument and also the
right filters) from an ANT or shell script and collect the traces in
separate files (you can pass the trace file name as part of -XrunPiAgent
argument), then import the files in the TPTP workbench.
If you want to import the trace files in headless mode take a look at
/org.eclipse.tptp.platform.models/tests/org/eclipse/hyades/m odels/tests/Mode
lTests.java headless application.
Please let me know if you need more info.
Regards,
Marius
"Yu Chen" <yuchen@bea.com> wrote in message
news:d3h1u2$42q$1@news.eclipse.org...
> I am currently trying to figure out.
> - Any web tools integrated with eclipse platform for
> web-based reporting?
> - Can we have views of data from multiple runs?
>
> For example, if I want to run the same program 100 times with a
steady
> increment of one profiling param, how would I use TPTP to view the result,
> in a tabular or graphical view? Can this be done in TPTP?
>
> Any info would be greatly appreciated.
>
> -Yu
>
> "Scott E. Schneider" <scott.schneider@us.ibm.com> wrote in message
> news:425AFF13.4060000@us.ibm.com...
> > Yu Chen wrote:
> >> Looks like TPTP provides a platform for our performance profiling and
> >> testing needs... is there anyway/API to automate the configuration, app
> >> launching, and data exporting in TPTP? Any ideas or pointers would be
> >> great.
> >>
> >> Thanks!
> >> -yu
> >
> >
> > Hello Yu,
> >
> > I'm currently working on a new feature (enhancement request
> > bugzilla_74805) in TPTP for release 3.3 and 4.0 -- it provides a new
TPTP
> > public automation framework/API. For 3.3 and 4.0 only test execution
> > automatable services will be provided.
> >
> > For example, and end-user of TPTP can execute a test defined by TPTP
(such
> > as a JUnit or URL test, or other TPTP adopting product downstream test
> > type) headlessly from outside of Eclipse/TPTP [or programmatically from
> > within Eclipse]. The command and request of automatable services will
be
> > supported in base TPTP via any of the following use-cases:
> >
> > 1. A simple Java API
> >
> > 2. A command file, shell script helper (for Windows and Unix/Linux)
> >
> > 3. A human-readable XML document specification via the launch
> > command-line (through an embedded XML document or external XML
> > document file, both conforming to the defined and provided XML
> > schema)
> >
> > 4. Through an ant script using a small set of ant tasks
> > provided via a TPTP antlib (for example, an ant script could be
> > written that executes tests in a fashion similar to the ant JUnit
> > test task)
> >
> > The automation framework is a general framework and will allow any
Eclipse
> > automatable service (a simple Java class that conforms to a given
service
> > interface) to be executed programmatically via a service identifier, an
> > automation command and a set of name/value pairs. This framework will
be
> > in its first release in 3.3 and 4.0 but hopefully it will be made
> > increasingly more robust in future releases.
> >
> > Please e-mail me directly if you would like more information and/or
> > details (or have comments or suggestions for future versions of this
> > feature), thanks!
> >
> > -Scott E. Schneider
> > IBM Rational, Raleigh, NC
> > scott.schneider@us.ibm.com
>
>
|
|
|
Powered by
FUDForum. Page generated in 0.03888 seconds
Home