I do not have the full platform code to
test. How can I easily test that patches do not break anything for
the Platform performance tests. I thought they were not run
anymore.
Thanks,
On 04/22/2014 09:39 AM, David M Williams wrote:
Patches would be most
welcome. I was trying
to make the point that it's not supported "as much" as the
Platform
itself.
Naturally, demonstrating the
patches
not only work for you, but also (still) work for Eclipse
Platform would
be important. For some patches, that might be obvious? But, for
others,
it might require someone having some test cases, or
demonstrating the performance
tests for the Platform still work.
Thanks,
From:
Geneviève Bastien
<gbastien+lttng@xxxxxxxxxxxx>
To:
platform-releng-dev@xxxxxxxxxxx,
Date:
04/22/2014 09:33 AM
Subject:
Re:
[platform-releng-dev]
Status of the performance test project
Sent by:
platform-releng-dev-bounces@xxxxxxxxxxx
Hi David,
Thanks for your detailed answer and sorry about taking so long
to come
back to you. I've just recently had time to look at the
performance test
and really I think it's very interested. It does about 90% of
what we want
it to do (the core part that is, the .ui plug-in has a lot of
hard-coded
values and I couldn't make it work at all [yet] for our
project).
We'd like to use it to keep track of the performance of our
project (linuxtools-lttng),
possibly on our own hardware, but the students working with us
will also
want to use it to get performance statistics from different
version of
their algorithms. They will have some more needs, like keeping
the results
of all iterations, not just average and standard deviation.
Can we contribute to the org.eclipse.test.performance and
org.eclipse.test.performance.ui
plug-ins? Will patches be reviewed in good time? The "degree of
support"
worries me a bit. And is this the right place to discuss these
plugins
or should I bring this discussion to another mailing list?
Thanks,
--
Geneviève Bastien
Research Associate
École Polytechnique de Montréal
On 03/31/2014 11:06 PM, David M Williams wrote:
You are correct we have not used
in
a few years. But, it is our intent to again.
That said, it's "degree of support" has never been great. See,
for example, this old bug from 2008,
Bug
246613 - [results]
performance test plugin
has hard coded values specific to Platform
That bug's history is not all bad news ... its just not great
news. In
an ideal world some interested parties could join forces and
improve that
to the point it could become part of "CBI" or similar ... but,
I honestly do not know how much work that would be, or if there
are other
or better alternatives, or "more trouble than its worth"?
You obviously found org.eclipse.test.performance
but its companion org.eclipse.test.performance.ui
may not be so easy
to find.
It is now in the platform/eclipse.platform.releng.buildtools
repository.
We don't currently
build it, and it has some minor compile or pre-req issues, last
I had time
to look, 2 years ago.
I know there is definitely others interested: Matthias Mailänder
recently
moved the "how to" html from the plugin, to the wiki (bug
390820).
Its currently at https://wiki.eclipse.org/Performance/Automated_Tests
There is an "umbrella bug" that tracks many other "to do"
items, see bug
374441.
This is an area I plan to work on soon, so if others are too,
would love
to hear what you've learned ... or you might contribute or at
least comment
in bug
374441.
Sorry I don't have more specifics at the moment. Glad to hear
you think
it might be useful.
Thanks,
From: Geneviève
Bastien <gbastien+lttng@xxxxxxxxxxxx>
To: platform-releng-dev@xxxxxxxxxxx,
Date: 03/31/2014
08:34 PM
Subject: [platform-releng-dev]
Status
of the performance test project
Sent by: platform-releng-dev-bounces@xxxxxxxxxxx
Hi all,
I am a developer on the linuxtools Eclipse plug-in and I am
looking into
a way to make automatic benchmarks for some parts of the
application and
save the results to be able to see how the application
develops.
I was looking at the org.eclipse.test.performance plugin,
which sounds
about right for our needs. But I see it hasn't been developed
much in
the last few years. Is it still supported? Or has something
else
replaced it for performance testing and keeping (and
eventually
visualizing) benchmark data?
Thanks,
Geneviève Bastien
_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev
_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev
_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev
_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev
|