Re: [platform-releng-dev] ANN: Performance test infrastructure HowTo, Pa

[Andre Weinand <eclipse@xxxxxxxxxxx>]

Rafael,

> In the first part of the how-to, tests should do several calls to
> start/stop and only then do the assertion. In the second part, it seems the
> way of obtaining more accurate data by repeated measurements is by running
> Eclipse several times, and assertion enablement is done externaly by
> tweaking the perf_ctrl system property. Is this something everybody is
> supposed to arrange in their own test scripts (as I believe Christof
> suggested before), or is RelEng going to do multiple runs of all
> performance tests setting the property properly for each run (I guess not)?

Yes, I agree, we should do the latter, that is automatically run 
session test multiple times and set the perf_ctrl property 
accordingly. However, since support for this is not yet available, 
we'll have to arrange our test scripts until a better solution is in 
place.

Thanks,
--andre