RE: [wtp-releng] Perf tests on M5 and later

[David M Williams <david_williams@xxxxxxxxxx>]

Yes, I can give some hints. 
Assuming you use the "wtp.perf"
distribution in releng.wtpbuilder ... 
I see it using the dependancies in the
releng map files. 
When we switched to the split-up emf zips,
the emf runtime was left with an ID of emf
and a new one added for the xsd info set
with an ID of emfxsd ... so, the following needs to be 
added to the "setup" target
in the build.xml. I've released this change to head ... but not sure if/how/where
you can version it to make it part of your M5 run. 

      <antcall
target="getAndInstall">
          <param
           
  name="groupId"
           
  value="emfxsd"
/>
          <param
           
  name="clean"
           
  value="true"
/>
      </antcall>

Thanks,

From:	"Raev, Kaloyan" <kaloyan.raev@xxxxxxx>
To:	"Webtools releng discussion list" <wtp-releng@xxxxxxxxxxx>
Date:	04/07/2008 11:47 AM
Subject:	RE: [wtp-releng] Perf tests on M5 and later

---

One step ahead...

The described performance tests plugins cannot be started, because they
depend (indirectly) on the org.eclipse.xsd plugin, which is not
available in the target installation. It turns out that the perf test
procudure extracts only the emf-runtime.zip, but not the
xsd-runtime.zip. 

As far as I remember the old emf-xsd-sdo.zip has been split to
emf-runtime.zip, xsd-runtime.zip, etc. starting M5. But the perf test
script does not reflect this change correctly. 

David, can you give some hints on this?

Greetings,
Kaloyan
 

-----Original Message-----
From: wtp-releng-bounces@xxxxxxxxxxx
[mailto:wtp-releng-bounces@xxxxxxxxxxx]
On Behalf Of Raev, Kaloyan
Sent: Wednesday, April 02, 2008 7:38 PM
To: Webtools releng discussion list
Subject: [wtp-releng] Perf tests on M5 and later

Hello, this mail is a follow-up from the last status call:
http://wiki.eclipse.org/WTP_2008-03-27

There I mentioned that the perf test procedure experience problems (new
one) with M5 and later builds. Perf results can be seen here:
http://download.eclipse.org/webtools/downloads/drops/R3.0/S-3.0M5-200802
18021547/perfresults/graph/performance.php

There are some test groups that failed executing. Reasons:
                
Could not find plugin "org.eclipse.wst.xsd.tests.performance"
                
Could not find plugin "org.eclipse.wst.wsdl.tests.performance"
                
Could not find plugin "org.eclipse.jst.ws.tests.performance"
                
Could not find plugin
"org.eclipse.jst.j2ee.core.tests.performance"

It is strange that the above plugins are actually in the plug-in
directory of the installation and they should be found with no problem.

Another issue is that there are some tests that prints lots of messages
to System.out: total of ~1,500,000 lines or ~120 MB. The tests are:
                
org.eclipse.wst.common.tests.performance.internal.CleanBuildTestCase 
                
org.eclipse.jst.server.tomcat.tests.performance.tomcat50.AllTests
                
org.eclipse.wst.html.ui.tests.performance.scalability.Validate1KBFileTes
tCase
I guess this is the reason that the perf test procedure takes three
times more than normal. The pattern of all of the dumps is: "<timestamp>
<some_id> TestValidator3 <something>". 

Here is the console log (~120 MB) for reference:
http://download.eclipse.org/webtools/downloads/drops/R3.0/S-3.0M5-200802
18021547/perfresults/consolelogs/wtpperflog.txt

I hope someone have an idea why the above issues happen and give me a
hand on finding solution. 

Greetings,
Kaloyan Raev
Eclipse WTP Committer
<http://www.eclipse.org/webtools/people/person.php?name=raev>
Senior Developer
NW C JS TOOLS JEE (BG)
SAP Labs Bulgaria
T +359/2/9157-416
mailto:kaloyan.raev@xxxxxxx
www.sap.com

P Save a tree - please do not print this email unless you really need
to! 

_______________________________________________
wtp-releng mailing list
wtp-releng@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/wtp-releng
_______________________________________________
wtp-releng mailing list
wtp-releng@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/wtp-releng