Eclipse Community Forums: Eclipse Foundation

Home » General (non-technical) » Eclipse Foundation » Eclipse test-suite

Mon, 04 August 2008 07:58

Eclipse User

Hello everyone!

Could anybody give me a link to the whole test-suite that is used for
releasing the Eclipse IDE?

At this page of eclipsepedia
--http://wiki.eclipse.org/Automated_Testing#Correctness_test s --
It is explained how to run the Eclipse tests and short list of plugins
(not all though) that I will likely need for this.

However, there is no link to how to download and install these plugins. I
failed to find the plugins by myself: I have found them in CVS repository
but not in downloadable form. So do they exist in a public available
binary form?

Thanx,
Nikita

Re: Eclipse test-suite [message #55520 is a reply to message #55493]

Tue, 05 August 2008 03:40

Eclipse User

Nikita Lipsky wrote:
> Hello everyone!
>
> Could anybody give me a link to the whole test-suite that is used for
> releasing the Eclipse IDE?
> At this page of eclipsepedia
> --http://wiki.eclipse.org/Automated_Testing#Correctness_test s --
> It is explained how to run the Eclipse tests and short list of plugins
> (not all though) that I will likely need for this.
>
> However, there is no link to how to download and install these
> plugins. I failed to find the plugins by myself: I have found them in
> CVS repository but not in downloadable form. So do they exist in a
> public available binary form?
Each download page contains different downloads. Among them are normally
also the tests.
e.g.
http://download.eclipse.org/eclipse/downloads/drops/R-3.4-20 0806172000/index.php

Dani
>
> Thanx,
> Nikita
>
>
>
>
>

Re: Eclipse test-suite [message #55599 is a reply to message #55520]

Wed, 06 August 2008 04:54

Eclipse User

Thank you very much!

It is exactly what I was looking for :)

--Nikita

"Daniel Megert" <daniel_megert@ch.ibm.com> wrote in message
news:g7904k$6a0$1@build.eclipse.org...
> Nikita Lipsky wrote:
>> Hello everyone!
>>
>> Could anybody give me a link to the whole test-suite that is used for
>> releasing the Eclipse IDE?
>> At this page of
>> eclipsepedia --http://wiki.eclipse.org/Automated_Testing#Correctness_test s
>> --
>> It is explained how to run the Eclipse tests and short list of plugins
>> (not all though) that I will likely need for this.
>>
>> However, there is no link to how to download and install these plugins.
>> I failed to find the plugins by myself: I have found them in CVS
>> repository but not in downloadable form. So do they exist in a public
>> available binary form?
> Each download page contains different downloads. Among them are normally
> also the tests.
> e.g.
> http://download.eclipse.org/eclipse/downloads/drops/R-3.4-20 0806172000/index.php
>
> Dani
>>
>> Thanx,
>> Nikita
>>
>>
>>
>>
>>

Re: Eclipse test-suite [message #55626 is a reply to message #55520]

Thu, 07 August 2008 05:53

Eclipse User

Hello again,

Ok, I have passed the tests and got 44 .html files with results. Is there
any way to combine them together to see overall results in one html file
like
http://download.eclipse.org/eclipse/downloads/drops/R-3.4-20 0806172000/testResults.php ?

There are some failures in results. There is a note in results "failures are
anticipated and checked for with assertions while errors are unanticipated."
So should I think that test passes if it fails by failure not by error?

Is there a way to pass a test (not a group of tests) separately? Do I need
check out the test or the group of tests from CVS for this? Is there any GUI
(plug-in to Eclipse?) for running tests separately and configuring them like
JCK JavaTest harness?

Regards,
--Nikita

"Daniel Megert" <daniel_megert@ch.ibm.com> wrote in message
news:g7904k$6a0$1@build.eclipse.org...
> Nikita Lipsky wrote:
>> Hello everyone!
>>
>> Could anybody give me a link to the whole test-suite that is used for
>> releasing the Eclipse IDE?
>> At this page of
>> eclipsepedia --http://wiki.eclipse.org/Automated_Testing#Correctness_test s
>> --
>> It is explained how to run the Eclipse tests and short list of plugins
>> (not all though) that I will likely need for this.
>>
>> However, there is no link to how to download and install these plugins.
>> I failed to find the plugins by myself: I have found them in CVS
>> repository but not in downloadable form. So do they exist in a public
>> available binary form?
> Each download page contains different downloads. Among them are normally
> also the tests.
> e.g.
> http://download.eclipse.org/eclipse/downloads/drops/R-3.4-20 0806172000/index.php
>
> Dani
>>
>> Thanx,
>> Nikita
>>
>>
>>
>>
>>

Re: Eclipse test-suite [message #55658 is a reply to message #55626]

Mon, 11 August 2008 04:08

Eclipse User

Nikita Lipsky wrote:
> Hello again,
>
> Ok, I have passed the tests and got 44 .html files with results. Is
> there any way to combine them together to see overall results in one
> html file like
> http://download.eclipse.org/eclipse/downloads/drops/R-3.4-20 0806172000/testResults.php
> ?
>
> There are some failures in results. There is a note in results
> "failures are anticipated and checked for with assertions while errors
> are unanticipated." So should I think that test passes if it fails by
> failure not by error?
Do you have a concrete example? Normally the test should either be green
or red but might log some errors in the console even if the test itself
is green.
>
> Is there a way to pass a test (not a group of tests) separately? Do I
> need check out the test or the group of tests from CVS for this? Is
> there any GUI (plug-in to Eclipse?) for running tests separately and
> configuring them like JCK JavaTest harness?
AFAIK there's no GUI.

You might find some answers here:
http://wiki.eclipse.org/index.php/Platform-releng-faq

Dani
>
> Regards,
> --Nikita
>
>
>
> "Daniel Megert" <daniel_megert@ch.ibm.com> wrote in message
> news:g7904k$6a0$1@build.eclipse.org...
>> Nikita Lipsky wrote:
>>> Hello everyone!
>>>
>>> Could anybody give me a link to the whole test-suite that is used
>>> for releasing the Eclipse IDE?
>>> At this page of eclipsepedia
>>> --http://wiki.eclipse.org/Automated_Testing#Correctness_test s --
>>> It is explained how to run the Eclipse tests and short list of
>>> plugins (not all though) that I will likely need for this.
>>>
>>> However, there is no link to how to download and install these
>>> plugins. I failed to find the plugins by myself: I have found them
>>> in CVS repository but not in downloadable form. So do they exist in
>>> a public available binary form?
>> Each download page contains different downloads. Among them are
>> normally also the tests.
>> e.g.
>> http://download.eclipse.org/eclipse/downloads/drops/R-3.4-20 0806172000/index.php
>>
>>
>> Dani
>>>
>>> Thanx,
>>> Nikita
>>>
>>>
>>>
>>>
>>>
>

Re: Eclipse test-suite [message #55681 is a reply to message #55658]

Tue, 12 August 2008 03:58

Eclipse User

"Daniel Megert" <daniel_megert@ch.ibm.com> wrote in message
news:g7os1d$3fr$1@build.eclipse.org...

>> There are some failures in results. There is a note in results "failures
>> are anticipated and checked for with assertions while errors are
>> unanticipated." So should I think that test passes if it fails by failure
>> not by error?
> Do you have a concrete example? Normally the test should either be green
> or red but might log some errors in the console even if the test itself is
> green.

See for instance this link:
http://download.eclipse.org/eclipse/downloads/drops/R-3.4-20 0806172000/testresults/html/org.eclipse.releng.tests_linux.g tk.x86.html

There is 1 failtire, sucess rate 80%, however it is reported in the overall
page as all-passed: "(0)"

> You might find some answers here:
> http://wiki.eclipse.org/index.php/Platform-releng-faq
>
Thank you, I will check it.

Regards,
Nikita

Re: Eclipse test-suite [message #55708 is a reply to message #55681]

Tue, 12 August 2008 04:21

Eclipse User

Nikita Lipsky wrote:
>
> "Daniel Megert" <daniel_megert@ch.ibm.com> wrote in message
> news:g7os1d$3fr$1@build.eclipse.org...
>
>>> There are some failures in results. There is a note in results
>>> "failures are anticipated and checked for with assertions while
>>> errors are unanticipated." So should I think that test passes if it
>>> fails by failure not by error?
>> Do you have a concrete example? Normally the test should either be
>> green or red but might log some errors in the console even if the
>> test itself is green.
>
> See for instance this link:
> http://download.eclipse.org/eclipse/downloads/drops/R-3.4-20 0806172000/testresults/html/org.eclipse.releng.tests_linux.g tk.x86.html
>
>
> There is 1 failtire, sucess rate 80%, however it is reported in the
> overall page as all-passed: "(0)"
Yes, that was "fixed" manually on the main page(s) because the reported
error was known/intended. This is also done when a test fails for
unknown reasons and a rerun makes the failure go away: instead of doing
a full rebuild the pages are adjusted manually.

Dani
>
>> You might find some answers here:
>> http://wiki.eclipse.org/index.php/Platform-releng-faq
>>
> Thank you, I will check it.
>
> Regards,
> Nikita

Previous Topic:	RCP Webinar - Aug. 26
Next Topic:	A Second RCP Webinar - Sep. 4

Goto Forum:

-=] Back to Top [=-

Current Time: Fri Apr 25 21:07:53 EDT 2025

.:: Contact :: Home ::.

Breadcrumbs

Sign up to our Newsletter