[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
[
List Home]
|
Re: [linuxtools-dev] Announcement: SWTBot tests
|
And one question: When will we see swtbot debug output disabled again?
8 MB of useless output always makes it really hard when someone tries to go through the warning for spotting some obvious problems that went in.
Alexander Kurtakov
Red Hat Eclipse team
----- Original Message -----
> From: "Aleksandar Kurtakov" <akurtako@xxxxxxxxxx>
> To: "Linux Tools developer discussions" <linuxtools-dev@xxxxxxxxxxx>
> Sent: Saturday, September 27, 2014 10:49:14 AM
> Subject: Re: [linuxtools-dev] Announcement: SWTBot tests
>
> ----- Original Message -----
> > From: "Aleksandar Kurtakov" <akurtako@xxxxxxxxxx>
> > To: "Linux Tools developer discussions" <linuxtools-dev@xxxxxxxxxxx>
> > Sent: Saturday, September 27, 2014 10:48:12 AM
> > Subject: Announcement: SWTBot tests
> >
> > I've committed a patch that ignores some of the failing tests.
> >
> > I beg every contributor - PLEASE DO NOT ADD MORE SWTBOT tests.
> > I'm really tired of the instability of these tests. There are many problems
> > with these tests like:
> > * They are fragile - a widget being added/removed in other components
> > breaks
> > them
> > * They are not real unit tests - failures are usually not in the component
> > that is supposed to be under test but elsewhere.
> > * They do not help shaping good API as people don't use the API that are
> > exposed but do "clicks"
> > * So much noise generated by swtbot tests in hudson that make the mailing
> > list unusable
> > * No one cares about test failures anymore and ignores them
> > * ...............
> > I do not mind having SWTBot tests in the codebase but they should not be
> > enabled in the default build and hudson. Every test that runs by default
> > must work 100% when doing "mvn clean verify".
> > From now on, whenever I spot a test case failing more than twice in gerrit
> > when testing unrelated patch I'll add ignore to it as it is high time to
> > get
> > reliable builds. I'm really getting tired of these issues.
> >
> > Tests that fail randomly are useless and even harmless. Period.
>
> Edit:
> Tests that fail randomly are useless and even harmfull. Period.
>
> >
> >
> > Alexander Kurtakov
> > Red Hat Eclipse team
> >
> >
> _______________________________________________
> linuxtools-dev mailing list
> linuxtools-dev@xxxxxxxxxxx
> To change your delivery options, retrieve your password, or unsubscribe from
> this list, visit
> https://dev.eclipse.org/mailman/listinfo/linuxtools-dev
>
