[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
[
List Home]
|
[eclipse-dev] Re: Found a few hundred bugs in Eclipse
|
From: Wassim Melhem <wassimm@xxxxxxxxxx>
Date: Tue, 20 Jul 2004 13:13:02 -0400
Reply-To: eclipse-dev@xxxxxxxxxxx
I love this plug-in so much that I'm going to marry it :-)
Having said that...
Some of the categories of warnings it flags are questionable, so the
claim
that a "few hundred bugs" were found in Eclipse is a little dramatic.
Nice piece of work nevertheless!
Wassim.
Glad you like it. :-)
We strive very hard to keep the false positive rate under 50% for high
and medium warnings,
and if you are experiencing a higher false positive rate than that,
we'd definitely like to talk with you
so we can figure out why our accuracy isn't hitting our goals.
The claim of a couple of hundred bugs was partially to get people's
attention.
It is based on the fact that when run over all code that ships with
Eclipse (which includes some non-eclipse
code), we generate 810 medium and high correctness warnings. Looking at
just Eclipse code, we generate
587 medium and high correctness warnings. We are pretty confident that
that translates into at least 200, maybe three
hundred bugs.
A while back we went through some of the bug categories, and tried to
manually verify the bugs. We verified 50 of them (I'm not sure how many
we actually looked at when we did that manual verification, but I know
our false positive rate was less than 50 % in that experiment).
Bill
