Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
[eclipse-dev] Re: Found a few hundred bugs in Eclipse

From: Wassim Melhem <wassimm@xxxxxxxxxx>
Date: Tue, 20 Jul 2004 13:13:02 -0400
Reply-To: eclipse-dev@xxxxxxxxxxx

I love this plug-in so much that I'm going to marry it :-)

Having said that...
Some of the categories of warnings it flags are questionable, so the claim
that a "few hundred bugs" were found in Eclipse is a little dramatic.

Nice piece of work nevertheless!

Wassim.



Glad you like it. :-)

We strive very hard to keep the false positive rate under 50% for high and medium warnings, and if you are experiencing a higher false positive rate than that, we'd definitely like to talk with you
so we can figure out why our accuracy isn't hitting our goals.

The claim of a couple of hundred bugs was partially to get people's attention. It is based on the fact that when run over all code that ships with Eclipse (which includes some non-eclipse code), we generate 810 medium and high correctness warnings. Looking at just Eclipse code, we generate 587 medium and high correctness warnings. We are pretty confident that that translates into at least 200, maybe three
hundred bugs.

A while back we went through some of the bug categories, and tried to manually verify the bugs. We verified 50 of them (I'm not sure how many we actually looked at when we did that manual verification, but I know our false positive rate was less than 50 % in that experiment).

	Bill



Back to the top