| Re: [cdi-dev] CDI TCK for Core Profile - test count? |
_______________________________________________Yikes, okay. So we have 3 different numbers so far.
Interestingly, when I change my automation to exclude only se (and not cdi-full), I get a test count of 1267, which is much closer (but still not exactly the same) as what others are seeing. Are y’all seeing a bunch of org.jboss.cdi.tck.tests.full.* executed in your runs? If so, I would wager that your excludes aren’t actually being honored for some reason.
In my run, I see exactly one of those tests run -- org.jboss.cdi.tck.tests.full.lookup.injection.visibility – and that seems like it might be a mistake. I would think that all tests in org.jboss.cdi.tck.tests.full should be tagged with @Test(groups = CDI_FULL).
-Brian
Brian Decker
Jakarta Platform TCK Lead, Open Liberty
Home Office
(612) 216-4881
Roch. Office
t/l 553-4686
bmdecker@xxxxxxxxxx
From: cdi-dev <cdi-dev-bounces@xxxxxxxxxxx> On Behalf Of Alfonso Altamirano
Sent: Friday, June 17, 2022 4:01 PM
To: cdi developer discussions <cdi-dev@xxxxxxxxxxx>
Subject: [EXTERNAL] Re: [cdi-dev] CDI TCK for Core Profile - test count?
On our side we are seeing the following amount of tests with the following core profile configuration: <!--core profile--> <excludedGroups>cdi-full,se</excludedGroups> <dependenciesToScan>
ZjQcmQRYFpfptBannerStart
This Message Is From an External Sender
This message came from outside your organization.
ZjQcmQRYFpfptBannerEnd
On our side we are seeing the following amount of tests with the following core profile configuration:
<!--core profile-->
<excludedGroups>cdi-full,se</excludedGroups>
<dependenciesToScan>
<dependency>jakarta.enterprise:cdi-tck-core-impl</dependency>
</dependenciesToScan>
total number of test: 1295
if anyone can confirm the number of tests, that can be good
From: cdi-dev <cdi-dev-bounces@xxxxxxxxxxx> on behalf of Brian M Decker <bmdecker@xxxxxxxxxx>
Sent: Friday, June 17, 2022 3:31 PM
To: cdi developer discussions <cdi-dev@xxxxxxxxxxx>
Subject: [cdi-dev] CDI TCK for Core Profile - test count?
Hello,
I’m attempting to run the CDI TCK for Core Profile and am getting a dramatically different test count than I see posted elsewhere, so I was hoping to compare notes with someone (Scott Stark, perhaps?) on what exactly I might be missing.
The User Guide indicates that I should be running with the cdi-tck-core-impl TCK artifact and excluding groups cdi-full & se. When I do this, my runner executes only 725 tests. For comparison, I can see from results published online that Wildfly is reporting 1263 tests when running in this configuration. This is obviously a pretty massive difference. Unfortunately, the Wildfly output doesn’t show exactly what tests are being run, so I can’t see which specific things are missing. I can provide the breakdown of tests being run on my end upon request.
Thanks.
-Brian
Brian Decker
Jakarta Platform TCK Lead, Open Liberty
Home Office
(612) 216-4881
Roch. Office
t/l 553-4686
bmdecker@xxxxxxxxxx
cdi-dev mailing list
cdi-dev@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/cdi-dev