Yikes, okay. So we have 3 different numbers so far.
Interestingly, when I change my automation to exclude only se (and not cdi-full), I get a test count of 1267, which is much closer (but still not exactly the same) as what
others are seeing. Are y’all seeing a bunch of org.jboss.cdi.tck.tests.full.* executed in your runs? If so, I would wager that your excludes aren’t actually being honored for some reason.
In my run, I see exactly one of those tests run -- org.jboss.cdi.tck.tests.full.lookup.injection.visibility – and that seems like it might be a mistake. I would think that all tests in org.jboss.cdi.tck.tests.full should be tagged with @Test(groups = CDI_FULL).
-Brian
Brian Decker
Jakarta Platform TCK Lead, Open Liberty
Home Office
(612) 216-4881
Roch. Office
t/l 553-4686
bmdecker@xxxxxxxxxx
From: cdi-dev <cdi-dev-bounces@xxxxxxxxxxx>
On Behalf Of Alfonso Altamirano
Sent: Friday, June 17, 2022 4:01 PM
To: cdi developer discussions <cdi-dev@xxxxxxxxxxx>
Subject: [EXTERNAL] Re: [cdi-dev] CDI TCK for Core Profile - test count?
On our side we are seeing the following amount of tests with the following core profile configuration: <!--core profile--> <excludedGroups>cdi-full,se</excludedGroups>
<dependenciesToScan>
This Message Is From an External Sender
|
This message came from outside your organization.
|
|
|
On our side we are seeing the following amount of tests with the following core profile configuration:
<!--core profile-->
<excludedGroups>cdi-full,se</excludedGroups>
<dependency>jakarta.enterprise:cdi-tck-core-impl</dependency>
</dependenciesToScan>
total number of test: 1295
if anyone can confirm the number of tests, that can be good
Hello,
I’m attempting to run the CDI TCK for Core Profile and am getting a dramatically different test count than I see posted elsewhere, so I was hoping to compare notes with someone (Scott Stark, perhaps?) on
what exactly I might be missing.
The User Guide indicates that I should be running with the cdi-tck-core-impl TCK artifact and excluding groups cdi-full & se. When I do this, my runner executes only 725 tests. For comparison, I can see
from results published online that Wildfly is reporting 1263 tests when running in this configuration. This is obviously a pretty massive difference. Unfortunately, the Wildfly output doesn’t show exactly what tests are being run, so I can’t see which specific
things are missing. I can provide the breakdown of tests being run on my end upon request.
Thanks.
-Brian
Brian Decker
Jakarta Platform TCK Lead, Open Liberty
Home Office
(612) 216-4881
Roch. Office
t/l 553-4686
bmdecker@xxxxxxxxxx