Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [cdi-dev] CDI TCK for Core Profile - test count?
  • From: Brian M Decker <bmdecker@xxxxxxxxxx>
  • Date: Fri, 17 Jun 2022 22:41:30 +0000
  • Accept-language: en-US
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=us.ibm.com; dmarc=pass action=none header.from=us.ibm.com; dkim=pass header.d=us.ibm.com; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=6KjVUa1UeewGwvfcGlkjgDsmKNXmkPwwWIs1FsnHCPg=; b=j6yBF5wBmQw2pDE4zsaza+tbAt96nHazYzcFNHQnAeBrbr41TgPQN0+jPJN3kKGKSUUHwlOFxinrkFT0r8QVNcdADa4ZKI9BmsxpzLq0P9ePCy3nYmQQLAxRTie15wvG3HfC1Ty1Q4a/S+cdzPkPjpFW/3bi/WKo6cn5YyTkmzJP4M9VacPRXfFAJZAT2+/ko7VPmn5EmapdQ3JKG3ry8nUrmcULssrOY5st74BzX+0DEEVw6YjXWqrQUHrdKTD3O+Y9XVCINLNsPzs6PWo6G4IjHS1hoLMvAVVkD2MN85QVuevTyULC7L66lHNA1AcAmaBnv4GRps8D4ZmMlWOIGQ==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=jQEgvQ1Ve3V0oM5fNN5ox6lvHx2RR3nlUdNyQ0n+xYqCoUsILGQwXPYmMLXKKeZczpJ3XnXt7nACTof1QYmvWn/Eu8CKxPRL8Dt1YoXZTnI5zl31ej9uwu2N6xonqP36b3YJvfwNtub4oiskWaGZmREeQ1sCSLs1ZwA8RSisO472S5G4Lj/IP+MxrV9XMHaxCbAYGr5QMiKF9OwgyP65nkTj6K+KiutOJw8bxLYWHunq4lD0t7epFt/ir3EEz1/YQQyDiTn/7TN1DgPRxaKsnH2U3swMwy3ijAbKV6AbNIOvE74Bta6sEF3CVo+ajw2gzxDrjFjPltd+nd0UfXS56g==
  • Delivered-to: cdi-dev@xxxxxxxxxxx
  • List-archive: <https://www.eclipse.org/mailman/private/cdi-dev/>
  • List-help: <mailto:cdi-dev-request@eclipse.org?subject=help>
  • List-subscribe: <https://www.eclipse.org/mailman/listinfo/cdi-dev>, <mailto:cdi-dev-request@eclipse.org?subject=subscribe>
  • List-unsubscribe: <https://www.eclipse.org/mailman/options/cdi-dev>, <mailto:cdi-dev-request@eclipse.org?subject=unsubscribe>
  • Msip_labels:
  • Thread-index: AdiCe8wbCJ/TdDAGQ6OoPdKsri2ADQAEP1UvAALlFxA=
  • Thread-topic: CDI TCK for Core Profile - test count?

Yikes, okay.  So we have 3 different numbers so far.

 

Interestingly, when I change my automation to exclude only se (and not cdi-full), I get a test count of 1267, which is much closer (but still not exactly the same) as what others are seeing.  Are y’all seeing a bunch of org.jboss.cdi.tck.tests.full.* executed in your runs?  If so, I would wager that your excludes aren’t actually being honored for some reason.

In my run, I see exactly one of those tests run -- org.jboss.cdi.tck.tests.full.lookup.injection.visibility – and that seems like it might be a mistake.  I would think that all tests in org.jboss.cdi.tck.tests.full should be tagged with @Test(groups = CDI_FULL).

 

-Brian

 

Brian Decker
Jakarta Platform TCK Lead, Open Liberty

Home Office
(612) 216-4881
Roch. Office
t/l 553-4686
bmdecker@xxxxxxxxxx

 

 

From: cdi-dev <cdi-dev-bounces@xxxxxxxxxxx> On Behalf Of Alfonso Altamirano
Sent: Friday, June 17, 2022 4:01 PM
To: cdi developer discussions <cdi-dev@xxxxxxxxxxx>
Subject: [EXTERNAL] Re: [cdi-dev] CDI TCK for Core Profile - test count?

 

On our side we are seeing the following amount of tests with the following core profile configuration: <!--core profile--> <excludedGroups>cdi-full,se</excludedGroups> <dependenciesToScan> ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍

ZjQcmQRYFpfptBannerStart

This Message Is From an External Sender

This message came from outside your organization.

ZjQcmQRYFpfptBannerEnd

On our side we are seeing the following amount of tests with the following core profile configuration:

 

<!--core profile-->

      <excludedGroups>cdi-full,se</excludedGroups>

       <dependenciesToScan>

              <dependency>jakarta.enterprise:cdi-tck-core-impl</dependency>

        </dependenciesToScan>

 

total number of test: 1295

 

if anyone can confirm the number of tests, that can be good

 

From: cdi-dev <cdi-dev-bounces@xxxxxxxxxxx> on behalf of Brian M Decker <bmdecker@xxxxxxxxxx>
Sent: Friday, June 17, 2022 3:31 PM
To: cdi developer discussions <cdi-dev@xxxxxxxxxxx>
Subject: [cdi-dev] CDI TCK for Core Profile - test count?

 

Hello,

 

I’m attempting to run the CDI TCK for Core Profile and am getting a dramatically different test count than I see posted elsewhere, so I was hoping to compare notes with someone (Scott Stark, perhaps?) on what exactly I might be missing.

 

The User Guide indicates that I should be running with the cdi-tck-core-impl TCK artifact and excluding groups cdi-full & se.  When I do this, my runner executes only 725 tests.  For comparison, I can see from results published online that Wildfly is reporting 1263 tests when running in this configuration.  This is obviously a pretty massive difference.  Unfortunately, the Wildfly output doesn’t show exactly what tests are being run, so I can’t see which specific things are missing.  I can provide the breakdown of tests being run on my end upon request.

 

Thanks.

 

-Brian

Brian Decker
Jakarta Platform TCK Lead, Open Liberty

Home Office
(612) 216-4881
Roch. Office
t/l 553-4686
bmdecker@xxxxxxxxxx

 

Back to the top