Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [glassfish-dev] [jakartaee-tck-dev] [jakartaee-platform-dev] Stable location of GF 6 used to pass TCK?
  • From: "Steve Millidge (Payara)" <steve.millidge@xxxxxxxxxxx>
  • Date: Thu, 23 Jul 2020 11:40:02 +0000
  • Accept-language: en-GB, en-US
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=payara.fish; dmarc=pass action=none header.from=payara.fish; dkim=pass header.d=payara.fish; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=dJeiAnl3Vtg9AewGd7Nph/Kq9jgEUhYeDg/395pOxvI=; b=Qz/j19YAWPQpNrcRcxIvTdcMwWQH85flPaJDqODONBpTGgzAYAG/bI+KK1l0eL4DMyKxkVFJEpzGrV8gQl0+3CVTECk5YaCKpSUDT3zSah03ls142SDw+Or7fmKXhQQVqg/FGQEf4pMs1Y7FQ3bUYlHXmLl8Yf96SDHtWzjHfch2Aku+wTbL6kFMWUfrHa8iHfGynlp2p1undBZVf+p8OCxp0GIfd7qCqUZqYgNfrDmm7BJ2ca/KiUAi/NTk3hNyZooxuNfP7Ak9VD/f24pJfpu/sGL7Snn7bTBXBguBRFNoLiooCBf3fB59JRxF02S7yQkelaBtlooWTdIX9yGrSA==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=TiTsmOz9TXkks6MYWEQIkNvPNHNgcjw92CQJEqG8BKBx6vRxeG8cdhbY+2k3trj7BAYzmLUBlVGaMcPSH3xgzJbAI3cwgS2mk/e1gDKf0XeBaxkK0Z36d2BaycMpX/BB9FIKNYxN2UAj4JAcr44OgBGNFKHWDPUW3w7HkL4IEkNvU4U3daqIjLeuopeEzwpjpCyDmHAMWOgn5ZwwBiwRHVym30UuFnjMBAHjL8CHD67o1OND1ii7uA0RZJAzAr3FwVtrMIJbYT62z13RTxqpotTM4T03OuRz+zz1BE5bbzC53LI5FDTqmDuZ0OxvgUKdiqfa1+/gyfXtcKqjue/unw==
  • Delivered-to: glassfish-dev@xxxxxxxxxxx
  • List-archive: <https://www.eclipse.org/mailman/private/glassfish-dev>
  • List-help: <mailto:glassfish-dev-request@eclipse.org?subject=help>
  • List-subscribe: <https://www.eclipse.org/mailman/listinfo/glassfish-dev>, <mailto:glassfish-dev-request@eclipse.org?subject=subscribe>
  • List-unsubscribe: <https://www.eclipse.org/mailman/options/glassfish-dev>, <mailto:glassfish-dev-request@eclipse.org?subject=unsubscribe>
  • Thread-index: AQHWX1b879SyKpMZ8EqQLSYJqLM/EqkSJXuAgALnSs2AAAAwAA==
  • Thread-topic: [jakartaee-tck-dev] [jakartaee-platform-dev] Stable location of GF 6 used to pass TCK?

I think the connector changes are valid. Repeatable was added to some annotations as allowed in Jakarta EE 9. As project lead for connectors how do I get these updates to the signature added into the TCK?

 

From: Alwin Joseph <alwin.joseph@xxxxxxxxxx>
Sent: 23 July 2020 12:36
To: jakartaee-tck developer discussions <jakartaee-tck-dev@xxxxxxxxxxx>; Steve Millidge (Payara) <steve.millidge@xxxxxxxxxxx>; jakartaee-platform developer discussions <jakartaee-platform-dev@xxxxxxxxxxx>
Cc: glassfish developer discussions <glassfish-dev@xxxxxxxxxxx>
Subject: Re: [jakartaee-tck-dev] [jakartaee-platform-dev] Stable location of GF 6 used to pass TCK?

 

There are signature test failures for connector, jaspic & jsp for which I need to verify the signature files with the jars in glassfish. But these are the major failures for standalone TCKs. Few of the below should be resolved by now. I will send out a recent test run result for all standalone TCKs in few hours to confirm.

I have not covered mail & activation TCKs in this list.

Regards,
Alwin

On 23/07/20 3:58 pm, Steve Millidge (Payara) wrote:

Hi Alwin,

 

Are these the only standalone TCKs with failures?

 

Steve

 

From: Alwin Joseph <alwin.joseph@xxxxxxxxxx>
Sent: 21 July 2020 16:18
To: Steve Millidge (Payara) <steve.millidge@xxxxxxxxxxx>; jakartaee-platform developer discussions <jakartaee-platform-dev@xxxxxxxxxxx>
Cc: jakartaee-tck developer discussions <jakartaee-tck-dev@xxxxxxxxxxx>; glassfish developer discussions <glassfish-dev@xxxxxxxxxxx>
Subject: Re: [jakartaee-platform-dev] Stable location of GF 6 used to pass TCK?

 

Hi Steve,

The standalone TCKs with consistent failures are present at [1].

authentication-tck : 1 signature test (need to verify the signatures with the current jars in glassfish)
restful-ws-tck : 2 failures (https://github.com/eclipse-ee4j/glassfish/issues/23122 )
security-tck : 5 test failures (https://github.com/eclipse-ee4j/glassfish/issues/23130 will probably address most)
websocket-tck :1 signature test ( https://github.com/eclipse-ee4j/glassfish/issues/23128 )

The platform TCK will have more failures and we do not have a recent test run for those.

[1] https://ci.eclipse.org/jakartaee-tck/job/eftl-standalonetck-certification/56/junit-reports-with-handlebars/testSuitesOverview.html

Thanks & Regards,
Alwin Joseph

On 21/07/20 5:33 pm, Alwin Joseph wrote:

Hi Steve,

I will send a detailed report of test run status.

For the initial waves(wave 0 & wave 1), we have 1 signature test failure in Websocket TCK when run with glassfish (issue : https://github.com/eclipse-ee4j/glassfish/issues/23128)

Regards,
Alwin

On 21/07/20 2:18 pm, Steve Millidge (Payara) wrote:

I’d like to get to an understanding of where we are on TCK testing. What suites pass, which have a small number of failures and which have a large number? That way I can seek volunteers to focus on each test suite.

 

If a number of specs, currently pass their TCK, and  need a milestone release to reference in their spec compliance PRs, we can create one and  that way we can have a download for them to point to. However I don’t want to do this spec by spec.

 

I will raise at the platform dev meeting today.

 

Steve

 

From: jakartaee-platform-dev-bounces@xxxxxxxxxxx <jakartaee-platform-dev-bounces@xxxxxxxxxxx> On Behalf Of arjan tijms
Sent: 20 July 2020 14:14
To: Alwin Joseph <alwin.joseph@xxxxxxxxxx>
Cc: glassfish developer discussions <glassfish-dev@xxxxxxxxxxx>; jakartaee-platform developer discussions <jakartaee-platform-dev@xxxxxxxxxxx>
Subject: Re: [jakartaee-platform-dev] Stable location of GF 6 used to pass TCK?

 

Hi Alwin,

 

On Mon, Jul 20, 2020 at 2:58 PM Alwin Joseph <alwin.joseph@xxxxxxxxxx> wrote:

I think it would help if the full & web profile bundles are updated at https://download.eclipse.org/ee4j/glassfish/ to run the tests for the certification.

I can update something there too, but I'll wait for some of the other GlassFish committers to agree with that.

 

It should also be ok to upload it in a Github release if that is more stable. In this case the bundle will be considered final I believe.

 

Okay, I just did that:

 

 

The build that passes the Servlet TCK at least (and possibly more), is this one: https://github.com/eclipse-ee4j/glassfish/releases/download/M2-servlet5/glassfish.zip

 

 

In order to pass TCKs in GlassFish 6, for instance the Servlet 5 TCK, I can reference the Jenkins archived build.

We were referring to the last successful build to get latest glassfish build from the source using [1] in tck CI to run tests with latest changes.

[1] https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip

 

Yes, that's the same URL I've been using.

 

Kind regards,

Arjan

 

 

 




_______________________________________________
jakartaee-platform-dev mailing list
jakartaee-platform-dev@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/jakartaee-platform-dev



_______________________________________________
jakartaee-tck-dev mailing list
jakartaee-tck-dev@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/jakartaee-tck-dev

Back to the top